[SERVER-24274] Create a command to provide query bounds for partitioning data in a collection - MongoDB Jira

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Backlog
Priority: Major - P3
Resolution: Unresolved
Affects Version/s: None
Fix Version/s: None
Component/s: Querying
Labels:
None

Assigned Teams:

Query Execution

Description

Both the Spark and Hadoop connectors have custom code to partition data in a collection so they can be processed externally in parallel.

This requires either SplitVector for non sharded systems or access to query the config database for sharded systems. The permissions to determine the partitions may not be possible in a sharded or hosted MongoDB setup.

Adding a command that could provide the min, max query bounds for splitting a collection into multiple parts would allow any external framework to query in parallel each partition and process in parallel.

Attachments

Issue Links

is duplicated by

SERVER-25289 Make it possible to select a subset of documents based on the shard key

Closed

is related to

SERVER-28667 Provide a way for the Aggregation framework to query against intervals of a hashed index

Backlog

SERVER-33998 Remove the parallelCollectionScan command

Closed

Activity

People

Assignee:: Backlog - Query Execution

Reporter:: Ross Lawley

Participants:: Andrew Doumaux, Backlog - Query Execution, Charlie Swanson, Geert Bosch, Ross Lawley

Votes:: 2 Vote for this issue

Watchers:: 24 Start watching this issue

Dates

Created:: May 24 2016 04:23:31 PM UTC

Updated:: Dec 06 2022 04:24:59 AM UTC