[SERVER-27533] Allow "from" collection of $graphLookup to be sharded Created: 28/Dec/16  Updated: 06/Dec/22  Resolved: 30/Sep/21

Status: Closed
Project: Core Server
Component/s: Aggregation Framework
Affects Version/s: None
Fix Version/s: None

Type: Improvement Priority: Major - P3
Reporter: Jyotman Singh Assignee: Backlog - Query Optimization
Resolution: Duplicate Votes: 11
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
depends on SERVER-38728 Allow pipeline with $lookup into a sh... Closed
depends on SERVER-32666 Allow $graphLookup against a sharded ... Closed
Related
related to SERVER-29159 Allow "from" collection of $lookup to... Closed
Assigned Teams:
Query Optimization
Participants:
Case:

 Description   
Issue Status as of Mar 21, 2019

The $graphLookup aggregation stage allows for graph searches across unsharded collections or to use results from a sharded collection to perform a graph search in an unsharded collection. It does not allow for the "from" collection to be sharded.

We understand this is a painful and unfortunate limit on the capabilities of the query language. We strive to make it so that the distribution of data does not impact the experience with the database, but are unable to implement this improvement to our satisfaction at this time. Implementing this feature would be subject to the same problems as SERVER-29159, where you can find a summary of the reasons we haven't implemented it. SERVER-29159 also describes some workarounds which may be applicable to your use case as well.

We plan to work towards this feature in the future, but have no specific target date or release at this time.

Original Description

In the docs it mentions that the from field in $graphLookup stage in the aggregation pipeline cannot take a sharded collection.
Wanted to know if this would be allowed in the near future. Would be a great addition.



 Comments   
Comment by Katherine Wu (Inactive) [ 30/Sep/21 ]

Closing this ticket, support for sharded "from" collections in $lookup and $graphLookup will be part of the upcoming 5.1 release.

Comment by Muralikrishnan Mathiraju Ragupathiraju [ 10/Feb/21 ]

Can you provide ETA for this feature? Will be great if you can include in upcoming releaseĀ 

Comment by senthil [ 02/Aug/19 ]

is there any update on this feature? Regards

Sentil

Comment by Yuri Sokolovski [ 13/Mar/19 ]

Is there an ETA for this feature? Can it be made part of upcoming 4.2? Thanks!

Comment by Anton Ioffe [ 25/Jan/19 ]

really need this

Comment by James Wahlin [ 24/Jan/19 ]

This ticket will remove the requirement that we must run on mongos as with SERVER-38728 we will be able to perform shard to shard routing. It will not include test for shard versioning which will be added under SERVER-39015.

Comment by Micha? Czernecki [ 04/Jul/17 ]

$graphLookup in 3.4 (SERVER-27533) and $lookup in 3.2 (SERVER-29159) are great new things in MongoDB, but restriction to non-sharded collections makes it useless in practice.
Add sharded collections support to $graphQuery or at least to $lookup as soon as possible please, it is crucial to make it useful in real production environments.
Best Regards.

Generated at Thu Feb 08 04:15:25 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.