Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-32308

Add the ability for a $lookup stage to execute on mongos against a sharded foreign collection

    XMLWordPrintable

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.1.7
    • Labels:
      None

      Description

      In order to support $changeStreams "updateLookup" functionality (see the documentation here), the aggregation subsystem now has machinery for $lookup-like query execution on mongos.

      We should extend this functionality to work for the $lookup stage itself:

      • When the foreign collection is sharded, split the pipeline such that the $lookup is part of the merging pipeline. Execute the merging pipeline on mongos, performing lookups across the network to the shards as needed.
      • If the foreign collection is not sharded, send the merging part of the pipeline to the primary shard and perform local lookups, just as we do in all existing versions of MongoDB.
      • If the merging part of the pipeline containing the $lookup cannot execute on mongos, raise an error to the application.
      • Support only localField/foreignField $lookup for now; adding support for $lookup with a sub-pipeline into a sharded foreign collection is future work.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              james.wahlin James Wahlin
              Reporter:
              david.storch David Storch
              Participants:
              Votes:
              4 Vote for this issue
              Watchers:
              10 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: