Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-12261

Map Reduce with sharded output collection creates orphan documents

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Gone away
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: MapReduce, Sharding
    • Labels:
    • Operating System:
      ALL
    • Sprint:
      Sharding 2019-01-28, Sharding 2019-02-11

      Description

      During the post-processing phase of a map reduce run, when a shard pulls the documents for the chunks (of the output collection) that it owns from other shard(s), those documents are not deleted from the source shard(s). This may result in a large number of orphan documents which greatly increases the storage size of the output collection.

      When documents are migrated across shards during post-processing, they should be removed from the source shard.

        Attachments

          Issue Links

            Activity

              People

              • Votes:
                1 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: