Uploaded image for project: 'MongoDB Database Tools'
  1. MongoDB Database Tools
  2. TOOLS-30

Add an option to mongodump to write the data out in sorted order

    XMLWordPrintable

    Details

    • Type: Task
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: mongodump
    • Labels:

      Description

      Allow mongodump to sort the data written out on disk by some indexed field. This will require that the dump do an in memory sort and significantly slow down the dump process, however when restoring with indexes, this will give a huge boost in performance due to sequential b-tree writes.

      We already get this for free with objectID's because they are always increasing, but if you override _id to be something not increasing it will mean mongorestore will take a really long time due to random btree accesses triggering random IO.

      There won't be much advantage unless we sort by _id which is always restored by mongorestore, or if we are restoring indexes as well but the performance boost in terms of random IO will be significant.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              backlog-server-platform DO NOT USE - Backlog - Platform Team
              Reporter:
              osmar.olivo Osmar Olivo
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: