Uploaded image for project: 'MongoDB Database Tools'
  1. MongoDB Database Tools
  2. TOOLS-30

Add an option to mongodump to write the data out in sorted order

XMLWordPrintableJSON

    • Type: Icon: Task Task
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: mongodump
    • Labels:

      Allow mongodump to sort the data written out on disk by some indexed field. This will require that the dump do an in memory sort and significantly slow down the dump process, however when restoring with indexes, this will give a huge boost in performance due to sequential b-tree writes.

      We already get this for free with objectID's because they are always increasing, but if you override _id to be something not increasing it will mean mongorestore will take a really long time due to random btree accesses triggering random IO.

      There won't be much advantage unless we sort by _id which is always restored by mongorestore, or if we are restoring indexes as well but the performance boost in terms of random IO will be significant.

            Assignee:
            backlog-server-platform DO NOT USE - Backlog - Platform Team
            Reporter:
            osmar.olivo Osmar Olivo
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: