Parrallelize querying collections in mognoexport and mongodump

XMLWordPrintableJSON

    • Type: New Feature
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: mongodump, mongoexport
    • None
    • 979

      Currently mognoexport and mogodump use a single find query per collection. We could use the mongosync partitioning logic to run multiple queries in parallel per collection.

      Acceptance criteria:

      • Test the performance impact of running multiple queries in parallel to copy data.
      • If the test shows good results, add parallel queries to mongoexport and mongodump. Also:
        • Consider adding an option to change the number of parallel queries per collection
        • This is particularly important for mongoimport since if the --sort option is set, then we cannot use parallel queries.

              Assignee:
              Unassigned
              Reporter:
              Tim Fogarty
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: