Uploaded image for project: 'MongoDB Database Tools'
  1. MongoDB Database Tools
  2. TOOLS-3228

Parrallelize querying collections in mognoexport and mongodump

    • Type: Icon: New Feature New Feature
    • Resolution: Unresolved
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: mongodump, mongoexport
    • None
    • 716

      Currently mognoexport and mogodump use a single find query per collection. We could use the mongosync partitioning logic to run multiple queries in parallel per collection.

      Acceptance criteria:

      • Test the performance impact of running multiple queries in parallel to copy data.
      • If the test shows good results, add parallel queries to mongoexport and mongodump. Also:
        • Consider adding an option to change the number of parallel queries per collection
        • This is particularly important for mongoimport since if the --sort option is set, then we cannot use parallel queries.

            Assignee:
            Unassigned Unassigned
            Reporter:
            tim.fogarty@mongodb.com Tim Fogarty
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: