Uploaded image for project: 'MongoDB Command Line Tools'
  1. MongoDB Command Line Tools
  2. TOOLS-18

make mongodump multi-threaded / parallel

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: Legacy C++ Implementation
    • Fix Version/s: 2.8.0-rc0
    • Component/s: mongodump
    • Labels:
      None
    • Sprint:
      MCI 2.8.0-RC0

      Description

      Mongodump is single threaded and therefor very slow to dump on large databases.

      The simplest approach to making mongodump parallelized is to assign one thread per collection (up to some user-defined or adaptively arrived at limit). It would be easy to overload either source or client machine by using multiple threads.

      Going further, it may be possible to partition individual collections by range. This could be tricky in sharded clusters.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                kyle.erf Kyle Erf
                Reporter:
                ian.whalen Ian Whalen
              • Votes:
                2 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: