Uploaded image for project: 'MongoDB Database Tools'
  1. MongoDB Database Tools
  2. TOOLS-3047

Document-level parallelisation for mongorestore

    • Type: Icon: Question Question
    • Resolution: Unresolved
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: mongodump, mongorestore
    • None
    • 1,024

      As I can see we currently don't support document-level parallelisation on `mongodump` / `mongorestore` (and only support collection-level parallelisation via `--numParallelCollections` option) (please correct me if I'm wrong)

      Can we consider doing document-level parallelisation on dump / restore operations? I.e. to be able to insert documents for the same namespace (`<DATABASE>.<COLLECTION>`) in multiple (parallel) threads / MongoDB Wire Protocol connections?
      (this will allow to significantly speed-up the dump / restore process for MongoDB Server processes with large amount of resources (CPU/RAM/Disk IO/Network IO) available on them)

            Assignee:
            Unassigned Unassigned
            Reporter:
            alexey.matyushin@mongodb.com Alexey Matyushin
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated: