Uploaded image for project: 'MongoDB Database Tools'
  1. MongoDB Database Tools
  2. TOOLS-639

Benchmark non-blocking index builds in mongorestore

    XMLWordPrintable

    Details

    • Type: Task
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: mongorestore
    • Labels:
      None

      Description

      During parallel mongorestore jobs, a worker routine will block while it waits for a createIndexes command to return. This can take a very long time for many-gigabyte collections. We should explore the performance hit we would get by allowing a new collection to restore while we are still waiting for index builds from another collection.

      I'd wager we could get some real throughput increase by allowing a couple of index builds to happen as we pick up a new collection to restore. This will likely vary by storage engine, but it is worth exploring.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              backlog-server-tools Backlog - Server Tools Team
              Reporter:
              kyle.erf Kyle Erf
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: