Uploaded image for project: 'Compass '
  1. Compass
  2. COMPASS-6210

Investigate changes in PM-3001: BACKPORT: Add concurrency to the chunk migration code

    XMLWordPrintableJSON

Details

    • Icon: Investigation Investigation
    • Resolution: Done
    • Icon: Major - P3 Major - P3
    • No version
    • None
    • None
    • None
    • Not Needed

    Description

      Original Downstream Change Summary

      We are providing a way to add a server parameter (setParameter) to change the destination shard insert concurrency. backporting to 4.4, 5.0 and 6.0.

      syntax changes -
      {setParameter: { migrationConcurrency: N }}

      Description of Linked Ticket

      Summary

      This project is for backporting changes to parallelize portions of the existing chunk migration algorithm. We propose backporting this through mongoDB 4.4.

      Motivation

      During PM-2740 spike we implemented the following changes to realize up to 5 times higher chunk migration throughput:

      • Increase the level of concurrency on the destination for the insert portion when moving a chunk.

      As a result of that spike, we created PM-3014, which implements a new server parameter specifying the level of concurrency for the item above.

      Attachments

        Activity

          People

            Unassigned Unassigned
            backlog-server-pm Backlog - Core Eng Program Management Team
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: