Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-74312

Avoid issuing too many automerge requests in parallel

    • Type: Icon: Improvement Improvement
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • Labels:
      None
    • Sharding EMEA

      Currently, from a high level point of view, the auto-merger is:

      1. Constructing a <shard, nss> map (that is being optimized under SERVER-73378)
      2. for each shard:
      3. - For each namespace
      4. ---- Issue an auto merger request (in parallel)
      5. - Wait for previous merge requests to drain before throttling and issuing requests for next shard

      In presence of thousands of collections, this may result in performance issues:

      • Sending 100K network requests to the same shard in case of 100K collections with mergeable chunks on the same shard
      • The commit of merges (for different collections) will serialize on the CSRS under the chunks lock

            Assignee:
            backlog-server-sharding-emea [DO NOT USE] Backlog - Sharding EMEA
            Reporter:
            pierlauro.sciarelli@mongodb.com Pierlauro Sciarelli
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: