Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-30572

Support configurable 'jumbo' chunk threshold

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Sharding
    • Labels:
      None
    • Backwards Compatibility:
      Fully Compatible

      Description

      Currently if a chunk spans over more than 250,000 documents it will be considered 'jumbo' and the balancer will refuse to move it until it is split into smaller chunks. In the case of bad shard key selection where the key cardinality is too high, jumbo chunks may arise which cannot be split because the entire chunk consists of the same shard key value.

      The hardcoded 250,000 documents limit was included as a precaution against such large chunks taking too long to migrate and causing the donor shard to run out of memory because of accumulation of 'mods'.

      In order to allow users in emergency situations to move jumbo chunks out of shards we should allow this limit to be temporarily increased. If we do this, we should also put a cap on the size of accumulated in-memory mods.

        Attachments

          Issue Links

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: