Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-13806

Need better detection and reporting of the existence of jumbo chunks

    XMLWordPrintable

Details

    • Bug
    • Status: Closed
    • Major - P3
    • Resolution: Won't Fix
    • None
    • None
    • Sharding
    • None
    • ALL
    • Hide

      sh.enableSharding("test");
      sh.shardCollection("test.foo",{a:1});
      sh.splitAt("test.foo",{a:1000});
      for (var i=0; i<10000000; i++) {db.getSiblingDB("test").foo.insert({a:1, padding:"xxxxxxxx...xxxxx"})}

      Run the above commands and observe that chunk MinKey -> 1000 is not marked as jumbo in the chunk meta data, even after it has grown past the max chunk size for the cluster.

      Show
      sh.enableSharding("test"); sh.shardCollection("test.foo",{a:1}); sh.splitAt("test.foo",{a:1000}); for (var i=0; i<10000000; i++) {db.getSiblingDB("test").foo.insert({a:1, padding:"xxxxxxxx...xxxxx"})} Run the above commands and observe that chunk MinKey -> 1000 is not marked as jumbo in the chunk meta data, even after it has grown past the max chunk size for the cluster.

    Description

      As far as I can see, a jumbo chunk is only marked as such when the balancer has attempted to migrate it to another shard (Chunk::markAsJumbo is only called from Balancer::_moveChunks).

      This means that there's no indication of jumbo chunks unless:

      • chunk imbalance has grown past the threshold at which the balancer tries to move chunks, and
      • the balancer has attempted to move a jumbo chunk to redress the imbalance

      It would be good to have more comprehensive and early warning of jumbo chunks. This checking could perhaps be added to the splitVector handling in mongod.

      Attachments

        Issue Links

          Activity

            People

              backlog-server-sharding Backlog - Sharding Team
              jon.rangel@mongodb.com Jon Rangel
              Votes:
              1 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: