Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-43902

Apply scaling for totalIndexSize after summing the sizes from individual shards

    XMLWordPrintable

Details

    • Improvement
    • Status: Closed
    • Major - P3
    • Resolution: Fixed
    • None
    • 4.7.0
    • None
    • None
    • Minor Change
    • Execution Team 2020-09-07

    Description

      Currently, when we run db.collection.stats() on a sharded cluster, it appears that the scale factor gets "passed down" to calculate each shards' index size, and then those individual sizes get summed up to give the totalIndexSize. For example, as we can observe below,

      1) The "totalIndexSize" = 0 = 0 + 0 + 0, which is the sum of the totalIndexSize from each shard.

       

      mongos> db.DOB_2565354.stats({scale:1024*1024*1024}){ "sharded" : true, "capped" : false, "ns" : "test.DOB_2565354",... "totalIndexSize" : 0,... "shards" : { "shard0" : {... "totalIndexSize" : 0,... "shard1" : {... "totalIndexSize" : 0,... "shard2" : {... "totalIndexSize" : 0,...

      2) The "totalIndexSize" = 73838592 = 49078272 + 16392192 + 8368128, which is the sum of the totalIndexSize from each shard.

       

      mongos> db.DOB_2565354.stats({}){ "sharded" : true, "capped" : false, "ns" : "test.DOB_2565354", ..."totalIndexSize" : 73838592,... "shards" : { "shard0" : {... "totalIndexSize" : 49078272,... "shard1" : {... "totalIndexSize" : 16392192,... "shard2" : {... "totalIndexSize" : 8368128,...

       Therefore, the scale factor gets "passed down" to calculate each shards' index size, and then those individual sizes get summed up to give the totalIndexSize.

      However, instead of calculating the totalIndexSize this way, it would be more accurate if the totalIndexSize returned was scaled/rounded after summing the size from the individual shards. For example, if there are 3 shards with each shard having an index sized 0.99 GB, then the scale 1024*1024*1024 would round each shard's index size to 0, and so the totalIndexSize reported will be 0 as well. However, if the individual shards' index sizes were to be added first (to yield 2.997 GB) and then the scaling factor was applied to the totalIndexSize, then the totalIndexSize reported will be 2GB (and not 0 GB).

      Therefore, instead of applying the scaling factor to the index sizes retrieved for each shards, this improvement request is to scale/round the totalIndexSize only after summing the index sizes from the individual shards.

      Attachments

        Issue Links

          Activity

            People

              gregory.wlodarek@mongodb.com Gregory Wlodarek
              harshad.dhavale@mongodb.com Harshad Dhavale
              Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: