Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-84187

Regression in balancer round storage statistics retrieval

    XMLWordPrintableJSON

Details

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major - P3 Major - P3
    • None
    • 7.0.0, 7.2.0-rc0, 7.1.0, 7.3.0-rc0
    • None
    • Catalog and Routing
    • ALL
    • 2

    Description

      In every balancing round, we retrieve per-shard storage statics. Since this is done serially, in a cluster with several shards this can be particularly slow, limiting considerably the balancing speed.

      Back in SERVER-30060 we did an optimization to retrieve storage statistics only from shards that have maxSize configured.

      Recently as part of SERVER-66297 we removed this optimization, so now we retrieve again statistics from all the shards serially at every round.

      The implementation of these statistics retrieval is affected by multiple performance issues:

       

                  Proposal: Do it only once per round and re-use the same ClusterStatistcs object

      Attachments

        Activity

          People

            backlog-server-catalog-and-routing Backlog - Catalog and Routing
            tommaso.tocci@mongodb.com Tommaso Tocci
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: