Uploaded image for project: 'Compass '
  1. Compass
  2. COMPASS-6812

Investigate changes in PM-3338: Global Balancing with the Ability to Move Unsharded Collection

    XMLWordPrintableJSON

Details

    • Icon: Investigation Investigation
    • Resolution: Done
    • Icon: Major - P3 Major - P3
    • No version
    • None
    • None
    • None

    Description

      Original Downstream Change Summary

      This project will allow the balancer to automatically move unsharded collections so documentation must be updated to reflect the new functionality and this project will require shell helpers to improve the developer experience.

      Description of Linked Ticket

      Epic Summary

      Summary

      The balancer will have a new policy that will distribute all collections equally across the shards in a cluster by data size with ability to move an unsharded collection if necessary to another shard.

      Motivation

      Today only sharded collections are balanced across shards which can lead to a poor distribution of the data across the shards which leads to less than optimal resource utilization at a cluster level. Customers desire their workload to be as evenly distributed across the shards in their cluster as possible. To better distribute the workload across the cluster the balancer will take into account the size of both sharded and unsharded collection and will be able distribute unsharded and sharded collections as needed to achieve the goal of equal distribution of data across all shards.

      Additionally customers that would like gain the benefits of horizontal scalability without sharding all of their collections can now have the balancer distribute collections across a sharded collection automatically, greatly reducing the barrier to entry to receive value from a horizontally scaled cluster. 

       

      Documentation

      Product Description
      Scope
      Technical Design
      Docs Update

      Attachments

        Activity

          People

            Unassigned Unassigned
            backlog-server-pm Backlog - Core Eng Program Management Team
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: