[COMPASS-6812] Investigate changes in PM-3338: Global Balancing with the Ability to Move Unsharded Collection Created: 10/May/23  Updated: 06/Feb/24  Resolved: 19/Jan/24

Status: Closed
Project: Compass
Component/s: None
Affects Version/s: None
Fix Version/s: No version

Type: Investigation Priority: Major - P3
Reporter: Backlog - Core Eng Program Management Team Assignee: Unassigned
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
Epic Link: COMPASS-7048
Documentation Changes: Not Needed

 Description   
Original Downstream Change Summary

This project will allow the balancer to automatically move unsharded collections so documentation must be updated to reflect the new functionality and this project will require shell helpers to improve the developer experience.

Description of Linked Ticket

Epic Summary

Summary

The balancer will have a new policy that will distribute all collections equally across the shards in a cluster by data size with ability to move an unsharded collection if necessary to another shard.

Motivation

Today only sharded collections are balanced across shards which can lead to a poor distribution of the data across the shards which leads to less than optimal resource utilization at a cluster level. Customers desire their workload to be as evenly distributed across the shards in their cluster as possible. To better distribute the workload across the cluster the balancer will take into account the size of both sharded and unsharded collection and will be able distribute unsharded and sharded collections as needed to achieve the goal of equal distribution of data across all shards.

Additionally customers that would like gain the benefits of horizontal scalability without sharding all of their collections can now have the balancer distribute collections across a sharded collection automatically, greatly reducing the barrier to entry to receive value from a horizontally scaled cluster. 

 

Documentation

Product Description
Scope
Technical Design
Docs Update



 Comments   
Comment by PM Bot [ 06/Feb/24 ]

Fix Version updated for upstream PM-3338:
8.1 Targeted

Comment by Anna Henningsen [ 19/Jan/24 ]

We will include a goal in our 8.0 support scope to add a shell helper for the newly introduced balancer command.

Generated at Wed Feb 07 22:44:25 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.