Details
-
Investigation
-
Resolution: Done
-
Major - P3
-
None
-
None
-
None
-
Not Needed
Description
This project will allow the balancer to automatically move unsharded collections so documentation must be updated to reflect the new functionality and this project will require shell helpers to improve the developer experience.
Description of Linked Ticket
Summary
The balancer will have a new policy that will distribute all collections equally across the shards in a cluster by data size with ability to move an unsharded collection if necessary to another shard.
Motivation
Today only sharded collections are balanced across shards which can lead to a poor distribution of the data across the shards which leads to less than optimal resource utilization at a cluster level. Customers desire their workload to be as evenly distributed across the shards in their cluster as possible. To better distribute the workload across the cluster the balancer will take into account the size of both sharded and unsharded collection and will be able distribute unsharded and sharded collections as needed to achieve the goal of equal distribution of data across all shards.
Additionally customers that would like gain the benefits of horizontal scalability without sharding all of their collections can now have the balancer distribute collections across a sharded collection automatically, greatly reducing the barrier to entry to receive value from a horizontally scaled cluster.