[SERVER-56470] Evaluate the `consolidate_ns_chunks.js` script Created: 29/Apr/21 Updated: 06/Dec/22 Resolved: 09/May/21 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | None |
| Type: | Task | Priority: | Major - P3 |
| Reporter: | Kaloian Manassiev | Assignee: | [DO NOT USE] Backlog - Sharding EMEA |
| Resolution: | Won't Fix | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||
| Assigned Teams: |
Sharding EMEA
|
||||
| Participants: | |||||
| Description |
|
This task is to come up with a model for what a consolidation/defragmentation algorithm for a sharded cluster would look like and to evaluate whether the existing consolidate_ns_chunks.js script fulfills that model. As part of this ticket we should evaluate whether we could perform most of the merges prior to moving data around so that the effect of refreshes for clusters with large number of chunks can be kept to a minimum. |
| Comments |
| Comment by Kaloian Manassiev [ 09/May/21 ] |
|
We won't be using the JS variant of the script in lieu of a Python-based one, which adds concurrency and operates closer to the way the Balancer does. |