[SERVER-56470] Evaluate the `consolidate_ns_chunks.js` script Created: 29/Apr/21  Updated: 06/Dec/22  Resolved: 09/May/21

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Major - P3
Reporter: Kaloian Manassiev Assignee: [DO NOT USE] Backlog - Sharding EMEA
Resolution: Won't Fix Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Related
Assigned Teams:
Sharding EMEA
Participants:

 Description   

This task is to come up with a model for what a consolidation/defragmentation algorithm for a sharded cluster would look like and to evaluate whether the existing consolidate_ns_chunks.js script fulfills that model.

As part of this ticket we should evaluate whether we could perform most of the merges prior to moving data around so that the effect of refreshes for clusters with large number of chunks can be kept to a minimum.



 Comments   
Comment by Kaloian Manassiev [ 09/May/21 ]

We won't be using the JS variant of the script in lieu of a Python-based one, which adds concurrency and operates closer to the way the Balancer does.

Generated at Thu Feb 08 05:39:20 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.