[SERVER-61637] Review range deleter batching policy Created: 19/Nov/21 Updated: 29/Oct/23 Resolved: 14/Dec/21 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Sharding |
| Affects Version/s: | None |
| Fix Version/s: | 5.3.0, 5.1.2, 5.0.6, 5.2.0-rc3, 4.4.12 |
| Type: | Task | Priority: | Major - P3 |
| Reporter: | Pierlauro Sciarelli | Assignee: | Pierlauro Sciarelli |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | range-deleter | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||||||||||||||||||
| Backwards Compatibility: | Fully Compatible | ||||||||||||||||||||||||
| Backport Requested: |
v5.2, v5.1, v5.0, v4.4, v4.2, v4.0
|
||||||||||||||||||||||||
| Sprint: | Sharding EMEA 2021-12-13, Sharding EMEA 2021-12-27 | ||||||||||||||||||||||||
| Participants: | |||||||||||||||||||||||||
| Linked BF Score: | 135 | ||||||||||||||||||||||||
| Description |
|
With the changes committed under Keeping the current behavior of the range-deleter can easily result in the balancer starving waiting for a specific range deletion to drain (the more range deletions, the more likely this happens - because the task gets re-enqueued behind all the other ones). Objective of this ticket is to decide whether we need to: - Get rid of the batching policy |
| Comments |
| Comment by Githook User [ 24/Dec/21 ] |
|
Author: {'name': 'Pierlauro Sciarelli', 'email': 'pierlauro.sciarelli@mongodb.com', 'username': 'pierlauro'}Message: |
| Comment by Githook User [ 24/Dec/21 ] |
|
Author: {'name': 'Pierlauro Sciarelli', 'email': 'pierlauro.sciarelli@mongodb.com', 'username': 'pierlauro'}Message: |
| Comment by Githook User [ 24/Dec/21 ] |
|
Author: {'name': 'Pierlauro Sciarelli', 'email': 'pierlauro.sciarelli@mongodb.com', 'username': 'pierlauro'}Message: |
| Comment by Githook User [ 24/Dec/21 ] |
|
Author: {'name': 'Pierlauro Sciarelli', 'email': 'pierlauro.sciarelli@mongodb.com', 'username': 'pierlauro'}Message: |
| Comment by Pierlauro Sciarelli [ 14/Dec/21 ] |
|
Comment for posterity: it has been decided to set the batch size to unlimited (max int) but still leaving the possibility to tune the rangeDeleterBatchSize parameter in case someone wants to throttle range deletions. |
| Comment by Githook User [ 14/Dec/21 ] |
|
Author: {'name': 'Pierlauro Sciarelli', 'email': 'pierlauro.sciarelli@mongodb.com', 'username': 'pierlauro'}Message: |