[SERVER-64406] Improve throttling on migration batches issued by the Balancer Created: 10/Mar/22  Updated: 06/Dec/22  Resolved: 26/May/22

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Major - P3
Reporter: Paolo Polato Assignee: [DO NOT USE] Backlog - Sharding EMEA
Resolution: Won't Do Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Assigned Teams:
Sharding EMEA
Sprint: Sharding EMEA 2022-05-02
Participants:

 Description   

Nowadays, the balancer interleaves consecutive batches of migrations issued by its main thread with a fixed delay of one second to avoid starving CRUD operations with continuous cache invalidations on shards/routers.

While this solution works, it may introduce excessive or unnecessary delays (as the time spent computing the batch of migrations within each round may be already enough for avoiding the problem).

A more efficient alternative would consist in measuring the time between consecutive balancer rounds and applying a variable throttling only when required (similarly to what has been already implemented in the secondary thread of the balancer).



 Comments   
Comment by Pierlauro Sciarelli [ 26/May/22 ]

Closing because this has been reverted.

Opened SERVER-66795 with the same description upon suggestion from TOmmaso

Comment by Githook User [ 26/May/22 ]

Author:

{'name': 'Kaloian Manassiev', 'email': 'kaloian.manassiev@mongodb.com', 'username': 'kaloianm'}

Message: Revert "SERVER-64406 apply dynamic throttling to balancer rounds"

This reverts commit 35453bdcfecf00c1fa4fde5289545439171313da.
Branch: master
https://github.com/mongodb/mongo/commit/956195f40885c1ab7930fcbe975e17e52eddc2d5

Comment by Githook User [ 25/Apr/22 ]

Author:

{'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}

Message: SERVER-64406 apply dynamic throttling to balancer rounds
Branch: master
https://github.com/mongodb/mongo/commit/35453bdcfecf00c1fa4fde5289545439171313da

Generated at Thu Feb 08 06:00:15 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.