[SERVER-71009] Make sure the select chunks operation doesn't take too long Created: 02/Nov/22  Updated: 29/Oct/23  Resolved: 12/Apr/23

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 7.0.0-rc0, 7.1.0-rc0, 6.0.6, 6.3.2

Type: Bug Priority: Major - P3
Reporter: Silvia Surroca Assignee: Silvia Surroca
Resolution: Fixed Votes: 0
Labels: balancer-perf-improvement
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Depends
depends on SERVER-68670 Cache imbalanced collections for bala... Closed
Problem/Incident
causes SERVER-76172 Fix BalancerChunkSelection unit test ... Closed
Backwards Compatibility: Fully Compatible
Operating System: ALL
Backport Requested:
v7.0, v6.3, v6.0
Sprint: Sharding EMEA 2022-11-14, Sharding EMEA 2022-11-28, Sharding EMEA 2022-12-12, Sharding EMEA 2022-12-26, Sharding EMEA 2023-01-09, Sharding EMEA 2023-01-23, Sharding EMEA 2023-02-06, Sharding EMEA 2023-02-20, Sharding EMEA 2023-03-06, Sharding EMEA 2023-03-20, Sharding EMEA 2023-04-03, Sharding EMEA 2023-04-17
Participants:
Linked BF Score: 5

 Description   

On every balancer round, the balancer iterates over all the sharded collections stopping when all shards are already involved in one migration (SERVER-70973).
However, the balancer can still exceed the 1 sec defined interval time between rounds (kBalancerMigrationsThrottling) in the following scenarios:

  • The number of sharded collections is very high and it's not possible to involve all shards in a migration.
  • The number of sharded collections is very high and just a few of them are imbalanced.


 Comments   
Comment by Githook User [ 24/Apr/23 ]

Author:

{'name': 'Silvia Surroca', 'email': 'silvia.surroca@mongodb.com', 'username': 'silviasuhu'}

Message: SERVER-71009 SERVER-76172 Limit the select chunks operation time
Branch: v6.0
https://github.com/mongodb/mongo/commit/3c9b92a1890de2fac294e1e8d4829f986fba9337

Comment by Githook User [ 20/Apr/23 ]

Author:

{'name': 'Silvia Surroca', 'email': 'silvia.surroca@mongodb.com', 'username': 'silviasuhu'}

Message: SERVER-71009 SERVER-76172 Limit the select chunks operation time
Branch: v6.3
https://github.com/mongodb/mongo/commit/ed2a1d626231da574e86e99dd584c42e364f0300

Comment by Githook User [ 13/Apr/23 ]

Author:

{'name': 'Silvia Surroca', 'email': 'silvia.surroca@mongodb.com', 'username': 'silviasuhu'}

Message: SERVER-71009 Limit the select chunks operation time

(cherry picked from commit bdd5308d1b1dbc3d55a35a5a6ef4700d58bf32af)
Branch: v7.0
https://github.com/mongodb/mongo/commit/cfbfeae2c34db7fe134803e420134a1b7fc52a4c

Comment by Githook User [ 12/Apr/23 ]

Author:

{'name': 'Silvia Surroca', 'email': 'silvia.surroca@mongodb.com', 'username': 'silviasuhu'}

Message: SERVER-71009 Limit the select chunks operation time
Branch: master
https://github.com/mongodb/mongo/commit/bdd5308d1b1dbc3d55a35a5a6ef4700d58bf32af

Generated at Thu Feb 08 06:17:47 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.