[SERVER-84548] Using ShardServerCatalogCacheLoader on configsvr causes excessive WT data handles / memory usage Created: 04/Jan/24 Updated: 08/Feb/24 |
|
| Status: | In Code Review |
| Project: | Core Server |
| Component/s: | None |
| Affects Version/s: | 7.0.0 |
| Fix Version/s: | 7.2.1, 7.3 Required, 7.0.6 |
| Type: | Bug | Priority: | Critical - P2 |
| Reporter: | Jordi Serra Torrens | Assignee: | Kshitij Gupta |
| Resolution: | Unresolved | Votes: | 0 |
| Labels: | car-product-sync, cs-subteam1 | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||||||||||||||||||
| Assigned Teams: |
Cluster Scalability
|
||||||||||||||||||||||||
| Operating System: | ALL | ||||||||||||||||||||||||
| Backport Requested: |
v7.3, v7.2, v7.0
|
||||||||||||||||||||||||
| Participants: | |||||||||||||||||||||||||
| Case: | (copied to CRM) | ||||||||||||||||||||||||
| Story Points: | 4 | ||||||||||||||||||||||||
| Description |
|
PM-2290/ Some processes on the configsvr, such as the balancer or the shardingIndexConsistencyCheker, periodically refresh and use the routing tables. On deployments with a huge number of collections this will caused increased resource usage, particularly WT data handles, which are only garbage-collected after 10 minutes of inactivity. This leads to increased memory usage. Given that configsvr instances are typically small sized, this may trigger OOM failures.
For this issue, don’t allow transitioning into embedded config server and we restore always using the ConfigServerCatalogCacheLoader in 7.0 and 7.3, but do not change 8.0.
This means disabling transitionFromDedicatedConfigServer/transitionToDedicatedConfigServer. |
| Comments |
| Comment by Githook User [ 08/Feb/24 ] |
|
Author: {'name': 'Kshitij Gupta', 'email': 'kshitij.gupta@mongodb.com', 'username': 'kshitijng'}Message: SERVER-84548: Re-add transition to catalog shard feature flag and use |
| Comment by Githook User [ 07/Feb/24 ] |
|
Author: {'name': 'kshitij', 'email': 'kshitij.gupta@mongodb.com', 'username': 'kshitijng'}Message: SERVER-84548: Use CSCCL for dedicated config server on 7.x. (#18391) GitOrigin-RevId: d24349ec9e99f3f597ca9441d87ef669af05e755 |
| Comment by Jordi Serra Torrens [ 04/Jan/24 ] |
|
Possible solutions:
|