[DOCS-13797] [SERVER] Limit the number of simultaneous index builds Created: 28/Jul/20 Updated: 13/Nov/23 Resolved: 01/Sep/22 |
|
| Status: | Closed |
| Project: | Documentation |
| Component/s: | manual, Server |
| Affects Version/s: | 4.4.0, 5.0.0, 6.0.0 |
| Fix Version/s: | 4.4.0-rc0, 4.7.0, Server_Docs_20231030, Server_Docs_20231106, Server_Docs_20231105, Server_Docs_20231113 |
| Type: | Task | Priority: | Major - P3 |
| Reporter: | Backlog - Core Eng Program Management Team | Assignee: | Dave Cuthbert (Inactive) |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||||||||||||||
| Participants: | |||||||||||||||||||||
| Days since reply: | 1 year, 22 weeks, 1 day ago | ||||||||||||||||||||
| Epic Link: | DOCSP-12974 | ||||||||||||||||||||
| Description |
|
From DescriptionDownstream Change Summary Existing, undocumented behavior as of 4.2.3 and 4.4.0: New behavior (as of 4.4.0 only): This default limit can be raised with the maxNumActiveUserIndexBuilds setParameter. This can be changed at startup or runtime. Description of Linked TicketEach index build is allowed to use up to 200MB of memory outside of the WT cache by default. This is controlled by maxIndexBuildMemoryUsageMegabytes. In an attempt to bound memory usage and reduce WT cache pressure, we limit the number of concurrent index builds started by a user on a primary node. Any index builds started over the limit will block until the number of concurrent index builds drops below the limit. The log message "Too many index builds running simultaneously, waiting until the number of active index builds is below the threshold" (ID 4715500) will be logged when the limit is reached and an index build has blocked. This default limit can be raised with the maxNumActiveUserIndexBuilds setParameter. This can be changed at startup or runtime. Original DescriptionBoth the primary and secondary nodes will have an unlimited thread pool size. This is done to allow secondary nodes to startup as many index builders as necessary in order to prevent scheduling deadlocks during initial sync or oplog application. When commands are run from user connections that need to create indexes, those commands will hang until there are less than 3 running index builder threads, or until the operation is interrupted.
Scope of changesImpact to Other DocsMVP (Work and Date)Resources (Scope or Design Docs, Invision, etc.) |
| Comments |
| Comment by Githook User [ 06/Sep/22 ] |
|
Author: {'name': 'Dave Cuthbert', 'email': '69165704+davemungo@users.noreply.github.com', 'username': 'davemungo'}Message:
|
| Comment by Githook User [ 01/Sep/22 ] |
|
Author: {'name': 'Dave Cuthbert', 'email': '69165704+davemungo@users.noreply.github.com', 'username': 'davemungo'}Message: |
| Comment by Githook User [ 01/Sep/22 ] |
|
Author: {'name': 'Dave Cuthbert', 'email': '69165704+davemungo@users.noreply.github.com', 'username': 'davemungo'}Message: |
| Comment by Githook User [ 31/Aug/22 ] |
|
Author: {'name': 'Dave Cuthbert', 'email': '69165704+davemungo@users.noreply.github.com', 'username': 'davemungo'}Message:
|
| Comment by Eric Milkie [ 29/Jul/20 ] |
|
This ticket is automatically generated by someone checking the "Docs" checkbox in the Downstream Changes tab of |