[DOCS-13213] Investigate changes in SERVER-44174: $push and $addToSet should restrict memory usage Created: 09/Nov/19 Updated: 13/Nov/23 Resolved: 06/Jan/20 |
|
| Status: | Closed |
| Project: | Documentation |
| Component/s: | manual, Server |
| Affects Version/s: | None |
| Fix Version/s: | 4.3.1, 4.0.14, 3.6.17, 4.2.3, Server_Docs_20231030, Server_Docs_20231106, Server_Docs_20231105, Server_Docs_20231113 |
| Type: | Task | Priority: | Major - P3 |
| Reporter: | Backlog - Core Eng Program Management Team | Assignee: | Kay Kim (Inactive) |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||||||
| Participants: | |||||||||||||
| Days since reply: | 4 years, 1 day ago | ||||||||||||
| Epic Link: | DOCS: 4.4 Server Release Work | ||||||||||||
| Description |
DescriptionDownstream Change Summary In this ticket we added a 100MB memory limit on accumulators $push and $addToSet. Before this, these accumulators could use unbounded memory in rare cases. The one we noticed was when everything had been spilled to disk, but upon merging the separate files spilled to disk we accumulated more than 100MB worth of data in the array. These accumulators cannot spill to disk, so pipelines which use more than 100MB will fail. Description of Linked TicketSERVER-43944 describes a more pervasive problem, but it's probably the case that $push and $addToSet are the worst offenders and not too difficult to fix. Let's start with those two and leave SERVER-43944 to track the more general problem which is likely more complex. Scope of changesImpact to Other DocsMVP (Work and Date)Resources (Scope or Design Docs, Invision, etc.) |
| Comments |
| Comment by Githook User [ 11/Feb/20 ] |
|
Author: {'username': 'kay-kim', 'name': 'Kay Kim', 'email': 'kay.kim@10gen.com'}Message: |
| Comment by Githook User [ 28/Jan/20 ] |
|
Author: {'email': 'kay.kim@10gen.com', 'name': 'Kay Kim', 'username': 'kay-kim'}Message: |
| Comment by Githook User [ 28/Jan/20 ] |
|
Author: {'email': 'kay.kim@10gen.com', 'username': 'kay-kim', 'name': 'Kay Kim'}Message: |
| Comment by Githook User [ 27/Jan/20 ] |
|
Author: {'username': 'kay-kim', 'name': 'Kay Kim', 'email': 'kay.kim@10gen.com'}Message: |
| Comment by Githook User [ 06/Jan/20 ] |
|
Author: {'name': 'Kay Kim', 'email': 'kay.kim@10gen.com', 'username': 'kay-kim'}Message: |
| Comment by Githook User [ 06/Jan/20 ] |
|
Author: {'name': 'Kay Kim', 'email': 'kay.kim@10gen.com', 'username': 'kay-kim'}Message: |
| Comment by Githook User [ 06/Jan/20 ] |
|
Author: {'name': 'Kay Kim', 'email': 'kay.kim@10gen.com', 'username': 'kay-kim'}Message: |