[DOCS-13213] Investigate changes in SERVER-44174: $push and $addToSet should restrict memory usage Created: 09/Nov/19  Updated: 13/Nov/23  Resolved: 06/Jan/20

Status: Closed
Project: Documentation
Component/s: manual, Server
Affects Version/s: None
Fix Version/s: 4.3.1, 4.0.14, 3.6.17, 4.2.3, Server_Docs_20231030, Server_Docs_20231106, Server_Docs_20231105, Server_Docs_20231113

Type: Task Priority: Major - P3
Reporter: Backlog - Core Eng Program Management Team Assignee: Kay Kim (Inactive)
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Documented
documents SERVER-44174 $push and $addToSet should restrict m... Closed
Related
Participants:
Days since reply: 4 years, 1 day ago
Epic Link: DOCS: 4.4 Server Release Work

 Description   

Description

Downstream Change Summary

In this ticket we added a 100MB memory limit on accumulators $push and $addToSet. Before this, these accumulators could use unbounded memory in rare cases. The one we noticed was when everything had been spilled to disk, but upon merging the separate files spilled to disk we accumulated more than 100MB worth of data in the array. These accumulators cannot spill to disk, so pipelines which use more than 100MB will fail.

Description of Linked Ticket

SERVER-43944 describes a more pervasive problem, but it's probably the case that $push and $addToSet are the worst offenders and not too difficult to fix. Let's start with those two and leave SERVER-43944 to track the more general problem which is likely more complex.

Scope of changes

Impact to Other Docs

MVP (Work and Date)

Resources (Scope or Design Docs, Invision, etc.)



 Comments   
Comment by Githook User [ 11/Feb/20 ]

Author:

{'username': 'kay-kim', 'name': 'Kay Kim', 'email': 'kay.kim@10gen.com'}

Message: DOCS-13213: push and addToSet mem limit
Branch: v4.2
https://github.com/mongodb/docs/commit/8e388cd91e8505dcc630da46a542af222c0a0c15

Comment by Githook User [ 28/Jan/20 ]

Author:

{'email': 'kay.kim@10gen.com', 'name': 'Kay Kim', 'username': 'kay-kim'}

Message: DOCS-13213: push and addToSet mem limit
Branch: v3.6
https://github.com/mongodb/docs/commit/45c0a24adeff64784a51ebe0b5d1bf2c4c963362

Comment by Githook User [ 28/Jan/20 ]

Author:

{'email': 'kay.kim@10gen.com', 'username': 'kay-kim', 'name': 'Kay Kim'}

Message: DOCS-13213: push and addToSet mem limit
Branch: v3.6.17
https://github.com/mongodb/docs/commit/aad61be1f8ba36a1538b42399206f9dcd4d0b9a0

Comment by Githook User [ 27/Jan/20 ]

Author:

{'username': 'kay-kim', 'name': 'Kay Kim', 'email': 'kay.kim@10gen.com'}

Message: DOCS-13213: push and addToSet mem limit
Branch: v4.2
https://github.com/mongodb/docs/commit/8e388cd91e8505dcc630da46a542af222c0a0c15

Comment by Githook User [ 06/Jan/20 ]

Author:

{'name': 'Kay Kim', 'email': 'kay.kim@10gen.com', 'username': 'kay-kim'}

Message: DOCS-13213: push and addToSet mem limit
Branch: v3.6.17
https://github.com/mongodb/docs/commit/431ce75a68f3cc37a699ed0747f0f47c69402b42

Comment by Githook User [ 06/Jan/20 ]

Author:

{'name': 'Kay Kim', 'email': 'kay.kim@10gen.com', 'username': 'kay-kim'}

Message: DOCS-13213: push and addToSet mem limit
Branch: v4.0
https://github.com/mongodb/docs/commit/0cc7ecabde44bfcdaa7f08c9a3d8e04df8a49199

Comment by Githook User [ 06/Jan/20 ]

Author:

{'name': 'Kay Kim', 'email': 'kay.kim@10gen.com', 'username': 'kay-kim'}

Message: DOCS-13213: push and addToSet mem limit
Branch: v4.2.3
https://github.com/mongodb/docs/commit/f48ad390f5586f88d47152919d50035d5ace69e9

Generated at Thu Feb 08 08:07:12 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.