[SERVER-62550] Lower BSONColumn roundtrip memory usage in validate Created: 12/Jan/22  Updated: 29/Oct/23  Resolved: 12/Jan/22

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 5.3.0, 5.2.1

Type: Bug Priority: Major - P3
Reporter: Gregory Wlodarek Assignee: Gregory Wlodarek
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Depends
Backwards Compatibility: Fully Compatible
Operating System: ALL
Backport Requested:
v5.2
Sprint: Execution Team 2022-01-24
Participants:
Linked BF Score: 150

 Description   

We limit the number of documents we hold in memory to ~100MB to avoid running out of memory. However, there are configurations on Evergreen that can run as a 5-node replica set with 8 jobs (40 mongod's!). If all nodes are running validate at the same time, that could use up to 4GB to roundtrip the BSONColumn.



 Comments   
Comment by Githook User [ 20/Jan/22 ]

Author:

{'name': 'Gregory Wlodarek', 'email': 'gregory.wlodarek@mongodb.com', 'username': 'GWlodarek'}

Message: SERVER-62550 Lower BSONColumn roundtrip memory usage in validate

(cherry picked from commit d186067e1d81467e585204087e2757875b7aa8c6)
Branch: v5.2
https://github.com/mongodb/mongo/commit/c8d7be21cf6b6ba10d0bb38191403ed27d5d88cb

Comment by Githook User [ 12/Jan/22 ]

Author:

{'name': 'Gregory Wlodarek', 'email': 'gregory.wlodarek@mongodb.com', 'username': 'GWlodarek'}

Message: SERVER-62550 Lower BSONColumn roundtrip memory usage in validate
Branch: master
https://github.com/mongodb/mongo/commit/d186067e1d81467e585204087e2757875b7aa8c6

Generated at Thu Feb 08 05:55:26 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.