[SERVER-84493] Slow memory creep with repeated stream starts/stops Created: 02/Jan/24  Updated: 22/Jan/24

Status: Needs Scheduling
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Improvement Priority: Major - P3
Reporter: Mayuresh Kulkarni Assignee: Backlog - Atlas Streams
Resolution: Unresolved Votes: 0
Labels: init-337-ga
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: PNG File asan.png     PNG File tcmalloc_release.png    
Assigned Teams:
Atlas Streams
Participants:

 Description   

When running a jstest which repeatedly starts and stops a stream processor (https://github.com/10gen/mongo-enterprise-modules/blob/03031668b9efbfc90fa54a2d031d7a629c2a2fe2/jstests/streams/sp_repeated_starts.js), a slow increase is observed in the memory usage of the mongod process (the RES col in top)

When trying an asan build, the problem is no longer observed. So this looks like a tcmalloc issue, though, the rate of growth is very small and so this may not be a real problem.

Using the following tcmalloc settings does not help either:

See attached graphs for the memory usage for asan build vs a build with ^ tcmalloc settings.

Additionally, I also tried a build where the checkpoint-at-stop feature was turned off but it showed the same behavior



Generated at Thu Feb 08 06:55:10 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.