[SERVER-84493] Slow memory creep with repeated stream starts/stops Created: 02/Jan/24 Updated: 22/Jan/24 |
|
| Status: | Needs Scheduling |
| Project: | Core Server |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | None |
| Type: | Improvement | Priority: | Major - P3 |
| Reporter: | Mayuresh Kulkarni | Assignee: | Backlog - Atlas Streams |
| Resolution: | Unresolved | Votes: | 0 |
| Labels: | init-337-ga | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Attachments: |
|
| Assigned Teams: |
Atlas Streams
|
| Participants: |
| Description |
|
When running a jstest which repeatedly starts and stops a stream processor (https://github.com/10gen/mongo-enterprise-modules/blob/03031668b9efbfc90fa54a2d031d7a629c2a2fe2/jstests/streams/sp_repeated_starts.js), a slow increase is observed in the memory usage of the mongod process (the RES col in top) When trying an asan build, the problem is no longer observed. So this looks like a tcmalloc issue, though, the rate of growth is very small and so this may not be a real problem. Using the following tcmalloc settings does not help either:
See attached graphs for the memory usage for asan build vs a build with ^ tcmalloc settings. Additionally, I also tried a build where the checkpoint-at-stop feature was turned off but it showed the same behavior
|