Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-84493

Slow memory creep with repeated stream starts/stops

    XMLWordPrintableJSON

Details

    • Icon: Improvement Improvement
    • Resolution: Unresolved
    • Icon: Major - P3 Major - P3
    • None
    • None
    • None
    • Atlas Streams

    Description

      When running a jstest which repeatedly starts and stops a stream processor (https://github.com/10gen/mongo-enterprise-modules/blob/03031668b9efbfc90fa54a2d031d7a629c2a2fe2/jstests/streams/sp_repeated_starts.js), a slow increase is observed in the memory usage of the mongod process (the RES col in top)

      When trying an asan build, the problem is no longer observed. So this looks like a tcmalloc issue, though, the rate of growth is very small and so this may not be a real problem.

      Using the following tcmalloc settings does not help either:

      See attached graphs for the memory usage for asan build vs a build with ^ tcmalloc settings.

      Additionally, I also tried a build where the checkpoint-at-stop feature was turned off but it showed the same behavior


      Attachments

        1. asan.png
          asan.png
          126 kB
        2. tcmalloc_release.png
          tcmalloc_release.png
          47 kB

        Activity

          People

            backlog-atlas-streams@mongodb.com Backlog - Atlas Streams
            mayuresh.kulkarni@mongodb.com Mayuresh Kulkarni
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: