Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-2294

memory consumption in 2.7.0 vs 2.6.1

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Duplicate
    • Affects Version/s: WT2.7.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Hi!

      We noticed that memory consumption increased significantly in WT2.7.0
      One of our applications has 38 WT DB's we see ~1.5x increase in VSIZE and 10x increase in RSS right after start.
      Moreover CPU usage is also 3x higher when nothing is going on (or maybe except periodical snapshots once in 30sec).

      Attached small program that opens 10 DB's.
      Results I get on my box:

      2.6.1

      $ /opt/llvm-3.7.0/bin/clang -D_GNU_SOURCE -O3 -g -o many-dbs -I /home/sbn/src/wiredtiger-2.6.1 -L /home/sbn/src/wiredtiger-2.6.1/.libs -lwiredtiger many-dbs.c 
      $ LD_LIBRARY_PATH=/home/sbn/src/wiredtiger-2.6.1/.libs/ ./many-dbs
      Opening DB's
      DB's opened: took 5.17866s
         VSZ   RSS %CPU %MEM COMMAND
      1193348 28332 2.9  0.2 many-dbs
      

      2.7.0:

      $ /opt/llvm-3.7.0/bin/clang -D_GNU_SOURCE -O3 -g -o many-dbs -I /home/sbn/src/wiredtiger-2.7.0 -L /home/sbn/src/wiredtiger-2.7.0/.libs -lwiredtiger many-dbs.c 
      $ LD_LIBRARY_PATH=/home/sbn/src/wiredtiger-2.7.0/.libs/ ./many-dbs
      Opening DB's
      DB's opened: took 12.5321s
         VSZ   RSS %CPU %MEM COMMAND
      1527744 349472 7.1  2.8 many-dbs
      

      Thanks!

        Attachments

        1. many-dbs.c
          1 kB
        2. many-dbs-2.6.svg
          68 kB
        3. many-dbs-2.7.svg
          83 kB

          Issue Links

            Activity

              People

              • Assignee:
                alexander.gorrod Alexander Gorrod
                Reporter:
                Dmitri Shubin Dmitri Shubin
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: