Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-2294

memory consumption in 2.7.0 vs 2.6.1

XMLWordPrintableJSON

    • Type: Icon: Bug Bug
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: WT2.7.0
    • Component/s: None
    • None

      Hi!

      We noticed that memory consumption increased significantly in WT2.7.0
      One of our applications has 38 WT DB's we see ~1.5x increase in VSIZE and 10x increase in RSS right after start.
      Moreover CPU usage is also 3x higher when nothing is going on (or maybe except periodical snapshots once in 30sec).

      Attached small program that opens 10 DB's.
      Results I get on my box:

      2.6.1

      $ /opt/llvm-3.7.0/bin/clang -D_GNU_SOURCE -O3 -g -o many-dbs -I /home/sbn/src/wiredtiger-2.6.1 -L /home/sbn/src/wiredtiger-2.6.1/.libs -lwiredtiger many-dbs.c 
$ LD_LIBRARY_PATH=/home/sbn/src/wiredtiger-2.6.1/.libs/ ./many-dbs
Opening DB's
DB's opened: took 5.17866s
   VSZ   RSS %CPU %MEM COMMAND
1193348 28332 2.9  0.2 many-dbs

      2.7.0:

      $ /opt/llvm-3.7.0/bin/clang -D_GNU_SOURCE -O3 -g -o many-dbs -I /home/sbn/src/wiredtiger-2.7.0 -L /home/sbn/src/wiredtiger-2.7.0/.libs -lwiredtiger many-dbs.c 
$ LD_LIBRARY_PATH=/home/sbn/src/wiredtiger-2.7.0/.libs/ ./many-dbs
Opening DB's
DB's opened: took 12.5321s
   VSZ   RSS %CPU %MEM COMMAND
1527744 349472 7.1  2.8 many-dbs

      Thanks!

        1. many-dbs.c
          1 kB
          Dmitri Shubin
        2. many-dbs-2.6.svg
          68 kB
          Sarunas Vancevicius
        3. many-dbs-2.7.svg
          83 kB
          Sarunas Vancevicius

            Assignee:
            alexander.gorrod@mongodb.com Alexander Gorrod
            Reporter:
            Dmitri Shubin Dmitri Shubin
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

              Created:
              Updated:
              Resolved: