Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-18337

DB fails to recover when specifying mixed compression for Journal & BlockCompressor, after system crash

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Duplicate
    • Affects Version/s: 3.1.2
    • Fix Version/s: None
    • Component/s: Storage, WiredTiger
    • Labels:
    • Operating System:
      ALL
    • Steps To Reproduce:
      Hide

      Setup is the same as SERVER-18316, except, the following options are specified at startup:

      --wiredTigerJournalCompressor zlib --wiredTigerCollectionBlockCompressor snappy

      Show
      Setup is the same as SERVER-18316 , except, the following options are specified at startup: --wiredTigerJournalCompressor zlib --wiredTigerCollectionBlockCompressor snappy

      Description

      DB recovery failed for WT when the following options were specified:

      --wiredTigerJournalCompressor zlib --wiredTigerCollectionBlockCompressor snappy

      2015-05-05T16:31:47.052-0400 I CONTROL  ***** SERVER RESTARTED *****
      2015-05-05T16:31:47.234-0400 W -        [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty.
      2015-05-05T16:31:47.234-0400 W STORAGE  [initandlisten] Recovering data from the last clean checkpoint.
      2015-05-05T16:31:47.235-0400 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),
      2015-05-05T16:33:06.488-0400 E STORAGE  WiredTiger (2) [1430857986:488588][1373:0x7f593b1fe700], log-server: /data/wiredTiger/journal: opendir: No such file or directory
      2015-05-05T16:33:06.488-0400 E STORAGE  WiredTiger (2) [1430857986:488709][1373:0x7f593b1fe700], log-server: dirlist journal prefix WiredTigerPreplog: No such file or directory
      2015-05-05T16:33:06.488-0400 E STORAGE  WiredTiger (2) [1430857986:488726][1373:0x7f593b1fe700], log-server: log pre-alloc server error: No such file or directory
      2015-05-05T16:33:06.488-0400 E STORAGE  WiredTiger (2) [1430857986:488739][1373:0x7f593b1fe700], log-server: log server error: No such file or directory
      2015-05-05T16:33:06.489-0400 E STORAGE  [initandlisten] WiredTiger (2) [1430857986:489199][1373:0x7f593f71db80], file:sizeStorer.wt, WT_SESSION.open_cursor: /data/wiredTiger/sizeStorer.wt: No such file or directory
      2015-05-05T16:33:06.489-0400 E STORAGE  [initandlisten] WiredTiger (2) [1430857986:489448][1373:0x7f593f71db80], file:sizeStorer.wt, WT_SESSION.open_cursor: /data/wiredTiger/sizeStorer.wt: No such file or directory
      2015-05-05T16:33:06.489-0400 I -        [initandlisten] Invariant failure: ret resulted in status UnknownError 2: No such file or directory at src/mongo/db/storage/wiredtiger/wiredtiger_size_storer.cpp 67
      2015-05-05T16:33:06.527-0400 I CONTROL  [initandlisten] 0xf4ba16 0xeee0f8 0xed1ee5 0xd6b43f 0xd5b730 0xd5938b 0xcaa860 0x8291ce 0x7ed989 0x7f593dceeec5 0x8272f7
      ----- BEGIN BACKTRACE -----
      {"backtrace":[{"b":"400000","o":"B4BA16"},{"b":"400000","o":"AEE0F8"},{"b":"400000","o":"AD1EE5"},{"b":"400000","o":"96B43F"},{"b":"400000","o":"95B730"},{"b":"400000","o":"95938B"},{"b":"400000","o":"8AA860"},{"b":"400000","o":"4291CE"},{"b":"400000","o":"3ED989"},{"b":"7F593DCCD000","o":"21EC5"},{"b":"400000","o":"4272F7"}],"processInfo":{ "mongodbVersion" : "3.1.2", "gitVersion" : "aa0066050f0a9db81aa47181d0fbd18c109ae991", "uname" : { "sysname" : "Linux", "release" : "3.16.0-31-generic", "version" : "#41~14.04.1-Ubuntu SMP Wed Feb 11 19:30:13 UTC 2015", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "5A1AB53E82C3717157B58AE3409311D6B24478D5" }, { "b" : "7FFF1F3CC000", "elfType" : 3, "buildId" : "5552B9335DDE9349419BA10896C1E75C9432A946" }, { "b" : "7F593F2B6000", "path" : "/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "FF43D0947510134A8A494063A3C1CF3CEBB27791" }, { "b" : "7F593EEDC000", "path" : "/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "379F80D2768BA6A21F52781895EE9F47B34A0A85" }, { "b" : "7F593ECD4000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "92FCF41EFE012D6186E31A59AD05BDBB487769AB" }, { "b" : "7F593EAD0000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "C1AE4CB7195D337A77A3C689051DABAA3980CA0C" }, { "b" : "7F593E7CC000", "path" : "/usr/lib/x86_64-linux-gnu/libstdc++.so.6", "elfType" : 3, "buildId" : "19EFDDAB11B3BF5C71570078C59F91CF6592CE9E" }, { "b" : "7F593E4C6000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "1D76B71E905CB867B27CEF230FCB20F01A3178F5" }, { "b" : "7F593E2B0000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "8D0AA71411580EE6C08809695C3984769F25725B" }, { "b" : "7F593E092000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "9318E8AF0BFBE444731BB0461202EF57F7C39542" }, { "b" : "7F593DCCD000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "30C94DC66A1FE95180C3D68D2B89E576D5AE213C" }, { "b" : "7F593F514000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "9F00581AB3C73E3AEA35995A0C50D24D59A01D47" } ] }}
       mongod(_ZN5mongo15printStackTraceERSo+0x26) [0xf4ba16]
       mongod(_ZN5mongo10logContextEPKc+0x138) [0xeee0f8]
       mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xA5) [0xed1ee5]
       mongod(_ZN5mongo20WiredTigerSizeStorerC1EP15__wt_connectionRKSs+0x24F) [0xd6b43f]
       mongod(_ZN5mongo18WiredTigerKVEngineC1ERKSsS2_bb+0x520) [0xd5b730]
       mongod(+0x95938B) [0xd5938b]
       mongod(_ZN5mongo20ServiceContextMongoD22setGlobalStorageEngineERKSs+0x350) [0xcaa860]
       mongod(_ZN5mongo13initAndListenEi+0x3EE) [0x8291ce]
       mongod(main+0x139) [0x7ed989]
       libc.so.6(__libc_start_main+0xF5) [0x7f593dceeec5]
       mongod(+0x4272F7) [0x8272f7]
      -----  END BACKTRACE  -----
      2015-05-05T16:33:06.527-0400 I -        [initandlisten]
       
      ***aborting after invariant() failure
       
      2015-05-05T16:33:25.573-0400 I CONTROL  ***** SERVER RESTARTED *****
      2015-05-05T16:33:25.702-0400 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=zlib),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),
      2015-05-05T16:33:25.793-0400 E STORAGE  [initandlisten] WiredTiger (2) [1430858005:793103][1376:0x7f4e42626b80], file:WiredTiger.wt, connection: /data/wiredTiger/WiredTiger.wt: No such file or directory
      2015-05-05T16:33:25.794-0400 I -        [initandlisten] Assertion: 28595:2: No such file or directory
      2015-05-05T16:33:25.982-0400 I STORAGE  [initandlisten] exception in initAndListen: 28595 2: No such file or directory, terminating
      2015-05-05T16:33:25.982-0400 I CONTROL  [initandlisten] dbexit:  rc: 100
      
      

        Attachments

        1. crashserver.sh
          0.9 kB
        2. mongod-wiredTiger.log
          7.77 MB
        3. mongod-wiredTiger-recovery.log
          10.00 MB
        4. startmongo.sh
          2 kB
        5. wiredTiger.tar.gz
          93.65 MB
        6. wiredTiger-afterrecovery.tar.gz
          7.57 MB
        7. wiredTiger-beforerecovery.tar.gz
          93.65 MB
        8. wiredTiger-firstrun.tar.gz
          8 kB

          Issue Links

            Activity

              People

              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: