after crashed, mongod can't startup

XMLWordPrintableJSON

    • Type: Bug
    • Resolution: Done
    • Priority: Critical - P2
    • None
    • Affects Version/s: None
    • Component/s: Admin, WiredTiger
    • None
    • ALL
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Help! When i tried to fix this issue by server-18448, it can not work.
      mongo version: 3.0.4
      cmd: mongod -shardsvr -port 27017 -dbpath=/shard/shard160/ --storageEngine wiredTiger --repair

      2015-08-27T20:18:03.686+0800 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=3G,session_max=20000,eviction=(threads_max=4),statistics=(fast),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),
      2015-08-27T20:18:03.859+0800 E STORAGE  [initandlisten] WiredTiger (2) [1440677883:858985][2229:0x7f17b0fc2b60]: /shard/shard160//journal/WiredTigerLog.0000000263: No such file or directory
      2015-08-27T20:18:03.859+0800 E STORAGE  [initandlisten] WiredTiger (0) [1440677883:859579][2229:0x7f17b0fc2b60], file:WiredTiger.wt, cursor.next: read checksum error [24576B @ 77824, 146658712 != 325107312]
      2015-08-27T20:18:03.859+0800 E STORAGE  [initandlisten] WiredTiger (0) [1440677883:859605][2229:0x7f17b0fc2b60], file:WiredTiger.wt, cursor.next: WiredTiger.wt: encountered an illegal file format or internal value
      2015-08-27T20:18:03.859+0800 E STORAGE  [initandlisten] WiredTiger (-31804) [1440677883:859618][2229:0x7f17b0fc2b60], file:WiredTiger.wt, cursor.next: the process must exit and restart: WT_PANIC: WiredTiger library panic
      2015-08-27T20:18:03.859+0800 I -        [initandlisten] Fatal Assertion 28558
      2015-08-27T20:18:03.871+0800 I CONTROL  [initandlisten] 
       0xf605f9 0xf09361 0xeece61 0xd893ea 0x1395d89 0x1395f45 0x13963e4 0x12e9df2 0x13034fc 0x1307df5 0x13050db 0x13190d8 0x12edfc6 0x1337609 0x13a1ead 0x13a2348 0x132fc21 0x1329773 0xd73050 0xd70e28 0xa6f30d 0x7e3bf2 0x7e8b19 0x7f17afc71d5d 0x7e19b9
      ----- BEGIN BACKTRACE -----
      {"backtrace":[{"b":"400000","o":"B605F9"},{"b":"400000","o":"B09361"},{"b":"400000","o":"AECE61"},{"b":"400000","o":"9893EA"},{"b":"400000","o":"F95D89"},{"b":"400000","o":"F95F45"},{"b":"400000","o":"F963E4"},{"b":"400000","o":"EE9DF2"},{"b":"400000","o":"F034FC"},{"b"
      :"400000","o":"F07DF5"},{"b":"400000","o":"F050DB"},{"b":"400000","o":"F190D8"},{"b":"400000","o":"EEDFC6"},{"b":"400000","o":"F37609"},{"b":"400000","o":"FA1EAD"},{"b":"400000","o":"FA2348"},{"b":"400000","o":"F2FC21"},{"b":"400000","o":"F29773"},{"b":"400000","o":"973050"},{"b":"400000","o":"970E28"},{"b":"400000","o":"66F30D"},{"b":"400000","o":"3E3BF2"},{"b":"400000","o":"3E8B19"},{"b":"7F17AFC53000","o":"1ED5D"},{"b":"400000","o":"3E19B9"}],"processInfo":{ "mongodbVersion" : "3.0.4", "gitVersion" : "0481c958daeb2969800511e7475dc66986fa9ed5", "uname" : { "sysname" : "Linux", "release" : "2.6.32-358.el6.x86_64", "version" : "#1 SMP Fri Feb 22 00:31:26 UTC 2013", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC54F9000", "elfType" : 3 }, { "b" : "7F17B0B93000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F17B098B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F17B0787000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F17B0481000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F17B01FD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F17AFFE7000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F17AFC53000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F17B0DB0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf605f9]
       mongod(_ZN5mongo10logContextEPKc+0xE1) [0xf09361]
       mongod(_ZN5mongo13fassertFailedEi+0x61) [0xeece61]
       mongod(+0x9893EA) [0xd893ea]
       mongod(__wt_eventv+0x489) [0x1395d89]
       mongod(__wt_err+0x95) [0x1395f45]
       mongod(__wt_panic+0x24) [0x13963e4]
       mongod(__wt_bm_read+0x72) [0x12e9df2]
       mongod(__wt_bt_read+0x1AC) [0x13034fc]
       mongod(__wt_cache_read+0x1C5) [0x1307df5]
       mongod(__wt_page_in_func+0x40B) [0x13050db]
       mongod(__wt_tree_walk+0x2D8) [0x13190d8]
       mongod(__wt_btcur_next+0x316) [0x12edfc6]
       mongod(+0xF37609) [0x1337609]
       mongod(+0xFA1EAD) [0x13a1ead]
       mongod(__wt_txn_recover+0x3E8) [0x13a2348]
       mongod(__wt_connection_workers+0x61) [0x132fc21]
       mongod(wiredtiger_open+0x11B3) [0x1329773]
       mongod(_ZN5mongo18WiredTigerKVEngineC1ERKSsS2_bb+0x300) [0xd73050]
       mongod(+0x970E28) [0xd70e28]
       mongod(_ZN5mongo23GlobalEnvironmentMongoD22setGlobalStorageEngineERKSs+0x30D) [0xa6f30d]
       mongod(_ZN5mongo13initAndListenEi+0x422) [0x7e3bf2]
       mongod(main+0x139) [0x7e8b19]
       libc.so.6(__libc_start_main+0xFD) [0x7f17afc71d5d]
       mongod(+0x3E19B9) [0x7e19b9]
      -----  END BACKTRACE  -----
      2015-08-27T20:18:03.871+0800 I -        [initandlisten] 
      
      ***aborting after fassert() failure
      
      

        1. _mdb_catalog.wt
          48 kB
          shixiong
        2. new_files.tgz
          6 kB
          Ramon Fernandez
        3. sizeStorer.wt
          172 kB
          shixiong
        4. storage.bson
          0.1 kB
          shixiong
        5. WiredTiger
          0.0 kB
          shixiong
        6. WiredTiger.basecfg
          0.5 kB
          shixiong
        7. WiredTiger.turtle
          0.9 kB
          shixiong
        8. WiredTiger.wt
          124 kB
          shixiong

            Assignee:
            Ramon Fernandez
            Reporter:
            shixiong
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: