Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-20160

after crashed, mongod can't startup

    XMLWordPrintableJSON

Details

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Critical - P2 Critical - P2
    • None
    • None
    • Admin, WiredTiger
    • None
    • ALL

    Description

      Help! When i tried to fix this issue by server-18448, it can not work.
      mongo version: 3.0.4
      cmd: mongod -shardsvr -port 27017 -dbpath=/shard/shard160/ --storageEngine wiredTiger --repair

      2015-08-27T20:18:03.686+0800 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=3G,session_max=20000,eviction=(threads_max=4),statistics=(fast),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),
      2015-08-27T20:18:03.859+0800 E STORAGE  [initandlisten] WiredTiger (2) [1440677883:858985][2229:0x7f17b0fc2b60]: /shard/shard160//journal/WiredTigerLog.0000000263: No such file or directory
      2015-08-27T20:18:03.859+0800 E STORAGE  [initandlisten] WiredTiger (0) [1440677883:859579][2229:0x7f17b0fc2b60], file:WiredTiger.wt, cursor.next: read checksum error [24576B @ 77824, 146658712 != 325107312]
      2015-08-27T20:18:03.859+0800 E STORAGE  [initandlisten] WiredTiger (0) [1440677883:859605][2229:0x7f17b0fc2b60], file:WiredTiger.wt, cursor.next: WiredTiger.wt: encountered an illegal file format or internal value
      2015-08-27T20:18:03.859+0800 E STORAGE  [initandlisten] WiredTiger (-31804) [1440677883:859618][2229:0x7f17b0fc2b60], file:WiredTiger.wt, cursor.next: the process must exit and restart: WT_PANIC: WiredTiger library panic
      2015-08-27T20:18:03.859+0800 I -        [initandlisten] Fatal Assertion 28558
      2015-08-27T20:18:03.871+0800 I CONTROL  [initandlisten] 
       0xf605f9 0xf09361 0xeece61 0xd893ea 0x1395d89 0x1395f45 0x13963e4 0x12e9df2 0x13034fc 0x1307df5 0x13050db 0x13190d8 0x12edfc6 0x1337609 0x13a1ead 0x13a2348 0x132fc21 0x1329773 0xd73050 0xd70e28 0xa6f30d 0x7e3bf2 0x7e8b19 0x7f17afc71d5d 0x7e19b9
      ----- BEGIN BACKTRACE -----
      {"backtrace":[{"b":"400000","o":"B605F9"},{"b":"400000","o":"B09361"},{"b":"400000","o":"AECE61"},{"b":"400000","o":"9893EA"},{"b":"400000","o":"F95D89"},{"b":"400000","o":"F95F45"},{"b":"400000","o":"F963E4"},{"b":"400000","o":"EE9DF2"},{"b":"400000","o":"F034FC"},{"b"
      :"400000","o":"F07DF5"},{"b":"400000","o":"F050DB"},{"b":"400000","o":"F190D8"},{"b":"400000","o":"EEDFC6"},{"b":"400000","o":"F37609"},{"b":"400000","o":"FA1EAD"},{"b":"400000","o":"FA2348"},{"b":"400000","o":"F2FC21"},{"b":"400000","o":"F29773"},{"b":"400000","o":"973050"},{"b":"400000","o":"970E28"},{"b":"400000","o":"66F30D"},{"b":"400000","o":"3E3BF2"},{"b":"400000","o":"3E8B19"},{"b":"7F17AFC53000","o":"1ED5D"},{"b":"400000","o":"3E19B9"}],"processInfo":{ "mongodbVersion" : "3.0.4", "gitVersion" : "0481c958daeb2969800511e7475dc66986fa9ed5", "uname" : { "sysname" : "Linux", "release" : "2.6.32-358.el6.x86_64", "version" : "#1 SMP Fri Feb 22 00:31:26 UTC 2013", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFFC54F9000", "elfType" : 3 }, { "b" : "7F17B0B93000", "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "b" : "7F17B098B000", "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "b" : "7F17B0787000", "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "b" : "7F17B0481000", "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "b" : "7F17B01FD000", "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "b" : "7F17AFFE7000", "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "b" : "7F17AFC53000", "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "b" : "7F17B0DB0000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }} mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf605f9]
       mongod(_ZN5mongo10logContextEPKc+0xE1) [0xf09361]
       mongod(_ZN5mongo13fassertFailedEi+0x61) [0xeece61]
       mongod(+0x9893EA) [0xd893ea]
       mongod(__wt_eventv+0x489) [0x1395d89]
       mongod(__wt_err+0x95) [0x1395f45]
       mongod(__wt_panic+0x24) [0x13963e4]
       mongod(__wt_bm_read+0x72) [0x12e9df2]
       mongod(__wt_bt_read+0x1AC) [0x13034fc]
       mongod(__wt_cache_read+0x1C5) [0x1307df5]
       mongod(__wt_page_in_func+0x40B) [0x13050db]
       mongod(__wt_tree_walk+0x2D8) [0x13190d8]
       mongod(__wt_btcur_next+0x316) [0x12edfc6]
       mongod(+0xF37609) [0x1337609]
       mongod(+0xFA1EAD) [0x13a1ead]
       mongod(__wt_txn_recover+0x3E8) [0x13a2348]
       mongod(__wt_connection_workers+0x61) [0x132fc21]
       mongod(wiredtiger_open+0x11B3) [0x1329773]
       mongod(_ZN5mongo18WiredTigerKVEngineC1ERKSsS2_bb+0x300) [0xd73050]
       mongod(+0x970E28) [0xd70e28]
       mongod(_ZN5mongo23GlobalEnvironmentMongoD22setGlobalStorageEngineERKSs+0x30D) [0xa6f30d]
       mongod(_ZN5mongo13initAndListenEi+0x422) [0x7e3bf2]
       mongod(main+0x139) [0x7e8b19]
       libc.so.6(__libc_start_main+0xFD) [0x7f17afc71d5d]
       mongod(+0x3E19B9) [0x7e19b9]
      -----  END BACKTRACE  -----
      2015-08-27T20:18:03.871+0800 I -        [initandlisten] 
       
      ***aborting after fassert() failure
      
      

      Attachments

        1. _mdb_catalog.wt
          48 kB
        2. new_files.tgz
          6 kB
        3. sizeStorer.wt
          172 kB
        4. storage.bson
          0.1 kB
        5. WiredTiger
          0.0 kB
        6. WiredTiger.basecfg
          0.5 kB
        7. WiredTiger.turtle
          0.9 kB
        8. WiredTiger.wt
          124 kB

        Activity

          People

            ramon.fernandez@mongodb.com Ramon Fernandez Marina
            shixiong shixiong
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: