Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-36246

WiredTiger.wt read checksum error repair fail

    • Type: Icon: Bug Bug
    • Resolution: Done
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 3.2.9
    • Component/s: WiredTiger
    • Windows

      After a power failure attempting a repair results in the following error.

      Log below. WiredTiger.wt and WiredTiger.turtle attached.

       

       

      2018-07-23T13:09:53.410-0700 I CONTROL  [initandlisten] MongoDB starting : pid=6044 port=27017 dbpath=data\db 64-bit host=Red
      2018-07-23T13:09:53.410-0700 I CONTROL  [initandlisten] targetMinOS: Windows 7/Windows Server 2008 R2
      2018-07-23T13:09:53.410-0700 I CONTROL  [initandlisten] db version v3.2.9
      2018-07-23T13:09:53.410-0700 I CONTROL  [initandlisten] git version: 22ec9e93b40c85fc7cae7d56e7d6a02fd811088c
      2018-07-23T13:09:53.410-0700 I CONTROL  [initandlisten] OpenSSL version: OpenSSL 1.0.1p-fips 9 Jul 2015
      2018-07-23T13:09:53.410-0700 I CONTROL  [initandlisten] allocator: tcmalloc
      2018-07-23T13:09:53.410-0700 I CONTROL  [initandlisten] modules: none
      2018-07-23T13:09:53.410-0700 I CONTROL  [initandlisten] build environment:
      2018-07-23T13:09:53.410-0700 I CONTROL  [initandlisten]     distmod: 2008plus-ssl
      2018-07-23T13:09:53.410-0700 I CONTROL  [initandlisten]     distarch: x86_64
      2018-07-23T13:09:53.410-0700 I CONTROL  [initandlisten]     target_arch: x86_64
      2018-07-23T13:09:53.410-0700 I CONTROL  [initandlisten] options: { repair: true, storage: { dbPath: "data\db" } }
      2018-07-23T13:09:53.411-0700 I -        [initandlisten] Detected data files in data\db created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'.
      2018-07-23T13:09:53.412-0700 I STORAGE  [initandlisten] Detected WT journal files.  Running recovery from last checkpoint.
      2018-07-23T13:09:53.412-0700 I STORAGE  [initandlisten] journal to nojournal transition config: create,cache_size=18G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),
      2018-07-23T13:09:53.440-0700 E STORAGE  [initandlisten] WiredTiger (0) [1532376593:440297][6044:140706448019584], file:WiredTiger.wt, WT_CURSOR.insert: read checksum error for 24576B block at offset 10211328: block header checksum of 3563982783 doesn't match expected checksum of 784024568
      2018-07-23T13:09:53.440-0700 E STORAGE  [initandlisten] WiredTiger (0) [1532376593:440297][6044:140706448019584], file:WiredTiger.wt, WT_CURSOR.insert: WiredTiger.wt: encountered an illegal file format or internal value
      2018-07-23T13:09:53.440-0700 E STORAGE  [initandlisten] WiredTiger (-31804) [1532376593:440297][6044:140706448019584], file:WiredTiger.wt, WT_CURSOR.insert: the process must exit and restart: WT_PANIC: WiredTiger library panic
      2018-07-23T13:09:53.440-0700 I -        [initandlisten] Fatal Assertion 28558
      2018-07-23T13:09:53.440-0700 I -        [initandlisten] ***aborting after fassert() failure
      2018-07-23T13:09:54.762-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\mongo\util\stacktrace_windows.cpp(174)                     mongo::printStackTrace+0x43
      2018-07-23T13:09:54.762-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\mongo\util\signal_handlers_synchronous.cpp(182)            mongo::`anonymous namespace'::printSignalAndBacktrace+0x74
      2018-07-23T13:09:54.762-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\mongo\util\signal_handlers_synchronous.cpp(238)            mongo::`anonymous namespace'::abruptQuit+0x76
      2018-07-23T13:09:54.762-0700 I CONTROL  [initandlisten] MSVCR120.dll                                                                     raise+0x1e9
      2018-07-23T13:09:54.762-0700 I CONTROL  [initandlisten] MSVCR120.dll                                                                     abort+0x18
      2018-07-23T13:09:54.762-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\mongo\util\assert_util.cpp(173)                            mongo::fassertFailed+0xf0
      2018-07-23T13:09:54.762-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\mongo\db\storage\wiredtiger\wiredtiger_util.cpp(327)       mongo::`anonymous namespace'::mdb_handle_error+0xd2
      2018-07-23T13:09:54.762-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\third_party\wiredtiger\src\support\err.c(297)              __wt_eventv+0x408
      2018-07-23T13:09:54.762-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\third_party\wiredtiger\src\support\err.c(322)              __wt_err+0x32
      2018-07-23T13:09:54.762-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\third_party\wiredtiger\src\support\err.c(527)              __wt_illegal_value+0x5e
      2018-07-23T13:09:54.762-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\third_party\wiredtiger\src\block\block_read.c(225)         __wt_block_read_off+0x1ec
      2018-07-23T13:09:54.762-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\third_party\wiredtiger\src\block\block_read.c(101)         __wt_bm_read+0x136
      2018-07-23T13:09:54.762-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\third_party\wiredtiger\src\btree\bt_io.c(40)               __wt_bt_read+0x78
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\third_party\wiredtiger\src\btree\bt_read.c(389)            __page_read+0x12e
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\third_party\wiredtiger\src\btree\bt_read.c(486)            __wt_page_in_func+0x171
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\third_party\wiredtiger\src\include\btree.i(1320)           __wt_page_swap_func+0x3e
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\third_party\wiredtiger\src\btree\row_srch.c(446)           __wt_row_search+0x495
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\third_party\wiredtiger\src\btree\bt_cursor.c(551)          __wt_btcur_insert+0x251
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\third_party\wiredtiger\src\cursor\cur_file.c(245)          __curfile_insert+0x304
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\third_party\wiredtiger\src\txn\txn_recover.c(178)          __txn_op_apply+0x432
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\third_party\wiredtiger\src\txn\txn_recover.c(290)          __txn_log_recover+0x98
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\third_party\wiredtiger\src\log\log.c(1766)                 __wt_log_scan+0x825
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\third_party\wiredtiger\src\txn\txn_recover.c(477)          __wt_txn_recover+0x1b3
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\third_party\wiredtiger\src\conn\conn_open.c(238)           __wt_connection_workers+0x30
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\third_party\wiredtiger\src\conn\conn_api.c(2335)           wiredtiger_open+0xb8a
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\mongo\db\storage\wiredtiger\wiredtiger_kv_engine.cpp(226)  mongo::WiredTigerKVEngine::WiredTigerKVEngine+0x62a
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\mongo\db\storage\wiredtiger\wiredtiger_init.cpp(85)        mongo::`anonymous namespace'::WiredTigerFactory::create+0x1a3
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\mongo\db\service_context_d.cpp(148)                        mongo::ServiceContextMongoD::initializeGlobalStorageEngine+0x88a
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\mongo\db\db.cpp(577)                                       mongo::_initAndListen+0x5bd
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\mongo\db\db.cpp(772)                                       mongo::initAndListen+0x27
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\mongo\db\db.cpp(1005)                                      mongoDbMain+0x216
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] mongod.exe    ...\src\mongo\db\db.cpp(811)                                       wmain+0x35
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] mongod.exe    f:\dd\vctools\crt\crtw32\dllstuff\crtexe.c(623)                    __tmainCRTStartup+0x10f
      2018-07-23T13:09:54.763-0700 I CONTROL  [initandlisten] KERNEL32.DLL                                                                     BaseThreadInitThunk+0x22
      2018-07-23T13:09:54.763-0700 F -        [initandlisten] Got signal: 22 (SIGABRT).
      2018-07-23T13:09:54.764-0700 I CONTROL  [initandlisten] writing minidump diagnostic file mongod.2018-07-23T20-09-54.mdmp
      

       

       

        1. repair-attempt.tar.gz
          617 kB
          Nick Brewer
        2. WiredTiger.turtle
          0.9 kB
          Felix
        3. WiredTiger.wt
          10.55 MB
          Felix

            Assignee:
            nick.brewer Nick Brewer
            Reporter:
            fb4652 Felix
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: