[SERVER-51000] WiredTiger error Created: 17/Sep/20  Updated: 27/Oct/23  Resolved: 23/Sep/20

Status: Closed
Project: Core Server
Component/s: WiredTiger
Affects Version/s: 3.4.2
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: Fanyu Hao Assignee: Dmitry Agranat
Resolution: Community Answered Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

VMware Workstation


Attachments: Zip Archive WiredTiger.zip     Zip Archive repair_attempt_SERVER-51000.zip    
Operating System: ALL
Participants:

 Description   

Hi, 

 

I install Mongo DB on VMware Workstation, but someday i can not start the service.

By looking at similar issues, it should be that mongodb was shut down by mistake. I tried to use --repair, but it didn't work.

I've uploaded my WiredTiger.* files in the hopes that someone can respond with fixed WiredTiger.* files. I would be extremely grateful!!

 

Thank you very much!!

 

2020-09-16T17:42:01.344+0800 I CONTROL [initandlisten] MongoDB starting : pid=1
252 port=27017 dbpath=D:\tmpData master=1 64-bit host=kmMdss1019
2020-09-16T17:42:01.344+0800 I CONTROL [initandlisten] targetMinOS: Windows Vis
ta/Windows Server 2008
2020-09-16T17:42:01.344+0800 I CONTROL [initandlisten] db version v3.4.23
2020-09-16T17:42:01.344+0800 I CONTROL [initandlisten] git version: 324017ede1d
bb1c9554dd2dceb15f8da3c59d0e8
2020-09-16T17:42:01.344+0800 I CONTROL [initandlisten] allocator: tcmalloc
2020-09-16T17:42:01.344+0800 I CONTROL [initandlisten] modules: none
2020-09-16T17:42:01.345+0800 I CONTROL [initandlisten] build environment:
2020-09-16T17:42:01.345+0800 I CONTROL [initandlisten] distarch: x86_64
2020-09-16T17:42:01.345+0800 I CONTROL [initandlisten] target_arch: x86_64
2020-09-16T17:42:01.345+0800 I CONTROL [initandlisten] options: { master: true,
 storage: \{ dbPath: "D:\tmpData" } }
2020-09-16T17:42:01.345+0800 I - [initandlisten] Detected data files in D
:\tmpData created by the 'wiredTiger' storage engine, so setting the active stor
age engine to 'wiredTiger'.
2020-09-16T17:42:01.345+0800 I STORAGE [initandlisten] wiredtiger_open config:
create,cache_size=511M,session_max=20000,eviction=(threads_min=4,threads_max=4),
config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,
compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log
_size=2GB),statistics_log=(wait=0),verbose=(recovery_progress),
2020-09-16T17:42:01.350+0800 E STORAGE [initandlisten] WiredTiger error (0) [16
00249321:350063][1252:140732637385520], file:WiredTiger.wt, connection: WiredTig
er.turtle: encountered an illegal file format or internal value
2020-09-16T17:42:01.351+0800 E STORAGE [initandlisten] WiredTiger error (-31804
) [1600249321:351004][1252:140732637385520], file:WiredTiger.wt, connection: the
 process must exit and restart: WT_PANIC: WiredTiger library panic
2020-09-16T17:42:01.352+0800 I - [initandlisten] Fatal Assertion 28558 at
 src\mongo\db\storage\wiredtiger\wiredtiger_util.cpp 365
2020-09-16T17:42:01.352+0800 I - [initandlisten]
 
***aborting after fassert() failure
 
 
2020-09-16T17:42:01.417+0800 I CONTROL [initandlisten] mongod.exe ...\src\mo
ngo\util\stacktrace_windows.cpp(239) mongo::printStackTrace+
0x43
2020-09-16T17:42:01.418+0800 I CONTROL [initandlisten] mongod.exe ...\src\mo
ngo\util\signal_handlers_synchronous.cpp(180) mongo::`anonymous names
pace'::printSignalAndBacktrace+0x73
2020-09-16T17:42:01.419+0800 I CONTROL [initandlisten] mongod.exe ...\src\mo
ngo\util\signal_handlers_synchronous.cpp(236) mongo::`anonymous names
pace'::abruptQuit+0x83
2020-09-16T17:42:01.419+0800 I CONTROL [initandlisten] mongod.exe d:\th\mink
ernel\crts\ucrt\src\appcrt\misc\signal.cpp(516) raise+0x25e
2020-09-16T17:42:01.420+0800 I CONTROL [initandlisten] mongod.exe d:\th\mink
ernel\crts\ucrt\src\appcrt\startup\abort.cpp(71) abort+0x18
2020-09-16T17:42:01.421+0800 I CONTROL [initandlisten] mongod.exe ...\src\mo
ngo\util\assert_util.cpp(172) mongo::fassertFailedWit
hLocation+0x189
2020-09-16T17:42:01.422+0800 I CONTROL [initandlisten] mongod.exe ...\src\mo
ngo\db\storage\wiredtiger\wiredtiger_util.cpp(365) mongo::`anonymous names
pace'::mdb_handle_error+0x1fc
2020-09-16T17:42:01.422+0800 I CONTROL [initandlisten] mongod.exe ...\src\th
ird_party\wiredtiger\src\support\err.c(275) __wt_eventv+0x376
2020-09-16T17:42:01.423+0800 I CONTROL [initandlisten] mongod.exe ...\src\th
ird_party\wiredtiger\src\support\err.c(317) __wt_err+0x32
2020-09-16T17:42:01.423+0800 I CONTROL [initandlisten] mongod.exe ...\src\th
ird_party\wiredtiger\src\support\err.c(541) __wt_illegal_value+0x6a
 
2020-09-16T17:42:01.424+0800 I CONTROL [initandlisten] mongod.exe ...\src\th
ird_party\wiredtiger\src\meta\meta_turtle.c(291) __wt_turtle_read+0x2ab
2020-09-16T17:42:01.424+0800 I CONTROL [initandlisten] mongod.exe ...\src\th
ird_party\wiredtiger\src\meta\meta_table.c(280) __wt_metadata_search+0x
2c7
2020-09-16T17:42:01.425+0800 I CONTROL [initandlisten] mongod.exe ...\src\th
ird_party\wiredtiger\src\conn\conn_dhandle.c(269) __conn_btree_config_set
+0x22
2020-09-16T17:42:01.425+0800 I CONTROL [initandlisten] mongod.exe ...\src\th
ird_party\wiredtiger\src\conn\conn_dhandle.c(340) __wt_conn_btree_open+0x
6c
2020-09-16T17:42:01.426+0800 I CONTROL [initandlisten] mongod.exe ...\src\th
ird_party\wiredtiger\src\session\session_dhandle.c(543) __wt_session_get_btree+
0x113
2020-09-16T17:42:01.426+0800 I CONTROL [initandlisten] mongod.exe ...\src\th
ird_party\wiredtiger\src\session\session_dhandle.c(535) __wt_session_get_btree+
0x1d5
2020-09-16T17:42:01.427+0800 I CONTROL [initandlisten] mongod.exe ...\src\th
ird_party\wiredtiger\src\session\session_dhandle.c(348) __wt_session_get_btree_
ckpt+0xc3
2020-09-16T17:42:01.427+0800 I CONTROL [initandlisten] mongod.exe ...\src\th
ird_party\wiredtiger\src\cursor\cur_file.c(567) __wt_curfile_open+0x1da
 
2020-09-16T17:42:01.427+0800 I CONTROL [initandlisten] mongod.exe ...\src\th
ird_party\wiredtiger\src\session\session_api.c(390) __session_open_cursor_i
nt+0x312
2020-09-16T17:42:01.428+0800 I CONTROL [initandlisten] mongod.exe ...\src\th
ird_party\wiredtiger\src\session\session_api.c(445) __wt_open_cursor+0x1b
2020-09-16T17:42:01.428+0800 I CONTROL [initandlisten] mongod.exe ...\src\th
ird_party\wiredtiger\src\meta\meta_table.c(91) __wt_metadata_cursor+0x
99
2020-09-16T17:42:01.429+0800 I CONTROL [initandlisten] mongod.exe ...\src\th
ird_party\wiredtiger\src\conn\conn_api.c(2492) wiredtiger_open+0xb49
2020-09-16T17:42:01.429+0800 I CONTROL [initandlisten] mongod.exe ...\src\mo
ngo\db\storage\wiredtiger\wiredtiger_kv_engine.cpp(273) mongo::WiredTigerKVEngi
ne::WiredTigerKVEngine+0x97f
2020-09-16T17:42:01.430+0800 I CONTROL [initandlisten] mongod.exe ...\src\mo
ngo\db\storage\wiredtiger\wiredtiger_init.cpp(105) mongo::`anonymous names
pace'::WiredTigerFactory::create+0x291
2020-09-16T17:42:01.430+0800 I CONTROL [initandlisten] mongod.exe ...\src\mo
ngo\db\service_context_d.cpp(202) mongo::ServiceContextMo
ngoD::initializeGlobalStorageEngine+0x59c
2020-09-16T17:42:01.430+0800 I CONTROL [initandlisten] mongod.exe ...\src\mo
ngo\db\db.cpp(606) mongo::`anonymous names
pace'::_initAndListen+0x768
2020-09-16T17:42:01.431+0800 I CONTROL [initandlisten] mongod.exe ...\src\mo
ngo\db\db.cpp(867) mongo::`anonymous names
pace'::initAndListen+0x27
2020-09-16T17:42:01.431+0800 I CONTROL [initandlisten] mongod.exe ...\src\mo
ngo\db\db.cpp(1223) mongoDbMain+0x226
2020-09-16T17:42:01.432+0800 I CONTROL [initandlisten] mongod.exe ...\src\mo
ngo\db\db.cpp(905) wmain+0x35
2020-09-16T17:42:01.434+0800 I CONTROL [initandlisten] mongod.exe f:\dd\vcto
ols\crt\vcstartup\src\startup\exe_common.inl(253) __scrt_common_main_seh+
0x11d
2020-09-16T17:42:01.435+0800 I CONTROL [initandlisten] KERNEL32.DLL
 BaseThreadInitThunk+0xd
 
2020-09-16T17:42:01.436+0800 F - [initandlisten] Got signal: 22 (SIGABRT)
.
2020-09-16T17:42:01.437+0800 F CONTROL [initandlisten] *** unhandled exception
0x0000000E at 0x00007FFEDE05AB78, terminating
2020-09-16T17:42:01.438+0800 F CONTROL [initandlisten] *** stack trace for unha
ndled exception:
2020-09-16T17:42:01.447+0800 I CONTROL [initandlisten] KERNELBASE.dll
 RaiseException+0x6c
2020-09-16T17:42:01.447+0800 I CONTROL [initandlisten] mongod.exe ...\src\
mongo\util\signal_handlers_synchronous.cpp(237) mongo::`anonymous nam
espace'::abruptQuit+0x9b
2020-09-16T17:42:01.448+0800 I CONTROL [initandlisten] mongod.exe d:\th\mi
nkernel\crts\ucrt\src\appcrt\misc\signal.cpp(516) raise+0x25e
2020-09-16T17:42:01.448+0800 I CONTROL [initandlisten] mongod.exe d:\th\mi
nkernel\crts\ucrt\src\appcrt\startup\abort.cpp(71) abort+0x18
2020-09-16T17:42:01.448+0800 I CONTROL [initandlisten] mongod.exe ...\src\
mongo\util\assert_util.cpp(172) mongo::fassertFailedW
ithLocation+0x189
2020-09-16T17:42:01.449+0800 I CONTROL [initandlisten] mongod.exe ...\src\
mongo\db\storage\wiredtiger\wiredtiger_util.cpp(365) mongo::`anonymous nam
espace'::mdb_handle_error+0x1fc
2020-09-16T17:42:01.449+0800 I CONTROL [initandlisten] mongod.exe ...\src\
third_party\wiredtiger\src\support\err.c(275) __wt_eventv+0x376
2020-09-16T17:42:01.450+0800 I CONTROL [initandlisten] mongod.exe ...\src\
third_party\wiredtiger\src\support\err.c(317) __wt_err+0x32
2020-09-16T17:42:01.450+0800 I CONTROL [initandlisten] mongod.exe ...\src\
third_party\wiredtiger\src\support\err.c(541) __wt_illegal_value+0x
6a
2020-09-16T17:42:01.451+0800 I CONTROL [initandlisten] mongod.exe ...\src\
third_party\wiredtiger\src\meta\meta_turtle.c(291) __wt_turtle_read+0x2a
b
2020-09-16T17:42:01.451+0800 I CONTROL [initandlisten] mongod.exe ...\src\
third_party\wiredtiger\src\meta\meta_table.c(280) __wt_metadata_search+
0x2c7
2020-09-16T17:42:01.452+0800 I CONTROL [initandlisten] mongod.exe ...\src\
third_party\wiredtiger\src\conn\conn_dhandle.c(269) __conn_btree_config_s
et+0x22
2020-09-16T17:42:01.452+0800 I CONTROL [initandlisten] mongod.exe ...\src\
third_party\wiredtiger\src\conn\conn_dhandle.c(340) __wt_conn_btree_open+
0x6c
2020-09-16T17:42:01.453+0800 I CONTROL [initandlisten] mongod.exe ...\src\
third_party\wiredtiger\src\session\session_dhandle.c(543) __wt_session_get_btre
e+0x113
2020-09-16T17:42:01.454+0800 I CONTROL [initandlisten] mongod.exe ...\src\
third_party\wiredtiger\src\session\session_dhandle.c(535) __wt_session_get_btre
e+0x1d5
2020-09-16T17:42:01.454+0800 I CONTROL [initandlisten] mongod.exe ...\src\
third_party\wiredtiger\src\session\session_dhandle.c(348) __wt_session_get_btre
e_ckpt+0xc3
2020-09-16T17:42:01.455+0800 I CONTROL [initandlisten] mongod.exe ...\src\
third_party\wiredtiger\src\cursor\cur_file.c(567) __wt_curfile_open+0x1
da
2020-09-16T17:42:01.455+0800 I CONTROL [initandlisten] mongod.exe ...\src\
third_party\wiredtiger\src\session\session_api.c(390) __session_open_cursor
_int+0x312
2020-09-16T17:42:01.456+0800 I CONTROL [initandlisten] mongod.exe ...\src\
third_party\wiredtiger\src\session\session_api.c(445) __wt_open_cursor+0x1b
 
2020-09-16T17:42:01.456+0800 I CONTROL [initandlisten] mongod.exe ...\src\
third_party\wiredtiger\src\meta\meta_table.c(91) __wt_metadata_cursor+
0x99
2020-09-16T17:42:01.456+0800 I CONTROL [initandlisten] mongod.exe ...\src\
third_party\wiredtiger\src\conn\conn_api.c(2492) wiredtiger_open+0xb49
 
2020-09-16T17:42:01.457+0800 I CONTROL [initandlisten] mongod.exe ...\src\
mongo\db\storage\wiredtiger\wiredtiger_kv_engine.cpp(273) mongo::WiredTigerKVEn
gine::WiredTigerKVEngine+0x97f
2020-09-16T17:42:01.457+0800 I CONTROL [initandlisten] mongod.exe ...\src\
mongo\db\storage\wiredtiger\wiredtiger_init.cpp(105) mongo::`anonymous nam
espace'::WiredTigerFactory::create+0x291
2020-09-16T17:42:01.458+0800 I CONTROL [initandlisten] mongod.exe ...\src\
mongo\db\service_context_d.cpp(202) mongo::ServiceContext
MongoD::initializeGlobalStorageEngine+0x59c
2020-09-16T17:42:01.458+0800 I CONTROL [initandlisten] mongod.exe ...\src\
mongo\db\db.cpp(606) mongo::`anonymous nam
espace'::_initAndListen+0x768
2020-09-16T17:42:01.459+0800 I CONTROL [initandlisten] mongod.exe ...\src\
mongo\db\db.cpp(867) mongo::`anonymous nam
espace'::initAndListen+0x27
2020-09-16T17:42:01.459+0800 I CONTROL [initandlisten] mongod.exe ...\src\
mongo\db\db.cpp(1223) mongoDbMain+0x226
2020-09-16T17:42:01.460+0800 I CONTROL [initandlisten] mongod.exe ...\src\
mongo\db\db.cpp(905) wmain+0x35
2020-09-16T17:42:01.460+0800 I CONTROL [initandlisten] mongod.exe f:\dd\vc
tools\crt\vcstartup\src\startup\exe_common.inl(253) __scrt_common_main_se
h+0x11d
2020-09-16T17:42:01.461+0800 I CONTROL [initandlisten] KERNEL32.DLL
 BaseThreadInitThunk+0
xd
2020-09-16T17:42:01.461+0800 I - [initandlisten]
2020-09-16T17:42:01.462+0800 I CONTROL [initandlisten] writing minidump diagnos
tic file C:\Program Files\MongoDB\Server\3.2020-09-16T09-42-01.mdmp
2020-09-16T17:42:01.476+0800 F CONTROL [initandlisten] *** immediate exit due t
o unhandled exception
 
C:\Program Files\MongoDB\Server\3.4\bin>mongodump
2020-09-16T17:42:25.060+0800 Failed: error connecting to db server: no reacha
ble servers
 
C:\Program Files\MongoDB\Server\3.4\bin>mongodump --host 127.0.0.1 --port 27017
2020-09-16T17:44:42.735+0800 Failed: error connecting to db server: no reacha
ble servers
 
C:\Program Files\MongoDB\Server\3.4\bin>mongo
MongoDB shell version v3.4.23
connecting to: mongodb://127.0.0.1:27017
2020-09-17T09:35:22.564+0800 W NETWORK [thread1] Failed to connect to 127.0.0.1
:27017 after 5000ms milliseconds, giving up.
2020-09-17T09:35:22.602+0800 E QUERY [thread1] Error: couldn't connect to ser
ver 127.0.0.1:27017, connection attempt failed :
connect@src/mongo/shell/mongo.js:240:13
@(connect):1:6
exception: connect failed



 Comments   
Comment by Dmitry Agranat [ 23/Sep/20 ]

Hi 233949043@qq.com,

Unfortunately we aren't able to repair this corruption.

To avoid a problem like this in the future, it is our strong recommendation to:

Regards,
Dima

Comment by Fanyu Hao [ 22/Sep/20 ]

Hi Dmitry:

Unfortunately, the problem was not solved. The content of the error is displayed as follows.

2020-09-22T11:09:07.693+0800 E STORAGE  [initandlisten] WiredTiger error (0) [16
00744147:693264][3052:140714866971440], file:collection-4--5044993959492258041.w
t, WT_SESSION.open_cursor: read checksum error for 4096B block at offset 98304:
block header checksum of 0 doesn't match expected checksum of 2774502953
2020-09-22T11:09:07.694+0800 E STORAGE  [initandlisten] WiredTiger error (0) [16
00744147:694206][3052:140714866971440], file:collection-4--5044993959492258041.w
t, WT_SESSION.open_cursor: collection-4--5044993959492258041.wt: encountered an
illegal file format or internal value
2020-09-22T11:09:07.695+0800 E STORAGE  [initandlisten] WiredTiger error (-31804
) [1600744147:695385][3052:140714866971440], file:collection-4--5044993959492258
041.wt, WT_SESSION.open_cursor: the process must exit and restart: WT_PANIC: Wir
edTiger library panic
2020-09-22T11:09:07.696+0800 I -        [initandlisten] Fatal Assertion 28558 at
 src\mongo\db\storage\wiredtiger\wiredtiger_util.cpp 365
2020-09-22T11:09:07.697+0800 I -        [initandlisten]
 
***aborting after fassert() failure
 
 
2020-09-22T11:09:07.793+0800 I -        [WTJournalFlusher] Fatal Assertion 28559
 at src\mongo\db\storage\wiredtiger\wiredtiger_util.cpp 64
2020-09-22T11:09:07.794+0800 I -        [WTJournalFlusher]
 
***aborting after fassert() failure

Comment by Dmitry Agranat [ 21/Sep/20 ]

Hi 233949043@qq.com,

As MongoDB 3.4 has reached EOL, we can try to assist you as a one-time exception.

I've attached a repair attempt of the files you provided as repair_attempt_SERVER-51000.zip. Please extract these files, replace them in your $dbpath, and let us know if it resolves the issue.

Thanks,
Dima

Generated at Thu Feb 08 05:24:14 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.