[SERVER-54503] mongod start failed Created: 12/Feb/21  Updated: 17/Mar/21  Resolved: 17/Mar/21

Status: Closed
Project: Core Server
Component/s: WiredTiger
Affects Version/s: None
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: Simon-Pierre Tremblay Assignee: Edwin Zhou
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Operating System: ALL
Participants:

 Description   

I am using mongodb v3.6.3
from yesterday morning i am facing this issue and the mongod service won't start.

the file WiredTiger.wt seems to be corrupted

2021-02-12T16:41:43.167+0000 E STORAGE [initandlisten] WiredTiger error (0) [1613148103:167834][2832:0x7f00645e60c0], file:WiredTiger.wt, connection: WiredTiger.turtle: encountered an illegal file format or internal value: (__wt_turtle_read, 291)

// code placeholder
2021-02-12T16:41:42.365+0000 I CONTROL  [initandlisten] MongoDB starting : pid=2832 port=27017 dbpath=/usr/lib/unifi/data/db 64-bit host=590cfb020b0f
2021-02-12T16:41:42.365+0000 I CONTROL  [initandlisten] db version v3.6.3
2021-02-12T16:41:42.365+0000 I CONTROL  [initandlisten] git version: 9586e557d54ef70f9ca4b43c26892cd55257e1a5
2021-02-12T16:41:42.365+0000 I CONTROL  [initandlisten] OpenSSL version: OpenSSL 1.1.1  11 Sep 2018
2021-02-12T16:41:42.365+0000 I CONTROL  [initandlisten] allocator: tcmalloc
2021-02-12T16:41:42.365+0000 I CONTROL  [initandlisten] modules: none
2021-02-12T16:41:42.365+0000 I CONTROL  [initandlisten] build environment:
2021-02-12T16:41:42.365+0000 I CONTROL  [initandlisten]     distarch: x86_64
2021-02-12T16:41:42.365+0000 I CONTROL  [initandlisten]     target_arch: x86_64
2021-02-12T16:41:42.366+0000 I CONTROL  [initandlisten] options: { storage: { dbPath: "/usr/lib/unifi/data/db" } }
2021-02-12T16:41:42.366+0000 I -        [initandlisten] Detected data files in /usr/lib/unifi/data/db created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'.
2021-02-12T16:41:42.366+0000 I STORAGE  [initandlisten] 
2021-02-12T16:41:42.366+0000 I STORAGE  [initandlisten] ** WARNING: Using the XFS filesystem is strongly recommended with the WiredTiger storage engine
2021-02-12T16:41:42.366+0000 I STORAGE  [initandlisten] **          See http://dochub.mongodb.org/core/prodnotes-filesystem
2021-02-12T16:41:42.366+0000 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=23578M,session_max=20000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),statistics_log=(wait=0),verbose=(recovery_progress),
2021-02-12T16:41:43.167+0000 E STORAGE  [initandlisten] WiredTiger error (0) [1613148103:167834][2832:0x7f00645e60c0], file:WiredTiger.wt, connection: WiredTiger.turtle: encountered an illegal file format or internal value: (__wt_turtle_read, 291)
2021-02-12T16:41:43.167+0000 E STORAGE  [initandlisten] WiredTiger error (-31804) [1613148103:167895][2832:0x7f00645e60c0], file:WiredTiger.wt, connection: the process must exit and restart: WT_PANIC: WiredTiger library panic
2021-02-12T16:41:43.167+0000 F -        [initandlisten] Fatal Assertion 28558 at src/mongo/db/storage/wiredtiger/wiredtiger_util.cpp 361
2021-02-12T16:41:43.167+0000 F -        [initandlisten] ***aborting after fassert() failure
2021-02-12T16:41:43.182+0000 F -        [initandlisten] Got signal: 6 (Aborted). 0x55878d6064ca 0x55878d60578e 0x55878d605c62 0x7f00616f9980 0x7f0061334fb7 0x7f0061336921 0x55878be06621 0x55878bed3656 0x55878bf40227 0x55878bdb4667 0x55878bdb499a 0x55878bf04b23 0x55878bf0327d 0x55878bee552a 0x55878bf3eac1 0x55878bf3f0e3 0x55878bf3f344 0x55878bfb69d2 0x55878bf2fd7f 0x55878bf027ee 0x55878bf028db 0x55878bee4031 0x55878beb93c4 0x55878be9ce6f 0x55878c098ea3 0x55878be79f31 0x55878be7d51a 0x55878be07e19 0x7f0061317bf7 0x55878be6974a
----- BEGIN BACKTRACE -----
{"backtrace":[{"b":"55878B5CB000","o":"203B4CA","s":"_ZN5mongo15printStackTraceERSo"},{"b":"55878B5CB000","o":"203A78E"},{"b":"55878B5CB000","o":"203AC62"},{"b":"7F00616E7000","o":"12980"},{"b":"7F00612F6000","o":"3EFB7","s":"gsignal"},{"b":"7F00612F6000","o":"40921","s":"abort"},{"b":"55878B5CB000","o":"83B621","s":"_ZN5mongo32fassertFailedNoTraceWithLocationEiPKcj"},{"b":"55878B5CB000","o":"908656"},{"b":"55878B5CB000","o":"975227"},{"b":"55878B5CB000","o":"7E9667","s":"__wt_err"},{"b":"55878B5CB000","o":"7E999A","s":"__wt_panic"},{"b":"55878B5CB000","o":"939B23","s":"__wt_turtle_read"},{"b":"55878B5CB000","o":"93827D","s":"__wt_metadata_search"},{"b":"55878B5CB000","o":"91A52A","s":"__wt_conn_dhandle_open"},{"b":"55878B5CB000","o":"973AC1","s":"__wt_session_get_dhandle"},{"b":"55878B5CB000","o":"9740E3","s":"__wt_session_get_dhandle"},{"b":"55878B5CB000","o":"974344","s":"__wt_session_get_btree_ckpt"},{"b":"55878B5CB000","o":"9EB9D2","s":"__wt_curfile_open"},{"b":"55878B5CB000","o":"964D7F"},{"b":"55878B5CB000","o":"9377EE","s":"__wt_metadata_cursor_open"},{"b":"55878B5CB000","o":"9378DB","s":"__wt_metadata_cursor"},{"b":"55878B5CB000","o":"919031","s":"wiredtiger_open"},{"b":"55878B5CB000","o":"8EE3C4","s":"_ZN5mongo18WiredTigerKVEngineC2ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mbbbb"},{"b":"55878B5CB000","o":"8D1E6F"},{"b":"55878B5CB000","o":"ACDEA3","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"55878B5CB000","o":"8AEF31"},{"b":"55878B5CB000","o":"8B251A","s":"_ZN5mongo11mongoDbMainEiPPcS1_"},{"b":"55878B5CB000","o":"83CE19","s":"main"},{"b":"7F00612F6000","o":"21BF7","s":"__libc_start_main"},{"b":"55878B5CB000","o":"89E74A","s":"_start"}],"processInfo":{ "mongodbVersion" : "3.6.3", "gitVersion" : "9586e557d54ef70f9ca4b43c26892cd55257e1a5", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "5.4.0-65-generic", "version" : "#73-Ubuntu SMP Mon Jan 18 17:25:17 UTC 2021", "machine" : "x86_64" }, "somap" : [ { "b" : "55878B5CB000", "elfType" : 3, "buildId" : "40A22A63C3F04AF7F9D3983994C20023104C5804" }, { "b" : "7FFF681F4000", "path" : "linux-vdso.so.1", "elfType" : 3, "buildId" : "60E99D2C80F7CA55C6916D2C262C526B768CF8AA" }, { "b" : "7F006417B000", "path" : "/usr/lib/x86_64-linux-gnu/libstemmer.so.0d", "elfType" : 3, "buildId" : "278CA72E21C11FF2E15A86B0B2C13A8922951702" }, { "b" : "7F0063F5E000", "path" : "/lib/x86_64-linux-gnu/libz.so.1", "elfType" : 3, "buildId" : "EF3E006DFE3132A41D4D4DC0E407D6EA658E11C4" }, { "b" : "7F0063D56000", "path" : "/usr/lib/x86_64-linux-gnu/libsnappy.so.1", "elfType" : 3, "buildId" : "55765D88D03CC928130D788F1C7E4BF8415AC7E3" }, { "b" : "7F0063ADC000", "path" : "/usr/lib/x86_64-linux-gnu/libyaml-cpp.so.0.5", "elfType" : 3, "buildId" : "BF65D47C8CD968E616F7D179F84A80CA71DB8249" }, { "b" : "7F00638D3000", "path" : "/usr/lib/x86_64-linux-gnu/libpcrecpp.so.0", "elfType" : 3, "buildId" : "089B8438CC1394E978E56C556C9CAE768BD2F18C" }, { "b" : "7F0063652000", "path" : "/usr/lib/x86_64-linux-gnu/libboost_program_options.so.1.65.1", "elfType" : 3, "buildId" : "9F69F11220BB1FAAB0B73A2B6F4B0E81D9B901CE" }, { "b" : "7F0063438000", "path" : "/usr/lib/x86_64-linux-gnu/libboost_filesystem.so.1.65.1", "elfType" : 3, "buildId" : "32B8421A0643426D9FB008005F5A86688065008B" }, { "b" : "7F0063233000", "path" : "/usr/lib/x86_64-linux-gnu/libboost_system.so.1.65.1", "elfType" : 3, "buildId" : "4BA851D242F2DB710CB1817DE860CF97AE2F9714" }, { "b" : "7F0062FC3000", "path" : "/usr/lib/x86_64-linux-gnu/libtcmalloc.so.4", "elfType" : 3, "buildId" : "572D5C17FBDA6B678DF653411F676819DE18CA6B" }, { "b" : "7F0062DA9000", "path" : "/lib/x86_64-linux-gnu/libresolv.so.2", "elfType" : 3, "buildId" : "ECC229C833EA118D2B04BCE42BAE383B72B11865" }, { "b" : "7F0062B1C000", "path" : "/usr/lib/x86_64-linux-gnu/libssl.so.1.1", "elfType" : 3, "buildId" : "881B3F4FDA206DF3909B141DC7410A08C2DD4B90" }, { "b" : "7F0062651000", "path" : "/usr/lib/x86_64-linux-gnu/libcrypto.so.1.1", "elfType" : 3, "buildId" : "8CA1430180B8D3284004334713C5B769A14D5589" }, { "b" : "7F0062449000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "8BB230E1D019753B019313B61A920224F1A372C9" }, { "b" : "7F0062245000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "C5396CFCF808B3137C70C50F87A21BB9CEBD4824" }, { "b" : "7F0061EBC000", "path" : "/usr/lib/x86_64-linux-gnu/libstdc++.so.6", "elfType" : 3, "buildId" : "F2119A44A99758114620C8E9D8E243D7094F77F6" }, { "b" : "7F0061B1E000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "39ED4F8264119C7115DF214E0A34DE90AACDBE77" }, { "b" : "7F0061906000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "679F3AE11120EC7C483BC9295345D836F5C104F7" }, { "b" : "7F00616E7000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "68F36706EB2E6EEE4046C4FDCA2A19540B2F6113" }, { "b" : "7F00612F6000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "CE450EB01A5E5ACC7CE7B8C2633B02CC1093339E" }, { "b" : "7F0061084000", "path" : "/lib/x86_64-linux-gnu/libpcre.so.3", "elfType" : 3, "buildId" : "5B3416BB188EAF3FA4B7530AAE6C1890B38B0372" }, { "b" : "7F0060E69000", "path" : "/usr/lib/x86_64-linux-gnu/libunwind.so.8", "elfType" : 3, "buildId" : "7995F03B59E1D6EB7968EEA5B8534910D4E8E8D6" }, { "b" : "7F00643CC000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "977C39FE87ABFA426D3043F6C8E21F7BE3F0E876" }, { "b" : "7F0060C43000", "path" : "/lib/x86_64-linux-gnu/liblzma.so.5", "elfType" : 3, "buildId" : "8FBCCA354D964860B9E6EB3736E9B7BC6177B417" } ] }}
 mongod(_ZN5mongo15printStackTraceERSo+0x3A) [0x55878d6064ca]
 mongod(+0x203A78E) [0x55878d60578e]
 mongod(+0x203AC62) [0x55878d605c62]
 libpthread.so.0(+0x12980) [0x7f00616f9980]
 libc.so.6(gsignal+0xC7) [0x7f0061334fb7]
 libc.so.6(abort+0x141) [0x7f0061336921]
 mongod(_ZN5mongo32fassertFailedNoTraceWithLocationEiPKcj+0x0) [0x55878be06621]
 mongod(+0x908656) [0x55878bed3656]
 mongod(+0x975227) [0x55878bf40227]
 mongod(__wt_err+0xA0) [0x55878bdb4667]
 mongod(__wt_panic+0x34) [0x55878bdb499a]
 mongod(__wt_turtle_read+0x233) [0x55878bf04b23]
 mongod(__wt_metadata_search+0x1BD) [0x55878bf0327d]
 mongod(__wt_conn_dhandle_open+0x8A) [0x55878bee552a]
 mongod(__wt_session_get_dhandle+0xE1) [0x55878bf3eac1]
 mongod(__wt_session_get_dhandle+0x703) [0x55878bf3f0e3]
 mongod(__wt_session_get_btree_ckpt+0x154) [0x55878bf3f344]
 mongod(__wt_curfile_open+0x52) [0x55878bfb69d2]
 mongod(+0x964D7F) [0x55878bf2fd7f]
 mongod(__wt_metadata_cursor_open+0x6E) [0x55878bf027ee]
 mongod(__wt_metadata_cursor+0x4B) [0x55878bf028db]
 mongod(wiredtiger_open+0x1851) [0x55878bee4031]
 mongod(_ZN5mongo18WiredTigerKVEngineC2ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mbbbb+0x8E4) [0x55878beb93c4]
 mongod(+0x8D1E6F) [0x55878be9ce6f]
 mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x613) [0x55878c098ea3]
 mongod(+0x8AEF31) [0x55878be79f31]
 mongod(_ZN5mongo11mongoDbMainEiPPcS1_+0x61A) [0x55878be7d51a]
 mongod(main+0x9) [0x55878be07e19]
 libc.so.6(__libc_start_main+0xE7) [0x7f0061317bf7]
 mongod(_start+0x2A) [0x55878be6974a]
-----  END BACKTRACE  -----
Aborted (core dumped)

 

I've tried a repair but doesen't work

// code placeholder
2021-02-12T16:44:21.803+0000 I CONTROL  [initandlisten] MongoDB starting : pid=3081 port=27017 dbpath=/usr/lib/unifi/data/db 64-bit host=590cfb020b0f
2021-02-12T16:44:21.803+0000 I CONTROL  [initandlisten] db version v3.6.3
2021-02-12T16:44:21.803+0000 I CONTROL  [initandlisten] git version: 9586e557d54ef70f9ca4b43c26892cd55257e1a5
2021-02-12T16:44:21.803+0000 I CONTROL  [initandlisten] OpenSSL version: OpenSSL 1.1.1  11 Sep 2018
2021-02-12T16:44:21.803+0000 I CONTROL  [initandlisten] allocator: tcmalloc
2021-02-12T16:44:21.803+0000 I CONTROL  [initandlisten] modules: none
2021-02-12T16:44:21.803+0000 I CONTROL  [initandlisten] build environment:
2021-02-12T16:44:21.803+0000 I CONTROL  [initandlisten]     distarch: x86_64
2021-02-12T16:44:21.803+0000 I CONTROL  [initandlisten]     target_arch: x86_64
2021-02-12T16:44:21.803+0000 I CONTROL  [initandlisten] options: { repair: true, storage: { dbPath: "/usr/lib/unifi/data/db" } }
2021-02-12T16:44:21.804+0000 I -        [initandlisten] Detected data files in /usr/lib/unifi/data/db created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'.
2021-02-12T16:44:21.804+0000 I STORAGE  [initandlisten] 
2021-02-12T16:44:21.804+0000 I STORAGE  [initandlisten] ** WARNING: Using the XFS filesystem is strongly recommended with the WiredTiger storage engine
2021-02-12T16:44:21.804+0000 I STORAGE  [initandlisten] **          See http://dochub.mongodb.org/core/prodnotes-filesystem
2021-02-12T16:44:21.804+0000 I STORAGE  [initandlisten] Detected WT journal files.  Running recovery from last checkpoint.
2021-02-12T16:44:21.804+0000 I STORAGE  [initandlisten] journal to nojournal transition config: create,cache_size=23578M,session_max=20000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),statistics_log=(wait=0),verbose=(recovery_progress),
2021-02-12T16:44:22.604+0000 E STORAGE  [initandlisten] WiredTiger error (0) [1613148262:603992][3081:0x7f2610bc10c0], file:WiredTiger.wt, connection: WiredTiger.turtle: encountered an illegal file format or internal value: (__wt_turtle_read, 291)
2021-02-12T16:44:22.604+0000 E STORAGE  [initandlisten] WiredTiger error (-31804) [1613148262:604053][3081:0x7f2610bc10c0], file:WiredTiger.wt, connection: the process must exit and restart: WT_PANIC: WiredTiger library panic
2021-02-12T16:44:22.604+0000 F -        [initandlisten] Fatal Assertion 28558 at src/mongo/db/storage/wiredtiger/wiredtiger_util.cpp 361
2021-02-12T16:44:22.604+0000 F -        [initandlisten] ***aborting after fassert() failure
2021-02-12T16:44:22.618+0000 F -        [initandlisten] Got signal: 6 (Aborted). 0x55fea07f24ca 0x55fea07f178e 0x55fea07f1c62 0x7f260dcd4980 0x7f260d90ffb7 0x7f260d911921 0x55fe9eff2621 0x55fe9f0bf656 0x55fe9f12c227 0x55fe9efa0667 0x55fe9efa099a 0x55fe9f0f0b23 0x55fe9f0ef27d 0x55fe9f0d152a 0x55fe9f12aac1 0x55fe9f12b0e3 0x55fe9f12b344 0x55fe9f1a29d2 0x55fe9f11bd7f 0x55fe9f0ee7ee 0x55fe9f0ee8db 0x55fe9f0d0031 0x55fe9f0a58f2 0x55fe9f088e6f 0x55fe9f284ea3 0x55fe9f065f31 0x55fe9f06951a 0x55fe9eff3e19 0x7f260d8f2bf7 0x55fe9f05574a
----- BEGIN BACKTRACE -----
{"backtrace":[{"b":"55FE9E7B7000","o":"203B4CA","s":"_ZN5mongo15printStackTraceERSo"},{"b":"55FE9E7B7000","o":"203A78E"},{"b":"55FE9E7B7000","o":"203AC62"},{"b":"7F260DCC2000","o":"12980"},{"b":"7F260D8D1000","o":"3EFB7","s":"gsignal"},{"b":"7F260D8D1000","o":"40921","s":"abort"},{"b":"55FE9E7B7000","o":"83B621","s":"_ZN5mongo32fassertFailedNoTraceWithLocationEiPKcj"},{"b":"55FE9E7B7000","o":"908656"},{"b":"55FE9E7B7000","o":"975227"},{"b":"55FE9E7B7000","o":"7E9667","s":"__wt_err"},{"b":"55FE9E7B7000","o":"7E999A","s":"__wt_panic"},{"b":"55FE9E7B7000","o":"939B23","s":"__wt_turtle_read"},{"b":"55FE9E7B7000","o":"93827D","s":"__wt_metadata_search"},{"b":"55FE9E7B7000","o":"91A52A","s":"__wt_conn_dhandle_open"},{"b":"55FE9E7B7000","o":"973AC1","s":"__wt_session_get_dhandle"},{"b":"55FE9E7B7000","o":"9740E3","s":"__wt_session_get_dhandle"},{"b":"55FE9E7B7000","o":"974344","s":"__wt_session_get_btree_ckpt"},{"b":"55FE9E7B7000","o":"9EB9D2","s":"__wt_curfile_open"},{"b":"55FE9E7B7000","o":"964D7F"},{"b":"55FE9E7B7000","o":"9377EE","s":"__wt_metadata_cursor_open"},{"b":"55FE9E7B7000","o":"9378DB","s":"__wt_metadata_cursor"},{"b":"55FE9E7B7000","o":"919031","s":"wiredtiger_open"},{"b":"55FE9E7B7000","o":"8EE8F2","s":"_ZN5mongo18WiredTigerKVEngineC2ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mbbbb"},{"b":"55FE9E7B7000","o":"8D1E6F"},{"b":"55FE9E7B7000","o":"ACDEA3","s":"_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv"},{"b":"55FE9E7B7000","o":"8AEF31"},{"b":"55FE9E7B7000","o":"8B251A","s":"_ZN5mongo11mongoDbMainEiPPcS1_"},{"b":"55FE9E7B7000","o":"83CE19","s":"main"},{"b":"7F260D8D1000","o":"21BF7","s":"__libc_start_main"},{"b":"55FE9E7B7000","o":"89E74A","s":"_start"}],"processInfo":{ "mongodbVersion" : "3.6.3", "gitVersion" : "9586e557d54ef70f9ca4b43c26892cd55257e1a5", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "5.4.0-65-generic", "version" : "#73-Ubuntu SMP Mon Jan 18 17:25:17 UTC 2021", "machine" : "x86_64" }, "somap" : [ { "b" : "55FE9E7B7000", "elfType" : 3, "buildId" : "40A22A63C3F04AF7F9D3983994C20023104C5804" }, { "b" : "7FFDB3FFB000", "path" : "linux-vdso.so.1", "elfType" : 3, "buildId" : "60E99D2C80F7CA55C6916D2C262C526B768CF8AA" }, { "b" : "7F2610756000", "path" : "/usr/lib/x86_64-linux-gnu/libstemmer.so.0d", "elfType" : 3, "buildId" : "278CA72E21C11FF2E15A86B0B2C13A8922951702" }, { "b" : "7F2610539000", "path" : "/lib/x86_64-linux-gnu/libz.so.1", "elfType" : 3, "buildId" : "EF3E006DFE3132A41D4D4DC0E407D6EA658E11C4" }, { "b" : "7F2610331000", "path" : "/usr/lib/x86_64-linux-gnu/libsnappy.so.1", "elfType" : 3, "buildId" : "55765D88D03CC928130D788F1C7E4BF8415AC7E3" }, { "b" : "7F26100B7000", "path" : "/usr/lib/x86_64-linux-gnu/libyaml-cpp.so.0.5", "elfType" : 3, "buildId" : "BF65D47C8CD968E616F7D179F84A80CA71DB8249" }, { "b" : "7F260FEAE000", "path" : "/usr/lib/x86_64-linux-gnu/libpcrecpp.so.0", "elfType" : 3, "buildId" : "089B8438CC1394E978E56C556C9CAE768BD2F18C" }, { "b" : "7F260FC2D000", "path" : "/usr/lib/x86_64-linux-gnu/libboost_program_options.so.1.65.1", "elfType" : 3, "buildId" : "9F69F11220BB1FAAB0B73A2B6F4B0E81D9B901CE" }, { "b" : "7F260FA13000", "path" : "/usr/lib/x86_64-linux-gnu/libboost_filesystem.so.1.65.1", "elfType" : 3, "buildId" : "32B8421A0643426D9FB008005F5A86688065008B" }, { "b" : "7F260F80E000", "path" : "/usr/lib/x86_64-linux-gnu/libboost_system.so.1.65.1", "elfType" : 3, "buildId" : "4BA851D242F2DB710CB1817DE860CF97AE2F9714" }, { "b" : "7F260F59E000", "path" : "/usr/lib/x86_64-linux-gnu/libtcmalloc.so.4", "elfType" : 3, "buildId" : "572D5C17FBDA6B678DF653411F676819DE18CA6B" }, { "b" : "7F260F384000", "path" : "/lib/x86_64-linux-gnu/libresolv.so.2", "elfType" : 3, "buildId" : "ECC229C833EA118D2B04BCE42BAE383B72B11865" }, { "b" : "7F260F0F7000", "path" : "/usr/lib/x86_64-linux-gnu/libssl.so.1.1", "elfType" : 3, "buildId" : "881B3F4FDA206DF3909B141DC7410A08C2DD4B90" }, { "b" : "7F260EC2C000", "path" : "/usr/lib/x86_64-linux-gnu/libcrypto.so.1.1", "elfType" : 3, "buildId" : "8CA1430180B8D3284004334713C5B769A14D5589" }, { "b" : "7F260EA24000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "8BB230E1D019753B019313B61A920224F1A372C9" }, { "b" : "7F260E820000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "C5396CFCF808B3137C70C50F87A21BB9CEBD4824" }, { "b" : "7F260E497000", "path" : "/usr/lib/x86_64-linux-gnu/libstdc++.so.6", "elfType" : 3, "buildId" : "F2119A44A99758114620C8E9D8E243D7094F77F6" }, { "b" : "7F260E0F9000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "39ED4F8264119C7115DF214E0A34DE90AACDBE77" }, { "b" : "7F260DEE1000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "679F3AE11120EC7C483BC9295345D836F5C104F7" }, { "b" : "7F260DCC2000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "68F36706EB2E6EEE4046C4FDCA2A19540B2F6113" }, { "b" : "7F260D8D1000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "CE450EB01A5E5ACC7CE7B8C2633B02CC1093339E" }, { "b" : "7F260D65F000", "path" : "/lib/x86_64-linux-gnu/libpcre.so.3", "elfType" : 3, "buildId" : "5B3416BB188EAF3FA4B7530AAE6C1890B38B0372" }, { "b" : "7F260D444000", "path" : "/usr/lib/x86_64-linux-gnu/libunwind.so.8", "elfType" : 3, "buildId" : "7995F03B59E1D6EB7968EEA5B8534910D4E8E8D6" }, { "b" : "7F26109A7000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "977C39FE87ABFA426D3043F6C8E21F7BE3F0E876" }, { "b" : "7F260D21E000", "path" : "/lib/x86_64-linux-gnu/liblzma.so.5", "elfType" : 3, "buildId" : "8FBCCA354D964860B9E6EB3736E9B7BC6177B417" } ] }}
 mongod(_ZN5mongo15printStackTraceERSo+0x3A) [0x55fea07f24ca]
 mongod(+0x203A78E) [0x55fea07f178e]
 mongod(+0x203AC62) [0x55fea07f1c62]
 libpthread.so.0(+0x12980) [0x7f260dcd4980]
 libc.so.6(gsignal+0xC7) [0x7f260d90ffb7]
 libc.so.6(abort+0x141) [0x7f260d911921]
 mongod(_ZN5mongo32fassertFailedNoTraceWithLocationEiPKcj+0x0) [0x55fe9eff2621]
 mongod(+0x908656) [0x55fe9f0bf656]
 mongod(+0x975227) [0x55fe9f12c227]
 mongod(__wt_err+0xA0) [0x55fe9efa0667]
 mongod(__wt_panic+0x34) [0x55fe9efa099a]
 mongod(__wt_turtle_read+0x233) [0x55fe9f0f0b23]
 mongod(__wt_metadata_search+0x1BD) [0x55fe9f0ef27d]
 mongod(__wt_conn_dhandle_open+0x8A) [0x55fe9f0d152a]
 mongod(__wt_session_get_dhandle+0xE1) [0x55fe9f12aac1]
 mongod(__wt_session_get_dhandle+0x703) [0x55fe9f12b0e3]
 mongod(__wt_session_get_btree_ckpt+0x154) [0x55fe9f12b344]
 mongod(__wt_curfile_open+0x52) [0x55fe9f1a29d2]
 mongod(+0x964D7F) [0x55fe9f11bd7f]
 mongod(__wt_metadata_cursor_open+0x6E) [0x55fe9f0ee7ee]
 mongod(__wt_metadata_cursor+0x4B) [0x55fe9f0ee8db]
 mongod(wiredtiger_open+0x1851) [0x55fe9f0d0031]
 mongod(_ZN5mongo18WiredTigerKVEngineC2ERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mbbbb+0xE12) [0x55fe9f0a58f2]
 mongod(+0x8D1E6F) [0x55fe9f088e6f]
 mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x613) [0x55fe9f284ea3]
 mongod(+0x8AEF31) [0x55fe9f065f31]
 mongod(_ZN5mongo11mongoDbMainEiPPcS1_+0x61A) [0x55fe9f06951a]
 mongod(main+0x9) [0x55fe9eff3e19]
 libc.so.6(__libc_start_main+0xE7) [0x7f260d8f2bf7]
 mongod(_start+0x2A) [0x55fe9f05574a]
-----  END BACKTRACE  -----
Aborted (core dumped)

Is there a way to recover the file ?

 



 Comments   
Comment by Edwin Zhou [ 17/Mar/21 ]

Hi tremblay.simonpierre@gmail.com,

We haven’t heard back from you for some time, so I’m going to close this ticket. If this is still an issue for you, please provide additional information and we will reopen the ticket.

Best,
Edwin

Comment by Edwin Zhou [ 08/Mar/21 ]

Hi tremblay.simonpierre@gmail.com,

Were you able to find success in using --repair to resolve your issues during startup?

Thanks,
Edwin

Comment by Edwin Zhou [ 16/Feb/21 ]

Hi tremblay.simonpierre@gmail.com,

Please make a complete copy of the database's $dbpath directory to safeguard so that you can work off of the current $dbpath.

You can try mongod --repair using the latest version of MongoDB. Running --repair on the latest version will attempt additional steps to help resolve your corruption.

In the event that a --repair operation is unsuccessful, then please also provide:

  • The logs leading up to the first occurrence of any issue
  • The logs of the repair operation.
  • The logs of any attempt to start mongod after the repair operation completed.

Best,
Edwin

Generated at Thu Feb 08 05:33:43 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.