<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 04:59:58 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-42245] file:WiredTiger.wt, connection: the process must exit and restart: WT_PANIC: WiredTiger library panic</title>
                <link>https://jira.mongodb.org/browse/SERVER-42245</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;The problem was caused by power failure , and all the 3 nodes in the replica set crashed&#160;simultaneously. The mongodb version we are using is 3.4.2, running on&#160;CentOS release 6.5 (Final).&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;I have found a few issues of not being able to repair mongo data files, which were caused by corrupted &#160;WiredTiger.wt OR WiredTiger.turtle, &#160;and the reporters all uploaded the two files , then you will try to repair them and re-upload .&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;What I am encountering is the exact the same &#160;issue. So, here are the original WT files and also the repair output. Would you please help to fix this issue for me?&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;The below are the repair output:&lt;/p&gt;

&lt;p&gt;2019-07-16T16:41:45.178+0800 I CONTROL &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; MongoDB starting : pid=2255 port=30000 dbpath=/iflytek/data/mongodb/new_data/data27017_bak/ 64-bit host=i-A3566A06&lt;br/&gt;
2019-07-16T16:41:45.178+0800 I CONTROL &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; db version v3.4.2&lt;br/&gt;
2019-07-16T16:41:45.178+0800 I CONTROL &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; git version: 3f76e40c105fc223b3e5aac3e20dcd026b83b38b&lt;br/&gt;
2019-07-16T16:41:45.178+0800 I CONTROL &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; OpenSSL version: OpenSSL 1.0.1e-fips 11 Feb 2013&lt;br/&gt;
2019-07-16T16:41:45.178+0800 I CONTROL &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; allocator: tcmalloc&lt;br/&gt;
2019-07-16T16:41:45.178+0800 I CONTROL &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; modules: none&lt;br/&gt;
2019-07-16T16:41:45.178+0800 I CONTROL &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; build environment:&lt;br/&gt;
2019-07-16T16:41:45.178+0800 I CONTROL &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; distmod: rhel62&lt;br/&gt;
2019-07-16T16:41:45.178+0800 I CONTROL &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; distarch: x86_64&lt;br/&gt;
2019-07-16T16:41:45.178+0800 I CONTROL &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; target_arch: x86_64&lt;br/&gt;
2019-07-16T16:41:45.178+0800 I CONTROL &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; options: { net: &lt;/p&gt;
{ port: 30000 }
&lt;p&gt;, repair: true, storage: { dbPath: &quot;/iflytek/data/mongodb/new_data/data27017_bak/&quot; } }&lt;br/&gt;
2019-07-16T16:41:45.226+0800 I - &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; Detected data files in /iflytek/data/mongodb/new_data/data27017_bak/ created by the &apos;wiredTiger&apos; storage engine, so setting the active storage engine to &apos;wiredTiger&apos;.&lt;br/&gt;
2019-07-16T16:41:45.226+0800 I STORAGE &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt;&lt;br/&gt;
2019-07-16T16:41:45.226+0800 I STORAGE &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; ** WARNING: Using the XFS filesystem is strongly recommended with the WiredTiger storage engine&lt;br/&gt;
2019-07-16T16:41:45.226+0800 I STORAGE &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; ** See &lt;a href=&quot;http://dochub.mongodb.org/core/prodnotes-filesystem&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://dochub.mongodb.org/core/prodnotes-filesystem&lt;/a&gt;&lt;br/&gt;
2019-07-16T16:41:45.226+0800 I STORAGE &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; Detected WT journal files. Running recovery from last checkpoint.&lt;br/&gt;
2019-07-16T16:41:45.226+0800 I STORAGE &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; journal to nojournal transition config: create,cache_size=7463M,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),&lt;br/&gt;
2019-07-16T16:41:45.392+0800 E STORAGE &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; WiredTiger error (0) &lt;span class=&quot;error&quot;&gt;&amp;#91;1563266505:392024&amp;#93;&lt;/span&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;2255:0x7fdc4d817d40&amp;#93;&lt;/span&gt;, &lt;a href=&quot;file:WiredTiger.wt&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;file:WiredTiger.wt&lt;/a&gt;, connection: read checksum error for 4096B block at offset 36864: block header checksum of 3570790737 doesn&apos;t match expected checksum of 1564876380&lt;br/&gt;
2019-07-16T16:41:45.392+0800 E STORAGE &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; WiredTiger error (0) &lt;span class=&quot;error&quot;&gt;&amp;#91;1563266505:392085&amp;#93;&lt;/span&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;2255:0x7fdc4d817d40&amp;#93;&lt;/span&gt;, &lt;a href=&quot;file:WiredTiger.wt&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;file:WiredTiger.wt&lt;/a&gt;, connection: WiredTiger.wt: encountered an illegal file format or internal value&lt;br/&gt;
2019-07-16T16:41:45.392+0800 E STORAGE &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; WiredTiger error (-31804) &lt;span class=&quot;error&quot;&gt;&amp;#91;1563266505:392097&amp;#93;&lt;/span&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;2255:0x7fdc4d817d40&amp;#93;&lt;/span&gt;, &lt;a href=&quot;file:WiredTiger.wt&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;file:WiredTiger.wt&lt;/a&gt;, connection: the process must exit and restart: WT_PANIC: WiredTiger library panic&lt;br/&gt;
2019-07-16T16:41:45.392+0800 I - &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; Fatal Assertion 28558 at src/mongo/db/storage/wiredtiger/wiredtiger_util.cpp 361&lt;br/&gt;
2019-07-16T16:41:45.392+0800 I - &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt;&lt;/p&gt;

&lt;p&gt;***aborting after fassert() failure&lt;/p&gt;


&lt;p&gt;2019-07-16T16:41:45.413+0800 F - &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; Got signal: 6 (Aborted).&lt;/p&gt;

&lt;p&gt;0x7fdc4edb8d21 0x7fdc4edb7e19 0x7fdc4edb82fd 0x7fdc4c508710 0x7fdc4c197925 0x7fdc4c199105 0x7fdc4e040c9d 0x7fdc4eac73e6 0x7fdc4e04af80 0x7fdc4e04b074 0x7fdc4e04b2cc 0x7fdc4f6bb1df 0x7fdc4f6bb72b 0x7fdc4f6b7e3d 0x7fdc4f6bc907 0x7fdc4f6da056 0x7fdc4f7106db 0x7fdc4f79d4fd 0x7fdc4f79dbf8 0x7fdc4f79e10c 0x7fdc4f7204c1 0x7fdc4f792f30 0x7fdc4f75d38e 0x7fdc4f75d47b 0x7fdc4f70cb2f 0x7fdc4eaaacec 0x7fdc4eaa3865 0x7fdc4e991fa7 0x7fdc4e02c559 0x7fdc4e04c6c4 0x7fdc4c183d1d 0x7fdc4e0aa371&lt;br/&gt;
----- BEGIN BACKTRACE -----&lt;/p&gt;
{&quot;backtrace&quot;:[\{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;1589D21&quot;,&quot;s&quot;:&quot;_ZN5mongo15printStackTraceERSo&quot;}
&lt;p&gt;,{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;1588E19&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;15892FD&quot;},{&quot;b&quot;:&quot;7FDC4C4F9000&quot;,&quot;o&quot;:&quot;F710&quot;},{&quot;b&quot;:&quot;7FDC4C165000&quot;,&quot;o&quot;:&quot;32925&quot;,&quot;s&quot;:&quot;gsignal&quot;},{&quot;b&quot;:&quot;7FDC4C165000&quot;,&quot;o&quot;:&quot;34105&quot;,&quot;s&quot;:&quot;abort&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;811C9D&quot;,&quot;s&quot;:&quot;&lt;em&gt;ZN5mongo32fassertFailedNoTraceWithLocationEiPKcj&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;12983E6&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;81BF80&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;81C074&quot;,&quot;s&quot;:&quot;&lt;/em&gt;&lt;em&gt;wt_err&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;81C2CC&quot;,&quot;s&quot;:&quot;&lt;/em&gt;&lt;em&gt;wt_panic&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;1E8C1DF&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;1E8C72B&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;1E88E3D&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;1E8D907&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;1EAB056&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;1EE16DB&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;1F6E4FD&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;1F6EBF8&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;1F6F10C&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;1EF14C1&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;1F63F30&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;1F2E38E&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;1F2E47B&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;1EDDB2F&quot;,&quot;s&quot;:&quot;wiredtiger_open&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;127BCEC&quot;,&quot;s&quot;:&quot;_ZN5mongo18WiredTigerKVEngineC2ERKNSt7&lt;/em&gt;&lt;em&gt;cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mbbbb&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;1274865&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;1162FA7&quot;,&quot;s&quot;:&quot;_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;7FD559&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;81D6C4&quot;,&quot;s&quot;:&quot;main&quot;},{&quot;b&quot;:&quot;7FDC4C165000&quot;,&quot;o&quot;:&quot;1ED1D&quot;,&quot;s&quot;:&quot;&lt;/em&gt;_libc_start_main&quot;},{&quot;b&quot;:&quot;7FDC4D82F000&quot;,&quot;o&quot;:&quot;87B371&quot;}],&quot;processInfo&quot;:{ &quot;mongodbVersion&quot; : &quot;3.4.2&quot;, &quot;gitVersion&quot; : &quot;3f76e40c105fc223b3e5aac3e20dcd026b83b38b&quot;, &quot;compiledModules&quot; : [], &quot;uname&quot; : &lt;/p&gt;
{ &quot;sysname&quot; : &quot;Linux&quot;, &quot;release&quot; : &quot;2.6.32-431.el6.x86_64&quot;, &quot;version&quot; : &quot;#1 SMP Fri Nov 22 03:15:09 UTC 2013&quot;, &quot;machine&quot; : &quot;x86_64&quot; }
&lt;p&gt;, &quot;somap&quot; : [ { &quot;b&quot; : &quot;7FDC4D82F000&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;0409C529A50A34D3E255B4350462A560B78F8892&quot; }, { &quot;b&quot; : &quot;7FFF2F9F0000&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;81A81BE2E44C93640ADEDB62ADC93A47F4A09DD1&quot; }, { &quot;b&quot; : &quot;7FDC4D3A1000&quot;, &quot;path&quot; : &quot;/usr/lib64/libssl.so.10&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;BECFB85A8BC084042D5BF2BA9E66325CE798B659&quot; }, { &quot;b&quot; : &quot;7FDC4CFBC000&quot;, &quot;path&quot; : &quot;/usr/lib64/libcrypto.so.10&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;CBDA444A7109874C5350AE9CEEF3F82F749B347F&quot; }, { &quot;b&quot; : &quot;7FAAB95B4000&quot;, &quot;path&quot; : &quot;/lib64/librt.so.1&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;B26528BF6C0636AC1CAE5AC50BDBC07E60851DF4&quot; }, { &quot;b&quot; : &quot;7FAAB9FB0000&quot;, &quot;path&quot; : &quot;/lib64/libdl.so.2&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;AFC7448F2F2F6ED4E5BC82B1BD8A7320B84A9D48&quot; }, { &quot;b&quot; : &quot;7FAAB892C000&quot;, &quot;path&quot; : &quot;/lib64/libm.so.6&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;98B028A725D6E93253F25DF00B794DFAA66A3145&quot; }, { &quot;b&quot; : &quot;7FA47BF16000&quot;, &quot;path&quot; : &quot;/lib64/libgcc_s.so.1&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;EDC925E58FE28DCA536993EB13179C739F1E6566&quot; }, { &quot;b&quot; : &quot;7FAAB90F9000&quot;, &quot;path&quot; : &quot;/lib64/libpthread.so.0&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;1BB4E10307D6B94223749CFDF2AD14C365972C60&quot; }, { &quot;b&quot; : &quot;7FAAB9165000&quot;, &quot;path&quot; : &quot;/lib64/libc.so.6&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;F1A1C0575F0EC141A157E5DFA4525E70BD27B62E&quot; }, { &quot;b&quot; : &quot;7FAABAE0D000&quot;, &quot;path&quot; : &quot;/lib64/ld-linux-x86-64.so.2&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;57BF668F99B7F5917B8D55FBB645173C9A644575&quot; }, { &quot;b&quot; : &quot;7FA478B21000&quot;, &quot;path&quot; : &quot;/lib64/libgssapi_krb5.so.2&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;9A737F8BF10FC99C37CC404D3FC188F6E11FEDD9&quot; }, { &quot;b&quot; : &quot;7FA47983A000&quot;, &quot;path&quot; : &quot;/lib64/libkrb5.so.3&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;8D3D6E28DF6EB3752642A7031AAC17D39EA4265D&quot; }, { &quot;b&quot; : &quot;7FA47A636000&quot;, &quot;path&quot; : &quot;/lib64/libcom_err.so.2&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;7EC54D6E88BB7D2C1284117C2A483496A01EAAF4&quot; }, { &quot;b&quot; : &quot;7FA47900A000&quot;, &quot;path&quot; : &quot;/lib64/libk5crypto.so.3&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;CC89B4C8CDCCD32BA610BC72784DC3B7E9BD9E19&quot; }, { &quot;b&quot; : &quot;7FDC4B5F2000&quot;, &quot;path&quot; : &quot;/usr/local/lib/libz.so.1&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;F7DFD2C44B176B74A351A07FAEA54721D114FD95&quot; }, { &quot;b&quot; : &quot;7FA479BE7000&quot;, &quot;path&quot; : &quot;/lib64/libkrb5support.so.0&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;E0C522C589F775C324330BE09CE67DC83950A213&quot; }, { &quot;b&quot; : &quot;7FA4795E4000&quot;, &quot;path&quot; : &quot;/lib64/libkeyutils.so.1&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;AF374BAFB7F5B139A0B431D3F06D82014AFF3251&quot; }, { &quot;b&quot; : &quot;7FAAB63CA000&quot;, &quot;path&quot; : &quot;/lib64/libresolv.so.2&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;56843351EFB2CE304A7E4BD0754991613E9EC8BD&quot; }, { &quot;b&quot; : &quot;7FA47A9AB000&quot;, &quot;path&quot; : &quot;/lib64/libselinux.so.1&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;B4576BE308DDCF7BC31F7304E4734C3D846D0236&quot; } ] }}&lt;br/&gt;
 mongod(_ZN5mongo15printStackTraceERSo+0x41) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4edb8d21&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(+0x1588E19) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4edb7e19&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(+0x15892FD) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4edb82fd&amp;#93;&lt;/span&gt;&lt;br/&gt;
 libpthread.so.0(+0xF710) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4c508710&amp;#93;&lt;/span&gt;&lt;br/&gt;
 libc.so.6(gsignal+0x35) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4c197925&amp;#93;&lt;/span&gt;&lt;br/&gt;
 libc.so.6(abort+0x175) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4c199105&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(_ZN5mongo32fassertFailedNoTraceWithLocationEiPKcj+0x0) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4e040c9d&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(+0x12983E6) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4eac73e6&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(+0x81BF80) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4e04af80&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(__wt_err+0x9D) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4e04b074&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(__wt_panic+0x24) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4e04b2cc&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(+0x1E8C1DF) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4f6bb1df&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(+0x1E8C72B) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4f6bb72b&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(+0x1E88E3D) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4f6b7e3d&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(+0x1E8D907) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4f6bc907&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(+0x1EAB056) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4f6da056&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(+0x1EE16DB) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4f7106db&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(+0x1F6E4FD) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4f79d4fd&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(+0x1F6EBF8) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4f79dbf8&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(+0x1F6F10C) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4f79e10c&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(+0x1EF14C1) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4f7204c1&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(+0x1F63F30) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4f792f30&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(+0x1F2E38E) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4f75d38e&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(+0x1F2E47B) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4f75d47b&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(wiredtiger_open+0x171F) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4f70cb2f&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(&lt;em&gt;ZN5mongo18WiredTigerKVEngineC2ERKNSt7&lt;/em&gt;_cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_PNS_11ClockSourceES8_mbbbb+0xD7C) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4eaaacec&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(+0x1274865) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4eaa3865&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(_ZN5mongo20ServiceContextMongoD29initializeGlobalStorageEngineEv+0x6B7) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4e991fa7&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(+0x7FD559) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4e02c559&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(main+0x964) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4e04c6c4&amp;#93;&lt;/span&gt;&lt;br/&gt;
 libc.so.6(__libc_start_main+0xFD) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4c183d1d&amp;#93;&lt;/span&gt;&lt;br/&gt;
 mongod(+0x87B371) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7fdc4e0aa371&amp;#93;&lt;/span&gt;&lt;br/&gt;
----- END BACKTRACE -----&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;PS: Since this kind of problems had occurred so many time, have you considered telling us how to correct the&#160;corrupted file by ourselves, not just fix the files problems for us?&#160;&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;</description>
                <environment></environment>
        <key id="858998">SERVER-42245</key>
            <summary>file:WiredTiger.wt, connection: the process must exit and restart: WT_PANIC: WiredTiger library panic</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="kelsey.schubert@mongodb.com">Kelsey Schubert</assignee>
                                    <reporter username="cora_ma">Chengcheng Ma</reporter>
                        <labels>
                            <label>wtc</label>
                    </labels>
                <created>Tue, 16 Jul 2019 09:53:40 +0000</created>
                <updated>Wed, 24 Jul 2019 02:26:19 +0000</updated>
                            <resolved>Mon, 22 Jul 2019 23:03:48 +0000</resolved>
                                                                    <component>WiredTiger</component>
                                        <votes>0</votes>
                                    <watches>3</watches>
                                                                                                                <comments>
                            <comment id="2340247" author="cora_ma" created="Wed, 24 Jul 2019 02:26:19 +0000"  >&lt;p&gt;So many thanks,&#160; Kelsey Schubert.&#160;&lt;/p&gt;

&lt;p&gt;By using the files you attached, we have dumped most of the data from .wt data file directly, through the utility of wt. Now we have reloaded the dumped data into a monogd instance. Thanks again.&lt;/p&gt;</comment>
                            <comment id="2337849" author="thomas.schubert" created="Mon, 22 Jul 2019 23:03:37 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=cora_ma&quot; class=&quot;user-hover&quot; rel=&quot;cora_ma&quot;&gt;cora_ma&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;This error indicates additional corruption on disk affecting other files, and I&apos;d strongly recommend verifying the integrity of your disks. Unfortunately, we do not have any scripts that would repair these files.&lt;/p&gt;

&lt;p&gt;Kind regards,&lt;br/&gt;
Kelsey&lt;/p&gt;</comment>
                            <comment id="2333208" author="cora_ma" created="Fri, 19 Jul 2019 06:13:31 +0000"  >&lt;p&gt;@Kelsey Schubert&lt;/p&gt;

&lt;p&gt;Would please help?&lt;/p&gt;</comment>
                            <comment id="2331489" author="cora_ma" created="Thu, 18 Jul 2019 06:29:23 +0000"  >&lt;p&gt;Sorry to not upload the log files which mentioned in the 1st answer.&lt;/p&gt;

&lt;p&gt;The file named&#160;mongod.log.2019-07-11T10-22-54 is the log when tried to start after crash.&lt;/p&gt;

&lt;p&gt;&lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/attachment/224556/224556_mongod.log.2019-07-11T10-22-54&quot; title=&quot;mongod.log.2019-07-11T10-22-54 attached to SERVER-42245&quot;&gt;mongod.log.2019-07-11T10-22-54&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.mongodb.org/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt;&lt;/p&gt;

&lt;p&gt;mongo_repair.log is the repair log which replaced with your uploaded files.&#160;&lt;/p&gt;

&lt;p&gt;&#160;&lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/attachment/224555/224555_mongo_repair.log&quot; title=&quot;mongo_repair.log attached to SERVER-42245&quot;&gt;mongo_repair.log&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.mongodb.org/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt;&lt;/p&gt;</comment>
                            <comment id="2329901" author="cora_ma" created="Wed, 17 Jul 2019 08:41:43 +0000"  >&lt;p&gt;@Kelsey Schubert, unfortunately we were not able to recover the dead mongod. As you mentioned, here are the corresponding information which you suspected:&lt;/p&gt;
&lt;ol&gt;
	&lt;li&gt;The file attached, named orig.log, is the logs which recorded the process of crash-up, failure of start-up.&lt;/li&gt;
	&lt;li&gt;The storage underlying:
	&lt;ol&gt;
		&lt;li&gt;FS Type: ext4&lt;/li&gt;
		&lt;li&gt;Locally attached;&lt;/li&gt;
		&lt;li&gt;No Raid for the data path mount;&lt;/li&gt;
		&lt;li&gt;Disk Type: HDD&lt;/li&gt;
	&lt;/ol&gt;
	&lt;/li&gt;
	&lt;li&gt;Never backed up.&lt;/li&gt;
	&lt;li&gt;Disk check recently is OK.&lt;/li&gt;
	&lt;li&gt;Deployment history:&lt;/li&gt;
&lt;/ol&gt;


&lt;ol&gt;
	&lt;li&gt;
	&lt;ol&gt;
		&lt;li&gt;No version change;&lt;/li&gt;
		&lt;li&gt;No hardware upgrade/downgrade, no configuration change;&lt;/li&gt;
		&lt;li&gt;No activities of backup and restoration;&lt;/li&gt;
		&lt;li&gt;No file movement.&lt;/li&gt;
	&lt;/ol&gt;
	&lt;/li&gt;
&lt;/ol&gt;


&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;Because all the 3 nodes in the replica set have the same situation, so we do not have any unaffected node to resync.&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;Thanks a lot in advance.&lt;/p&gt;</comment>
                            <comment id="2329865" author="thomas.schubert" created="Wed, 17 Jul 2019 06:28:29 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=cora_ma&quot; class=&quot;user-hover&quot; rel=&quot;cora_ma&quot;&gt;cora_ma&lt;/a&gt;, this error message leads us to suspect some form of physical corruption.&lt;br/&gt;
 Our ability to determine the source of this corruption depends greatly on your ability to provide:&lt;/p&gt;
&lt;ol&gt;
	&lt;li&gt;The logs for the affected node, including before, leading up to, and after the first sign of corruption.&lt;/li&gt;
	&lt;li&gt;A description of the underlying storage mechanism in use, including details like:
	&lt;ol&gt;
		&lt;li&gt;What file system and/or volume management system is in use?&lt;/li&gt;
		&lt;li&gt;Is data storage locally attached or network-attached?&lt;/li&gt;
		&lt;li&gt;Are disks RAIDed and if so how?&lt;/li&gt;
		&lt;li&gt;Are disks SSDs or HDDs?&lt;/li&gt;
	&lt;/ol&gt;
	&lt;/li&gt;
	&lt;li&gt;A description of your backup method, if any.&lt;/li&gt;
	&lt;li&gt;A description of your disks have been recently checked for integrity?&lt;/li&gt;
	&lt;li&gt;A history of the deployment, including:
	&lt;ol&gt;
		&lt;li&gt;a timeline of version changes&lt;/li&gt;
		&lt;li&gt;a timeline of hardware upgrade/downgrade cycles or configuration changes&lt;/li&gt;
		&lt;li&gt;a timeline of disaster recovery or backup restoration activities&lt;/li&gt;
		&lt;li&gt;a timeline of any manipulations of the underlying database files, including copies or moves, and information about whether mongod was running during each manipulation.&lt;/li&gt;
	&lt;/ol&gt;
	&lt;/li&gt;
&lt;/ol&gt;


&lt;p&gt;The ideal resolution is to perform a clean &lt;a href=&quot;https://docs.mongodb.org/manual/tutorial/resync-replica-set-member/#automatically-sync-a-member&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;resync&lt;/a&gt; from an unaffected node. If that is not possible,&#160;I&apos;ve attached a repair attempt of the files you provided as &lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/attachment/224429/224429_repair_attempt.tar.gz&quot; title=&quot;repair_attempt.tar.gz attached to SERVER-42245&quot;&gt;repair_attempt.tar.gz&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.mongodb.org/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt;. Please extract these files, replace them in your &lt;tt&gt;$dbpath&lt;/tt&gt;, and let us know if it resolves the issue.&lt;/p&gt;

&lt;p&gt;Kind regards,&lt;br/&gt;
Kelsey&lt;/p&gt;</comment>
                            <comment id="2329850" author="cora_ma" created="Wed, 17 Jul 2019 05:43:45 +0000"  >&lt;p&gt;Does any one help?&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                            <attachment id="224334" name="WiredTiger.turtle" size="1021" author="cora_ma" created="Tue, 16 Jul 2019 09:51:32 +0000"/>
                            <attachment id="224333" name="WiredTiger.wt" size="1122304" author="cora_ma" created="Tue, 16 Jul 2019 09:51:33 +0000"/>
                            <attachment id="224555" name="mongo_repair.log" size="198449" author="cora_ma" created="Thu, 18 Jul 2019 06:26:52 +0000"/>
                            <attachment id="224556" name="mongod.log.2019-07-11T10-22-54" size="9727" author="cora_ma" created="Thu, 18 Jul 2019 06:27:23 +0000"/>
                            <attachment id="224429" name="repair_attempt.tar.gz" size="70752" author="kelsey.schubert@mongodb.com" created="Wed, 17 Jul 2019 06:26:44 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>7.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Wed, 17 Jul 2019 06:28:29 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        4 years, 29 weeks, 1 day ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>cora_ma</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            4 years, 29 weeks, 1 day ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>cora_ma</customfieldvalue>
            <customfieldvalue>kelsey.schubert@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hveo6n:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hv3q7r:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10750" key="com.atlassian.jira.plugin.system.customfieldtypes:textarea">
                        <customfieldname>Steps To Reproduce</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>&lt;p&gt;&lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/attachment/224334/224334_WiredTiger.turtle&quot; title=&quot;WiredTiger.turtle attached to SERVER-42245&quot;&gt;WiredTiger.turtle&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.mongodb.org/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt;&lt;/p&gt;</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                    <customfieldvalue><![CDATA[dmitry.agranat@mongodb.com]]></customfieldvalue>
        <customfieldvalue><![CDATA[kelsey.schubert@mongodb.com]]></customfieldvalue>
    

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hveafz:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>