<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 06:00:46 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-64629] WiredTiger metadata corruption detected - unable to repair</title>
                <link>https://jira.mongodb.org/browse/SERVER-64629</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Hi all,&lt;/p&gt;

&lt;p&gt;We are using Graylog, Elasticsearch and MongoDB for logging and archiving. These apps are run as docker containers with 3 replicas on 3 RHEL servers. We are using MongoDB version 3.6.18&lt;br/&gt;
Generally, the docker containers goes down and they are automatically brought up by the docker daemon. But sometimes, the shutdown is not proper and the data in MongoDB gets corrupted. Till now, we used to perform a repair and the data was able to be recovered successfully.&lt;/p&gt;

&lt;p&gt;I had previously created a ticket for the similar issue (&lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-61936&quot; class=&quot;external-link&quot; rel=&quot;nofollow&quot;&gt;https://jira.mongodb.org/browse/SERVER-61936&lt;/a&gt;). At that time, I had restored the data from the backup and could not try the repair command as mentioned by &quot;Edwin Zhou&quot;. &lt;/p&gt;

&lt;p&gt;I have encountered the problem again. The same DB got corrupted. &lt;br/&gt;
I have tried the repair operations with 4 different versions of MongoDB. All the log outputs from the repair operations are attached below. But none of the repair was successful.&lt;/p&gt;

&lt;p&gt;I have attached the WiredTiger files from this corrupted db.&lt;/p&gt;

&lt;p&gt;Can you please help me in recovering from this failure?&lt;br/&gt;
Also can you let me know how I can prevent this frequent corruption of Data in the DB?&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Saroj&lt;/p&gt;</description>
                <environment></environment>
        <key id="2004269">SERVER-64629</key>
            <summary>WiredTiger metadata corruption detected - unable to repair</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="edwin.zhou@mongodb.com">Edwin Zhou</assignee>
                                    <reporter username="saroj.jillalla@cgi.com">Sarojini Jillalla</reporter>
                        <labels>
                    </labels>
                <created>Fri, 18 Mar 2022 02:00:10 +0000</created>
                <updated>Wed, 4 May 2022 16:06:05 +0000</updated>
                            <resolved>Wed, 4 May 2022 16:06:05 +0000</resolved>
                                    <version>3.6.18</version>
                                                                        <votes>0</votes>
                                    <watches>4</watches>
                                                                                                                <comments>
                            <comment id="4526099" author="JIRAUSER1257066" created="Wed, 4 May 2022 16:05:55 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=saroj.jillalla%40cgi.com&quot; class=&quot;user-hover&quot; rel=&quot;saroj.jillalla@cgi.com&quot;&gt;saroj.jillalla@cgi.com&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Thank you for following up. We&apos;re happy to hear that you were able to resolve the problem by restoring the data from backup.&lt;/p&gt;

&lt;p&gt;Since you are operating with a replica set, the ideal resolution is to perform a clean &lt;a href=&quot;https://docs.mongodb.org/manual/tutorial/resync-replica-set-member/#automatically-sync-a-member&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;resync&lt;/a&gt; from an unaffected node. &lt;/p&gt;

&lt;p&gt;To avoid a problem like this in the future, it is our strong recommendation to:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;Use the &lt;a href=&quot;https://docs.mongodb.com/manual/release-notes/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;most recent version&lt;/a&gt;.&lt;/li&gt;
	&lt;li&gt;Follow all &lt;a href=&quot;https://docs.mongodb.com/manual/administration/production-notes/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;production notes&lt;/a&gt;, especially those for &lt;a href=&quot;https://docs.mongodb.com/manual/administration/production-notes/#disk-and-storage-systems&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;underlying storage systems&lt;/a&gt;.&lt;/li&gt;
	&lt;li&gt;Schedule and perform regular checks of the integrity of your filesystems and disks.&lt;/li&gt;
	&lt;li&gt;Never manipulate the underlying database files in any way.&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;Best,&lt;br/&gt;
Edwin&lt;/p&gt;</comment>
                            <comment id="4511718" author="JIRAUSER1263839" created="Thu, 28 Apr 2022 01:35:08 +0000"  >&lt;p&gt;Hi Edwin/Louis,&lt;br/&gt;
Sorry for the delayed update.&lt;br/&gt;
We had to restore the data from a backup and the issue was resolved. I did not try the repair operation using v4.0.28.&lt;/p&gt;</comment>
                            <comment id="4433691" author="JIRAUSER1257066" created="Thu, 24 Mar 2022 20:56:56 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=saroj.jillalla%40cgi.com&quot; class=&quot;user-hover&quot; rel=&quot;saroj.jillalla@cgi.com&quot;&gt;saroj.jillalla@cgi.com&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;To add on to &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=louis.williams&quot; class=&quot;user-hover&quot; rel=&quot;louis.williams&quot;&gt;louis.williams&lt;/a&gt;, please make a complete copy of the database&apos;s $dbpath directory prior to running any sort of repair operation to safeguard so that you can work off of the current $dbpath.&lt;/p&gt;

&lt;p&gt;We look forward to hearing about the status of the repair operation on MongoDB 4.0.28.&lt;/p&gt;

&lt;p&gt;Best,&lt;br/&gt;
Edwin&lt;/p&gt;</comment>
                            <comment id="4423170" author="louis.williams" created="Mon, 21 Mar 2022 09:26:02 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=saroj.jillalla%40cgi.com&quot; class=&quot;user-hover&quot; rel=&quot;saroj.jillalla@cgi.com&quot;&gt;saroj.jillalla@cgi.com&lt;/a&gt;, sorry to hear about this issue. Have you tried repairing with version 4.0.28? If not, can you post the result of that operation?&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                            <attachment id="366858" name="Repair - 3.6.18.txt" size="4561" author="saroj.jillalla@cgi.com" created="Fri, 18 Mar 2022 01:51:57 +0000"/>
                            <attachment id="366857" name="Repair - 3.6.23.txt" size="4524" author="saroj.jillalla@cgi.com" created="Fri, 18 Mar 2022 01:51:57 +0000"/>
                            <attachment id="366855" name="Repair - 4.4.13.txt" size="3884" author="saroj.jillalla@cgi.com" created="Fri, 18 Mar 2022 01:51:57 +0000"/>
                            <attachment id="366856" name="Repair - 4.4.3.txt" size="3882" author="saroj.jillalla@cgi.com" created="Fri, 18 Mar 2022 01:51:57 +0000"/>
                            <attachment id="366854" name="WiredTiger" size="45" author="saroj.jillalla@cgi.com" created="Fri, 18 Mar 2022 01:59:08 +0000"/>
                            <attachment id="366853" name="WiredTiger.turtle" size="1130" author="saroj.jillalla@cgi.com" created="Fri, 18 Mar 2022 01:59:08 +0000"/>
                            <attachment id="366852" name="WiredTiger.wt" size="655360" author="saroj.jillalla@cgi.com" created="Fri, 18 Mar 2022 01:59:08 +0000"/>
                            <attachment id="366851" name="WiredTigerLAS.wt" size="4096" author="saroj.jillalla@cgi.com" created="Fri, 18 Mar 2022 01:59:08 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>4.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Mon, 21 Mar 2022 09:26:02 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        1 year, 40 weeks ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>edwin.zhou@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            1 year, 40 weeks ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>edwin.zhou@mongodb.com</customfieldvalue>
            <customfieldvalue>louis.williams@mongodb.com</customfieldvalue>
            <customfieldvalue>saroj.jillalla@cgi.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i0npqv:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|i06qlg:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                    <customfieldvalue><![CDATA[edwin.zhou@mongodb.com]]></customfieldvalue>
    

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i0nbw7:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>