<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 04:36:31 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-34392] file:WiredTiger.wt, connection: WiredTiger.wt: encountered an illegal file format or internal value</title>
                <link>https://jira.mongodb.org/browse/SERVER-34392</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Hi,&lt;/p&gt;

&lt;p&gt;We had a major power outage and it knocked down our mongo db running in docker as part of a stack. Now it won&apos;t come back up. Mongo had it&apos;s own volume mounted to /data/db.&lt;/p&gt;

&lt;p&gt;At first I took the stack down created and ran a temporary container mounted to the same volume to see if I could repair the data. I ran the &quot;mongod --repair --dbpath /data/db&quot; and nothing, It was still saying &quot;file:WiredTiger.wt, connection: read checksum error for 4096B block at offset 12288: block header checksum of 1843462872 doesn&apos;t match expected checksum of 1205067277&quot;.&lt;/p&gt;

&lt;p&gt;I also ran this command &quot;mongod --repair --dbpath /data/db --storageEngine wiredTiger&quot;...same thing.&lt;/p&gt;

&lt;p&gt;I then went as far as to restore the data from a backup that we had done the day prior of the volume used to store the mongo data. When I deployed the stack again (fresh containers, etc.) and I check the logs that the server is outputting...still the same issue.&lt;/p&gt;

&lt;p&gt;Please advise/help as I thought that restoring from the backup if anything would of fixed it but still nothing. I&apos;m attaching the stdout of the repair command as well as the regular log of the server while running (or trying to anyways). I just don&apos;t understand why the backup restore isn&apos;t working as the backup was done before the outage therefor it shouldn&apos;t be corrupted.&lt;/p&gt;

&lt;p&gt;Please help me recover the db as it&apos;s very important.  Much appreciation and thanks.&lt;br/&gt;
Sincerely,&lt;br/&gt;
Frank Perez&lt;/p&gt;</description>
                <environment></environment>
        <key id="524265">SERVER-34392</key>
            <summary>file:WiredTiger.wt, connection: WiredTiger.wt: encountered an illegal file format or internal value</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="kelsey.schubert@mongodb.com">Kelsey Schubert</assignee>
                                    <reporter username="frankp">Frank Perez</reporter>
                        <labels>
                            <label>docker</label>
                            <label>envc</label>
                            <label>rpo</label>
                            <label>rps</label>
                            <label>trcf</label>
                            <label>wtc</label>
                    </labels>
                <created>Mon, 9 Apr 2018 17:48:40 +0000</created>
                <updated>Tue, 14 Aug 2018 17:09:37 +0000</updated>
                            <resolved>Wed, 2 May 2018 20:54:36 +0000</resolved>
                                    <version>3.2.19</version>
                                                    <component>WiredTiger</component>
                                        <votes>0</votes>
                                    <watches>4</watches>
                                                                                                                <comments>
                            <comment id="1881079" author="frankp" created="Wed, 2 May 2018 21:30:08 +0000"  >&lt;p&gt;Thank you Kelsey for the update!&lt;/p&gt;</comment>
                            <comment id="1881023" author="thomas.schubert" created="Wed, 2 May 2018 20:54:26 +0000"  >&lt;p&gt;HI &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=frankp&quot; class=&quot;user-hover&quot; rel=&quot;frankp&quot;&gt;frankp&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;We have improvements in this space currently scheduled, see &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-19815&quot; title=&quot;Improved mongod --repair option for WiredTiger&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-19815&quot;&gt;&lt;del&gt;SERVER-19815&lt;/del&gt;&lt;/a&gt; as an example.&lt;/p&gt;

&lt;p&gt;Additionally we suggest the following to help mitigate any issues related to unreliable storage layers or server failures:&lt;/p&gt;
&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;Make sure your &lt;a href=&quot;https://docs.mongodb.com/manual/administration/production-notes/#disk-and-storage-systems&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;underlying storage is configured in an optimal way&lt;/a&gt;.&lt;/li&gt;
	&lt;li&gt;Schedule and perform regular checks of the integrity of your filesystems and disks.&lt;/li&gt;
	&lt;li&gt;Make sure to update MongoDB to the &lt;a href=&quot;https://docs.mongodb.com/manual/release-notes/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;most recent version&lt;/a&gt;&lt;/li&gt;
	&lt;li&gt;Never manipulate the underlying database files in any way while &lt;tt&gt;mongod&lt;/tt&gt; is running.&lt;/li&gt;
	&lt;li&gt;Always keep up to date &lt;a href=&quot;https://docs.mongodb.com/manual/core/backups/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;backups of your databases&lt;/a&gt; and verify that you have a process in place to restore them.&lt;/li&gt;
	&lt;li&gt;Use a &lt;a href=&quot;https://docs.mongodb.com/manual/replication/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;replica set&lt;/a&gt; for improved reliability.&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;Kind regards,&lt;br/&gt;
 Kelsey&lt;/p&gt;</comment>
                            <comment id="1860295" author="frankp" created="Tue, 10 Apr 2018 14:35:24 +0000"  >&lt;p&gt;Kelsey,&lt;/p&gt;

&lt;p&gt;Thank you &lt;b&gt;very&lt;/b&gt; much for the repaired files, it worked!!!&lt;br/&gt;
I was wondering if you can just shed some light as to why restoring from a backup that was made prior to the power outage (the data should of not been corrupt) didn&apos;t work....and if there is anything on our end that we could do (way we do backups, etc.) better/different to prevent this moving forward? Lastly, we are currently running the 3.2 mongo docker image, has this issue been addressed in newer versions that updating to that version would help? Ultimately how can we prevent this from happening in the future?&lt;/p&gt;

&lt;p&gt;Thanks again for the help and any light you can shed on the questions above would be greatly appreciated.&lt;/p&gt;

&lt;p&gt;Sincerely,&lt;br/&gt;
Frank Perez&lt;/p&gt;</comment>
                            <comment id="1859829" author="thomas.schubert" created="Mon, 9 Apr 2018 23:09:22 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=frankp&quot; class=&quot;user-hover&quot; rel=&quot;frankp&quot;&gt;frankp&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;I&apos;ve attached a repair attempt, &lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/attachment/183768/183768_repair_attempt.tar.gz&quot; title=&quot;repair_attempt.tar.gz attached to SERVER-34392&quot;&gt;repair_attempt.tar.gz&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.mongodb.org/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt;, of the files you provided. Please extract these files and replace them in your &lt;tt&gt;$dbpath&lt;/tt&gt; and let us know if it resolves the issue. If you are still seeing errors after replacing these files, please provide the complete logs from the affected node so that we can further investigate.&lt;/p&gt;

&lt;p&gt;Thank you,&lt;br/&gt;
Kelsey&lt;/p&gt;</comment>
                            <comment id="1859395" author="frankp" created="Mon, 9 Apr 2018 18:26:59 +0000"  >&lt;p&gt;files have been uploaded.&lt;/p&gt;</comment>
                            <comment id="1859383" author="frankp" created="Mon, 9 Apr 2018 18:18:31 +0000"  >&lt;p&gt;ok. will do. thanks&lt;/p&gt;</comment>
                            <comment id="1859377" author="thomas.schubert" created="Mon, 9 Apr 2018 18:14:00 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=frankp&quot; class=&quot;user-hover&quot; rel=&quot;frankp&quot;&gt;frankp&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Would you please upload the wiredtiger.wt and wiredtiger.turtle files so we can attempt a repair?&lt;/p&gt;

&lt;p&gt;Thank you,&lt;br/&gt;
Kelsey&lt;/p&gt;</comment>
                            <comment id="1859350" author="frankp" created="Mon, 9 Apr 2018 17:59:09 +0000"  >&lt;p&gt;P.S I&apos;m running the mongo:3.2 docker image.&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                            <attachment id="183727" name="WiredTiger.turtle" size="1020" author="frankp" created="Mon, 9 Apr 2018 18:26:45 +0000"/>
                            <attachment id="183728" name="WiredTiger.wt" size="815104" author="frankp" created="Mon, 9 Apr 2018 18:26:46 +0000"/>
                            <attachment id="183725" name="logfile_while_running.txt" size="10721" author="frankp" created="Mon, 9 Apr 2018 17:48:08 +0000"/>
                            <attachment id="183724" name="output_of_repair_command.txt" size="7998" author="frankp" created="Mon, 9 Apr 2018 17:48:08 +0000"/>
                            <attachment id="183768" name="repair_attempt.tar.gz" size="45025" author="kelsey.schubert@mongodb.com" created="Mon, 9 Apr 2018 23:08:58 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>8.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Mon, 9 Apr 2018 18:14:00 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        5 years, 41 weeks ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>nick.brewer</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            5 years, 41 weeks ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10020"><![CDATA[Linux]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>frankp</customfieldvalue>
            <customfieldvalue>kelsey.schubert@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hturg7:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|htlysn:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                    <customfieldvalue><![CDATA[kelsey.schubert@mongodb.com]]></customfieldvalue>
    

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|htudof:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>