<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 04:29:26 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-32179] Data recovery</title>
                <link>https://jira.mongodb.org/browse/SERVER-32179</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Hi,&lt;/p&gt;

&lt;p&gt;We run MongoDB 3.2.10 in an OpenShift cluster. Data for one of databases is stored on NFS share which run out of space resulting in data corruption. WiredTiger.turtle is empty and I&apos;m unable to start the server or run automated recovery. I&apos;ve heard about manual recovery options. Are they documented somewhere?&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Pawel&lt;/p&gt;</description>
                <environment></environment>
        <key id="468536">SERVER-32179</key>
            <summary>Data recovery</summary>
                <type id="6" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14720&amp;avatarType=issuetype">Question</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="mark.agarunov">Mark Agarunov</assignee>
                                    <reporter username="pkar">Pawel</reporter>
                        <labels>
                    </labels>
                <created>Tue, 5 Dec 2017 22:29:35 +0000</created>
                <updated>Sun, 7 Jan 2018 04:36:19 +0000</updated>
                            <resolved>Thu, 7 Dec 2017 18:49:52 +0000</resolved>
                                    <version>3.2.10</version>
                                                                        <votes>0</votes>
                                    <watches>4</watches>
                                                                                                                <comments>
                            <comment id="1745783" author="mark.agarunov" created="Thu, 7 Dec 2017 18:49:38 +0000"  >&lt;p&gt;Hello &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=pkar&quot; class=&quot;user-hover&quot; rel=&quot;pkar&quot;&gt;pkar&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Unfortunately, this error indicates that there was corruption on the disk. In this situation, my best recommendation would be to &lt;a href=&quot;https://docs.mongodb.com/manual/tutorial/resync-replica-set-member/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;resync the affected node&lt;/a&gt; or &lt;a href=&quot;https://docs.mongodb.com/manual/core/backups/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;restore from a backup&lt;/a&gt; if possible.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Mark&lt;/p&gt;</comment>
                            <comment id="1745750" author="pkar" created="Thu, 7 Dec 2017 18:26:32 +0000"  >&lt;p&gt;Hi Mark,&lt;/p&gt;

&lt;p&gt;This didn&apos;t help. Log trace:&lt;br/&gt;
2017-12-07T18:18:29.359+0000 I CONTROL  &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; MongoDB starting : pid=30 port=27017 dbpath=/var/lib/mongodb/data 64-bit host=db-debug&lt;br/&gt;
2017-12-07T18:18:29.359+0000 I CONTROL  &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; db version v3.2.10&lt;br/&gt;
2017-12-07T18:18:29.359+0000 I CONTROL  &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; git version: 79d9b3ab5ce20f51c272b4411202710a082d0317&lt;br/&gt;
2017-12-07T18:18:29.359+0000 I CONTROL  &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; OpenSSL version: OpenSSL 1.0.1e-fips 11 Feb 2013&lt;br/&gt;
2017-12-07T18:18:29.359+0000 I CONTROL  &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; allocator: tcmalloc&lt;br/&gt;
2017-12-07T18:18:29.359+0000 I CONTROL  &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; modules: none&lt;br/&gt;
2017-12-07T18:18:29.359+0000 I CONTROL  &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; build environment:&lt;br/&gt;
2017-12-07T18:18:29.359+0000 I CONTROL  &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt;     distarch: x86_64&lt;br/&gt;
2017-12-07T18:18:29.359+0000 I CONTROL  &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt;     target_arch: x86_64&lt;br/&gt;
2017-12-07T18:18:29.359+0000 I CONTROL  &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; options: { storage: &lt;/p&gt;
{ dbPath: &quot;/var/lib/mongodb/data&quot; }
&lt;p&gt;, systemLog: &lt;/p&gt;
{ destination: &quot;file&quot;, path: &quot;/var/lib/mongodb/data/log.txt&quot;, verbosity: 6 }
&lt;p&gt; }&lt;br/&gt;
2017-12-07T18:18:29.359+0000 D NETWORK  &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; fd limit hard:1048576 soft:1048576 max conn: 838860&lt;br/&gt;
2017-12-07T18:18:29.364+0000 I -        &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; Detected data files in /var/lib/mongodb/data created by the &apos;wiredTiger&apos; storage engine, so setting the active storage engine to &apos;wiredTiger&apos;.&lt;br/&gt;
2017-12-07T18:18:29.366+0000 I STORAGE  &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; wiredtiger_open config: create,cache_size=8G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),&lt;br/&gt;
2017-12-07T18:18:29.377+0000 I -        &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; Assertion: 28595:2: No such file or directory&lt;br/&gt;
2017-12-07T18:18:29.377+0000 I STORAGE  &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; exception in initAndListen: 28595 2: No such file or directory, terminating&lt;br/&gt;
2017-12-07T18:18:29.377+0000 I CONTROL  &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; dbexit:  rc: 100&lt;/p&gt;

&lt;p&gt;Answers to your questions:&lt;br/&gt;
1. NFS storage&lt;br/&gt;
2. n/a&lt;br/&gt;
3. always this version of MongoDB&lt;br/&gt;
4. No&lt;br/&gt;
5. Yes. It was running ok afterwards&lt;br/&gt;
6. mongodump&lt;br/&gt;
7. it&apos;s clean&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Pawel&lt;/p&gt;
</comment>
                            <comment id="1745640" author="mark.agarunov" created="Thu, 7 Dec 2017 17:37:03 +0000"  >&lt;p&gt;Hello &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=pkar&quot; class=&quot;user-hover&quot; rel=&quot;pkar&quot;&gt;pkar&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Thank you for providing these files. I&apos;ve attached a repair attempt of the files you&apos;ve provided. Would you please extract these files and replace them in your &lt;tt&gt;$dbpath&lt;/tt&gt; and let us know if it resolves the issue? If you are still seeing errors after replacing these files, please provide the complete logs from mongod so that we can further investigate. Additionally, if this issue persists, please provide the following information:&lt;/p&gt;

&lt;ol&gt;
	&lt;li&gt;What kind of underlying storage mechanism are you using? Are the storage devices attached locally or over the network? Are the disks SSDs or HDDs? What kind of RAID and/or volume management system are you using?&lt;/li&gt;
	&lt;li&gt;Would you please check the integrity of your disks?&lt;/li&gt;
	&lt;li&gt;Has the database always been running this version of MongoDB? If not please describe the upgrade/downgrade cycles the database has been through.&lt;/li&gt;
	&lt;li&gt;Have you manipulated (copied or moved) the underlying database files? If so, was mongod running?&lt;/li&gt;
	&lt;li&gt;Have you ever restored this instance from backups?&lt;/li&gt;
	&lt;li&gt;What method do you use to create backups?&lt;/li&gt;
	&lt;li&gt;When was the underlying filesystem last checked and is it currently marked clean?&lt;/li&gt;
&lt;/ol&gt;


&lt;p&gt;Thanks,&lt;br/&gt;
Mark&lt;/p&gt;</comment>
                            <comment id="1745118" author="pkar" created="Thu, 7 Dec 2017 07:26:23 +0000"  >&lt;p&gt;Hi Mark,&lt;/p&gt;

&lt;p&gt;Files are attached. &lt;/p&gt;

&lt;p&gt;Thanks!&lt;br/&gt;
Pawel&lt;/p&gt;</comment>
                            <comment id="1744398" author="mark.agarunov" created="Wed, 6 Dec 2017 17:25:22 +0000"  >&lt;p&gt;Hello &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=pkar&quot; class=&quot;user-hover&quot; rel=&quot;pkar&quot;&gt;pkar&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Thank you for the report. If you can provide the WiredTiger.wt and WiredTiger.turtle files we can attempt a repair of the database, but please keep in mind that this is not a guaranteed fix.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Mark&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                            <attachment id="172579" name="WiredTiger-files.zip" size="9087" author="pkar" created="Thu, 7 Dec 2017 07:25:51 +0000"/>
                            <attachment id="172651" name="repair-SERVER-32179.tar.gz" size="8039" author="mark.agarunov" created="Thu, 7 Dec 2017 17:36:27 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>5.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Wed, 6 Dec 2017 17:25:22 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        6 years, 9 weeks, 6 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>backlog-server-pm</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            6 years, 9 weeks, 6 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>mark.agarunov</customfieldvalue>
            <customfieldvalue>pkar</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|htlnl3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|htd8r3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|htl9p3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>