<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 04:56:16 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-40904] Mongo wont restart following disk full</title>
                <link>https://jira.mongodb.org/browse/SERVER-40904</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;We are running Mongo 4.0.0 using a single node setup with a replica set enabled.&lt;/p&gt;

&lt;p&gt;Our data disk filled up and the mongo process stopped. We are now unable to connect to the DB and the process continually takes about between 500% and 800% CPU (We have 8 CPUs available).&lt;/p&gt;

&lt;p&gt;I&apos;ve increased the verbosity of the system log (to 5) as nothing is emitted otherwise.&lt;/p&gt;

&lt;p&gt;Apologies but I can&apos;t share the log files so I have tried to provide a summary below:&lt;/p&gt;

&lt;p&gt;We see lots of STORAGE messages for a while with out data records then printed out under with the text &quot;fetched CCE metadata&quot;. This runs for a while.&lt;/p&gt;

&lt;p&gt;We then see Debug messages from RECOVERY where it runs through &quot;Applying op x of 5000&quot;) through to 5000 of 5000.&lt;/p&gt;

&lt;p&gt;We then see lots of WT set timestamp of future write operations messages followed by WT begin transaction for snapshot id X and then commit_transaction for snapshot X.&lt;/p&gt;

&lt;p&gt;Eventually these logs message finish to be replaced by:&lt;/p&gt;

&lt;p&gt;WTJournalFlusher flushed Journal every 100ms&lt;/p&gt;

&lt;p&gt;and:&lt;/p&gt;

&lt;p&gt;STORAGE &lt;span class=&quot;error&quot;&gt;&amp;#91;ftdc&amp;#93;&lt;/span&gt;&#160;setting timestamp read source: 1, provided timestamp: none&lt;/p&gt;

&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;ftdc&amp;#93;&lt;/span&gt; User Assertion: NotYetInitialized: no replset config has been received src/mongo/db/repl/repl_set_get_status_cmd.cpp 54&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;STROAGE&#160;&#160;&lt;span class=&quot;error&quot;&gt;&amp;#91;ftdc&amp;#93;&lt;/span&gt;NamesplaceUUIDCache: registered namespace local.oplog.rs with UUID uuid&lt;/p&gt;

&lt;p&gt;(which happen every second)&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;Please let me know if you need any more information but our database instance is currently unable to start.&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;Thanks in advance.&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;</description>
                <environment></environment>
        <key id="750652">SERVER-40904</key>
            <summary>Mongo wont restart following disk full</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="4">Incomplete</resolution>
                                        <assignee username="kelsey.schubert@mongodb.com">Kelsey Schubert</assignee>
                                    <reporter username="leigh.jones@ripjar.com">Leigh Jones</reporter>
                        <labels>
                    </labels>
                <created>Tue, 30 Apr 2019 11:29:46 +0000</created>
                <updated>Tue, 30 Jul 2019 19:44:40 +0000</updated>
                            <resolved>Tue, 30 Jul 2019 19:20:54 +0000</resolved>
                                                                                        <votes>0</votes>
                                    <watches>5</watches>
                                                                                                                <comments>
                            <comment id="2351153" author="leigh.jones@ripjar.com" created="Tue, 30 Jul 2019 19:44:40 +0000"  >&lt;p&gt;Sorry, I didn&#8217;t see the previous comment. If it happens again I&#8217;ll try and send the requested info&lt;/p&gt;</comment>
                            <comment id="2351098" author="daniel.hatcher" created="Tue, 30 Jul 2019 19:20:54 +0000"  >&lt;p&gt;Closing due to lack of response.&lt;/p&gt;</comment>
                            <comment id="2233929" author="thomas.schubert" created="Fri, 3 May 2019 17:26:31 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=leigh.jones%40ripjar.com&quot; class=&quot;user-hover&quot; rel=&quot;leigh.jones@ripjar.com&quot;&gt;leigh.jones@ripjar.com&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Sorry for the delay getting back to you. Unfortunately, it&apos;s very challenging to diagnose an issue like this without the complete logs and diagnostic data. Would it be feasible to upload the mongod log and an archive of the diagnostic.data directory in your dbpath to this &lt;a href=&quot;https://10gen-httpsupload.s3.amazonaws.com/upload_forms/7b71e273-a6a3-467e-9c14-4ea8e00c7c3f.html&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;secure upload portal&lt;/a&gt; that is only visible to MongoDB employees?&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Kelsey&lt;/p&gt;</comment>
                            <comment id="2228870" author="leigh.jones@ripjar.com" created="Tue, 30 Apr 2019 11:31:07 +0000"  >&lt;p&gt;I forgot to say we have 32G RAM and are running on CENTOS 6&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>4.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Fri, 3 May 2019 17:26:31 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        4 years, 28 weeks, 1 day ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>leigh.jones@ripjar.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            4 years, 28 weeks, 1 day ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>daniel.hatcher@mongodb.com</customfieldvalue>
            <customfieldvalue>kelsey.schubert@mongodb.com</customfieldvalue>
            <customfieldvalue>leigh.jones@ripjar.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|huwkn3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hulydj:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                    <customfieldvalue><![CDATA[kelsey.schubert@mongodb.com]]></customfieldvalue>
    

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|huw6wf:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>