<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 04:01:53 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-22941] mongoDB hangup after one or two days&apos; high load mongoimport</title>
                <link>https://jira.mongodb.org/browse/SERVER-22941</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;My server configure:&lt;br/&gt;
E5 24cores/512GB memory,300GB for wiredTiger/1.5T SSD/linux as6u3 redhat.&lt;br/&gt;
My mongod instance configure:&lt;br/&gt;
wiredTiger/journal/commit interval:10s/wiredTiger cache 300GB/eviction thread 4-12&lt;/p&gt;

&lt;p&gt;I have at most 12 mongoimport process running with only one mongod instance at the same time to load data.I hava about 50 collections.And each collection has about 10 indexes.&lt;br/&gt;
Usually,after one or two days,mongoDB hangup.Before mongoDB hangup,it can store almost 1TB data each day.I get that through using show dbs.&lt;br/&gt;
I find there always be an INSERT operation hangup through using db.currentOp().It may have been active for thousands or more seconds.It locks the DB which it insert into and blocks all operation after it.db.killOp() doesn&apos;t work either.It seems like you are creating an index in that DB.show dbs don&apos;t respond.Insert or query in that DB doesn&apos;t respond either.But,other DBs are OK.And through mongostat,i find mongod is still running,dirty% decreases.&lt;br/&gt;
so ,my question:&lt;br/&gt;
Does this question is related to index?&lt;br/&gt;
How does mongoDB maintain index?&lt;br/&gt;
Is there only one thread can maintain index each DB at the same time?&lt;br/&gt;
How to avoid this question?&lt;/p&gt;</description>
                <environment>redhat&lt;br/&gt;
as6u3</environment>
        <key id="269624">SERVER-22941</key>
            <summary>mongoDB hangup after one or two days&apos; high load mongoimport</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="2" iconUrl="https://jira.mongodb.org/images/icons/priorities/critical.svg">Critical - P2</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="4">Incomplete</resolution>
                                        <assignee username="mark.agarunov">Mark Agarunov</assignee>
                                    <reporter username="zzz">???</reporter>
                        <labels>
                            <label>WTplaybook</label>
                    </labels>
                <created>Thu, 3 Mar 2016 11:53:52 +0000</created>
                <updated>Wed, 8 Mar 2017 16:21:38 +0000</updated>
                            <resolved>Fri, 17 Feb 2017 00:08:26 +0000</resolved>
                                    <version>3.2.0</version>
                    <version>3.2.3</version>
                                                    <component>Index Maintenance</component>
                                        <votes>0</votes>
                                    <watches>9</watches>
                                                                                                                <comments>
                            <comment id="1478465" author="mark.agarunov" created="Tue, 17 Jan 2017 20:53:49 +0000"  >&lt;p&gt;Hello &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=zzz&quot; class=&quot;user-hover&quot; rel=&quot;zzz&quot;&gt;zzz&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;My apologies for the delay in response. Unfortunately, we were unable to determine the root cause of the behavior described. Please note that the most recent release of MongoDB, 3.4.1, comes with many improvements which may help the issue you&apos;ve observed. If this this still an problem for you, would you please upgrade to 3.4.1 and let us know if it resolves the issue?&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Mark&lt;/p&gt;</comment>
                            <comment id="1230203" author="zzz" created="Fri, 8 Apr 2016 13:29:53 +0000"  >&lt;p&gt;hi,Thomas,&lt;br/&gt;
I have tried to send a shutdown signal to mongoDB.But it seems does not work.Command &lt;span class=&quot;error&quot;&gt;&amp;#91;kill pid&amp;#93;&lt;/span&gt;  may takes hours and mongoDB is still running.Only &lt;span class=&quot;error&quot;&gt;&amp;#91;kill -9&amp;#93;&lt;/span&gt; works,it just takes a few seconds.Then,i can start mongoDB in a few seconds too.&lt;br/&gt;
I hava executed &lt;tt&gt;db.currentOp()&lt;/tt&gt; when i observe this issue,there are hundreds of ops,most of them are waiting for locks.Only one(may be a little more,i do not remmber that clearly) op is running and not waiting for locks.&lt;br/&gt;
I will send these logs to you as soon as i get them.&lt;br/&gt;
Besides that,sometimes my mongoDB instance receives very long document.These document may be about 100-1000KB.Does these too long document can cause this problem?&lt;br/&gt;
Thank you,&lt;br/&gt;
&#38047;&#22825;&#33298;&lt;/p&gt;</comment>
                            <comment id="1230200" author="zzz" created="Fri, 8 Apr 2016 13:28:27 +0000"  >&lt;p&gt;hi,Thomas,&lt;br/&gt;
I have tried to send a shutdown signal to mongoDB.But it seems does not work.Command &lt;span class=&quot;error&quot;&gt;&amp;#91;kill pid&amp;#93;&lt;/span&gt;  may takes hours and mongoDB still running.Only &lt;span class=&quot;error&quot;&gt;&amp;#91;kill -9&amp;#93;&lt;/span&gt; works,it just takes a few seconds.Then,i can start mongoDB in a few seconds too.&lt;br/&gt;
I hava executed &lt;tt&gt;db.currentOp()&lt;/tt&gt; when i observe this issue,there are hundreds of ops,most of them are waiting for locks.Only one(may be a little more,i do not remmber clearly) op is running and not waiting for locks.&lt;br/&gt;
I will send these logs to you as soon as i get them.&lt;br/&gt;
Besides that,sometimes my mongoDB instance receives very long document.These document may be about 100-1000KB.Does these too long document can cause this problem?&lt;br/&gt;
Thank you,&lt;br/&gt;
&#38047;&#22825;&#33298;&lt;/p&gt;




&lt;p&gt;------------------ &#21407;&#22987;&#37038;&#20214; ------------------&lt;br/&gt;
&#21457;&#20214;&#20154;: &quot;Thomas Schubert (JIRA)&quot;;&amp;lt;jira@mongodb.org&amp;gt;;&lt;br/&gt;
&#21457;&#36865;&#26102;&#38388;: 2016&#24180;4&#26376;8&#26085;(&#26143;&#26399;&#20116;) &#20940;&#26216;0:38&lt;br/&gt;
&#25910;&#20214;&#20154;: &quot;tCold&quot;&amp;lt;526864170@qq.com&amp;gt;; &lt;/p&gt;

&lt;p&gt;&#20027;&#39064;: &lt;span class=&quot;error&quot;&gt;&amp;#91;MongoDB-JIRA&amp;#93;&lt;/span&gt; (&lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-22941&quot; title=&quot;mongoDB hangup after one or two days&amp;#39; high load mongoimport&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-22941&quot;&gt;&lt;del&gt;SERVER-22941&lt;/del&gt;&lt;/a&gt;) mongoDB hangup after one or two days&apos;high load mongoimport&lt;/p&gt;




&lt;p&gt;    [ &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-22941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&amp;amp;focusedCommentId=1229314#comment-1229314&quot; class=&quot;external-link&quot; rel=&quot;nofollow&quot;&gt;https://jira.mongodb.org/browse/SERVER-22941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&amp;amp;focusedCommentId=1229314#comment-1229314&lt;/a&gt; ] &lt;/p&gt;

&lt;p&gt;Thomas Schubert commented on &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-22941&quot; title=&quot;mongoDB hangup after one or two days&amp;#39; high load mongoimport&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-22941&quot;&gt;&lt;del&gt;SERVER-22941&lt;/del&gt;&lt;/a&gt;:&lt;br/&gt;
------------------------------------------&lt;/p&gt;

&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=zzz&quot; class=&quot;user-hover&quot; rel=&quot;zzz&quot;&gt;zzz&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;We are still investigating the diagnostic data and logs that you have provided. Can you please upload the output of &lt;tt&gt;db.currentOp()&lt;/tt&gt; when you observe this issue? Please also upload the logs after the affected MongoDB receives a shutdown signal. &lt;/p&gt;

&lt;p&gt;Thank you,&lt;br/&gt;
Thomas&lt;/p&gt;


&lt;p&gt;----------------------&lt;br/&gt;
This message was sent from MongoDB&apos;s issue tracking system. To respond to this ticket, please login to &lt;a href=&quot;https://jira.mongodb.org&quot; class=&quot;external-link&quot; rel=&quot;nofollow&quot;&gt;https://jira.mongodb.org&lt;/a&gt; using your JIRA or MMS credentials.&lt;/p&gt;</comment>
                            <comment id="1229314" author="thomas.schubert" created="Thu, 7 Apr 2016 16:38:26 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=zzz&quot; class=&quot;user-hover&quot; rel=&quot;zzz&quot;&gt;zzz&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;We are still investigating the diagnostic data and logs that you have provided. Can you please upload the output of &lt;tt&gt;db.currentOp()&lt;/tt&gt; when you observe this issue? Please also upload the logs after the affected MongoDB receives a shutdown signal. &lt;/p&gt;

&lt;p&gt;Thank you,&lt;br/&gt;
Thomas&lt;/p&gt;</comment>
                            <comment id="1212481" author="zzz" created="Wed, 23 Mar 2016 14:58:41 +0000"  >&lt;p&gt;I hava uploaded diagnostic.data and  full logs through that portal.&lt;br/&gt;
By the way,i meet this question just after i upgrade mongoDB to version 3.2.&lt;/p&gt;</comment>
                            <comment id="1199757" author="ramon.fernandez" created="Thu, 10 Mar 2016 22:25:18 +0000"  >&lt;p&gt;Thanks for the update. There was a similar behavior in &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-22062&quot; title=&quot;Foreground index build may hang 3.0.x WiredTiger node&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-22062&quot;&gt;&lt;del&gt;SERVER-22062&lt;/del&gt;&lt;/a&gt;, but we checked that such behavior only affected 3.0 and you&apos;re using 3.2.3.&lt;/p&gt;

&lt;p&gt;In addition to the &lt;tt&gt;diagnostic.data&lt;/tt&gt; content mentioned above, if you had a script and dataset that reproduces the behavior you describe and you could upload it that would help a lot with the investigation.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Ram&#243;n.&lt;/p&gt;</comment>
                            <comment id="1199002" author="zzz" created="Thu, 10 Mar 2016 14:20:28 +0000"  >&lt;p&gt;Now i create three dbs in my mongoDB instance.I switch to a new db to load data every 5 minutes.Each db loads data for only 5 minutes.That means,each db works 5 minutes and sleeps 10 minutes every 15 minutes.It has worked since last Tuesday,and that question doesn&apos;t show up.I didn&apos;t not reduce write pressure.In old plan,mongoDB can work only 2 or 3 days,then it hangup.&lt;br/&gt;
I will reconstruct that question next week.Because my mongoDB is deployed in intranet,it may takes time to transfer log to internet.&lt;br/&gt;
Thanks.&lt;/p&gt;</comment>
                            <comment id="1191695" author="ramon.fernandez" created="Thu, 3 Mar 2016 12:12:42 +0000"  >&lt;p&gt;Can you please upload the contents of the &lt;tt&gt;diagnostic.data&lt;/tt&gt; directory inside your &lt;tt&gt;dbpath&lt;/tt&gt; and the full logs for this server from startup until you experience the hang?&lt;/p&gt;

&lt;p&gt;You can upload this data &lt;a href=&quot;https://10gen-httpsupload.s3.amazonaws.com/upload_forms/db127cd8-7479-482a-8a58-b78f1a5fc0d2.html&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;through this portal&lt;/a&gt; privately and securely. Please let us know when the upload of the requested information is complete so we can investigate further.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Ram&#243;n.&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                            <attachment id="118599" name="currentop.txt" size="462699" author="zzz" created="Thu, 21 Apr 2016 11:16:59 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>8.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Thu, 3 Mar 2016 12:12:42 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        7 years, 4 weeks, 1 day ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>kelsey.schubert@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            7 years, 4 weeks, 1 day ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10020"><![CDATA[Linux]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>zzz</customfieldvalue>
            <customfieldvalue>kelsey.schubert@mongodb.com</customfieldvalue>
            <customfieldvalue>mark.agarunov</customfieldvalue>
            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrkenz:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hsj0cf:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                    <customfieldvalue><![CDATA[kelsey.schubert@mongodb.com]]></customfieldvalue>
    

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hsbyu7:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>