<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:56:43 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-21230] Insert performance degrades drastically or hangs on large capped collection with WiredTiger</title>
                <link>https://jira.mongodb.org/browse/SERVER-21230</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;We are using MongoDB to store some historical data and occasionally insert performance degrades drastically (up to hour for one record) or hangs.&lt;br/&gt;
Issue was reproduced few times on MongoDB 3.0.1 and 3.0.6.&lt;br/&gt;
Symptoms are the following:&lt;/p&gt;
&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;inserts are slow or hang&lt;/li&gt;
	&lt;li&gt;mogostat hangs&lt;/li&gt;
	&lt;li&gt;mongotop works and shows 0 numbers&lt;/li&gt;
	&lt;li&gt;remote Robomongo hangs on attempt to connect&lt;/li&gt;
	&lt;li&gt;local mongo shell connects and can perform some commands but hanging on getting db/collection stats and queries&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;pstack, WiredTiger stats, parts of mongod log, biggest DB stats and few longest Operations are attached.&lt;br/&gt;
Some data removed as it can be sensitive.&lt;/p&gt;</description>
                <environment></environment>
        <key id="237109">SERVER-21230</key>
            <summary>Insert performance degrades drastically or hangs on large capped collection with WiredTiger</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="4">Incomplete</resolution>
                                        <assignee username="-1">Unassigned</assignee>
                                    <reporter username="dixenon">Denys</reporter>
                        <labels>
                            <label>needs-repo</label>
                    </labels>
                <created>Fri, 30 Oct 2015 20:27:23 +0000</created>
                <updated>Fri, 7 Apr 2023 14:50:16 +0000</updated>
                            <resolved>Tue, 24 Nov 2015 23:40:22 +0000</resolved>
                                    <version>3.0.1</version>
                    <version>3.0.6</version>
                                                    <component>WiredTiger</component>
                                        <votes>0</votes>
                                    <watches>8</watches>
                                                                                                                <comments>
                            <comment id="1101924" author="dixenon" created="Tue, 1 Dec 2015 15:07:29 +0000"  >&lt;p&gt;Hi Ramon&lt;/p&gt;

&lt;p&gt;Issue is reproduced again on 3.0.7 enterprise. Will try to reach our db team to open commercial support ticket.&lt;br/&gt;
Another drawback of this issue &amp;#8211; in replicaset if primary got stuck this way whole replicaset became unavailable. Heartbeat still working but data can&apos;t be saved or read from primary.&lt;/p&gt;

&lt;p&gt;Can I collect some additional useful data from instance while it hanging? I can left it for few days in this state.&lt;/p&gt;</comment>
                            <comment id="1097822" author="ramon.fernandez" created="Tue, 24 Nov 2015 23:40:13 +0000"  >&lt;p&gt;Thanks for the update &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=s.dixenon%40gmail.com&quot; class=&quot;user-hover&quot; rel=&quot;s.dixenon@gmail.com&quot;&gt;s.dixenon@gmail.com&lt;/a&gt;. I&apos;m going to close this ticket for now, but if you see this behavior again please post here so we can reopen of just open a new ticket.&lt;/p&gt;

&lt;p&gt;Regards,&lt;br/&gt;
Ram&#243;n.&lt;/p&gt;</comment>
                            <comment id="1096524" author="dixenon" created="Tue, 24 Nov 2015 00:20:35 +0000"  >&lt;p&gt;Unfortunately I was able to upgrade only few days ago so it&apos;s too short period to have any results.&lt;br/&gt;
And as I said it&apos;s rarely reproducible and haven&apos;t occurred this month even on 3.0.6.&lt;br/&gt;
Will update the issue if it happens again.&lt;/p&gt;</comment>
                            <comment id="1096365" author="ramon.fernandez" created="Mon, 23 Nov 2015 22:08:55 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=s.dixenon%40gmail.com&quot; class=&quot;user-hover&quot; rel=&quot;s.dixenon@gmail.com&quot;&gt;s.dixenon@gmail.com&lt;/a&gt;, is this still an issue for you? Have you observed the same behavior in 3.0.7?&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Ram&#243;n.&lt;/p&gt;</comment>
                            <comment id="1076019" author="ramon.fernandez" created="Sat, 31 Oct 2015 13:06:13 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=s.dixenon%40gmail.com&quot; class=&quot;user-hover&quot; rel=&quot;s.dixenon@gmail.com&quot;&gt;s.dixenon@gmail.com&lt;/a&gt;, I believe you&apos;re experience some performance-related issues with deletions on capped collections in earlier 3.0 versions that have been addressed in 3.0.7: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-19522&quot; title=&quot;Capped collection insert rate declines over time under WiredTiger&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-19522&quot;&gt;&lt;del&gt;SERVER-19522&lt;/del&gt;&lt;/a&gt; fixed a declining insert rate, and there was performance drop-off reported in &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-19995&quot; title=&quot;Performance drop-off when capped collection becomes full in WiredTiger&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-19995&quot;&gt;&lt;del&gt;SERVER-19995&lt;/del&gt;&lt;/a&gt; that was &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-19995?focusedCommentId=1045690&amp;amp;page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-1045690&quot; class=&quot;external-link&quot; rel=&quot;nofollow&quot;&gt;fixed before 3.0.7&lt;/a&gt;.&lt;/p&gt;

&lt;p&gt;I am trying to reproduce this ticket locally in case this ticket uncovers a new bug related to capped collections, but I&apos;d recommend you upgrade to 3.0.7 to get better performance out of capped collections.&lt;/p&gt;</comment>
                            <comment id="1075891" author="dixenon" created="Fri, 30 Oct 2015 22:27:23 +0000"  >&lt;p&gt;Thanks for quick answer.&lt;br/&gt;
It&apos;s VmWare virtual hosts with 4 x Intel(R) Xeon(R) CPU X5650 @ 2.67GHz; 8Gb RAM; 6Gb swap; 100Gb SAN storage 21Gb free.&lt;br/&gt;
mongod is the only application running on the host and at the moment consumed 16% CPU and 79% memory, other apps about 2% of memory.&lt;br/&gt;
sar stats for the same day attached.&lt;/p&gt;

&lt;p&gt;Forget to mention that database contains single capped collection, current stats attached.&lt;br/&gt;
At the moment of the issue stats couldn&apos;t be retrieved.&lt;/p&gt;

&lt;p&gt;Typical usage scenario &amp;#8211; about 10M inserts and few hundred indexed queries for few hours during the day.&lt;br/&gt;
Issue rarely reproducible &amp;#8211; happens about once per month per host.&lt;/p&gt;</comment>
                            <comment id="1075817" author="ramon.fernandez" created="Fri, 30 Oct 2015 21:00:05 +0000"  >&lt;p&gt;Thanks for the detailed report. The only thing that seems odd in the WT stats is reconciliation numbers, I&apos;ve uploaded a visual representation of it. Looking at the logs I see the slow inserts on the &lt;tt&gt;testHarnessSIT_N&lt;/tt&gt; database; given its size it may take a while to reproduce this behavior onsite.&lt;/p&gt;

&lt;p&gt;Can you please provide some more information about this deployment? What&apos;s the machine size, available memory, etc.?&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Ram&#243;n.&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                            <outwardlinks description="related to">
                                                        </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                            <attachment id="96452" name="Screen Shot 2015-10-30 at 16.54.39.png" size="47305" author="ramon.fernandez@mongodb.com" created="Fri, 30 Oct 2015 20:55:40 +0000"/>
                            <attachment id="96449" name="WiredTigerStat.30.13" size="589466" author="s.dixenon@gmail.com" created="Fri, 30 Oct 2015 20:27:23 +0000"/>
                            <attachment id="96448" name="WiredTigerStat.30.14" size="589536" author="s.dixenon@gmail.com" created="Fri, 30 Oct 2015 20:27:23 +0000"/>
                            <attachment id="96447" name="WiredTigerStat.30.15" size="402869" author="s.dixenon@gmail.com" created="Fri, 30 Oct 2015 20:27:23 +0000"/>
                            <attachment id="96458" name="collection_stats.txt" size="52561" author="s.dixenon@gmail.com" created="Fri, 30 Oct 2015 22:28:12 +0000"/>
                            <attachment id="96444" name="mongod.log" size="19237" author="s.dixenon@gmail.com" created="Fri, 30 Oct 2015 20:27:23 +0000"/>
                            <attachment id="96443" name="mongodb.stack" size="682514" author="s.dixenon@gmail.com" created="Fri, 30 Oct 2015 20:27:23 +0000"/>
                            <attachment id="96459" name="sar30" size="103725" author="s.dixenon@gmail.com" created="Fri, 30 Oct 2015 22:28:12 +0000"/>
                            <attachment id="96445" name="stats.txt" size="535" author="s.dixenon@gmail.com" created="Fri, 30 Oct 2015 20:27:23 +0000"/>
                            <attachment id="96446" name="status.log" size="17132" author="s.dixenon@gmail.com" created="Fri, 30 Oct 2015 20:27:23 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>7.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Fri, 30 Oct 2015 21:00:05 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        8 years, 11 weeks, 1 day ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>luke.bonanomi@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            8 years, 11 weeks, 1 day ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10020"><![CDATA[Linux]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>dixenon</customfieldvalue>
            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrkq5z:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hse25j:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hsfi7z:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>