<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:37:29 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-15265] passes &gt;= maxPasses (capped collection)</title>
                <link>https://jira.mongodb.org/browse/SERVER-15265</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;We have a 5 node mongo replica set, and after a network outage, all our apps flushed their data to the mongo master. The master stayed up, and replicated across to the other nodes, but at a specific point, 3 of the replica set members crashed, and we were unable to recover them from that state. Fortunately we were able to restore the nodes from the remaining nodes.&lt;/p&gt;

&lt;p&gt;I&apos;ve attached log files from the master.&lt;/p&gt;

&lt;p&gt;A bit of context on what happened when we started the mongo node up. The journal recovered, but then the i/o went through the roof, and we saw the bgsync not keeping up when running with -vvvv. When the fatal exception happens, it&apos;s always for the same query on the same capped collection which I assume it&apos;s trying to replay from the master. I confirmed that the same query is where the other nodes also break. There is nothing special about the query, it is a small blob with very few fields, and the capped collection has many just like it.&lt;/p&gt;

&lt;p&gt;The OS is Ubuntu 10.04.3 LTS. FS is XFS. 22Gb memory.&lt;/p&gt;</description>
                <environment></environment>
        <key id="158358">SERVER-15265</key>
            <summary>passes &gt;= maxPasses (capped collection)</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="3">Duplicate</resolution>
                                        <assignee username="-1">Unassigned</assignee>
                                    <reporter username="duncanphillips">Duncan Phillips</reporter>
                        <labels>
                    </labels>
                <created>Tue, 16 Sep 2014 09:24:26 +0000</created>
                <updated>Fri, 17 Oct 2014 19:06:43 +0000</updated>
                            <resolved>Thu, 25 Sep 2014 19:34:36 +0000</resolved>
                                    <version>2.4.8</version>
                                                    <component>Replication</component>
                                        <votes>0</votes>
                                    <watches>5</watches>
                                                                                                                <comments>
                            <comment id="724721" author="dan@10gen.com" created="Tue, 23 Sep 2014 03:26:59 +0000"  >&lt;p&gt;Agree that the message could be cleaned up considerably.  &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=redbeard0531&quot; class=&quot;user-hover&quot; rel=&quot;redbeard0531&quot;&gt;redbeard0531&lt;/a&gt; is doing some work in that code for 2.8, so we should see some improvements there.&lt;/p&gt;</comment>
                            <comment id="723830" author="duncanphillips" created="Mon, 22 Sep 2014 05:48:50 +0000"  >&lt;p&gt;Hi Dan, thanks for the feedback and helping to understand the issue. As a side note, we discovered that the capped collection had been sized down at some point, so it was only 4Mb large. I have a feeling that this, together with the a large variation in record sizes in that collection caused the issue. Unfortunately, I can&apos;t provide the raw data. As a request, could that error message be improved, even after reading the source code it was unclear that this was the situation.&lt;/p&gt;</comment>
                            <comment id="723342" author="dan@10gen.com" created="Fri, 19 Sep 2014 19:52:15 +0000"  >&lt;p&gt;Hi Duncan,&lt;/p&gt;

&lt;p&gt;This message indicates that the server cannot find a contiguous run of free space large enough to fit a 55272 byte record after deleting 5000 records. Since your average record size is ~450 bytes, that would require at least 100 contiguous average-sized records to be deleted. If it happened to delete smaller records it could require much more. Would it be possible to get a compressed copy of the raw datafiles that are exhibiting this error?&lt;/p&gt;

&lt;p&gt;To workaround this, unfortunately, is onerous.  Because the operation which is causing the problem is already in the oplog and causing some secondaries to crash, you have to get past this operation to continue replication.  There are a couple ways to do this, but the easiest would be to resync the secondaries that are having the issue.  &lt;/p&gt;

&lt;p&gt;To be sure, this is a fairly rare occurrence, but it can be seen when inserting documents of vastly different sizes into capped collections.  If it is acceptable to your application to cap the number of documents in the collection, it is possible to avoid this situation by setting the max documents to be &amp;lt; 5000.  See an example here: &lt;a href=&quot;http://docs.mongodb.org/manual/reference/method/db.createCollection/#example&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://docs.mongodb.org/manual/reference/method/db.createCollection/#example&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="722866" author="duncanphillips" created="Fri, 19 Sep 2014 11:33:19 +0000"  >&lt;p&gt;We&apos;ve just been hit by this again, it&apos;s taken out 4 of our 5 nodes and brought our site down.&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10010">
                    <name>Duplicate</name>
                                            <outwardlinks description="duplicates">
                                        <issuelink>
            <issuekey id="50003">SERVER-6981</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                            <attachment id="52214" name="mongo.log" size="892002" author="duncanphillips" created="Tue, 16 Sep 2014 09:24:26 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>4.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Fri, 19 Sep 2014 19:52:15 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        9 years, 21 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ian@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            9 years, 21 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>dan@mongodb.com</customfieldvalue>
            <customfieldvalue>duncanphillips</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrlnwv:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hs2947:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>137839</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10750" key="com.atlassian.jira.plugin.system.customfieldtypes:textarea">
                        <customfieldname>Steps To Reproduce</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>&lt;p&gt;I&apos;m unable to reproduce&lt;/p&gt;</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hsgnbz:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>