<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:53:06 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-20088] both secondary crashed in replicaset in mongo 3.0.4 </title>
                <link>https://jira.mongodb.org/browse/SERVER-20088</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;We have 3 node replica cluster on mongo 3.0.4. And both mongo secondary crashed with out of memory error and due to this our primary mongo stepped down to secondary.&lt;br/&gt;
Attaching all logs in files. &lt;/p&gt;</description>
                <environment>mongo 3.0.4 with three node cluster. (1 primary and 2 secondary) on aws ec2 (ubuntu 14.04)</environment>
        <key id="226729">SERVER-20088</key>
            <summary>both secondary crashed in replicaset in mongo 3.0.4 </summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="ramon.fernandez@mongodb.com">Ramon Fernandez Marina</assignee>
                                    <reporter username="rakesh.mib.j@gmail.com">Rakesh Kumar</reporter>
                        <labels>
                            <label>bug</label>
                    </labels>
                <created>Sun, 23 Aug 2015 15:56:44 +0000</created>
                <updated>Tue, 16 Nov 2021 17:19:16 +0000</updated>
                            <resolved>Wed, 26 Aug 2015 12:56:20 +0000</resolved>
                                    <version>3.0.4</version>
                                                    <component>WiredTiger</component>
                                        <votes>0</votes>
                                    <watches>3</watches>
                                                                                                                <comments>
                            <comment id="1014789" author="ramon.fernandez" created="Wed, 26 Aug 2015 12:56:10 +0000"  >&lt;p&gt;My apologies &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=rakesh.mib.j&quot; class=&quot;user-hover&quot; rel=&quot;rakesh.mib.j&quot;&gt;rakesh.mib.j&lt;/a&gt;, that was pilot error on my part: I skipped to the end looking for the backtrace and I didn&apos;t see it. I can confirm that there were no index builds at the time, so &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-18829&quot; title=&quot;Cache usage exceeds configured maximum during index builds under WiredTiger&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-18829&quot;&gt;&lt;del&gt;SERVER-18829&lt;/del&gt;&lt;/a&gt; is not the issue you&apos;re running into.&lt;/p&gt;

&lt;p&gt;The first thing to note is about the WiredTiger cache setting: specifying a cache size of 12GB &lt;b&gt;doesn&apos;t mean &lt;tt&gt;mongod&lt;/tt&gt; will only use 12GB only&lt;/b&gt;. This setting only limits the WiredTiger cache, but &lt;tt&gt;mongod&lt;/tt&gt; needs additional memory to operate. Note also that using 12GB means that the OS will be strapped for file buffers, which will have a negative impact on performance. Bottom line, my first recommendation would be to let &lt;tt&gt;mongod&lt;/tt&gt; use the default cache size.&lt;/p&gt;

&lt;p&gt;This doesn&apos;t mean we&apos;re out of the woods; between 3.0.4 and 3.0.6 there have been some issues fixed on excessive memory consumption by WiredTiger, so I&apos;d also recommend upgrading to 3.0.6.&lt;/p&gt;

&lt;p&gt;Since I think the behavior you&apos;re seeing is related to the large cache size these nodes are configured with I&apos;m going to close this ticket for now. If the issue persists in 3.0.6 feel free to post here again and we&apos;ll reopen the ticket for further investigation.&lt;/p&gt;

&lt;p&gt;Regards,&lt;br/&gt;
Ram&#243;n.&lt;/p&gt;</comment>
                            <comment id="1014623" author="rakesh.mib.j@gmail.com" created="Wed, 26 Aug 2015 05:05:20 +0000"  >&lt;p&gt;this log is from the beginning, when server was started to the end (when server was crashed). server configuration is 4 core and 15 Gb ram on AWS cloud.&lt;br/&gt;
We don&apos;t have swap space on these servers.&lt;/p&gt;</comment>
                            <comment id="1012757" author="ramon.fernandez" created="Mon, 24 Aug 2015 12:23:46 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=rakesh.mib.j&quot; class=&quot;user-hover&quot; rel=&quot;rakesh.mib.j&quot;&gt;rakesh.mib.j&lt;/a&gt;, thanks for updating the log and the config file, but unfortunately this log does not contain the information we need to investigate this issue as it does not contain the time window we need. The logs we need are from server restart until the time of the crash.&lt;/p&gt;

&lt;p&gt;We also need to know how much memory and swap space these secondaries have.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Ram&#243;n.&lt;/p&gt;</comment>
                            <comment id="1012622" author="rakesh.mib.j@gmail.com" created="Mon, 24 Aug 2015 06:17:01 +0000"  >&lt;p&gt;Thanks for the update, i don&apos;t think at that time there is any index creation is going on.&lt;br/&gt;
Attached the Secondary full log file named &quot;mongod.log&quot; and mongo configuration file named &quot;mongod-secondary.com&quot;&lt;/p&gt;</comment>
                            <comment id="1012560" author="ramon.fernandez" created="Mon, 24 Aug 2015 00:55:31 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=rakesh.mib.j&quot; class=&quot;user-hover&quot; rel=&quot;rakesh.mib.j&quot;&gt;rakesh.mib.j&lt;/a&gt;, were there any index builds happening on these secondaries before they crashed? Also, what&apos;s the memory configuration on these boxes and the startup parameters? My first guess is that you may be running into &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-18829&quot; title=&quot;Cache usage exceeds configured maximum during index builds under WiredTiger&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-18829&quot;&gt;&lt;del&gt;SERVER-18829&lt;/del&gt;&lt;/a&gt;, but I&apos;d need you to provide the details above; ideally, if you could upload the full logs from the last restart for at least one of the crashed secondaries we could check this hypothesis quickly.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Ram&#243;n.&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                            <attachment id="87166" name="mongo primary" size="60393046" author="rakesh.mib.j" created="Sun, 23 Aug 2015 15:56:44 +0000"/>
                            <attachment id="87167" name="mongo sec. 1" size="1397758" author="rakesh.mib.j" created="Sun, 23 Aug 2015 15:56:45 +0000"/>
                            <attachment id="87165" name="mongo sec. 2" size="83215" author="rakesh.mib.j" created="Sun, 23 Aug 2015 15:56:44 +0000"/>
                            <attachment id="87194" name="mongod-secondary.conf" size="1884" author="rakesh.mib.j" created="Mon, 24 Aug 2015 06:23:42 +0000"/>
                            <attachment id="87193" name="mongod.log" size="85275860" author="rakesh.mib.j" created="Mon, 24 Aug 2015 06:17:01 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>5.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Mon, 24 Aug 2015 00:55:31 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        8 years, 25 weeks ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>luke.bonanomi@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            8 years, 25 weeks ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10020"><![CDATA[Linux]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>rakesh.mib.j@gmail.com</customfieldvalue>
            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrkwlr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hscoof:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10750" key="com.atlassian.jira.plugin.system.customfieldtypes:textarea">
                        <customfieldname>Steps To Reproduce</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>&lt;p&gt;Its production systems, i tried but can&apos;t replicate this in staging.&lt;/p&gt;</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrlg6n:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>