<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 05:08:28 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-45315] When replica-set member goes offline, other members CPU`s spike to 100%</title>
                <link>https://jira.mongodb.org/browse/SERVER-45315</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;&lt;b&gt;TL;DR:&lt;/b&gt;&#160;&lt;/p&gt;

&lt;p&gt;Powering off one of mongodb Shard members cause the others cpu`s to raise for 100%.&lt;/p&gt;

&lt;p&gt;&lt;b&gt;Background:&lt;/b&gt;&#160;&lt;/p&gt;

&lt;p&gt;I want to deploy an mongodb cluster on several ESXes. The cluster have to resist two component shutdown.&lt;/p&gt;

&lt;p&gt;&lt;b&gt;Cluster Architecture&lt;/b&gt; (Mongo 4.2)&lt;b&gt;:&lt;/b&gt;&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;5 config servers&lt;/li&gt;
	&lt;li&gt;3 query servers&lt;/li&gt;
	&lt;li&gt;shard01:
	&lt;ul&gt;
		&lt;li&gt;primary&lt;/li&gt;
		&lt;li&gt;2 secondary&lt;/li&gt;
		&lt;li&gt;2 arbiter&lt;/li&gt;
	&lt;/ul&gt;
	&lt;/li&gt;
	&lt;li&gt;shard02:
	&lt;ul&gt;
		&lt;li&gt;primary&lt;/li&gt;
		&lt;li&gt;2 secondary&lt;/li&gt;
		&lt;li&gt;2 arbiter&lt;/li&gt;
	&lt;/ul&gt;
	&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;&lt;b&gt;The problem:&lt;/b&gt;&lt;/p&gt;

&lt;p&gt;Whenever I have been testing HA by removing one of the members. I noticed,&#160;&lt;b&gt;after several minutes&lt;/b&gt;, that the rest of the members face to CPU spike to 100% which remains until I returned the missing member.&lt;/p&gt;

&lt;p&gt;&lt;b&gt;Tests I have been conducted:&lt;/b&gt;&lt;/p&gt;
&lt;ol&gt;
	&lt;li&gt;shutdown 1 replica -&amp;gt; members CPU raise to 100%&lt;/li&gt;
	&lt;li&gt;shutdown 1 replica and 1 arbiter -&amp;gt; members CPU raise to 100%&lt;/li&gt;
	&lt;li&gt;shutdown 1 arbiter -&amp;gt; members are OK&lt;/li&gt;
&lt;/ol&gt;


&lt;p&gt;&lt;b&gt;Things i have already checked:&lt;/b&gt;&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;When checking the problematic VMs I noticed that the mongod is the service which consume most of the CPU (99%).&lt;/li&gt;
	&lt;li&gt;I checked mongod for long run-time queries with&#160;&lt;tt&gt;db.currentOp()&lt;/tt&gt;. Everything looks just fine.&lt;/li&gt;
	&lt;li&gt;Mongod.log does not contain any suspicious logs.&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;&lt;b&gt;Bbottom_line:&lt;/b&gt;&lt;/p&gt;

&lt;p&gt;I published the problem in [stackoverflow |&lt;a href=&quot;https://stackoverflow.com/questions/59491006/why-when-one-of-mongodb-replica-set-shard-members-goes-offline-the-others-cpus&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://stackoverflow.com/questions/59491006/why-when-one-of-mongodb-replica-set-shard-members-goes-offline-the-others-cpus&lt;/a&gt;] and advised to report it as a bug.&#160;&lt;/p&gt;

&lt;p&gt;Regards,&lt;/p&gt;

&lt;p&gt;Aric&lt;/p&gt;</description>
                <environment></environment>
        <key id="1070187">SERVER-45315</key>
            <summary>When replica-set member goes offline, other members CPU`s spike to 100%</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="13204">Community Answered</resolution>
                                        <assignee username="dmitry.agranat@mongodb.com">Dmitry Agranat</assignee>
                                    <reporter username="naheim.lavon@opka.org">Arik Nano</reporter>
                        <labels>
                    </labels>
                <created>Sun, 29 Dec 2019 15:12:41 +0000</created>
                <updated>Fri, 27 Oct 2023 15:56:36 +0000</updated>
                            <resolved>Mon, 13 Jan 2020 21:09:24 +0000</resolved>
                                                                    <component>Performance</component>
                    <component>Replication</component>
                                        <votes>0</votes>
                                    <watches>5</watches>
                                                                                                                <comments>
                            <comment id="2722992" author="dmitry.agranat" created="Mon, 13 Jan 2020 21:08:58 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=naheim.lavon%40opka.org&quot; class=&quot;user-hover&quot; rel=&quot;naheim.lavon@opka.org&quot;&gt;naheim.lavon@opka.org&lt;/a&gt;, &lt;/p&gt;

&lt;p&gt;I will go ahead and close this case. Do not hesitate to reach out if you still face the same issue after implementing the recommendations from my last comment.&lt;/p&gt;

&lt;p&gt;Regards,&lt;br/&gt;
Dima&lt;/p&gt;</comment>
                            <comment id="2691225" author="dmitry.agranat" created="Mon, 30 Dec 2019 09:39:43 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=naheim.lavon%40opka.org&quot; class=&quot;user-hover&quot; rel=&quot;naheim.lavon@opka.org&quot;&gt;naheim.lavon@opka.org&lt;/a&gt;, your first 2 tests basically turn your replica set into a deployment we do not recommend. To address this, you should either &lt;a href=&quot;https://docs.mongodb.com/manual/reference/read-concern-majority/index.html#disable-read-concern-majority&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;disable read concern majority&lt;/a&gt; or do not use Arbiters in your deployment.&lt;/p&gt;

&lt;p&gt;If after the above suggestion you still see the same issue, please let us know and we&apos;ll send you a link to a secure portal to collect some data.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Dima&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10011" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Backwards Compatibility</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10038"><![CDATA[Fully Compatible]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Mon, 30 Dec 2019 09:39:43 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        4 years, 4 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_17050" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Downstream Team Attention</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="16941"><![CDATA[Not Needed]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>luke.bonanomi@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            4 years, 4 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>naheim.lavon@opka.org</customfieldvalue>
            <customfieldvalue>dmitry.agranat@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hwduxr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hw203j:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                    <customfieldvalue><![CDATA[dmitry.agranat@mongodb.com]]></customfieldvalue>
    

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hwdh73:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>