<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 04:24:57 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-30772] Can&apos;t get in to Mongo Shell for primary node, it hangs, apps could not connect to it</title>
                <link>https://jira.mongodb.org/browse/SERVER-30772</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;We are running MongoDB 3.2.12 three replica set on dockers on Redhat Linux 4.1.12-61.1.25.el7uek.x86_64.  It has happened a few times recently that our apps all a sudden could not connect to the set any more (mark this #1 for reference).  I went on the primary node, and could not get into mongo shell to the primary,  I could still get in to the two secondaries.  And the replication seems still fine (I checked with db.printSlaveReplicationInfo()).  &lt;/p&gt;

&lt;p&gt;One other strange thing I noticed is the MongoDB log file stopped being updated on the primary (mark this #2 for reference).  It was fine on secondaries.  This does not seem to be directly related with the above main issue.  It could take days for #1 to happen after #2 happened from recent observations.  &lt;/p&gt;

&lt;p&gt;Could you help?  We are at a loss and don&apos;t know what to look for. &lt;/p&gt;

&lt;p&gt;Thanks, &lt;/p&gt;

&lt;p&gt;Erin&lt;/p&gt;</description>
                <environment></environment>
        <key id="418852">SERVER-30772</key>
            <summary>Can&apos;t get in to Mongo Shell for primary node, it hangs, apps could not connect to it</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="5">Cannot Reproduce</resolution>
                                        <assignee username="mark.agarunov">Mark Agarunov</assignee>
                                    <reporter username="erinbaoathub">Erin Bao</reporter>
                        <labels>
                    </labels>
                <created>Tue, 22 Aug 2017 15:13:49 +0000</created>
                <updated>Mon, 9 Oct 2017 17:01:49 +0000</updated>
                            <resolved>Thu, 14 Sep 2017 22:15:46 +0000</resolved>
                                                                    <component>Logging</component>
                    <component>Networking</component>
                    <component>Replication</component>
                                        <votes>0</votes>
                                    <watches>7</watches>
                                                                                                                <comments>
                            <comment id="1673770" author="erinbaoathub" created="Fri, 15 Sep 2017 13:00:04 +0000"  >&lt;p&gt;Thank you Mark!  Thanks for the confirmation.  About two weeks ago, we re-directed the logs (mongodb log and docker lot) to Graylogs (I am not familiar with the technical details on this) and since then the problem has not happened again.  Thank you for your effort on this topic, appreciate it!  &lt;/p&gt;

&lt;p&gt;Erin&lt;/p&gt;
</comment>
                            <comment id="1673411" author="mark.agarunov" created="Thu, 14 Sep 2017 22:15:38 +0000"  >&lt;p&gt;Hello &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=erinbaoathub&quot; class=&quot;user-hover&quot; rel=&quot;erinbaoathub&quot;&gt;erinbaoathub&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Taking a deeper look at the data, I do not see anything to indicate a bug in the MongoDB server. For MongoDB-related support discussion please post on the &lt;a href=&quot;https://groups.google.com/group/mongodb-user&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;mongodb-user group&lt;/a&gt; or &lt;a href=&quot;https://stackoverflow.com/questions/tagged/mongodb&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;Stack Overflow with the &lt;tt&gt;mongodb&lt;/tt&gt; tag&lt;/a&gt;. A question like this involving more discussion would be best posted on the mongodb-user group.&lt;/p&gt;

&lt;p&gt;See also our &lt;a href=&quot;https://docs.mongodb.org/manual/support&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;Technical Support page&lt;/a&gt; for additional support resources.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Mark&lt;/p&gt;</comment>
                            <comment id="1665317" author="erinbaoathub" created="Wed, 6 Sep 2017 12:42:07 +0000"  >&lt;p&gt;Hi Mark, &lt;/p&gt;

&lt;p&gt;Where could I find the raw mongodb logs?  We are using dockers to run mongodb,  so if you see the logs were generated by something else, then could it be the docker?  But anyway, they moved all those logs to something called Graylog,  it is a UI that I could search for logs, but what showed are still about the same with what I sent you.  Surprisingly after they moved the logs to Graylog on Aug 31st, it seems our system stays put longer (it has been 8 days without rebooting and they are still fine!  The issue used to have every 3-4 days and we had to reboot).  Anyway, I don&apos;t know what other logs to look for, the set up with &apos;docker&apos; in picture gives me a lot of trouble in finding things around, versus just run mongodb on a few normal linux hosts. &lt;/p&gt;

&lt;p&gt;Thanks, &lt;br/&gt;
Erin&lt;/p&gt;</comment>
                            <comment id="1663087" author="mark.agarunov" created="Fri, 1 Sep 2017 21:25:52 +0000"  >&lt;p&gt;Hello &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=erinbaoathub&quot; class=&quot;user-hover&quot; rel=&quot;erinbaoathub&quot;&gt;erinbaoathub&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Thank you for providing this information. Unfortunately we still have not identified the cause of this issue. The provided logs appear to have been generated by a tool other than mongodb, would it be possible to get the raw logs from mongod for this time period? There look to be some discrepancies between the logs and diagnostic data, and I suspect there might be additional information in the raw logs that could be missing from these logs. &lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Mark&lt;/p&gt;</comment>
                            <comment id="1656619" author="erinbaoathub" created="Thu, 24 Aug 2017 20:36:31 +0000"  >&lt;p&gt;I also attached the logs from node1 and node3, just in case you&apos;d need them: node1_logAug24,txt and node3_logAug24.txt.   After we rebooted node 2 now our node 3 is our new primary.   Thanks again!  &lt;/p&gt;</comment>
                            <comment id="1656598" author="erinbaoathub" created="Thu, 24 Aug 2017 20:21:13 +0000"  >&lt;p&gt;And it just happened again between our time (Chicago)  14:10 and 14:40  on Aug 24th,  that will be UTC time 19:10 and 19:40 on Aug 24th. I got the diagnotistic data from the primary (which is our node 2 db02), and I will attached it as newjiraAug24.tgz.  &lt;br/&gt;
Please help if you could, we are like having a down time every  3-4 days now and it is our production.  &lt;br/&gt;
Appreciate your help! &lt;/p&gt;

&lt;p&gt;Erin&lt;/p&gt;</comment>
                            <comment id="1656434" author="erinbaoathub" created="Thu, 24 Aug 2017 18:02:08 +0000"  >&lt;p&gt;Hi Mark, &lt;/p&gt;

&lt;p&gt;Thanks for the reply!  I am now attaching three files from our three prod nodes.  &lt;/p&gt;

&lt;p&gt;The last time the issue happened it was 6-7-8am on Aug 21st. I discovered the issue at 7:28am but it might have started earlier and we just didn&apos;t know.  It was on node 1 (db01) which was the primary before the issue popped up.  We rebooted the box around 7:40am that day.  You could see the diagnostic data covering that time.  Please be aware, I am talking about Chicago time, plus 5 hours it will be the UTC time in the logs.  &lt;/p&gt;

&lt;p&gt;After the reboot, our current primary is node 2 (db02).  You can see its log file has stopped being updated since 12:10 on Aug 21st. &lt;/p&gt;

&lt;p&gt;Please let me know if you find anything we can improve, thanks a lot! &lt;/p&gt;

&lt;p&gt;Erin&lt;/p&gt;</comment>
                            <comment id="1656192" author="mark.agarunov" created="Thu, 24 Aug 2017 15:41:40 +0000"  >&lt;p&gt;Hello &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=erinbaoathub&quot; class=&quot;user-hover&quot; rel=&quot;erinbaoathub&quot;&gt;erinbaoathub&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Thank you for the report. To get some better insight into what may be causing this, could you please provide:&lt;/p&gt;

&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;The complete logs from all affected &lt;tt&gt;mongod&lt;/tt&gt; nodes when this issue is present,&lt;/li&gt;
	&lt;li&gt;An archive (tar or zip) of the &lt;tt&gt;$dbpath/diagnostic.data&lt;/tt&gt; directory from each affected node&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;This should provide some more information to better diagnose this issue.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Mark&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                            <attachment id="163960" name="forjira-node1.tgz" size="103684334" author="erinbaoathub" created="Thu, 24 Aug 2017 17:59:43 +0000"/>
                            <attachment id="163961" name="forjira-node2.tgz" size="103131287" author="erinbaoathub" created="Thu, 24 Aug 2017 18:03:53 +0000"/>
                            <attachment id="163962" name="forjira-node3.tgz" size="100259819" author="erinbaoathub" created="Thu, 24 Aug 2017 18:04:47 +0000"/>
                            <attachment id="163982" name="newdiagAug24.tgz" size="104389686" author="erinbaoathub" created="Thu, 24 Aug 2017 20:24:00 +0000"/>
                            <attachment id="163987" name="node1_logAug24.txt" size="582265" author="erinbaoathub" created="Thu, 24 Aug 2017 20:35:10 +0000"/>
                            <attachment id="163988" name="node3_logAug24.txt" size="966967" author="erinbaoathub" created="Thu, 24 Aug 2017 20:35:10 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>8.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Thu, 24 Aug 2017 15:41:40 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        6 years, 21 weeks, 5 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>backlog-server-pm</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            6 years, 21 weeks, 5 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>erinbaoathub</customfieldvalue>
            <customfieldvalue>mark.agarunov</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|htde8v:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|ht568f:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|htd0br:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>