<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:20:09 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-9351] 3 node replica set fresh config - failure after initial mongoimport</title>
                <link>https://jira.mongodb.org/browse/SERVER-9351</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;After setting up replication as per architecture design pattern &quot;Geographically Distributed Sets&quot; (2 nodes in one AZ, 1 node in another AZ, via VPN, as per Amazon recommended design), performing a fresh import on NODE 1 (client) to NODE 1 (server) triggers replication issues.&lt;/p&gt;

&lt;p&gt;NODE 1 - primary, AZ2 (availability zone)&lt;br/&gt;
NODE 2 - secondary, AZ2&lt;br/&gt;
NODE 3 - secondary, AZ1&lt;/p&gt;

&lt;p&gt;PROBLEM&lt;br/&gt;
----------&lt;br/&gt;
replication &quot;locks&quot; up on &lt;/p&gt;
{NODE 3} and does not recover, either by waiting or restarting mongodb server {NODE 3}
&lt;p&gt;.&lt;/p&gt;

&lt;p&gt;mongo client on &lt;/p&gt;
{NODE 3} responds very slowly (up to 30 seconds lag), even on enter with no command.&lt;br/&gt;
&lt;br/&gt;
Error logs:&lt;br/&gt;
-------------&lt;br/&gt;
Mon Apr 15 08:02:55.026 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsBackgroundSync&amp;#93;&lt;/span&gt; Socket recv() timeout {NODE 1}&lt;br/&gt;
Mon Apr 15 08:02:55.026 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsBackgroundSync&amp;#93;&lt;/span&gt; SocketException: remote: {NODE 1} error: 9001 socket exception &lt;span class=&quot;error&quot;&gt;&amp;#91;3&amp;#93;&lt;/span&gt; server [{NODE 1}]&lt;br/&gt;
Mon Apr 15 08:02:55.026 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsBackgroundSync&amp;#93;&lt;/span&gt; replSet db exception in producer: 10278 dbclient error communicating with server: {NODE 1}&lt;br/&gt;
Mon Apr 15 08:02:56.050 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSyncNotifier&amp;#93;&lt;/span&gt; Socket recv() timeout  {NODE 1}&lt;br/&gt;
Mon Apr 15 08:02:56.050 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSyncNotifier&amp;#93;&lt;/span&gt; SocketException: remote: {NODE 1} error: 9001 socket exception &lt;span class=&quot;error&quot;&gt;&amp;#91;3&amp;#93;&lt;/span&gt; server [{NODE 1}]&lt;br/&gt;
Mon Apr 15 08:02:56.050 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSyncNotifier&amp;#93;&lt;/span&gt; DBClientCursor::init call() failed&lt;br/&gt;
Mon Apr 15 08:02:57.050 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSyncNotifier&amp;#93;&lt;/span&gt; replset tracking exception: exception: 9001 socket exception &lt;span class=&quot;error&quot;&gt;&amp;#91;FAILED_STATE&amp;#93;&lt;/span&gt; for {NODE 1}&lt;br/&gt;
Mon Apr 15 08:02:58.051 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSyncNotifier&amp;#93;&lt;/span&gt; replset setting oplog notifier to {NODE 1}&lt;br/&gt;
&lt;br/&gt;
replication status&lt;br/&gt;
--------------------{NODE 1} state - PRIMARY, optime - 1366013200
{NODE 2} state - SECONDARY, optime - 1366013200{NODE 3}
&lt;p&gt; state - SECONDARY, optime - 1366012945&lt;/p&gt;</description>
                <environment>Ubuntu 12.04.2 LTS 3.2.0-40-virtual, 64-bit, hosted on AWS EC2</environment>
        <key id="71811">SERVER-9351</key>
            <summary>3 node replica set fresh config - failure after initial mongoimport</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="-1">Unassigned</assignee>
                                    <reporter username="dsobon">David Sobon</reporter>
                        <labels>
                    </labels>
                <created>Mon, 15 Apr 2013 08:45:34 +0000</created>
                <updated>Tue, 16 Apr 2013 10:14:23 +0000</updated>
                            <resolved>Tue, 16 Apr 2013 10:14:23 +0000</resolved>
                                    <version>2.4.1</version>
                                                    <component>Replication</component>
                                        <votes>0</votes>
                                    <watches>2</watches>
                                                                                                                <comments>
                            <comment id="314223" author="dsobon" created="Tue, 16 Apr 2013 02:40:05 +0000"  >&lt;p&gt;Please mark problem as INVALID.&lt;/p&gt;

&lt;p&gt;Issue ended up being the cross-availability-zone VPN connection, the TCP connections did not have TCP MSS set properly.&lt;/p&gt;

&lt;p&gt;The solution was on both ends of the VPN link:&lt;/p&gt;

&lt;p&gt;iptables -I FORWARD -p tcp --syn -s &lt;/p&gt;
{saddr}
&lt;p&gt;/24 -d &lt;/p&gt;
{daddr}
&lt;p&gt;/24 -j TCPMSS --set-mss 1356&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        10 years, 44 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ian@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            10 years, 44 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10000" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Old_Backport</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10000"><![CDATA[No]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>dsobon</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrmx1r:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hrna4f:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>49585</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10750" key="com.atlassian.jira.plugin.system.customfieldtypes:textarea">
                        <customfieldname>Steps To Reproduce</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>&lt;p&gt;1) create and initiate clean 3-node replica set cluster.&lt;/p&gt;
&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;place two nodes in one AZ (with sub 1msec latency and near 1gige networking)&lt;/li&gt;
	&lt;li&gt;place third node into another AWS AZ, 2msec away with 3 hops, via VPN.&lt;br/&gt;
4) mongoimport to 
{NODE 1}
&lt;p&gt;5) wait for replication on &lt;/p&gt;
{NODE 3}
&lt;p&gt; to fail.&lt;/p&gt;&lt;/li&gt;
&lt;/ul&gt;
</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|ht032v:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>