<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 05:55:50 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-62699] Replica set fails to restart after shutdown of all Nodes in a Dynamic DNS/network environment</title>
                <link>https://jira.mongodb.org/browse/SERVER-62699</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;We have recently moved to a MongoDB cluster setup from a single node setup.&lt;/p&gt;

&lt;p&gt;We have the dynamic network setup where the DNS entries activate after about 30 seconds a service(MongoDB Node) is started. Each service/node has a unique IP allocated after start/restart.&lt;/p&gt;

&lt;p&gt;Lets say my Mongo set up has 3 Nodes rs1,rs2,rs3.. Here is whats happening..&lt;/p&gt;

&lt;p&gt;1. When i shutdown rs1,rs2 and rs3 together, the DNS records for are removed.&lt;br/&gt;
2. After restart, each MongoDB node does a isSelf test, to find its hostname. isSelf test is simply MongoDB node connecting to each of the members in replica set config to find itself.&lt;br/&gt;
3. Due to above network setup delays isSelf test fails and the node enters REMOVED state.&lt;/p&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2022-01-18T15:57:16.513+05:30&quot;},&quot;s&quot;:&quot;I&quot;, &quot;c&quot;:&quot;NETWORK&quot;, &quot;id&quot;:4834700, &quot;ctx&quot;:&quot;ReplCoord-0&quot;,&quot;msg&quot;:&quot;isSelf could not connect via connectSocketOnly&quot;,&quot;attr&quot;:\{&quot;hostAndPort&quot;:&quot;rs1.example.com:12000&quot;,&quot;error&quot;:{&quot;code&quot;:6,&quot;codeName&quot;:&quot;HostUnreachable&quot;,&quot;errmsg&quot;:&quot;couldn&apos;t connect to server rs1.example.com:12000, connection attempt failed: HostNotFound: Could not find address for rs1.example.com:12000: SocketException: Host not found (authoritative)&quot;}}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2022-01-18T15:57:16.513+05:30&quot;},&quot;s&quot;:&quot;I&quot;, &quot;c&quot;:&quot;REPL&quot;, &quot;id&quot;:21394, &quot;ctx&quot;:&quot;ReplCoord-0&quot;,&quot;msg&quot;:&quot;This node is not a member of the config&quot;}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2022-01-18T15:57:16.513+05:30&quot;},&quot;s&quot;:&quot;I&quot;, &quot;c&quot;:&quot;REPL&quot;, &quot;id&quot;:21358, &quot;ctx&quot;:&quot;ReplCoord-0&quot;,&quot;msg&quot;:&quot;Replica set state transition&quot;,&quot;attr&quot;:{&quot;newState&quot;:&quot;REMOVED&quot;,&quot;oldState&quot;:&quot;STARTUP&quot;}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;4. Once a node enters REMOVED state it does not try to find other nodes and initiate cluster formation/election. So, MongoDB cluster formation fails after each restart of all Nodes.&lt;/p&gt;

&lt;p&gt;I think dynamic DNS environments like ours are seen in other Organizations also. Isn&apos;t it better to keep retrying isSelf test even after entering REMOVED state?&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;</description>
                <environment></environment>
        <key id="1965595">SERVER-62699</key>
            <summary>Replica set fails to restart after shutdown of all Nodes in a Dynamic DNS/network environment</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="10038" iconUrl="https://jira.mongodb.org/images/icons/subtask.gif" description="">Backlog</status>
                    <statusCategory id="2" key="new" colorName="default"/>
                                    <resolution id="-1">Unresolved</resolution>
                                        <assignee username="alan.zheng@mongodb.com">Alan Zheng</assignee>
                                    <reporter username="g.sravan4u@gmail.com">Sravan _</reporter>
                        <labels>
                            <label>pmr</label>
                    </labels>
                <created>Tue, 18 Jan 2022 13:09:53 +0000</created>
                <updated>Tue, 30 May 2023 14:49:29 +0000</updated>
                                            <version>4.4.14</version>
                    <version>4.4.7</version>
                                                                        <votes>1</votes>
                                    <watches>10</watches>
                                                                                                                <comments>
                            <comment id="5098973" author="JIRAUSER1260706" created="Mon, 9 Jan 2023 08:17:50 +0000"  >&lt;p&gt;Hi @Alan Zheng, Is there any timeline when this issue is expected to be fixed?&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;</comment>
                            <comment id="4632642" author="JIRAUSER1260706" created="Wed, 22 Jun 2022 15:56:02 +0000"  >&lt;blockquote&gt;&lt;p&gt;However, if at least ONE node&apos;s DNS works, it will restore the replica set config as soon as the DNS returns on the remaining nodes.&lt;/p&gt;&lt;/blockquote&gt;
&lt;p&gt;Got it Christopher.. &lt;br/&gt;
But In my case, I&#160; cannot control the dynamic DNS setup delay when mongo nodes restart..&lt;/p&gt;</comment>
                            <comment id="4610110" author="JIRAUSER1265262" created="Mon, 13 Jun 2022 07:56:47 +0000"  >&lt;p&gt;Hi _Sravan,&lt;/p&gt;

&lt;p&gt;Thanks for your report, and taking the time to submit your logs and reproduction. I was able to reproduce this behavior on 4.4.14. I created a 3 node replica set and created 3 hosts in /etc/hosts for them to use. I shut down the replica set, temporarily removed the entries from /etc/hosts, restarted the replica set, and observed the (expected) InvalidReplicaSetConfig in rs.status().&lt;/p&gt;

&lt;p&gt;I then re-introduced the entries to /etc/hosts while the replica set was still running and waited to see if it would resolve - it did not.&lt;/p&gt;

&lt;p&gt;&lt;b&gt;However, if at least ONE node&apos;s DNS works, it will restore the replica set config as soon as the DNS returns on the remaining nodes.&lt;/b&gt; So, if you were to leave 1 entry in /etc/hosts when starting up the whole replica set, that node will start up successfully while the others will still have an rs.status() of InvalidReplicaSetConfig. As soon as the other entries are returned to /etc/hosts, the config will immediately resolve on the other nodes and they will all be present in rs.status().&lt;/p&gt;

&lt;p&gt;It seems like this issue was looked at before in &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-35649&quot; title=&quot;Nodes removed due to isSelf failure should re-attempt to find themselves&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-35649&quot;&gt;&lt;del&gt;SERVER-35649&lt;/del&gt;&lt;/a&gt;, but may not affect the case where every single node&apos;s DNS fails during startup. I&apos;ll pass this along to the replication team to see if they may have input on this. I noticed a potentially similar issue in &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-40159&quot; title=&quot;Add retry logic for name resolution failure in isSelf&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-40159&quot;&gt;&lt;del&gt;SERVER-40159&lt;/del&gt;&lt;/a&gt; as well.&lt;/p&gt;

&lt;p&gt;Christopher&lt;/p&gt;</comment>
                            <comment id="4558683" author="rjferreira" created="Thu, 19 May 2022 09:01:14 +0000"  >&lt;p&gt;Hi,&lt;/p&gt;

&lt;p&gt;I&apos;m deploy in Azure and I got this error when a add a readinessProbe.&#160;&lt;br/&gt;
My readiness Probe is like this.&lt;/p&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;        readinessProbe:&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;          exec:&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;            command:&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;              - mongo&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;              - --disableImplicitSessions&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;              - --eval&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;              - &quot;db.adminCommand(&apos;ping&apos;)&quot;&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;          initialDelaySeconds: 120&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;          periodSeconds: 10&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;          timeoutSeconds: 5&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;          successThreshold: 1&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;          failureThreshold: 6&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;
&lt;p&gt;&#160;&lt;br/&gt;
If I remove readinessProbe it always work well.&lt;/p&gt;</comment>
                            <comment id="4556252" author="JIRAUSER1260706" created="Wed, 18 May 2022 13:12:46 +0000"  >&lt;p&gt;Hi @Brooke  and @Eric,&lt;/p&gt;

&lt;p&gt;I created a PoC database on my dev server to just reproduce this issue.. &lt;/p&gt;

&lt;p&gt;Attached the entire data directory archive, logs archive and commands/steps used to reproduce the issue..&lt;/p&gt;

&lt;p&gt; &lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/attachment/379559/379559_data.zip&quot; title=&quot;data.zip attached to SERVER-62699&quot;&gt;data.zip&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.mongodb.org/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt;  &lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/attachment/379560/379560_logs.zip&quot; title=&quot;logs.zip attached to SERVER-62699&quot;&gt;logs.zip&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.mongodb.org/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt;  &lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/attachment/379561/379561_mongo_replicaset_error_reproduce_steps.txt&quot; title=&quot;mongo_replicaset_error_reproduce_steps.txt attached to SERVER-62699&quot;&gt;mongo_replicaset_error_reproduce_steps.txt&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.mongodb.org/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt; &lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Sravan&lt;/p&gt;</comment>
                            <comment id="4545069" author="brooke.miller" created="Thu, 12 May 2022 14:48:05 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=g.sravan4u%40gmail.com&quot; class=&quot;user-hover&quot; rel=&quot;g.sravan4u@gmail.com&quot;&gt;g.sravan4u@gmail.com&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;We still need additional information to diagnose the problem. If this is still an issue for you, would you please reply with the additional information (requested in Eric&apos;s previous comment)?&lt;/p&gt;

&lt;p&gt;Thanks,&lt;/p&gt;

&lt;p&gt;Brooke&#160;&lt;/p&gt;</comment>
                            <comment id="4395141" author="eric.sedor" created="Mon, 7 Mar 2022 15:33:31 +0000"  >&lt;p&gt;Thanks &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=g.sravan4u%40gmail.com&quot; class=&quot;user-hover&quot; rel=&quot;g.sravan4u@gmail.com&quot;&gt;g.sravan4u@gmail.com&lt;/a&gt;, I did mean &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-35649&quot; title=&quot;Nodes removed due to isSelf failure should re-attempt to find themselves&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-35649&quot;&gt;&lt;del&gt;SERVER-35649&lt;/del&gt;&lt;/a&gt;. It sounds possible that the fix for &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-35649&quot; title=&quot;Nodes removed due to isSelf failure should re-attempt to find themselves&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-35649&quot;&gt;&lt;del&gt;SERVER-35649&lt;/del&gt;&lt;/a&gt; isn&apos;t helpful here because in the scenario you&apos;re testing DNS for all nodes are being removed. My theory is that the heartbeats that would trigger another lookup can&apos;t happen.&lt;/p&gt;

&lt;p&gt;Are you able to perform this test and then provide, for all nodes, an archive (tar or zip) the &lt;tt&gt;$dbpath/diagnostic.data&lt;/tt&gt; directory (the contents are described &lt;a href=&quot;https://docs.mongodb.com/manual/administration/analyzing-mongodb-performance/#full-time-diagnostic-data-capture&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;here&lt;/a&gt;), and mongod logs, and attach them to this ticket?&lt;/p&gt;</comment>
                            <comment id="4302149" author="JIRAUSER1260706" created="Thu, 20 Jan 2022 04:28:22 +0000"  >&lt;p&gt;Hi Eric, I think you mean this seems similar to &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-35649&quot; class=&quot;external-link&quot; rel=&quot;nofollow&quot;&gt;https://jira.mongodb.org/browse/SERVER-35649&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;We are using stable release version 4.4.7&lt;/p&gt;</comment>
                            <comment id="4301652" author="eric.sedor" created="Wed, 19 Jan 2022 22:27:44 +0000"  >&lt;p&gt;Thank you for your detailed walkthrough &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=g.sravan4u%40gmail.com&quot; class=&quot;user-hover&quot; rel=&quot;g.sravan4u@gmail.com&quot;&gt;g.sravan4u@gmail.com&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;&lt;del&gt;Can I please ask that you submit this same request to &lt;span class=&quot;error&quot;&gt;&amp;#91;feedback.mongodb.com|feedback.mongodb.com&amp;#93;&lt;/span&gt;? We&apos;re starting to direct new feature and improvement requests to that channel and preferring this JIRA project for bug reports specifically.&lt;/del&gt;&lt;/p&gt;

&lt;p&gt;&lt;del&gt;You may also want to search and post on the &lt;a href=&quot;https://community.mongodb.com/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;MongoDB Developer Community Forums&lt;/a&gt;, as it&apos;s possible there are others who have guidance on how to satisfy your use-case.&lt;/del&gt;&lt;/p&gt;

&lt;p&gt;EDIT: I misread this originally, sorry, and want to shift to asking what version of MongoDB this is on; as it seems similar to &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-62699&quot; title=&quot;Replica set fails to restart after shutdown of all Nodes in a Dynamic DNS/network environment&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-62699&quot;&gt;SERVER-62699&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;Thank you,&lt;br/&gt;
 Eric&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                            <outwardlinks description="related to">
                                        <issuelink>
            <issuekey id="560807">SERVER-35649</issuekey>
        </issuelink>
                            </outwardlinks>
                                                                <inwardlinks description="is related to">
                                        <issuelink>
            <issuekey id="560807">SERVER-35649</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="717412">SERVER-40159</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                            <attachment id="379559" name="data.zip" size="2030834" author="g.sravan4u@gmail.com" created="Wed, 18 May 2022 13:11:50 +0000"/>
                            <attachment id="379560" name="logs.zip" size="70241" author="g.sravan4u@gmail.com" created="Wed, 18 May 2022 13:11:48 +0000"/>
                            <attachment id="379561" name="mongo_replicaset_error_reproduce_steps.txt" size="11387" author="g.sravan4u@gmail.com" created="Wed, 18 May 2022 13:12:14 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Wed, 19 Jan 2022 22:27:44 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        1 year, 4 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>alan.zheng@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            1 year, 4 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>alan.zheng@mongodb.com</customfieldvalue>
            <customfieldvalue>brooke.miller@mongodb.com</customfieldvalue>
            <customfieldvalue>chris.kelly@mongodb.com</customfieldvalue>
            <customfieldvalue>eric.sedor@mongodb.com</customfieldvalue>
            <customfieldvalue>rjferreira</customfieldvalue>
            <customfieldvalue>g.sravan4u@gmail.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i0h59z:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|i0098n:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10750" key="com.atlassian.jira.plugin.system.customfieldtypes:textarea">
                        <customfieldname>Steps To Reproduce</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>&lt;ol&gt;
	&lt;li&gt;Stop all nodes in a MongoDB replica setup.&lt;/li&gt;
	&lt;li&gt;Remove DNS entries related to the MongoDB nodes.&lt;/li&gt;
	&lt;li&gt;Start all MongoDB nodes in replica setup.&lt;/li&gt;
	&lt;li&gt;Nodes will fail isSelf test and enter REMOVED state.&lt;/li&gt;
	&lt;li&gt;Add the relevant DNS entries in your network.&lt;/li&gt;
	&lt;li&gt;MongoDB nodes still remain in REMOVED state and does not retry isSelf test.&lt;/li&gt;
&lt;/ol&gt;
</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                    <customfieldvalue><![CDATA[eric.sedor@mongodb.com]]></customfieldvalue>
        <customfieldvalue><![CDATA[chris.kelly@mongodb.com]]></customfieldvalue>
    

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i0grfb:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>