<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:01:30 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-2899] Replicaset nodes doesn&apos;t reconnect after being down while rs.status() on the last started node shows all servers as being up</title>
                <link>https://jira.mongodb.org/browse/SERVER-2899</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;I&apos;m testing a replicaset with four mongodb 1.8.1-rc1 with each running in its own jail in FreeBSD 8.2.&lt;/p&gt;

&lt;p&gt;If I shutdown (a clean kill) one primary (a.k.a. mongo1) and one secondary (a.k.a. mongo2), the other two secondaries (a.k.a. mongo3 &amp;amp; mongo4) stays running and notices that the other two went away as they should.&lt;br/&gt;
After restarting the mongo2 server it gets voted to become a primary. All seems to be well (we know mongo1 is still down) when you check rs.status() from mongo2:&lt;/p&gt;

&lt;p&gt;DuegoWeb:PRIMARY&amp;gt; rs.status()&lt;br/&gt;
{&lt;br/&gt;
	&quot;set&quot; : &quot;DuegoWeb&quot;,&lt;br/&gt;
	&quot;date&quot; : ISODate(&quot;2011-04-05T08:31:11Z&quot;),&lt;br/&gt;
	&quot;myState&quot; : 1,&lt;br/&gt;
	&quot;members&quot; : [&lt;br/&gt;
		{&lt;br/&gt;
			&quot;_id&quot; : 0,&lt;br/&gt;
			&quot;name&quot; : &quot;mongo1.lan&quot;,&lt;br/&gt;
			&quot;health&quot; : 0,&lt;br/&gt;
			&quot;state&quot; : 6,&lt;br/&gt;
			&quot;stateStr&quot; : &quot;(not reachable/healthy)&quot;,&lt;br/&gt;
			&quot;uptime&quot; : 0,&lt;br/&gt;
			&quot;optime&quot; : &lt;/p&gt;
{
				&quot;t&quot; : 0,
				&quot;i&quot; : 0
			}
&lt;p&gt;,&lt;br/&gt;
			&quot;optimeDate&quot; : ISODate(&quot;1970-01-01T00:00:00Z&quot;),&lt;br/&gt;
			&quot;lastHeartbeat&quot; : ISODate(&quot;2011-04-05T08:31:11Z&quot;),&lt;br/&gt;
			&quot;errmsg&quot; : &quot;not running with --replSet&quot;&lt;br/&gt;
		},&lt;br/&gt;
		{&lt;br/&gt;
			&quot;_id&quot; : 1,&lt;br/&gt;
			&quot;name&quot; : &quot;mongo2.lan&quot;,&lt;br/&gt;
			&quot;health&quot; : 1,&lt;br/&gt;
			&quot;state&quot; : 1,&lt;br/&gt;
			&quot;stateStr&quot; : &quot;PRIMARY&quot;,&lt;br/&gt;
			&quot;optime&quot; : &lt;/p&gt;
{
				&quot;t&quot; : 1301991284000,
				&quot;i&quot; : 1
			}
&lt;p&gt;,&lt;br/&gt;
			&quot;optimeDate&quot; : ISODate(&quot;2011-04-05T08:14:44Z&quot;),&lt;br/&gt;
			&quot;self&quot; : true&lt;br/&gt;
		},&lt;br/&gt;
		{&lt;br/&gt;
			&quot;_id&quot; : 2,&lt;br/&gt;
			&quot;name&quot; : &quot;mongo3.lan&quot;,&lt;br/&gt;
			&quot;health&quot; : 1,&lt;br/&gt;
			&quot;state&quot; : 2,&lt;br/&gt;
			&quot;stateStr&quot; : &quot;SECONDARY&quot;,&lt;br/&gt;
			&quot;uptime&quot; : 1485,&lt;br/&gt;
			&quot;optime&quot; : &lt;/p&gt;
{
				&quot;t&quot; : 1301930804000,
				&quot;i&quot; : 1
			}
&lt;p&gt;,&lt;br/&gt;
			&quot;optimeDate&quot; : ISODate(&quot;2011-04-04T15:26:44Z&quot;),&lt;br/&gt;
			&quot;lastHeartbeat&quot; : ISODate(&quot;2011-04-05T08:31:11Z&quot;)&lt;br/&gt;
		},&lt;br/&gt;
		{&lt;br/&gt;
			&quot;_id&quot; : 3,&lt;br/&gt;
			&quot;name&quot; : &quot;mongo4.lan&quot;,&lt;br/&gt;
			&quot;health&quot; : 1,&lt;br/&gt;
			&quot;state&quot; : 2,&lt;br/&gt;
			&quot;stateStr&quot; : &quot;SECONDARY&quot;,&lt;br/&gt;
			&quot;uptime&quot; : 1485,&lt;br/&gt;
			&quot;optime&quot; : &lt;/p&gt;
{
				&quot;t&quot; : 1301930804000,
				&quot;i&quot; : 1
			}
&lt;p&gt;,&lt;br/&gt;
			&quot;optimeDate&quot; : ISODate(&quot;2011-04-04T15:26:44Z&quot;),&lt;br/&gt;
			&quot;lastHeartbeat&quot; : ISODate(&quot;2011-04-05T08:31:11Z&quot;)&lt;br/&gt;
		}&lt;br/&gt;
	],&lt;br/&gt;
	&quot;ok&quot; : 1&lt;br/&gt;
}&lt;/p&gt;

&lt;p&gt;However if we move to mongo3 and also run the rs.status() it says mongo2 isn&apos;t available:&lt;br/&gt;
		{&lt;br/&gt;
			&quot;_id&quot; : 1,&lt;br/&gt;
			&quot;name&quot; : &quot;mongo2.lan&quot;,&lt;br/&gt;
			&quot;health&quot; : 0,&lt;br/&gt;
			&quot;state&quot; : 2,&lt;br/&gt;
			&quot;stateStr&quot; : &quot;(not reachable/healthy)&quot;,&lt;br/&gt;
			&quot;uptime&quot; : 0,&lt;br/&gt;
			&quot;optime&quot; : &lt;/p&gt;
{
				&quot;t&quot; : 1301930804000,
				&quot;i&quot; : 1
			}
&lt;p&gt;,&lt;br/&gt;
			&quot;optimeDate&quot; : ISODate(&quot;2011-04-04T15:26:44Z&quot;),&lt;br/&gt;
			&quot;lastHeartbeat&quot; : ISODate(&quot;2011-04-05T08:30:33Z&quot;),&lt;br/&gt;
			&quot;errmsg&quot; : &quot;not running with --replSet&quot;&lt;br/&gt;
		},&lt;/p&gt;


&lt;p&gt;I find this confusing that the status() on mongo2 can say that mongo3 is ok, but not vice versa.&lt;/p&gt;

&lt;p&gt;If we then also start up mongo1, the rs.status() on this server says all servers are ok while mongo2 still doesn&apos;t show mongo1 as being up:&lt;br/&gt;
DuegoWeb:SECONDARY&amp;gt; rs.status()&lt;br/&gt;
{&lt;br/&gt;
	&quot;set&quot; : &quot;DuegoWeb&quot;,&lt;br/&gt;
	&quot;date&quot; : ISODate(&quot;2011-04-05T08:31:30Z&quot;),&lt;br/&gt;
	&quot;myState&quot; : 2,&lt;br/&gt;
	&quot;members&quot; : [&lt;br/&gt;
		{&lt;br/&gt;
			&quot;_id&quot; : 0,&lt;br/&gt;
			&quot;name&quot; : &quot;mongo1.lan&quot;,&lt;br/&gt;
			&quot;health&quot; : 1,&lt;br/&gt;
			&quot;state&quot; : 2,&lt;br/&gt;
			&quot;stateStr&quot; : &quot;SECONDARY&quot;,&lt;br/&gt;
			&quot;optime&quot; : &lt;/p&gt;
{
				&quot;t&quot; : 1301991284000,
				&quot;i&quot; : 1
			}
&lt;p&gt;,&lt;br/&gt;
			&quot;optimeDate&quot; : ISODate(&quot;2011-04-05T08:14:44Z&quot;),&lt;br/&gt;
			&quot;self&quot; : true&lt;br/&gt;
		},&lt;br/&gt;
		{&lt;br/&gt;
			&quot;_id&quot; : 1,&lt;br/&gt;
			&quot;name&quot; : &quot;mongo2.lan&quot;,&lt;br/&gt;
			&quot;health&quot; : 1,&lt;br/&gt;
			&quot;state&quot; : 1,&lt;br/&gt;
			&quot;stateStr&quot; : &quot;PRIMARY&quot;,&lt;br/&gt;
			&quot;uptime&quot; : 64,&lt;br/&gt;
			&quot;optime&quot; : &lt;/p&gt;
{
				&quot;t&quot; : 1301991284000,
				&quot;i&quot; : 1
			}
&lt;p&gt;,&lt;br/&gt;
			&quot;optimeDate&quot; : ISODate(&quot;2011-04-05T08:14:44Z&quot;),&lt;br/&gt;
			&quot;lastHeartbeat&quot; : ISODate(&quot;2011-04-05T08:31:28Z&quot;)&lt;br/&gt;
		},&lt;br/&gt;
		{&lt;br/&gt;
			&quot;_id&quot; : 2,&lt;br/&gt;
			&quot;name&quot; : &quot;mongo3.lan&quot;,&lt;br/&gt;
			&quot;health&quot; : 1,&lt;br/&gt;
			&quot;state&quot; : 2,&lt;br/&gt;
			&quot;stateStr&quot; : &quot;SECONDARY&quot;,&lt;br/&gt;
			&quot;uptime&quot; : 64,&lt;br/&gt;
			&quot;optime&quot; : &lt;/p&gt;
{
				&quot;t&quot; : 1301930804000,
				&quot;i&quot; : 1
			}
&lt;p&gt;,&lt;br/&gt;
			&quot;optimeDate&quot; : ISODate(&quot;2011-04-04T15:26:44Z&quot;),&lt;br/&gt;
			&quot;lastHeartbeat&quot; : ISODate(&quot;2011-04-05T08:31:28Z&quot;)&lt;br/&gt;
		},&lt;br/&gt;
		{&lt;br/&gt;
			&quot;_id&quot; : 3,&lt;br/&gt;
			&quot;name&quot; : &quot;mongo4.lan&quot;,&lt;br/&gt;
			&quot;health&quot; : 1,&lt;br/&gt;
			&quot;state&quot; : 2,&lt;br/&gt;
			&quot;stateStr&quot; : &quot;SECONDARY&quot;,&lt;br/&gt;
			&quot;uptime&quot; : 64,&lt;br/&gt;
			&quot;optime&quot; : &lt;/p&gt;
{
				&quot;t&quot; : 1301930804000,
				&quot;i&quot; : 1
			}
&lt;p&gt;,&lt;br/&gt;
			&quot;optimeDate&quot; : ISODate(&quot;2011-04-04T15:26:44Z&quot;),&lt;br/&gt;
			&quot;lastHeartbeat&quot; : ISODate(&quot;2011-04-05T08:31:28Z&quot;)&lt;br/&gt;
		}&lt;br/&gt;
	],&lt;br/&gt;
	&quot;ok&quot; : 1&lt;br/&gt;
}&lt;/p&gt;

&lt;p&gt;The same rs.status() is still shown on mongo2 and mongo3 just like before mongo1 was started again.&lt;br/&gt;
Inserting data on mongo2 doesn&apos;t get replicated to mongo3, even when it says its ok and even when mongo3 seem to have been participating in voting on mongo2 for becoming the new primary.&lt;/p&gt;

&lt;p&gt;Sorry if my example is badly explained.&lt;/p&gt;

&lt;p&gt;I&apos;ll attach logs and all rs statuses, the order is:&lt;/p&gt;
&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;start mongo1, mongo2, mongo3, mongo4&lt;/li&gt;
	&lt;li&gt;setup replicaset, check that it replicates and everything works fine, mongo1 is the primary&lt;/li&gt;
	&lt;li&gt;kill mongo1 and mongo2&lt;/li&gt;
	&lt;li&gt;mongo3 and mongo4 stays as secondaries as there are no majority&lt;/li&gt;
	&lt;li&gt;start mongo2&lt;/li&gt;
	&lt;li&gt;mongo2 gets elected as the new primary&lt;/li&gt;
	&lt;li&gt;rs.status() between mongo2 and mongo3 isn&apos;t equal. Inserting data on mongo2 doesn&apos;t show on mongo3&lt;/li&gt;
	&lt;li&gt;start mongo1&lt;/li&gt;
	&lt;li&gt;mongo1 says all servers are ok, mongo2 and mongo3 still shows the same status as before&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;The logs on mongo1 are +2 hours, I corrected the time on this machine later with the same results&lt;br/&gt;
I should also add that the replicaset is specified in a config file like this:&lt;br/&gt;
Mongo1:&lt;br/&gt;
  replSet=DuegoWeb&lt;br/&gt;
  journal=true&lt;br/&gt;
Mongo2:&lt;br/&gt;
  replSet=DuegoWeb/mongo1.lan,mongo2.lan&lt;br/&gt;
Mongo3:&lt;br/&gt;
  replSet=DuegoWeb/mongo3.lan,mongo1.lan&lt;br/&gt;
Mongo4:&lt;br/&gt;
  replSet=DuegoWeb/mongo4.lan,mongo1.lan&lt;/p&gt;


&lt;p&gt;Everything works and gets in sync as long as I restart the mongodb servers manually, but they never reconnect automatically&lt;/p&gt;</description>
                <environment>FreeBSD 8.2 jail</environment>
        <key id="15469">SERVER-2899</key>
            <summary>Replicaset nodes doesn&apos;t reconnect after being down while rs.status() on the last started node shows all servers as being up</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="3">Duplicate</resolution>
                                        <assignee username="kristina">Kristina Chodorow</assignee>
                                    <reporter username="balboah">Johnny Boy</reporter>
                        <labels>
                    </labels>
                <created>Tue, 5 Apr 2011 09:14:02 +0000</created>
                <updated>Wed, 4 Feb 2015 20:19:43 +0000</updated>
                            <resolved>Fri, 28 Oct 2011 20:55:33 +0000</resolved>
                                    <version>1.8.1</version>
                                                    <component>Replication</component>
                                        <votes>0</votes>
                                    <watches>2</watches>
                                                                                                                <comments>
                            <comment id="63435" author="kristina" created="Fri, 28 Oct 2011 20:55:33 +0000"  >&lt;p&gt;This should be fixed by &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-3715&quot; title=&quot;re-adding member to replica set without keyFile results in secondary node&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-3715&quot;&gt;&lt;del&gt;SERVER-3715&lt;/del&gt;&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="61438" author="kristina" created="Wed, 19 Oct 2011 17:28:37 +0000"  >&lt;p&gt;If you&apos;re still having problems with this, can you try the latest Development Release (Unstable) version from &lt;a href=&quot;http://www.mongodb.org/downloads?&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://www.mongodb.org/downloads?&lt;/a&gt;  I recently added some code that should make heartbeat reconnection much more aggressive.&lt;/p&gt;</comment>
                            <comment id="27936" author="balboah" created="Wed, 6 Apr 2011 09:26:49 +0000"  >&lt;p&gt;Ok here is run #2&lt;br/&gt;
I&apos;ve left mongo4 out this time, so don&apos;t bother it being down in the logs.&lt;/p&gt;

&lt;p&gt;This time I only started the 3 servers, but mongo3 which was elected as a primary never showed up as being ok in rs.status() from mongo1 and mongo2 while mongo3 did see 1 and 2 as being ok.&lt;br/&gt;
Only when restarting mongo1 and mongo2 did everything show up as ok and only then did they replicate from mongo3.&lt;/p&gt;

&lt;p&gt;I&apos;m new to replication sets but this behavior seem really odd to me and in my mind they should try to reconnect by themselves without me having to restart them manually.&lt;/p&gt;

&lt;p&gt;Attached is the full logs from mongo1, 2 and 3&lt;/p&gt;

&lt;p&gt;This is what rs.status() shows in mongo1 (and equivalent in mongo2) before restarting them:&lt;/p&gt;

&lt;p&gt;DuegoWeb:SECONDARY&amp;gt; rs.status()&lt;br/&gt;
{&lt;br/&gt;
	&quot;set&quot; : &quot;DuegoWeb&quot;,&lt;br/&gt;
	&quot;date&quot; : ISODate(&quot;2011-04-06T09:20:37Z&quot;),&lt;br/&gt;
	&quot;myState&quot; : 2,&lt;br/&gt;
	&quot;members&quot; : [&lt;br/&gt;
		{&lt;br/&gt;
			&quot;_id&quot; : 0,&lt;br/&gt;
			&quot;name&quot; : &quot;mongo1.lan&quot;,&lt;br/&gt;
			&quot;health&quot; : 1,&lt;br/&gt;
			&quot;state&quot; : 2,&lt;br/&gt;
			&quot;stateStr&quot; : &quot;SECONDARY&quot;,&lt;br/&gt;
			&quot;optime&quot; : &lt;/p&gt;
{
				&quot;t&quot; : 1302002256000,
				&quot;i&quot; : 2
			}
&lt;p&gt;,&lt;br/&gt;
			&quot;optimeDate&quot; : ISODate(&quot;2011-04-05T11:17:36Z&quot;),&lt;br/&gt;
			&quot;self&quot; : true&lt;br/&gt;
		},&lt;br/&gt;
		{&lt;br/&gt;
			&quot;_id&quot; : 1,&lt;br/&gt;
			&quot;name&quot; : &quot;mongo2.lan&quot;,&lt;br/&gt;
			&quot;health&quot; : 0,&lt;br/&gt;
			&quot;state&quot; : 6,&lt;br/&gt;
			&quot;stateStr&quot; : &quot;(not reachable/healthy)&quot;,&lt;br/&gt;
			&quot;uptime&quot; : 0,&lt;br/&gt;
			&quot;optime&quot; : &lt;/p&gt;
{
				&quot;t&quot; : 0,
				&quot;i&quot; : 0
			}
&lt;p&gt;,&lt;br/&gt;
			&quot;optimeDate&quot; : ISODate(&quot;1970-01-01T00:00:00Z&quot;),&lt;br/&gt;
			&quot;lastHeartbeat&quot; : ISODate(&quot;2011-04-06T09:20:37Z&quot;),&lt;br/&gt;
			&quot;errmsg&quot; : &quot;not running with --replSet&quot;&lt;br/&gt;
		},&lt;br/&gt;
		{&lt;br/&gt;
			&quot;_id&quot; : 2,&lt;br/&gt;
			&quot;name&quot; : &quot;mongo3.lan&quot;,&lt;br/&gt;
			&quot;health&quot; : 0,&lt;br/&gt;
			&quot;state&quot; : 6,&lt;br/&gt;
			&quot;stateStr&quot; : &quot;(not reachable/healthy)&quot;,&lt;br/&gt;
			&quot;uptime&quot; : 0,&lt;br/&gt;
			&quot;optime&quot; : &lt;/p&gt;
{
				&quot;t&quot; : 0,
				&quot;i&quot; : 0
			}
&lt;p&gt;,&lt;br/&gt;
			&quot;optimeDate&quot; : ISODate(&quot;1970-01-01T00:00:00Z&quot;),&lt;br/&gt;
			&quot;lastHeartbeat&quot; : ISODate(&quot;2011-04-06T09:20:37Z&quot;),&lt;br/&gt;
			&quot;errmsg&quot; : &quot;not running with --replSet&quot;&lt;br/&gt;
		},&lt;br/&gt;
		{&lt;br/&gt;
			&quot;_id&quot; : 3,&lt;br/&gt;
			&quot;name&quot; : &quot;mongo4.lan&quot;,&lt;br/&gt;
			&quot;health&quot; : 0,&lt;br/&gt;
			&quot;state&quot; : 6,&lt;br/&gt;
			&quot;stateStr&quot; : &quot;(not reachable/healthy)&quot;,&lt;br/&gt;
			&quot;uptime&quot; : 0,&lt;br/&gt;
			&quot;optime&quot; : &lt;/p&gt;
{
				&quot;t&quot; : 0,
				&quot;i&quot; : 0
			}
&lt;p&gt;,&lt;br/&gt;
			&quot;optimeDate&quot; : ISODate(&quot;1970-01-01T00:00:00Z&quot;),&lt;br/&gt;
			&quot;lastHeartbeat&quot; : ISODate(&quot;2011-04-06T09:20:37Z&quot;),&lt;br/&gt;
			&quot;errmsg&quot; : &quot;not running with --replSet&quot;&lt;br/&gt;
		}&lt;br/&gt;
	],&lt;br/&gt;
	&quot;ok&quot; : 1&lt;br/&gt;
}&lt;/p&gt;


&lt;p&gt;and this is after restarting:&lt;/p&gt;

&lt;p&gt;DuegoWeb:SECONDARY&amp;gt; rs.status()&lt;br/&gt;
{&lt;br/&gt;
	&quot;set&quot; : &quot;DuegoWeb&quot;,&lt;br/&gt;
	&quot;date&quot; : ISODate(&quot;2011-04-06T09:20:59Z&quot;),&lt;br/&gt;
	&quot;myState&quot; : 2,&lt;br/&gt;
	&quot;members&quot; : [&lt;br/&gt;
		{&lt;br/&gt;
			&quot;_id&quot; : 0,&lt;br/&gt;
			&quot;name&quot; : &quot;mongo1.lan&quot;,&lt;br/&gt;
			&quot;health&quot; : 1,&lt;br/&gt;
			&quot;state&quot; : 2,&lt;br/&gt;
			&quot;stateStr&quot; : &quot;SECONDARY&quot;,&lt;br/&gt;
			&quot;optime&quot; : &lt;/p&gt;
{
				&quot;t&quot; : 1302081483000,
				&quot;i&quot; : 1
			}
&lt;p&gt;,&lt;br/&gt;
			&quot;optimeDate&quot; : ISODate(&quot;2011-04-06T09:18:03Z&quot;),&lt;br/&gt;
			&quot;self&quot; : true&lt;br/&gt;
		},&lt;br/&gt;
		{&lt;br/&gt;
			&quot;_id&quot; : 1,&lt;br/&gt;
			&quot;name&quot; : &quot;mongo2.lan&quot;,&lt;br/&gt;
			&quot;health&quot; : 1,&lt;br/&gt;
			&quot;state&quot; : 2,&lt;br/&gt;
			&quot;stateStr&quot; : &quot;SECONDARY&quot;,&lt;br/&gt;
			&quot;uptime&quot; : 2,&lt;br/&gt;
			&quot;optime&quot; : &lt;/p&gt;
{
				&quot;t&quot; : 1302081483000,
				&quot;i&quot; : 1
			}
&lt;p&gt;,&lt;br/&gt;
			&quot;optimeDate&quot; : ISODate(&quot;2011-04-06T09:18:03Z&quot;),&lt;br/&gt;
			&quot;lastHeartbeat&quot; : ISODate(&quot;2011-04-06T09:20:57Z&quot;)&lt;br/&gt;
		},&lt;br/&gt;
		{&lt;br/&gt;
			&quot;_id&quot; : 2,&lt;br/&gt;
			&quot;name&quot; : &quot;mongo3.lan&quot;,&lt;br/&gt;
			&quot;health&quot; : 1,&lt;br/&gt;
			&quot;state&quot; : 1,&lt;br/&gt;
			&quot;stateStr&quot; : &quot;PRIMARY&quot;,&lt;br/&gt;
			&quot;uptime&quot; : 8,&lt;br/&gt;
			&quot;optime&quot; : &lt;/p&gt;
{
				&quot;t&quot; : 1302081483000,
				&quot;i&quot; : 1
			}
&lt;p&gt;,&lt;br/&gt;
			&quot;optimeDate&quot; : ISODate(&quot;2011-04-06T09:18:03Z&quot;),&lt;br/&gt;
			&quot;lastHeartbeat&quot; : ISODate(&quot;2011-04-06T09:20:57Z&quot;)&lt;br/&gt;
		},&lt;br/&gt;
		{&lt;br/&gt;
			&quot;_id&quot; : 3,&lt;br/&gt;
			&quot;name&quot; : &quot;mongo4.lan&quot;,&lt;br/&gt;
			&quot;health&quot; : 0,&lt;br/&gt;
			&quot;state&quot; : 6,&lt;br/&gt;
			&quot;stateStr&quot; : &quot;(not reachable/healthy)&quot;,&lt;br/&gt;
			&quot;uptime&quot; : 0,&lt;br/&gt;
			&quot;optime&quot; : &lt;/p&gt;
{
				&quot;t&quot; : 0,
				&quot;i&quot; : 0
			}
&lt;p&gt;,&lt;br/&gt;
			&quot;optimeDate&quot; : ISODate(&quot;1970-01-01T00:00:00Z&quot;),&lt;br/&gt;
			&quot;lastHeartbeat&quot; : ISODate(&quot;2011-04-06T09:20:57Z&quot;),&lt;br/&gt;
			&quot;errmsg&quot; : &quot;not running with --replSet&quot;&lt;br/&gt;
		}&lt;br/&gt;
	],&lt;br/&gt;
	&quot;ok&quot; : 1&lt;br/&gt;
}&lt;/p&gt;


&lt;p&gt;Also the ip adresses to help with the logs:&lt;br/&gt;
mongo1.lan = 10.101.5.1&lt;br/&gt;
mongo2.lan = 10.101.5.2&lt;br/&gt;
mongo3.lan = 10.101.5.3&lt;/p&gt;</comment>
                            <comment id="27822" author="kristina" created="Tue, 5 Apr 2011 15:01:24 +0000"  >&lt;p&gt;Great, thanks.&lt;/p&gt;</comment>
                            <comment id="27820" author="balboah" created="Tue, 5 Apr 2011 14:40:15 +0000"  >&lt;p&gt;Sure thing, I&apos;ll run it again a little later and try to save as much as possible. &lt;br/&gt;
I could probably leave mongo4 out as well&lt;/p&gt;</comment>
                            <comment id="27816" author="kristina" created="Tue, 5 Apr 2011 14:32:07 +0000"  >&lt;p&gt;It is difficult for me to decipher what is happening with the mongo1 logs from a different time (and the mongo4 logs are missing).  Could you run the experiment again (with -vvvvv, if possible) and zip up the logs again?  Please send the whole logs, not just the relevant subsections.  I&apos;d rather have a billion extra log lines than miss something important at the edges!&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                            <attachment id="11246" name="replicaset.tgz" size="24282" author="balboah" created="Wed, 6 Apr 2011 09:26:49 +0000"/>
                            <attachment id="11237" name="replicaset.tgz" size="3206" author="balboah" created="Tue, 5 Apr 2011 09:14:02 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>6.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Tue, 5 Apr 2011 14:32:07 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        12 years, 16 weeks, 5 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            12 years, 16 weeks, 5 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10024"><![CDATA[FreeBSD]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>balboah</customfieldvalue>
            <customfieldvalue>kristina</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrp1xr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hrieq7:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>21038</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrlg2f:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>