<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 05:53:09 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-61723] Two primary nodes found in one replica set.</title>
                <link>https://jira.mongodb.org/browse/SERVER-61723</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;We have a replica set of 5 nodes.&lt;/p&gt;

&lt;p&gt;From the log, the primary node was handling some aggregation which caused the CPU utilization to 100% in a short time. And after 10 seconds of no-respond from primary, an election started and a new primary was elected. The result sent to the previous primary node, and the log showed the previous primary stepped down and changed the state to secondary. However, the state did not change due to an unknown reason, and when we use `rs.status()` command on any node in the cluster, we can find two primary nodes at the same time (although other 3 secondary nodes sync to the new primary)&lt;/p&gt;

&lt;p&gt;As a result, some users using PyMongo to connect to the cluster met with connection issues while some users did not. I guess it&apos;s because some users connected to the wrong primary node (the previous one)&lt;/p&gt;

&lt;p&gt;We tried to remove the previous primary and added it back, there would still be two primary nodes. We had to reboot the previous primary and added it back to the cluster, this time it turned to be rollback state, after several minutes, it became a secondary.&lt;/p&gt;</description>
                <environment></environment>
        <key id="1932604">SERVER-61723</key>
            <summary>Two primary nodes found in one replica set.</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="edwin.zhou@mongodb.com">Edwin Zhou</assignee>
                                    <reporter username="zijun.tian@tusimple.ai">Zijun Tian</reporter>
                        <labels>
                    </labels>
                <created>Wed, 24 Nov 2021 02:31:31 +0000</created>
                <updated>Fri, 10 Jun 2022 13:07:24 +0000</updated>
                            <resolved>Wed, 22 Dec 2021 16:58:33 +0000</resolved>
                                    <version>4.2.17</version>
                                                                        <votes>0</votes>
                                    <watches>2</watches>
                                                                                                                <comments>
                            <comment id="4264275" author="JIRAUSER1257066" created="Wed, 22 Dec 2021 16:58:33 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=zijun.tian%40tusimple.ai&quot; class=&quot;user-hover&quot; rel=&quot;zijun.tian@tusimple.ai&quot;&gt;zijun.tian@tusimple.ai&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;I haven&apos;t heard from you in a while so I will now close this ticket. Please let us know if you run into this issue again after attempting to profile the database on the latest version of MongoDB v4.2 and are able to collect stack traces.&lt;/p&gt;

&lt;p&gt;Best,&lt;br/&gt;
Edwin&lt;/p&gt;</comment>
                            <comment id="4232943" author="JIRAUSER1257066" created="Mon, 6 Dec 2021 18:20:35 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=zijun.tian%40tusimple.ai&quot; class=&quot;user-hover&quot; rel=&quot;zijun.tian@tusimple.ai&quot;&gt;zijun.tian@tusimple.ai&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Thank you for following up and for your effort in this investigation. Knowing that profiling was active during this time heavily narrows this behavior down to &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-59226&quot; title=&quot;Deadlock when stepping down with a profile session marked as uninterruptible&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-59226&quot;&gt;&lt;del&gt;SERVER-59226&lt;/del&gt;&lt;/a&gt;, but we will need stack traces to confirm. I will leave this on waiting for reporter while we await your collection of stack traces.&lt;/p&gt;

&lt;p&gt;Best,&lt;br/&gt;
Edwin&lt;/p&gt;</comment>
                            <comment id="4227524" author="JIRAUSER1269666" created="Thu, 2 Dec 2021 17:50:25 +0000"  >&lt;p&gt;Yes, we set the profiling level to 2 at the time. And I will collect the trace if it happens again.&lt;/p&gt;

&lt;p&gt;Thanks!&lt;/p&gt;</comment>
                            <comment id="4226990" author="JIRAUSER1257066" created="Thu, 2 Dec 2021 15:36:44 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=zijun.tian%40tusimple.ai&quot; class=&quot;user-hover&quot; rel=&quot;zijun.tian@tusimple.ai&quot;&gt;zijun.tian@tusimple.ai&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;In my initial look at this diagnostic data, we are indeed seeing nodes appearing as two primaries. There appears to be contention on the ReplicationStateTransitionLock on the node that is stepping down. It&apos;s possible that this is an occurrence of &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-59226&quot; title=&quot;Deadlock when stepping down with a profile session marked as uninterruptible&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-59226&quot;&gt;&lt;del&gt;SERVER-59226&lt;/del&gt;&lt;/a&gt; which causes contention on this lock during &lt;a href=&quot;https://docs.mongodb.com/manual/tutorial/manage-the-database-profiler/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;database profiling&lt;/a&gt;. This behavior is fixed in 4.2.18 and I recommend upgrading to the latest version of 4.2.x.&lt;/p&gt;

&lt;p&gt;Can you confirm whether you were profiling the database at this time? There may be a different behavior that exhibits this issue, but we need stack traces to confirm that this is the case.&lt;/p&gt;

&lt;p&gt;If you area able to reproduce this behavior, or if this behavior happens again, can you collect stack traces on the stalled nodes, that is, the primary that is stalled and is unable to step down.&lt;/p&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;gdb -p $(pidof mongod) -batch -ex &apos;thread apply all bt&apos; &amp;gt; gdb_`date +&quot;%Y-%m-%d_%H-%M-%S&quot;`.txt&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;Best,&lt;br/&gt;
Edwin&lt;/p&gt;</comment>
                            <comment id="4222539" author="JIRAUSER1257066" created="Tue, 30 Nov 2021 22:23:31 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=zijun.tian%40tusimple.ai&quot; class=&quot;user-hover&quot; rel=&quot;zijun.tian@tusimple.ai&quot;&gt;zijun.tian@tusimple.ai&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Thank you again for following up. I&apos;m confirming that I&apos;ve received your diagnostic data files.&lt;/p&gt;

&lt;p&gt;Best,&lt;br/&gt;
Edwin&lt;/p&gt;</comment>
                            <comment id="4222491" author="JIRAUSER1269666" created="Tue, 30 Nov 2021 22:06:14 +0000"  >&lt;p&gt;Hi Edwin,&lt;/p&gt;

&lt;p&gt;It seems like I only replace the file one. I have replaced two instances and uploaded them again. Please have a check, thanks!&lt;/p&gt;</comment>
                            <comment id="4222421" author="JIRAUSER1257066" created="Tue, 30 Nov 2021 21:45:57 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=zijun.tian%40tusimple.ai&quot; class=&quot;user-hover&quot; rel=&quot;zijun.tian@tusimple.ai&quot;&gt;zijun.tian@tusimple.ai&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;I apologize for the inconvenience; however, the data still isn&apos;t in the portal. Can you confirm that you&apos;re replacing the two instances of &lt;tt&gt;&amp;lt;filename&amp;gt;&lt;/tt&gt; in the curl command? One instance is in &lt;tt&gt;&amp;#45;F attributes&lt;/tt&gt; and the second instance is in &lt;tt&gt;&amp;#45;F file&lt;/tt&gt;.&lt;/p&gt;

&lt;p&gt;Thanks for your patience.&lt;/p&gt;

&lt;p&gt;Best,&lt;br/&gt;
Edwin&lt;/p&gt;</comment>
                            <comment id="4222391" author="JIRAUSER1269666" created="Tue, 30 Nov 2021 21:37:17 +0000"  >&lt;p&gt;Hi Edwin,&lt;/p&gt;

&lt;p&gt;I uploaded it again, it&apos;s a zip file called &quot;mongo.zip&quot; in size of 167MB.&lt;/p&gt;

&lt;p&gt;Can you confirm that?&lt;/p&gt;

&lt;p&gt;Thanks!&lt;/p&gt;</comment>
                            <comment id="4222376" author="JIRAUSER1257066" created="Tue, 30 Nov 2021 21:32:21 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=zijun.tian%40tusimple.ai&quot; class=&quot;user-hover&quot; rel=&quot;zijun.tian@tusimple.ai&quot;&gt;zijun.tian@tusimple.ai&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Thank you for following up. Unfortunately I don&apos;t see that the diagnostic data has been uploaded to the upload portal. Can you try again and confirm?&lt;/p&gt;

&lt;p&gt;Best,&lt;br/&gt;
Edwin&lt;/p&gt;</comment>
                            <comment id="4216259" author="JIRAUSER1269666" created="Tue, 30 Nov 2021 00:53:36 +0000"  >&lt;p&gt;Hi Edwin,&lt;/p&gt;

&lt;p&gt;I&apos;ve uploaded them.&lt;/p&gt;</comment>
                            <comment id="4215479" author="JIRAUSER1257066" created="Mon, 29 Nov 2021 19:19:08 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=zijun.tian%40tusimple.ai&quot; class=&quot;user-hover&quot; rel=&quot;zijun.tian@tusimple.ai&quot;&gt;zijun.tian@tusimple.ai&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Thank you for following up and I apologize for the confusion. The metrics files that you see are indeed the ftdc files I previously referred to. You may upload all of the log files and diagnostic.data directory for every node.&lt;/p&gt;

&lt;p&gt;Best,&lt;br/&gt;
Edwin&lt;/p&gt;</comment>
                            <comment id="4215451" author="JIRAUSER1269666" created="Mon, 29 Nov 2021 19:07:20 +0000"  >&lt;p&gt;Hi Edwin,&lt;/p&gt;

&lt;p&gt;I did not see any ftdc files under the&#160;diagnostic.data folder. The only file missing is &quot;metrcis.interim&quot;.&lt;/p&gt;

&lt;p&gt;Will it be ok that I just upload all log &amp;amp;&#160;diagnostic.data of the replica set of 5 nodes?&lt;/p&gt;</comment>
                            <comment id="4215433" author="JIRAUSER1257066" created="Mon, 29 Nov 2021 19:01:43 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=zijun.tian%40tusimple.ai&quot; class=&quot;user-hover&quot; rel=&quot;zijun.tian@tusimple.ai&quot;&gt;zijun.tian@tusimple.ai&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Thank you for uploading the mongod log file and the timestamp of the incident; however, it&apos;s unclear which node this log file is associated with. Can you please also upload the log files from the remaining nodes and the FTDC data from the &lt;tt&gt;$dbpath/diagnostic.data&lt;/tt&gt; directory (the contents are described &lt;a href=&quot;https://docs.mongodb.com/manual/administration/analyzing-mongodb-performance/#full-time-diagnostic-data-capture&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;here&lt;/a&gt;) for the entire replicaset? &lt;/p&gt;

&lt;p&gt;Best,&lt;br/&gt;
Edwin&lt;/p&gt;</comment>
                            <comment id="4215320" author="JIRAUSER1269666" created="Mon, 29 Nov 2021 18:18:16 +0000"  >&lt;p&gt;Hi @Edwin Zhou&lt;/p&gt;

&lt;p&gt;I uploaded the files as a zip file &quot;mongo.zip&quot;.&lt;/p&gt;

&lt;p&gt;The incident happened on Nov.23 21:21:00 (UTC).&lt;/p&gt;</comment>
                            <comment id="4214841" author="JIRAUSER1257066" created="Mon, 29 Nov 2021 15:54:17 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=zijun.tian%40tusimple.ai&quot; class=&quot;user-hover&quot; rel=&quot;zijun.tian@tusimple.ai&quot;&gt;zijun.tian@tusimple.ai&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Would you please archive (tar or zip) the mongod.log files and the &lt;tt&gt;$dbpath/diagnostic.data&lt;/tt&gt; directory (the contents are described &lt;a href=&quot;https://docs.mongodb.com/manual/administration/analyzing-mongodb-performance/#full-time-diagnostic-data-capture&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;here&lt;/a&gt;) and upload them to this &lt;a href=&quot;https://amphora.corp.mongodb.com/public/upload/eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJmb2xkZXJfaWQiOiIxNTExNDE3NTEwMDkiLCJleHAiOjE2NDA3OTMyMjh9.gTF-ZOgAXMeipZGU_Q7c_neO2LDUp_46Eqp4XjanpwA&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;support uploader&lt;/a&gt; location?&lt;/p&gt;

&lt;p&gt;Files uploaded to this portal are visible only to MongoDB employees and are routinely deleted after some time.&lt;/p&gt;

&lt;p&gt;Best,&lt;br/&gt;
Edwin&lt;/p&gt;</comment>
                            <comment id="4209027" author="JIRAUSER1269666" created="Wed, 24 Nov 2021 02:33:50 +0000"  >&lt;p&gt;TSMongo:PRIMARY&amp;gt; rs.status()&lt;br/&gt;
{&lt;br/&gt;
 &quot;set&quot; : &quot;TSMongo&quot;,&lt;br/&gt;
 &quot;date&quot; : ISODate(&quot;2021-11-23T21:32:50.146Z&quot;),&lt;br/&gt;
 &quot;myState&quot; : 1,&lt;br/&gt;
 &quot;term&quot; : NumberLong(321),&lt;br/&gt;
 &quot;syncingTo&quot; : &quot;&quot;,&lt;br/&gt;
 &quot;syncSourceHost&quot; : &quot;&quot;,&lt;br/&gt;
 &quot;syncSourceId&quot; : -1,&lt;br/&gt;
 &quot;heartbeatIntervalMillis&quot; : NumberLong(2000),&lt;br/&gt;
 &quot;majorityVoteCount&quot; : 3,&lt;br/&gt;
 &quot;writeMajorityCount&quot; : 3,&lt;br/&gt;
 &quot;optimes&quot; : {&lt;br/&gt;
 &quot;lastCommittedOpTime&quot; : &lt;/p&gt;
{
 &quot;ts&quot; : Timestamp(1637702498, 79),
 &quot;t&quot; : NumberLong(321)
 }
&lt;p&gt;,&lt;br/&gt;
 &quot;lastCommittedWallTime&quot; : ISODate(&quot;2021-11-23T21:21:38.754Z&quot;),&lt;br/&gt;
 &quot;readConcernMajorityOpTime&quot; : &lt;/p&gt;
{
 &quot;ts&quot; : Timestamp(1637702498, 79),
 &quot;t&quot; : NumberLong(321)
 }
&lt;p&gt;,&lt;br/&gt;
 &quot;readConcernMajorityWallTime&quot; : ISODate(&quot;2021-11-23T21:21:38.754Z&quot;),&lt;br/&gt;
 &quot;appliedOpTime&quot; : &lt;/p&gt;
{
 &quot;ts&quot; : Timestamp(1637702510, 3),
 &quot;t&quot; : NumberLong(321)
 }
&lt;p&gt;,&lt;br/&gt;
 &quot;durableOpTime&quot; : &lt;/p&gt;
{
 &quot;ts&quot; : Timestamp(1637702510, 3),
 &quot;t&quot; : NumberLong(321)
 }
&lt;p&gt;,&lt;br/&gt;
 &quot;lastAppliedWallTime&quot; : ISODate(&quot;2021-11-23T21:21:50.186Z&quot;),&lt;br/&gt;
 &quot;lastDurableWallTime&quot; : ISODate(&quot;2021-11-23T21:21:50.186Z&quot;)&lt;br/&gt;
 },&lt;br/&gt;
 &quot;lastStableRecoveryTimestamp&quot; : Timestamp(1637702498, 79),&lt;br/&gt;
 &quot;lastStableCheckpointTimestamp&quot; : Timestamp(1637702498, 79),&lt;br/&gt;
 &quot;electionCandidateMetrics&quot; : {&lt;br/&gt;
 &quot;lastElectionReason&quot; : &quot;priorityTakeover&quot;,&lt;br/&gt;
 &quot;lastElectionDate&quot; : ISODate(&quot;2021-10-14T22:12:06.781Z&quot;),&lt;br/&gt;
 &quot;electionTerm&quot; : NumberLong(321),&lt;br/&gt;
 &quot;lastCommittedOpTimeAtElection&quot; : &lt;/p&gt;
{
 &quot;ts&quot; : Timestamp(1634249526, 43),
 &quot;t&quot; : NumberLong(320)
 }
&lt;p&gt;,&lt;br/&gt;
 &quot;lastSeenOpTimeAtElection&quot; : &lt;/p&gt;
{
 &quot;ts&quot; : Timestamp(1634249526, 43),
 &quot;t&quot; : NumberLong(320)
 }
&lt;p&gt;,&lt;br/&gt;
 &quot;numVotesNeeded&quot; : 3,&lt;br/&gt;
 &quot;priorityAtElection&quot; : 14,&lt;br/&gt;
 &quot;electionTimeoutMillis&quot; : NumberLong(10000),&lt;br/&gt;
 &quot;priorPrimaryMemberId&quot; : 10,&lt;br/&gt;
 &quot;numCatchUpOps&quot; : NumberLong(0),&lt;br/&gt;
 &quot;newTermStartDate&quot; : ISODate(&quot;2021-10-14T22:12:07.346Z&quot;),&lt;br/&gt;
 &quot;wMajorityWriteAvailabilityDate&quot; : ISODate(&quot;2021-10-14T22:12:09.733Z&quot;)&lt;br/&gt;
 },&lt;br/&gt;
 &quot;electionParticipantMetrics&quot; : &lt;/p&gt;
{
 &quot;votedForCandidate&quot; : false,
 &quot;electionTerm&quot; : NumberLong(320),
 &quot;lastVoteDate&quot; : ISODate(&quot;2021-10-14T22:11:43.722Z&quot;),
 &quot;electionCandidateMemberId&quot; : 10,
 &quot;voteReason&quot; : &quot;candidate&apos;s data is staler than mine. candidate&apos;s last applied OpTime: \{ ts: Timestamp(1634249493, 27), t: 319 }
&lt;p&gt;, my last applied OpTime: { ts: Timestamp(1634249503, 26), t: 319 }&quot;,&lt;br/&gt;
 &quot;lastAppliedOpTimeAtElection&quot; : &lt;/p&gt;
{
 &quot;ts&quot; : Timestamp(1634249503, 26),
 &quot;t&quot; : NumberLong(319)
 }
&lt;p&gt;,&lt;br/&gt;
 &quot;maxAppliedOpTimeInSet&quot; : &lt;/p&gt;
{
 &quot;ts&quot; : Timestamp(1634249503, 26),
 &quot;t&quot; : NumberLong(319)
 }
&lt;p&gt;,&lt;br/&gt;
 &quot;priorityAtElection&quot; : 14&lt;br/&gt;
 },&lt;br/&gt;
 &quot;members&quot; : [&lt;br/&gt;
 {&lt;br/&gt;
 &quot;_id&quot; : 6,&lt;br/&gt;
 &quot;name&quot; : &quot;runner6.tuc.tusimple.ai:27017&quot;,&lt;br/&gt;
 &quot;health&quot; : 1,&lt;br/&gt;
 &quot;state&quot; : 2,&lt;br/&gt;
 &quot;stateStr&quot; : &quot;SECONDARY&quot;,&lt;br/&gt;
 &quot;uptime&quot; : 419865,&lt;br/&gt;
 &quot;optime&quot; : &lt;/p&gt;
{
 &quot;ts&quot; : Timestamp(1637702498, 79),
 &quot;t&quot; : NumberLong(321)
 }
&lt;p&gt;,&lt;br/&gt;
 &quot;optimeDurable&quot; : &lt;/p&gt;
{
 &quot;ts&quot; : Timestamp(1637702498, 79),
 &quot;t&quot; : NumberLong(321)
 }
&lt;p&gt;,&lt;br/&gt;
 &quot;optimeDate&quot; : ISODate(&quot;2021-11-23T21:21:38Z&quot;),&lt;br/&gt;
 &quot;optimeDurableDate&quot; : ISODate(&quot;2021-11-23T21:21:38Z&quot;),&lt;br/&gt;
 &quot;lastHeartbeat&quot; : ISODate(&quot;2021-11-23T21:32:48.158Z&quot;),&lt;br/&gt;
 &quot;lastHeartbeatRecv&quot; : ISODate(&quot;2021-11-23T21:32:49.326Z&quot;),&lt;br/&gt;
 &quot;pingMs&quot; : NumberLong(60),&lt;br/&gt;
 &quot;lastHeartbeatMessage&quot; : &quot;&quot;,&lt;br/&gt;
 &quot;syncingTo&quot; : &quot;172.30.76.235:27017&quot;,&lt;br/&gt;
 &quot;syncSourceHost&quot; : &quot;172.30.76.235:27017&quot;,&lt;br/&gt;
 &quot;syncSourceId&quot; : 10,&lt;br/&gt;
 &quot;infoMessage&quot; : &quot;&quot;,&lt;br/&gt;
 &quot;configVersion&quot; : 40&lt;br/&gt;
 },&lt;br/&gt;
 {&lt;br/&gt;
 &quot;_id&quot; : 8,&lt;br/&gt;
 &quot;name&quot; : &quot;172.30.73.20:27017&quot;,&lt;br/&gt;
 &quot;health&quot; : 1,&lt;br/&gt;
 &quot;state&quot; : 1,&lt;br/&gt;
 &quot;stateStr&quot; : &quot;PRIMARY&quot;,&lt;br/&gt;
 &quot;uptime&quot; : 11319935,&lt;br/&gt;
 &quot;optime&quot; : &lt;/p&gt;
{
 &quot;ts&quot; : Timestamp(1637702510, 3),
 &quot;t&quot; : NumberLong(321)
 }
&lt;p&gt;,&lt;br/&gt;
 &quot;optimeDate&quot; : ISODate(&quot;2021-11-23T21:21:50Z&quot;),&lt;br/&gt;
 &quot;syncingTo&quot; : &quot;&quot;,&lt;br/&gt;
 &quot;syncSourceHost&quot; : &quot;&quot;,&lt;br/&gt;
 &quot;syncSourceId&quot; : -1,&lt;br/&gt;
 &quot;infoMessage&quot; : &quot;&quot;,&lt;br/&gt;
 &quot;electionTime&quot; : Timestamp(1634249526, 44),&lt;br/&gt;
 &quot;electionDate&quot; : ISODate(&quot;2021-10-14T22:12:06Z&quot;),&lt;br/&gt;
 &quot;configVersion&quot; : 40,&lt;br/&gt;
 &quot;self&quot; : true,&lt;br/&gt;
 &quot;lastHeartbeatMessage&quot; : &quot;&quot;&lt;br/&gt;
 },&lt;br/&gt;
 {&lt;br/&gt;
 &quot;_id&quot; : 9,&lt;br/&gt;
 &quot;name&quot; : &quot;172.30.74.112:27017&quot;,&lt;br/&gt;
 &quot;health&quot; : 1,&lt;br/&gt;
 &quot;state&quot; : 2,&lt;br/&gt;
 &quot;stateStr&quot; : &quot;SECONDARY&quot;,&lt;br/&gt;
 &quot;uptime&quot; : 1614789,&lt;br/&gt;
 &quot;optime&quot; : &lt;/p&gt;
{
 &quot;ts&quot; : Timestamp(1637702498, 79),
 &quot;t&quot; : NumberLong(321)
 }
&lt;p&gt;,&lt;br/&gt;
 &quot;optimeDurable&quot; : &lt;/p&gt;
{
 &quot;ts&quot; : Timestamp(1637702498, 79),
 &quot;t&quot; : NumberLong(321)
 }
&lt;p&gt;,&lt;br/&gt;
 &quot;optimeDate&quot; : ISODate(&quot;2021-11-23T21:21:38Z&quot;),&lt;br/&gt;
 &quot;optimeDurableDate&quot; : ISODate(&quot;2021-11-23T21:21:38Z&quot;),&lt;br/&gt;
 &quot;lastHeartbeat&quot; : ISODate(&quot;2021-11-23T21:32:50.088Z&quot;),&lt;br/&gt;
 &quot;lastHeartbeatRecv&quot; : ISODate(&quot;2021-11-23T21:32:50.033Z&quot;),&lt;br/&gt;
 &quot;pingMs&quot; : NumberLong(0),&lt;br/&gt;
 &quot;lastHeartbeatMessage&quot; : &quot;&quot;,&lt;br/&gt;
 &quot;syncingTo&quot; : &quot;172.30.76.235:27017&quot;,&lt;br/&gt;
 &quot;syncSourceHost&quot; : &quot;172.30.76.235:27017&quot;,&lt;br/&gt;
 &quot;syncSourceId&quot; : 10,&lt;br/&gt;
 &quot;infoMessage&quot; : &quot;&quot;,&lt;br/&gt;
 &quot;configVersion&quot; : 40&lt;br/&gt;
 },&lt;br/&gt;
 {&lt;br/&gt;
 &quot;_id&quot; : 10,&lt;br/&gt;
 &quot;name&quot; : &quot;172.30.76.235:27017&quot;,&lt;br/&gt;
 &quot;health&quot; : 1,&lt;br/&gt;
 &quot;state&quot; : 1,&lt;br/&gt;
 &quot;stateStr&quot; : &quot;PRIMARY&quot;,&lt;br/&gt;
 &quot;uptime&quot; : 11319922,&lt;br/&gt;
 &quot;optime&quot; : &lt;/p&gt;
{
 &quot;ts&quot; : Timestamp(1637702498, 79),
 &quot;t&quot; : NumberLong(321)
 }
&lt;p&gt;,&lt;br/&gt;
 &quot;optimeDurable&quot; : &lt;/p&gt;
{
 &quot;ts&quot; : Timestamp(1637702498, 79),
 &quot;t&quot; : NumberLong(321)
 }
&lt;p&gt;,&lt;br/&gt;
 &quot;optimeDate&quot; : ISODate(&quot;2021-11-23T21:21:38Z&quot;),&lt;br/&gt;
 &quot;optimeDurableDate&quot; : ISODate(&quot;2021-11-23T21:21:38Z&quot;),&lt;br/&gt;
 &quot;lastHeartbeat&quot; : ISODate(&quot;2021-11-23T21:32:48.447Z&quot;),&lt;br/&gt;
 &quot;lastHeartbeatRecv&quot; : ISODate(&quot;2021-11-23T21:32:48.405Z&quot;),&lt;br/&gt;
 &quot;pingMs&quot; : NumberLong(0),&lt;br/&gt;
 &quot;lastHeartbeatMessage&quot; : &quot;&quot;,&lt;br/&gt;
 &quot;syncingTo&quot; : &quot;&quot;,&lt;br/&gt;
 &quot;syncSourceHost&quot; : &quot;&quot;,&lt;br/&gt;
 &quot;syncSourceId&quot; : -1,&lt;br/&gt;
 &quot;infoMessage&quot; : &quot;&quot;,&lt;br/&gt;
 &quot;electionTime&quot; : Timestamp(1637702509, 2),&lt;br/&gt;
 &quot;electionDate&quot; : ISODate(&quot;2021-11-23T21:21:49Z&quot;),&lt;br/&gt;
 &quot;configVersion&quot; : 40&lt;br/&gt;
 },&lt;br/&gt;
 {&lt;br/&gt;
 &quot;_id&quot; : 11,&lt;br/&gt;
 &quot;name&quot; : &quot;runner39.sm.tusimple.ai:27017&quot;,&lt;br/&gt;
 &quot;health&quot; : 1,&lt;br/&gt;
 &quot;state&quot; : 2,&lt;br/&gt;
 &quot;stateStr&quot; : &quot;SECONDARY&quot;,&lt;br/&gt;
 &quot;uptime&quot; : 938547,&lt;br/&gt;
 &quot;optime&quot; : &lt;/p&gt;
{
 &quot;ts&quot; : Timestamp(1637702498, 79),
 &quot;t&quot; : NumberLong(321)
 }
&lt;p&gt;,&lt;br/&gt;
 &quot;optimeDurable&quot; : &lt;/p&gt;
{
 &quot;ts&quot; : Timestamp(1637702498, 79),
 &quot;t&quot; : NumberLong(321)
 }
&lt;p&gt;,&lt;br/&gt;
 &quot;optimeDate&quot; : ISODate(&quot;2021-11-23T21:21:38Z&quot;),&lt;br/&gt;
 &quot;optimeDurableDate&quot; : ISODate(&quot;2021-11-23T21:21:38Z&quot;),&lt;br/&gt;
 &quot;lastHeartbeat&quot; : ISODate(&quot;2021-11-23T21:32:50.146Z&quot;),&lt;br/&gt;
 &quot;lastHeartbeatRecv&quot; : ISODate(&quot;2021-11-23T21:32:49.842Z&quot;),&lt;br/&gt;
 &quot;pingMs&quot; : NumberLong(50),&lt;br/&gt;
 &quot;lastHeartbeatMessage&quot; : &quot;&quot;,&lt;br/&gt;
 &quot;syncingTo&quot; : &quot;runner6.tuc.tusimple.ai:27017&quot;,&lt;br/&gt;
 &quot;syncSourceHost&quot; : &quot;runner6.tuc.tusimple.ai:27017&quot;,&lt;br/&gt;
 &quot;syncSourceId&quot; : 6,&lt;br/&gt;
 &quot;infoMessage&quot; : &quot;&quot;,&lt;br/&gt;
 &quot;configVersion&quot; : 40&lt;br/&gt;
 }&lt;br/&gt;
 ],&lt;br/&gt;
 &quot;ok&quot; : 1,&lt;br/&gt;
 &quot;$clusterTime&quot; : {&lt;br/&gt;
 &quot;clusterTime&quot; : Timestamp(1637702510, 3),&lt;br/&gt;
 &quot;signature&quot; : &lt;/p&gt;
{
 &quot;hash&quot; : BinData(0,&quot;SNiJ0h81Pke0Q0fobM3KxmpXbR8=&quot;),
 &quot;keyId&quot; : NumberLong(&quot;7019048177479188481&quot;)
 }
&lt;p&gt; },&lt;br/&gt;
 &quot;operationTime&quot; : Timestamp(1637702510, 3)&lt;br/&gt;
}&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>16.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Mon, 29 Nov 2021 15:54:17 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        2 years, 7 weeks ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>luke.bonanomi@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            2 years, 7 weeks ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>edwin.zhou@mongodb.com</customfieldvalue>
            <customfieldvalue>zijun.tian@tusimple.ai</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i0bik7:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hzuvd3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                    <customfieldvalue><![CDATA[edwin.zhou@mongodb.com]]></customfieldvalue>
    

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i0b4pj:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>