<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 05:12:55 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-46964] Test locally that we eliminate retries of short-running reads due to planned secondary shutdown (with streamable isMaster)</title>
                <link>https://jira.mongodb.org/browse/SERVER-46964</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Test the secondary read workload created in&#160;&lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-46963&quot; title=&quot;Test locally that we eliminate retries of short-running reads due to planned secondary shutdown (without streamable isMaster)&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-46963&quot;&gt;&lt;del&gt;SERVER-46963&lt;/del&gt;&lt;/a&gt; with the latest version of pymongo.&lt;/p&gt;</description>
                <environment></environment>
        <key id="1280854">SERVER-46964</key>
            <summary>Test locally that we eliminate retries of short-running reads due to planned secondary shutdown (with streamable isMaster)</summary>
                <type id="3" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14718&amp;avatarType=issuetype">Task</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="jason.chan@mongodb.com">Jason Chan</assignee>
                                    <reporter username="tess.avitabile@mongodb.com">Tess Avitabile</reporter>
                        <labels>
                    </labels>
                <created>Wed, 18 Mar 2020 19:56:05 +0000</created>
                <updated>Thu, 21 May 2020 16:21:20 +0000</updated>
                            <resolved>Thu, 21 May 2020 16:21:19 +0000</resolved>
                                                                    <component>Replication</component>
                                        <votes>0</votes>
                                    <watches>1</watches>
                                                                                                                <comments>
                            <comment id="3098485" author="jason.chan" created="Wed, 20 May 2020 22:18:26 +0000"  >&lt;p&gt;An additional test case we wanted to observe:&lt;/p&gt;

&lt;p&gt;The secondary node S goes into quiesce mode while a read is still in progress. S will return a ShutdownInProgress error as an isMaster response to the driver. The find should proceed to complete and return to the driver without raising an error even if the driver has already marked S as unknown.&lt;/p&gt;

&lt;p&gt;We can see the following by increasing the log verbosity for the command component and setting the appropriate failpoints:&lt;/p&gt;

&lt;p&gt;Set a failpoint to hang during the find command on secondary node d20021:&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_streamable_ismaster] 2020-05-20T21:45:38.743+0000 d20021| 2020-05-20T21:45:38.743+00:00 W&#160; CONTROL&#160; 23829 &#160; [conn1] &quot;Set failpoint&quot;,&quot;attr&quot;:{&quot;failPointName&quot;:&quot;waitInFindBeforeMakingBatch&quot;,&quot;failPoint&quot;:{&quot;mode&quot;:1,&quot;data&quot;:{},&quot;timesEntered&quot;:0}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;
&lt;p&gt;Set a failpoint to hang while in quiesce mode on node d20021:&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_streamable_ismaster] 2020-05-20T21:45:38.845+0000 d20021| 2020-05-20T21:45:38.845+00:00 W&#160; CONTROL&#160; 23829 &#160; [conn1] &quot;Set failpoint&quot;,&quot;attr&quot;:{&quot;failPointName&quot;:&quot;hangDuringQuiesceMode&quot;,&quot;failPoint&quot;:{&quot;mode&quot;:1,&quot;data&quot;:{},&quot;timesEntered&quot;:0}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;
&lt;p&gt;Driver issues a read to node d20021 and hangs due to failpoint:&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_streamable_ismaster] 2020-05-20T21:45:38.744+0000 d20021| 2020-05-20T21:45:38.744+00:00 D2 COMMAND  21965   [conn22] &quot;About to run the command&quot;,&quot;attr&quot;:{&quot;db&quot;:&quot;test&quot;,&quot;commandArgs&quot;:{&quot;find&quot;:&quot;state&quot;,&quot;filter&quot;:{},&quot;limit&quot;:1,&quot;singleBatch&quot;:true,&quot;lsid&quot;:{&quot;id&quot;:{&quot;$uuid&quot;:&quot;382de285-7d34-4ebc-b2f0-9fc2458f9237&quot;}},&quot;$clusterTime&quot;:{&quot;clusterTime&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1590011138,&quot;i&quot;:2}},&quot;signature&quot;:{&quot;hash&quot;:{&quot;$binary&quot;:{&quot;base64&quot;:&quot;AAAAAAAAAAAAAAAAAAAAAAAAAAA=&quot;,&quot;subType&quot;:&quot;0&quot;}},&quot;keyId&quot;:0}},&quot;$db&quot;:&quot;test&quot;,&quot;$readPreference&quot;:{&quot;mode&quot;:&quot;secondary&quot;}}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_streamable_ismaster] 2020-05-20T21:45:38.755+0000 d20021| 2020-05-20T21:45:38.755+00:00 I  QUERY    20908   [conn22] &quot;Waiting in find before making batch for query - {cq_Short}&quot;,&quot;attr&quot;:{&quot;cq_Short&quot;:&quot;ns: test.state query: {} sort: {} projection: {} limit: 1&quot;}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;Shutdown secondary d20021 and  wait for it to enter quiesce mode and hang due to failpoint:&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_streamable_ismaster] 2020-05-20T21:45:38.846+0000 d20021| 2020-05-20T21:45:38.846+00:00 I  CONTROL  23377   [SignalHandler] &quot;got signal {sig} ({strsignal_sig})&quot;,&quot;attr&quot;:{&quot;sig&quot;:15,&quot;strsignal_sig&quot;:&quot;Terminated&quot;}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_streamable_ismaster] 2020-05-20T21:45:38.846+0000 d20021| 2020-05-20T21:45:38.846+00:00 I  CONTROL  23378   [SignalHandler] &quot;kill from pid:{si_si_pid} uid:{si_si_uid}&quot;,&quot;attr&quot;:{&quot;si_si_pid&quot;:10146,&quot;si_si_uid&quot;:0}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_streamable_ismaster] 2020-05-20T21:45:38.847+0000 d20021| 2020-05-20T21:45:38.846+00:00 I  CONTROL  23381   [SignalHandler] &quot;will terminate after current cmd ends&quot;&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_streamable_ismaster] 2020-05-20T21:45:38.847+0000 d20021| 2020-05-20T21:45:38.846+00:00 I  STORAGE  4695101 [SignalHandler] &quot;hangDuringQuiesceMode failpoint enabled&quot;&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;d20021 responds to the driver isMaster request with a ShutdownInProgress error. The driver will set d20021 as UNKNOWN:&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_streamable_ismaster] 2020-05-20T21:45:38.848+0000 d20021| 2020-05-20T21:45:38.848+00:00 D2 COMMAND  21965   [conn23] &quot;About to run the command&quot;,&quot;attr&quot;:{&quot;db&quot;:&quot;admin&quot;,&quot;commandArgs&quot;:{&quot;ismaster&quot;:1,&quot;client&quot;:{&quot;driver&quot;:{&quot;name&quot;:&quot;PyMongo&quot;,&quot;version&quot;:&quot;3.11.0b1.dev0&quot;},&quot;os&quot;:{&quot;type&quot;:&quot;Linux&quot;,&quot;name&quot;:&quot;Linux&quot;,&quot;architecture&quot;:&quot;x86_64&quot;,&quot;version&quot;:&quot;2.6.32-220.el6.x86_64&quot;},&quot;platform&quot;:&quot;CPython 3.7.0.final.0&quot;},&quot;$db&quot;:&quot;admin&quot;}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_streamable_ismaster] 2020-05-20T21:45:38.849+0000 d20021| 2020-05-20T21:45:38.848+00:00 I  NETWORK  51800   [conn23] &quot;client metadata&quot;,&quot;attr&quot;:{&quot;remote&quot;:&quot;10.122.77.150:40030&quot;,&quot;client&quot;:&quot;conn23&quot;,&quot;doc&quot;:{&quot;driver&quot;:{&quot;name&quot;:&quot;PyMongo&quot;,&quot;version&quot;:&quot;3.11.0b1.dev0&quot;},&quot;os&quot;:{&quot;type&quot;:&quot;Linux&quot;,&quot;name&quot;:&quot;Linux&quot;,&quot;architecture&quot;:&quot;x86_64&quot;,&quot;version&quot;:&quot;2.6.32-220.el6.x86_64&quot;},&quot;platform&quot;:&quot;CPython 3.7.0.final.0&quot;}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_streamable_ismaster] 2020-05-20T21:45:38.849+0000 d20021| 2020-05-20T21:45:38.849+00:00 D1 COMMAND  21962   [conn23] &quot;Assertion while executing command&quot;,&quot;attr&quot;:{&quot;command&quot;:&quot;ismaster&quot;,&quot;db&quot;:&quot;admin&quot;,&quot;commandArgs&quot;:{&quot;ismaster&quot;:1,&quot;client&quot;:{&quot;driver&quot;:{&quot;name&quot;:&quot;PyMongo&quot;,&quot;version&quot;:&quot;3.11.0b1.dev0&quot;},&quot;os&quot;:{&quot;type&quot;:&quot;Linux&quot;,&quot;name&quot;:&quot;Linux&quot;,&quot;architecture&quot;:&quot;x86_64&quot;,&quot;version&quot;:&quot;2.6.32-220.el6.x86_64&quot;},&quot;platform&quot;:&quot;CPython 3.7.0.final.0&quot;},&quot;$db&quot;:&quot;admin&quot;},&quot;error&quot;:&quot;ShutdownInProgress: The server is in quiesce mode and will shut down&quot;}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;We disable the failpoint on d20021 and the find is now allowed to complete:&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_streamable_ismaster] 2020-05-20T21:45:38.856+0000 d20021| 2020-05-20T21:45:38.856+00:00 I  COMMAND  51803   [conn22] &quot;Slow query&quot;,&quot;attr&quot;:{&quot;type&quot;:&quot;command&quot;,&quot;ns&quot;:&quot;test.state&quot;,&quot;command&quot;:{&quot;find&quot;:&quot;state&quot;,&quot;filter&quot;:{},&quot;limit&quot;:1,&quot;singleBatch&quot;:true,&quot;lsid&quot;:{&quot;id&quot;:{&quot;$uuid&quot;:&quot;382de285-7d34-4ebc-b2f0-9fc2458f9237&quot;}},&quot;$clusterTime&quot;:{&quot;clusterTime&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1590011138,&quot;i&quot;:2}},&quot;signature&quot;:{&quot;hash&quot;:{&quot;$binary&quot;:{&quot;base64&quot;:&quot;AAAAAAAAAAAAAAAAAAAAAAAAAAA=&quot;,&quot;subType&quot;:&quot;0&quot;}},&quot;keyId&quot;:0}},&quot;$db&quot;:&quot;test&quot;,&quot;$readPreference&quot;:{&quot;mode&quot;:&quot;secondary&quot;}},&quot;planSummary&quot;:&quot;COLLSCAN&quot;,&quot;keysExamined&quot;:0,&quot;docsExamined&quot;:1,&quot;cursorExhausted&quot;:true,&quot;numYields&quot;:1,&quot;nreturned&quot;:1,&quot;reslen&quot;:272,&quot;locks&quot;:{&quot;ReplicationStateTransition&quot;:{&quot;acquireCount&quot;:{&quot;w&quot;:2}},&quot;Global&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:2}},&quot;Database&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:2}},&quot;Collection&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:2}},&quot;Mutex&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:1}}},&quot;storage&quot;:{},&quot;protocol&quot;:&quot;op_msg&quot;,&quot;durationMillis&quot;:111}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_streamable_ismaster] 2020-05-20T21:45:38.857+0000 d20021| 2020-05-20T21:45:38.857+00:00 I  NETWORK  22944   [conn22] &quot;connection ended&quot;,&quot;attr&quot;:{&quot;remote&quot;:&quot;10.122.77.150:40029&quot;,&quot;connectionCount&quot;:7}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;All future reads go to the other secondary as d20021 proceeds to shutdown. The test completes successfully with retryReads=false. The driver does not receive an error from the find command that returns to the driver after the ShutdownInProgress isMaster response.&lt;/p&gt;</comment>
                            <comment id="3097433" author="jason.chan" created="Wed, 20 May 2020 15:23:44 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=tess.avitabile&quot; class=&quot;user-hover&quot; rel=&quot;tess.avitabile&quot;&gt;tess.avitabile&lt;/a&gt; Got it, that makes sense. Thanks for clarifying!&lt;/p&gt;</comment>
                            <comment id="3097418" author="tess.avitabile" created="Wed, 20 May 2020 15:18:23 +0000"  >&lt;p&gt;Thanks for detailing your observations. That behavior looks good to me.&lt;/p&gt;

&lt;p&gt;I wanted to mention that I disagree with the statement &quot;We don&apos;t expect S to service any reads while in quiesce mode when using the streamable isMaster protocol.&quot; If there was a read already running on S when S entered quiesce mode, or if the read was issued before the driver received the isMaster response (e.g. due to network latency), then S would service a read while in quiesce mode.&lt;/p&gt;</comment>
                            <comment id="3096326" author="jason.chan" created="Tue, 19 May 2020 22:11:28 +0000"  >&lt;p&gt;The goal of this testing ticket is to show the following:&lt;br/&gt;
 (1) A secondary node S entering quiesce mode will immediately return to all waiting isMasters with shutdownInProgress. This should prompt the driver to recognize S as unknown.&lt;br/&gt;
 (2) A find that gets issued once the driver recognizes S is UNKNOWN should be sent to a different available secondary. &lt;del&gt;We don&apos;t expect S to service any reads while in quiesce mode when using the streamable isMaster protocol.&lt;/del&gt; (EDIT: It is possible that we still service reads in quiesce mode if S was already servicing a read as it entered quiesce mode or if a read was issued before the driver received the isMaster response detailing the ShutdownInProgress error)&lt;/p&gt;

&lt;p&gt;We can see the following by increasing the log verbosity for the command component:&lt;/p&gt;

&lt;p&gt;The driver sends a series of finds to the replica set with read preference=secondary. The reads are sent to secondary node d20021:&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_non_streamable_ismaster] 2020-05-19T21:17:50.514+0000 d20021| 2020-05-19T21:17:50.514+00:00 D2 COMMAND  21965   [conn22] &quot;About to run the command&quot;,&quot;attr&quot;:{&quot;db&quot;:&quot;test&quot;,&quot;commandArgs&quot;:{&quot;find&quot;:&quot;state&quot;,&quot;filter&quot;:{},&quot;limit&quot;:1,&quot;singleBatch&quot;:true,&quot;lsid&quot;:{&quot;id&quot;:{&quot;$uuid&quot;:&quot;0b8b3a94-0866-4d35-bb87-2f038bf1bdde&quot;}},&quot;$clusterTime&quot;:{&quot;clusterTime&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1589923070,&quot;i&quot;:2}},&quot;signature&quot;:{&quot;hash&quot;:{&quot;$binary&quot;:{&quot;base64&quot;:&quot;AAAAAAAAAAAAAAAAAAAAAAAAAAA=&quot;,&quot;subType&quot;:&quot;0&quot;}},&quot;keyId&quot;:0}},&quot;$db&quot;:&quot;test&quot;,&quot;$readPreference&quot;:{&quot;mode&quot;:&quot;secondary&quot;}}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_non_streamable_ismaster] 2020-05-19T21:17:50.514+0000 d20021| 2020-05-19T21:17:50.514+00:00 I  COMMAND  51803   [conn22] &quot;Slow query&quot;,&quot;attr&quot;:{&quot;type&quot;:&quot;command&quot;,&quot;ns&quot;:&quot;test.state&quot;,&quot;command&quot;:{&quot;find&quot;:&quot;state&quot;,&quot;filter&quot;:{},&quot;limit&quot;:1,&quot;singleBatch&quot;:true,&quot;lsid&quot;:{&quot;id&quot;:{&quot;$uuid&quot;:&quot;0b8b3a94-0866-4d35-bb87-2f038bf1bdde&quot;}},&quot;$clusterTime&quot;:{&quot;clusterTime&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1589923070,&quot;i&quot;:2}},&quot;signature&quot;:{&quot;hash&quot;:{&quot;$binary&quot;:{&quot;base64&quot;:&quot;AAAAAAAAAAAAAAAAAAAAAAAAAAA=&quot;,&quot;subType&quot;:&quot;0&quot;}},&quot;keyId&quot;:0}},&quot;$db&quot;:&quot;test&quot;,&quot;$readPreference&quot;:{&quot;mode&quot;:&quot;secondary&quot;}},&quot;planSummary&quot;:&quot;COLLSCAN&quot;,&quot;keysExamined&quot;:0,&quot;docsExamined&quot;:1,&quot;cursorExhausted&quot;:true,&quot;numYields&quot;:0,&quot;nreturned&quot;:1,&quot;reslen&quot;:272,&quot;locks&quot;:{&quot;ReplicationStateTransition&quot;:{&quot;acquireCount&quot;:{&quot;w&quot;:1}},&quot;Global&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:1}},&quot;Database&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:1}},&quot;Collection&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:1}},&quot;Mutex&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:1}}},&quot;storage&quot;:{},&quot;protocol&quot;:&quot;op_msg&quot;,&quot;durationMillis&quot;:0}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_non_streamable_ismaster] 2020-05-19T21:17:50.766+0000 d20021| 2020-05-19T21:17:50.766+00:00 D2 COMMAND  21965   [conn22] &quot;About to run the command&quot;,&quot;attr&quot;:{&quot;db&quot;:&quot;test&quot;,&quot;commandArgs&quot;:{&quot;find&quot;:&quot;state&quot;,&quot;filter&quot;:{},&quot;limit&quot;:1,&quot;singleBatch&quot;:true,&quot;lsid&quot;:{&quot;id&quot;:{&quot;$uuid&quot;:&quot;0b8b3a94-0866-4d35-bb87-2f038bf1bdde&quot;}},&quot;$clusterTime&quot;:{&quot;clusterTime&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1589923070,&quot;i&quot;:2}},&quot;signature&quot;:{&quot;hash&quot;:{&quot;$binary&quot;:{&quot;base64&quot;:&quot;AAAAAAAAAAAAAAAAAAAAAAAAAAA=&quot;,&quot;subType&quot;:&quot;0&quot;}},&quot;keyId&quot;:0}},&quot;$db&quot;:&quot;test&quot;,&quot;$readPreference&quot;:{&quot;mode&quot;:&quot;secondary&quot;}}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_non_streamable_ismaster] 2020-05-19T21:17:50.766+0000 d20021| 2020-05-19T21:17:50.766+00:00 I  COMMAND  51803   [conn22] &quot;Slow query&quot;,&quot;attr&quot;:{&quot;type&quot;:&quot;command&quot;,&quot;ns&quot;:&quot;test.state&quot;,&quot;command&quot;:{&quot;find&quot;:&quot;state&quot;,&quot;filter&quot;:{},&quot;limit&quot;:1,&quot;singleBatch&quot;:true,&quot;lsid&quot;:{&quot;id&quot;:{&quot;$uuid&quot;:&quot;0b8b3a94-0866-4d35-bb87-2f038bf1bdde&quot;}},&quot;$clusterTime&quot;:{&quot;clusterTime&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1589923070,&quot;i&quot;:2}},&quot;signature&quot;:{&quot;hash&quot;:{&quot;$binary&quot;:{&quot;base64&quot;:&quot;AAAAAAAAAAAAAAAAAAAAAAAAAAA=&quot;,&quot;subType&quot;:&quot;0&quot;}},&quot;keyId&quot;:0}},&quot;$db&quot;:&quot;test&quot;,&quot;$readPreference&quot;:{&quot;mode&quot;:&quot;secondary&quot;}},&quot;planSummary&quot;:&quot;COLLSCAN&quot;,&quot;keysExamined&quot;:0,&quot;docsExamined&quot;:1,&quot;cursorExhausted&quot;:true,&quot;numYields&quot;:0,&quot;nreturned&quot;:1,&quot;reslen&quot;:272,&quot;locks&quot;:{&quot;ReplicationStateTransition&quot;:{&quot;acquireCount&quot;:{&quot;w&quot;:1}},&quot;Global&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:1}},&quot;Database&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:1}},&quot;Collection&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:1}},&quot;Mutex&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:1}}},&quot;storage&quot;:{},&quot;protocol&quot;:&quot;op_msg&quot;,&quot;durationMillis&quot;:0}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;...&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;
&lt;p&gt;Secondary node d20021 enters quiesce mode and immediately returns a ShutdownInProgress error to the waiting isMaster request from the driver:&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_non_streamable_ismaster] 2020-05-19T21:17:50.938+0000 d20021| 2020-05-19T21:17:50.938+00:00 I  STORAGE  4695102 [SignalHandler] &quot;Entering quiesce mode for shutdown&quot;,&quot;attr&quot;:{&quot;quiesceTimeMillis&quot;:5000}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_non_streamable_ismaster] 2020-05-19T21:17:50.941+0000 d20021| 2020-05-19T21:17:50.941+00:00 D1 COMMAND  21962   [conn20] &quot;Assertion while executing command&quot;,&quot;attr&quot;:{&quot;command&quot;:&quot;ismaster&quot;,&quot;db&quot;:&quot;admin&quot;,&quot;commandArgs&quot;:{&quot;ismaster&quot;:1,&quot;topologyVersion&quot;:{&quot;processId&quot;:{&quot;$oid&quot;:&quot;5ec44cf109834d95ff232356&quot;},&quot;counter&quot;:4},&quot;maxAwaitTimeMS&quot;:1000,&quot;$clusterTime&quot;:{&quot;clusterTime&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1589923059,&quot;i&quot;:2}},&quot;signature&quot;:{&quot;hash&quot;:{&quot;$binary&quot;:{&quot;base64&quot;:&quot;AAAAAAAAAAAAAAAAAAAAAAAAAAA=&quot;,&quot;subType&quot;:&quot;0&quot;}},&quot;keyId&quot;:0}},&quot;$db&quot;:&quot;admin&quot;,&quot;$readPreference&quot;:{&quot;mode&quot;:&quot;primary&quot;}},&quot;error&quot;:&quot;ShutdownInProgress: The server is in quiesce mode and will shut down&quot;}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_non_streamable_ismaster] 2020-05-19T21:17:50.941+0000 d20021| 2020-05-19T21:17:50.941+00:00 I  COMMAND  51803   [conn20] &quot;Slow query&quot;,&quot;attr&quot;:{&quot;type&quot;:&quot;command&quot;,&quot;ns&quot;:&quot;admin.$cmd&quot;,&quot;command&quot;:{&quot;ismaster&quot;:1,&quot;topologyVersion&quot;:{&quot;processId&quot;:{&quot;$oid&quot;:&quot;5ec44cf109834d95ff232356&quot;},&quot;counter&quot;:4},&quot;maxAwaitTimeMS&quot;:1000,&quot;$clusterTime&quot;:{&quot;clusterTime&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1589923059,&quot;i&quot;:2}},&quot;signature&quot;:{&quot;hash&quot;:{&quot;$binary&quot;:{&quot;base64&quot;:&quot;AAAAAAAAAAAAAAAAAAAAAAAAAAA=&quot;,&quot;subType&quot;:&quot;0&quot;}},&quot;keyId&quot;:0}},&quot;$db&quot;:&quot;admin&quot;,&quot;$readPreference&quot;:{&quot;mode&quot;:&quot;primary&quot;}},&quot;numYields&quot;:0,&quot;ok&quot;:0,&quot;errMsg&quot;:&quot;The server is in quiesce mode and will shut down&quot;,&quot;errName&quot;:91,&quot;errCode&quot;:91,&quot;reslen&quot;:329,&quot;locks&quot;:{},&quot;protocol&quot;:&quot;op_msg&quot;,&quot;durationMillis&quot;:714}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_non_streamable_ismaster] 2020-05-19T21:17:50.941+0000 d20021| 2020-05-19T21:17:50.941+00:00 I  NETWORK  22944   [conn20] &quot;connection ended&quot;,&quot;attr&quot;:{&quot;remote&quot;:&quot;10.122.79.102:42175&quot;,&quot;connectionCount&quot;:8}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_non_streamable_ismaster] 2020-05-19T21:17:50.942+0000 d20021| 2020-05-19T21:17:50.942+00:00 I  NETWORK  22944   [conn22] &quot;connection ended&quot;,&quot;attr&quot;:{&quot;remote&quot;:&quot;10.122.79.102:42180&quot;,&quot;connectionCount&quot;:7}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_non_streamable_ismaster] 2020-05-19T21:17:50.942+0000 d20021| 2020-05-19T21:17:50.942+00:00 I  NETWORK  22943   [listener] &quot;connection accepted&quot;,&quot;attr&quot;:{&quot;remote&quot;:&quot;10.122.79.102:42181&quot;,&quot;sessionId&quot;:23,&quot;connectionCount&quot;:8}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_non_streamable_ismaster] 2020-05-19T21:17:50.943+0000 d20021| 2020-05-19T21:17:50.943+00:00 D2 COMMAND  21965   [conn23] &quot;About to run the command&quot;,&quot;attr&quot;:{&quot;db&quot;:&quot;admin&quot;,&quot;commandArgs&quot;:{&quot;ismaster&quot;:1,&quot;client&quot;:{&quot;driver&quot;:{&quot;name&quot;:&quot;PyMongo&quot;,&quot;version&quot;:&quot;3.11.0b1.dev0&quot;},&quot;os&quot;:{&quot;type&quot;:&quot;Linux&quot;,&quot;name&quot;:&quot;Linux&quot;,&quot;architecture&quot;:&quot;x86_64&quot;,&quot;version&quot;:&quot;2.6.32-220.el6.x86_64&quot;},&quot;platform&quot;:&quot;CPython 3.7.0.final.0&quot;},&quot;$db&quot;:&quot;admin&quot;}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_non_streamable_ismaster] 2020-05-19T21:17:50.943+0000 d20021| 2020-05-19T21:17:50.943+00:00 I  NETWORK  51800   [conn23] &quot;client metadata&quot;,&quot;attr&quot;:{&quot;remote&quot;:&quot;10.122.79.102:42181&quot;,&quot;client&quot;:&quot;conn23&quot;,&quot;doc&quot;:{&quot;driver&quot;:{&quot;name&quot;:&quot;PyMongo&quot;,&quot;version&quot;:&quot;3.11.0b1.dev0&quot;},&quot;os&quot;:{&quot;type&quot;:&quot;Linux&quot;,&quot;name&quot;:&quot;Linux&quot;,&quot;architecture&quot;:&quot;x86_64&quot;,&quot;version&quot;:&quot;2.6.32-220.el6.x86_64&quot;},&quot;platform&quot;:&quot;CPython 3.7.0.final.0&quot;}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_non_streamable_ismaster] 2020-05-19T21:17:50.945+0000 d20021| 2020-05-19T21:17:50.945+00:00 D1 COMMAND  21962   [conn23] &quot;Assertion while executing command&quot;,&quot;attr&quot;:{&quot;command&quot;:&quot;ismaster&quot;,&quot;db&quot;:&quot;admin&quot;,&quot;commandArgs&quot;:{&quot;ismaster&quot;:1,&quot;client&quot;:{&quot;driver&quot;:{&quot;name&quot;:&quot;PyMongo&quot;,&quot;version&quot;:&quot;3.11.0b1.dev0&quot;},&quot;os&quot;:{&quot;type&quot;:&quot;Linux&quot;,&quot;name&quot;:&quot;Linux&quot;,&quot;architecture&quot;:&quot;x86_64&quot;,&quot;version&quot;:&quot;2.6.32-220.el6.x86_64&quot;},&quot;platform&quot;:&quot;CPython 3.7.0.final.0&quot;},&quot;$db&quot;:&quot;admin&quot;},&quot;error&quot;:&quot;ShutdownInProgress: The server is in quiesce mode and will shut down&quot;}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_non_streamable_ismaster] 2020-05-19T21:17:50.945+0000 d20021| 2020-05-19T21:17:50.945+00:00 I  COMMAND  51803   [conn23] &quot;Slow query&quot;,&quot;attr&quot;:{&quot;type&quot;:&quot;command&quot;,&quot;ns&quot;:&quot;admin.$cmd&quot;,&quot;command&quot;:{&quot;ismaster&quot;:1,&quot;client&quot;:{&quot;driver&quot;:{&quot;name&quot;:&quot;PyMongo&quot;,&quot;version&quot;:&quot;3.11.0b1.dev0&quot;},&quot;os&quot;:{&quot;type&quot;:&quot;Linux&quot;,&quot;name&quot;:&quot;Linux&quot;,&quot;architecture&quot;:&quot;x86_64&quot;,&quot;version&quot;:&quot;2.6.32-220.el6.x86_64&quot;},&quot;platform&quot;:&quot;CPython 3.7.0.final.0&quot;},&quot;$db&quot;:&quot;admin&quot;},&quot;numYields&quot;:0,&quot;ok&quot;:0,&quot;errMsg&quot;:&quot;The server is in quiesce mode and will shut down&quot;,&quot;errName&quot;:91,&quot;errCode&quot;:91,&quot;reslen&quot;:344,&quot;locks&quot;:{},&quot;protocol&quot;:&quot;op_query&quot;,&quot;durationMillis&quot;:2}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;
&lt;p&gt;We see that reads are now being sent to secondary node d20022. d20021 does not service any reads during quiesce mode:&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_non_streamable_ismaster] 2020-05-19T21:17:51.270+0000 d20022| 2020-05-19T21:17:51.270+00:00 D2 COMMAND  21965   [conn18] &quot;About to run the command&quot;,&quot;attr&quot;:{&quot;db&quot;:&quot;test&quot;,&quot;commandArgs&quot;:{&quot;find&quot;:&quot;state&quot;,&quot;filter&quot;:{},&quot;limit&quot;:1,&quot;singleBatch&quot;:true,&quot;lsid&quot;:{&quot;id&quot;:{&quot;$uuid&quot;:&quot;0b8b3a94-0866-4d35-bb87-2f038bf1bdde&quot;}},&quot;$clusterTime&quot;:{&quot;clusterTime&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1589923070,&quot;i&quot;:2}},&quot;signature&quot;:{&quot;hash&quot;:{&quot;$binary&quot;:{&quot;base64&quot;:&quot;AAAAAAAAAAAAAAAAAAAAAAAAAAA=&quot;,&quot;subType&quot;:&quot;0&quot;}},&quot;keyId&quot;:0}},&quot;$db&quot;:&quot;test&quot;,&quot;$readPreference&quot;:{&quot;mode&quot;:&quot;secondary&quot;}}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_non_streamable_ismaster] 2020-05-19T21:17:51.271+0000 d20022| 2020-05-19T21:17:51.271+00:00 I  COMMAND  51803   [conn18] &quot;Slow query&quot;,&quot;attr&quot;:{&quot;type&quot;:&quot;command&quot;,&quot;ns&quot;:&quot;test.state&quot;,&quot;command&quot;:{&quot;find&quot;:&quot;state&quot;,&quot;filter&quot;:{},&quot;limit&quot;:1,&quot;singleBatch&quot;:true,&quot;lsid&quot;:{&quot;id&quot;:{&quot;$uuid&quot;:&quot;0b8b3a94-0866-4d35-bb87-2f038bf1bdde&quot;}},&quot;$clusterTime&quot;:{&quot;clusterTime&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1589923070,&quot;i&quot;:2}},&quot;signature&quot;:{&quot;hash&quot;:{&quot;$binary&quot;:{&quot;base64&quot;:&quot;AAAAAAAAAAAAAAAAAAAAAAAAAAA=&quot;,&quot;subType&quot;:&quot;0&quot;}},&quot;keyId&quot;:0}},&quot;$db&quot;:&quot;test&quot;,&quot;$readPreference&quot;:{&quot;mode&quot;:&quot;secondary&quot;}},&quot;planSummary&quot;:&quot;COLLSCAN&quot;,&quot;keysExamined&quot;:0,&quot;docsExamined&quot;:1,&quot;cursorExhausted&quot;:true,&quot;numYields&quot;:0,&quot;nreturned&quot;:1,&quot;reslen&quot;:272,&quot;locks&quot;:{&quot;ReplicationStateTransition&quot;:{&quot;acquireCount&quot;:{&quot;w&quot;:1}},&quot;Global&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:1}},&quot;Database&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:1}},&quot;Collection&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:1}},&quot;Mutex&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:1}}},&quot;storage&quot;:{},&quot;protocol&quot;:&quot;op_msg&quot;,&quot;durationMillis&quot;:0}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_non_streamable_ismaster] 2020-05-19T21:17:51.522+0000 d20022| 2020-05-19T21:17:51.522+00:00 D2 COMMAND  21965   [conn18] &quot;About to run the command&quot;,&quot;attr&quot;:{&quot;db&quot;:&quot;test&quot;,&quot;commandArgs&quot;:{&quot;find&quot;:&quot;state&quot;,&quot;filter&quot;:{},&quot;limit&quot;:1,&quot;singleBatch&quot;:true,&quot;lsid&quot;:{&quot;id&quot;:{&quot;$uuid&quot;:&quot;0b8b3a94-0866-4d35-bb87-2f038bf1bdde&quot;}},&quot;$clusterTime&quot;:{&quot;clusterTime&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1589923070,&quot;i&quot;:2}},&quot;signature&quot;:{&quot;hash&quot;:{&quot;$binary&quot;:{&quot;base64&quot;:&quot;AAAAAAAAAAAAAAAAAAAAAAAAAAA=&quot;,&quot;subType&quot;:&quot;0&quot;}},&quot;keyId&quot;:0}},&quot;$db&quot;:&quot;test&quot;,&quot;$readPreference&quot;:{&quot;mode&quot;:&quot;secondary&quot;}}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:quiesce_mode_non_streamable_ismaster] 2020-05-19T21:17:51.522+0000 d20022| 2020-05-19T21:17:51.522+00:00 I  COMMAND  51803   [conn18] &quot;Slow query&quot;,&quot;attr&quot;:{&quot;type&quot;:&quot;command&quot;,&quot;ns&quot;:&quot;test.state&quot;,&quot;command&quot;:{&quot;find&quot;:&quot;state&quot;,&quot;filter&quot;:{},&quot;limit&quot;:1,&quot;singleBatch&quot;:true,&quot;lsid&quot;:{&quot;id&quot;:{&quot;$uuid&quot;:&quot;0b8b3a94-0866-4d35-bb87-2f038bf1bdde&quot;}},&quot;$clusterTime&quot;:{&quot;clusterTime&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1589923070,&quot;i&quot;:2}},&quot;signature&quot;:{&quot;hash&quot;:{&quot;$binary&quot;:{&quot;base64&quot;:&quot;AAAAAAAAAAAAAAAAAAAAAAAAAAA=&quot;,&quot;subType&quot;:&quot;0&quot;}},&quot;keyId&quot;:0}},&quot;$db&quot;:&quot;test&quot;,&quot;$readPreference&quot;:{&quot;mode&quot;:&quot;secondary&quot;}},&quot;planSummary&quot;:&quot;COLLSCAN&quot;,&quot;keysExamined&quot;:0,&quot;docsExamined&quot;:1,&quot;cursorExhausted&quot;:true,&quot;numYields&quot;:0,&quot;nreturned&quot;:1,&quot;reslen&quot;:272,&quot;locks&quot;:{&quot;ReplicationStateTransition&quot;:{&quot;acquireCount&quot;:{&quot;w&quot;:1}},&quot;Global&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:1}},&quot;Database&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:1}},&quot;Collection&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:1}},&quot;Mutex&quot;:{&quot;acquireCount&quot;:{&quot;r&quot;:1}}},&quot;storage&quot;:{},&quot;protocol&quot;:&quot;op_msg&quot;,&quot;durationMillis&quot;:0}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;...&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;
&lt;p&gt;The test completes successfully with driver option retryReads set to false, indicating that all reads completed successfully without the driver ever having to retry. With this, the test is able to show that goals (1) and (2) are achieved.&lt;/p&gt;

&lt;p&gt;Example logs &lt;a href=&quot;https://logkeeper.mongodb.org/lobster/build/0aba2da06faddea189a8ad249008e4f5/test/5ec44cf1c2ab687068e57652#bookmarks=0%2C1583%2C1584%2C1585%2C1591%2C1592%2C1593%2C1598%2C1599%2C1614%2C1615%2C4093&amp;amp;f~=100~d20021&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;here&lt;/a&gt;.&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10011">
                    <name>Depends</name>
                                            <outwardlinks description="depends on">
                                        <issuelink>
            <issuekey id="1280846">SERVER-46963</issuekey>
        </issuelink>
                            </outwardlinks>
                                                                <inwardlinks description="is depended on by">
                                        <issuelink>
            <issuekey id="1280871">SERVER-46967</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="1280884">SERVER-46969</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>4.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18555" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname># of Sprints</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Tue, 19 May 2020 22:11:28 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        3 years, 38 weeks ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[<s><a href='https://jira.mongodb.org/browse/SERVER-46963'>SERVER-46963</a></s>]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                            <customfield id="customfield_10857" key="com.pyxis.greenhopper.jira:gh-epic-link">
                        <customfieldname>Epic Link</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>PM-1703</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>jason.chan@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            3 years, 38 weeks ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>jason.chan@mongodb.com</customfieldvalue>
            <customfieldvalue>tess.avitabile@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hx9mvb:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hwxe67:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10557" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="3882">Repl 2020-05-18</customfieldvalue>
    <customfieldvalue id="3934">Repl 2020-06-01</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hx994n:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>