<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 05:54:35 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-62245] MigrationRecovery must not assume that only one migration needs to be recovered</title>
                <link>https://jira.mongodb.org/browse/SERVER-62245</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;div class=&quot;panel&quot; style=&quot;background-color: #eeeeee;border-color: #cccccc;border-width: 1px;&quot;&gt;&lt;div class=&quot;panelHeader&quot; style=&quot;border-bottom-width: 1px;border-bottom-color: #cccccc;background-color: #6cb33f;&quot;&gt;&lt;b&gt;Issue and status as of Dec 30, 2021&lt;/b&gt;&lt;/div&gt;&lt;div class=&quot;panelContent&quot; style=&quot;background-color: #eeeeee;&quot;&gt;
&lt;p&gt;&lt;b&gt;ISSUE DESCRIPTION AND IMPACT&lt;/b&gt;&lt;/p&gt;

&lt;p&gt;This issue can cause unavailability of a shard in sharded clusters running MongoDB versions 5.0.0 - 5.0.5 and 5.1.0 - 5.1.1. Next versions are not affected.&lt;/p&gt;

&lt;p&gt;The problem can potentially occur if all of the following conditions have been met at least once:&lt;/p&gt;
&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;More than one sharded collection&lt;/li&gt;
	&lt;li&gt;Multiple migrations&lt;/li&gt;
	&lt;li&gt;Intense write workloads or hardware failures&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;Symptom of the bug: mongod process crashing upon step-up due to an invariant failure with the following message: &quot;&lt;em&gt;Upon step-up a second migration coordinator was found&lt;/em&gt;&quot;.&lt;/p&gt;

&lt;p&gt;&lt;b&gt;REMEDIATION AND WORKAROUNDS&lt;/b&gt;&lt;/p&gt;
&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;Restart nodes of the shard as replica set&lt;/li&gt;
	&lt;li&gt;Double-check that at most one migration coordinator document does not have a definitive decision.&lt;/li&gt;
	&lt;li&gt;For each migration coordinator document with a definitive decision, double-check that range deletion tasks are consistent with migration coordinators (same &lt;em&gt;range&lt;/em&gt; and &lt;em&gt;collectionUUID&lt;/em&gt;, if present):
	&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
		&lt;li&gt;Aborted decision:&lt;br/&gt;
 &#8212; No range deletion document on donor&lt;br/&gt;
 &#8212; Zero or one ready range deletion document on recipient&lt;/li&gt;
		&lt;li&gt;Committed decision:&lt;br/&gt;
 &#8212; Zero or one ready range deletion document on donor&lt;br/&gt;
 &#8212; No range deletion document on recipient&lt;/li&gt;
		&lt;li&gt;No decision:&lt;br/&gt;
 &#8212; One pending range deletion tasks on donor&lt;br/&gt;
 &#8212; One pending range deletion tasks on recipient&lt;/li&gt;
	&lt;/ul&gt;
	&lt;/li&gt;
	&lt;li&gt;Majority-delete all migration coordinators with a definitive decision&lt;/li&gt;
	&lt;li&gt;Restart nodes as shard&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;&lt;b&gt;TECHNICAL DETAILS&lt;/b&gt;&lt;/p&gt;

&lt;p&gt;Migration coordinators:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;Documents persisted locally on shards in the internal collection &lt;b&gt;config.migrationCoordinators&lt;/b&gt;&#160;&lt;/li&gt;
	&lt;li&gt;The structure of migration coordinator documents can be found &lt;a href=&quot;https://github.com/mongodb/mongo/blob/master/src/mongo/db/s/migration_coordinator_document.idl&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;here&lt;/a&gt;.&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;Range deletion tasks:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;Documents persisted locally on shards in the internal collection &lt;b&gt;config.rangeDeletions&lt;/b&gt;&lt;/li&gt;
&lt;/ul&gt;


&lt;ul&gt;
	&lt;li&gt;The structure of range deletion task documents can be found &lt;a href=&quot;https://github.com/mongodb/mongo/blob/master/src/mongo/db/s/range_deletion_task.idl&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;here&lt;/a&gt;&lt;/li&gt;
&lt;/ul&gt;
&lt;/div&gt;&lt;/div&gt;
&lt;p&gt;&#160;&lt;/p&gt;
&lt;hr /&gt;
&lt;p&gt;&lt;b&gt;---&#160;Original ticket description ---&lt;/b&gt;&lt;/p&gt;

&lt;p&gt;There are several situations that can lead to more than one migration (for &lt;b&gt;different&lt;/b&gt; collections) needing recovery on stepup. For example, when a migration fails &lt;a href=&quot;https://github.com/mongodb/mongo/blob/c5051f95ad9813b80b9fc3e26ba79f94a610cfe2/src/mongo/db/s/migration_source_manager.cpp#L741&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;here&lt;/a&gt; we only &lt;a href=&quot;https://github.com/mongodb/mongo/blob/c5051f95ad9813b80b9fc3e26ba79f94a610cfe2/src/mongo/db/s/migration_source_manager.cpp#L747-L758&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;clear the collection&apos;s filtering metadata&lt;/a&gt; so that the next access to the collection will trigger the recovery, and then release the ActiveMigrationRegistry. At this point, nothing prevents a migration to a different collection from starting, so now if the shard stepped down it would have two migrations to recover.&lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;http://example.com/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;This invariant&lt;/a&gt; along with taking the MigrationBlockingGuard on stepup migration recovery was added on &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-50174&quot; title=&quot;Multiple concurrent migration recoveries after step-up can race for the fixed Lsid/TxnNumber&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-50174&quot;&gt;&lt;del&gt;SERVER-50174&lt;/del&gt;&lt;/a&gt;. It was meant to prevent migrations to different collections before the unfinished migrations found on stepup are recovered. However, as described above, situations where there are multiple migrations pending recovery are still possible in non-stepping situations.&lt;/p&gt;

&lt;p&gt;&lt;del&gt;The fact that a different migration (to another collection) starts using the same lsid as the migration pending recovery should not be a problem. The new migration will use a txnNumber that is two more than the previous migration. This will effectively be the same as &lt;a href=&quot;https://github.com/mongodb/mongo/blob/c5051f95ad9813b80b9fc3e26ba79f94a610cfe2/src/mongo/db/s/migration_coordinator.cpp#L195-L198&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;advancing the txn number&lt;/a&gt;: It will prevent the first migration from using its original (lsid, txnNumber pair).&lt;/del&gt;&#160;&lt;em&gt;The fact that a recovering migration gets a TransactionTooOld error when advancing the txnNumber on the recipient is not fully safe to ignore, because TransactionTooOld does not guarantee that a rollback can&apos;t occur, after which the original txnNumber could still be valid.&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;This ticket will provide a fix so that clusters that are already in the faulty situation of having several migrations pending to be recover don&apos;t hit the invariant on stepup anymore. &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-62296&quot; title=&quot;MoveChunk should recover any unfinished migration before starting a new one&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-62296&quot;&gt;&lt;del&gt;SERVER-62296&lt;/del&gt;&lt;/a&gt; will avoid this faulty situation from happening again.&lt;/p&gt;</description>
                <environment></environment>
        <key id="1955958">SERVER-62245</key>
            <summary>MigrationRecovery must not assume that only one migration needs to be recovered</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="2" iconUrl="https://jira.mongodb.org/images/icons/priorities/critical.svg">Critical - P2</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="13201">Fixed</resolution>
                                        <assignee username="jordi.serra-torrens@mongodb.com">Jordi Serra Torrens</assignee>
                                    <reporter username="jordi.serra-torrens@mongodb.com">Jordi Serra Torrens</reporter>
                        <labels>
                    </labels>
                <created>Thu, 23 Dec 2021 14:44:40 +0000</created>
                <updated>Sun, 29 Oct 2023 21:44:44 +0000</updated>
                            <resolved>Thu, 30 Dec 2021 12:44:51 +0000</resolved>
                                    <version>5.0.0</version>
                    <version>5.2.0</version>
                    <version>5.1.0</version>
                                    <fixVersion>5.3.0</fixVersion>
                    <fixVersion>5.1.2</fixVersion>
                    <fixVersion>5.0.6</fixVersion>
                    <fixVersion>5.2.0-rc4</fixVersion>
                                    <component>Sharding</component>
                                        <votes>0</votes>
                                    <watches>16</watches>
                                                                                                                <comments>
                            <comment id="4643929" author="xgen-internal-githook" created="Tue, 28 Jun 2022 07:46:29 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Jordi Serra Torrens&apos;, &apos;email&apos;: &apos;jordi.serra-torrens@mongodb.com&apos;, &apos;username&apos;: &apos;jordist&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-62316&quot; title=&quot;Remove the workaround for SERVER-62245 once 6.0 branches out&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-62316&quot;&gt;&lt;del&gt;SERVER-62316&lt;/del&gt;&lt;/a&gt; Remove the workaround for &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-62245&quot; title=&quot;MigrationRecovery must not assume that only one migration needs to be recovered&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-62245&quot;&gt;&lt;del&gt;SERVER-62245&lt;/del&gt;&lt;/a&gt;&lt;br/&gt;
Branch: master&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/da17e726a6fedddeb525229f7afa93dbce7f94d6&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/da17e726a6fedddeb525229f7afa93dbce7f94d6&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="4271232" author="xgen-internal-githook" created="Thu, 30 Dec 2021 17:08:22 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Jordi Serra Torrens&apos;, &apos;email&apos;: &apos;jordi.serra-torrens@mongodb.com&apos;, &apos;username&apos;: &apos;jordist&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-62245&quot; title=&quot;MigrationRecovery must not assume that only one migration needs to be recovered&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-62245&quot;&gt;&lt;del&gt;SERVER-62245&lt;/del&gt;&lt;/a&gt; MigrationRecovery must not assume that only one migration needs to be recovered&lt;/p&gt;

&lt;p&gt;(cherry picked from commit 8e6ab9a259d921298940190161fadfd118c6dc15)&lt;br/&gt;
Branch: v5.0&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/160cc06cd9dc4861ebe0678ed1a9286e21aef8ab&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/160cc06cd9dc4861ebe0678ed1a9286e21aef8ab&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="4271079" author="xgen-internal-githook" created="Thu, 30 Dec 2021 15:39:05 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Jordi Serra Torrens&apos;, &apos;email&apos;: &apos;jordi.serra-torrens@mongodb.com&apos;, &apos;username&apos;: &apos;jordist&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-62245&quot; title=&quot;MigrationRecovery must not assume that only one migration needs to be recovered&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-62245&quot;&gt;&lt;del&gt;SERVER-62245&lt;/del&gt;&lt;/a&gt; MigrationRecovery must not assume that only one migration needs to be recovered&lt;/p&gt;

&lt;p&gt;(cherry picked from commit 8e6ab9a259d921298940190161fadfd118c6dc15)&lt;br/&gt;
Branch: v5.1&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/8326031e5207e4f000ec81e1e51981e370edbab9&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/8326031e5207e4f000ec81e1e51981e370edbab9&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="4271078" author="xgen-internal-githook" created="Thu, 30 Dec 2021 15:39:02 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Jordi Serra Torrens&apos;, &apos;email&apos;: &apos;jordi.serra-torrens@mongodb.com&apos;, &apos;username&apos;: &apos;jordist&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-62245&quot; title=&quot;MigrationRecovery must not assume that only one migration needs to be recovered&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-62245&quot;&gt;&lt;del&gt;SERVER-62245&lt;/del&gt;&lt;/a&gt; MigrationRecovery must not assume that only one migration needs to be recovered&lt;/p&gt;

&lt;p&gt;(cherry picked from commit 8e6ab9a259d921298940190161fadfd118c6dc15)&lt;br/&gt;
Branch: v5.2&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/5a4409cca94498a8e7810ffedf4a049053db2c46&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/5a4409cca94498a8e7810ffedf4a049053db2c46&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="4270879" author="xgen-internal-githook" created="Thu, 30 Dec 2021 12:42:33 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Jordi Serra Torrens&apos;, &apos;email&apos;: &apos;jordi.serra-torrens@mongodb.com&apos;, &apos;username&apos;: &apos;jordist&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-62245&quot; title=&quot;MigrationRecovery must not assume that only one migration needs to be recovered&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-62245&quot;&gt;&lt;del&gt;SERVER-62245&lt;/del&gt;&lt;/a&gt; MigrationRecovery must not assume that only one migration needs to be recovered&lt;br/&gt;
Branch: master&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/8e6ab9a259d921298940190161fadfd118c6dc15&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/8e6ab9a259d921298940190161fadfd118c6dc15&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="4265917" author="tommaso.tocci" created="Thu, 23 Dec 2021 15:02:42 +0000"  >&lt;p&gt;This bug has been introduced by  &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-50174&quot; title=&quot;Multiple concurrent migration recoveries after step-up can race for the fixed Lsid/TxnNumber&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-50174&quot;&gt;&lt;del&gt;SERVER-50174&lt;/del&gt;&lt;/a&gt; and has been exacerbated by &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-49192&quot; title=&quot;Persist the VectorClock for configTime and topologyTime casual consistency&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-49192&quot;&gt;&lt;del&gt;SERVER-49192&lt;/del&gt;&lt;/a&gt;&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10420">
                    <name>Backports</name>
                                            <outwardlinks description="backported by">
                                                        </outwardlinks>
                                                        </issuelinktype>
                            <issuelinktype id="10520">
                    <name>Problem/Incident</name>
                                                                <inwardlinks description="is caused by">
                                        <issuelink>
            <issuekey id="1434852">SERVER-50174</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                            <outwardlinks description="related to">
                                        <issuelink>
            <issuekey id="1956917">SERVER-62296</issuekey>
        </issuelink>
                            </outwardlinks>
                                                                <inwardlinks description="is related to">
                                        <issuelink>
            <issuekey id="1892634">SERVER-60521</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="1955134">SERVER-62213</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="1955856">SERVER-62243</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="1957196">SERVER-62316</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                            <attachment id="352410" name="repro-62245.patch" size="4909" author="jordi.serra-torrens@mongodb.com" created="Thu, 23 Dec 2021 15:11:13 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>6.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18555" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname># of Sprints</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_12450" key="com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes">
                        <customfieldname>Backport Requested</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="22676"><![CDATA[v5.2]]></customfieldvalue>
    <customfieldvalue key="22495"><![CDATA[v5.1]]></customfieldvalue>
    <customfieldvalue key="21777"><![CDATA[v5.0]]></customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10011" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Backwards Compatibility</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10038"><![CDATA[Fully Compatible]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_13552" key="com.go2group.jira.plugin.crm:crm_generic_field">
                        <customfieldname>Case</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[[5002K000012RaYCQA0]]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Thu, 23 Dec 2021 15:02:42 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        1 year, 32 weeks, 1 day ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_17050" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Downstream Team Attention</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="16941"><![CDATA[Not Needed]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>luke.bonanomi@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            1 year, 32 weeks, 1 day ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>xgen-internal-githook</customfieldvalue>
            <customfieldvalue>jordi.serra-torrens@mongodb.com</customfieldvalue>
            <customfieldvalue>tommaso.tocci@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i0fhzj:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hzyp27:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10557" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="5430">Sharding EMEA 2021-12-27</customfieldvalue>
    <customfieldvalue id="5681">Sharding EMEA 2022-01-10</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10750" key="com.atlassian.jira.plugin.system.customfieldtypes:textarea">
                        <customfieldname>Steps To Reproduce</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>&lt;p&gt; &lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/attachment/352410/352410_repro-62245.patch&quot; title=&quot;repro-62245.patch attached to SERVER-62245&quot;&gt;repro-62245.patch&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.mongodb.org/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt; &lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;./buildscripts/resmoke.py run --storageEngine=wiredTiger --storageEngineCacheSizeGB=.50 --suite=sharding  jstests/sharding/recover_multiple_migrations_on_stepup.js --log=file&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i0f44v:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>