<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 05:15:06 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-47745] Make chunk query in ShardingCatalogManager compatible with chunks created in 3.4</title>
                <link>https://jira.mongodb.org/browse/SERVER-47745</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Prior to 4.4, the _id of each document in config.chunks is the &lt;a href=&quot;https://github.com/mongodb/mongo/blob/7bffc86bd02fb992f14bcce7bf686ca67adbf6a7/src/mongo/s/catalog/type_chunk.cpp#L419&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;concatenation of its namespace and min bound&lt;/a&gt;. It turns out that the string representation of UUID was changed from &lt;a href=&quot;https://github.com/mongodb/mongo/blob/68fadc9173d8565ff687b4b769700b48d35ca5d5/src/mongo/bson/bsonelement.cpp#L747-L757&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;&quot;BinData(...)&quot; in 3.4&lt;/a&gt; to &lt;a href=&quot;https://github.com/mongodb/mongo/blob/31624e095b163379dd95e0c29b44f2a9e412f8fd/src/mongo/bson/bsonelement.cpp#L779-L792&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;&quot;UUID(...)&quot; in 3.6&lt;/a&gt;. This has led to a couple of backward compatibility issues with the moveChunk, splitChunk, mergeChunk commands for chunks created in 3.4 for collections with UUID shard key. See example 4.0 test&#160;&lt;a href=&quot;https://gist.github.com/cheahuychou/f511a55957c62958a4044fb46b86c873&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;here&lt;/a&gt;&#160;and multiversion test &lt;a href=&quot;https://gist.github.com/cheahuychou/d36b339b26b6777e4910f19d4f29b690&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;here&lt;/a&gt;.&#160;&lt;/p&gt;
&lt;ol&gt;
	&lt;li&gt;The&#160;&lt;a href=&quot;https://github.com/mongodb/mongo/blob/31624e095b163379dd95e0c29b44f2a9e412f8fd/src/mongo/s/catalog/sharding_catalog_manager_chunk_operations.cpp#L195-L196&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;&quot;o2&quot; query&lt;/a&gt; in the update oplog entries for all chunk commands is incorrect as it cannot match the target chunks (e.g. the query is { _id:&#160;foo.bar-34-x_UUID(&quot;fa431a05-70ec-41f3-84f7-b82fc61544d5&quot;)} but the target chunk has { _id:&#160;foo.bar-34-x_BinData(4, FA431A0570EC41F384F7B82FC61544D5)}). Due to an issue related to alwaysUpsert described in &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-47744&quot; title=&quot;Include alwayUpsert: false in applyOps commands in sharding_catalog_manager_chunk_operations.cpp&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-47744&quot;&gt;&lt;del&gt;SERVER-47744&lt;/del&gt;&lt;/a&gt;, the chunks commands always end up failing with DuplicateKey error (if in 3.6, see explanation below).&lt;/li&gt;
	&lt;li&gt;In &lt;a href=&quot;https://github.com/mongodb/mongo/blob/7bffc86bd02fb992f14bcce7bf686ca67adbf6a7/src/mongo/db/s/config/sharding_catalog_manager_chunk_operations.cpp#L843&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;4.0&lt;/a&gt; and &lt;a href=&quot;https://github.com/mongodb/mongo/blob/23f28ec9b46619d9b2cf6784b344c62bd0ffccaa/src/mongo/db/s/config/sharding_catalog_manager_chunk_operations.cpp#L795&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;4.2&lt;/a&gt;, the moveChunk and splitChunk commands also use _id to look up the chunk to migrate and split. Since these lookups occur before the applyOps, these two commands always fail with&#160;&lt;a href=&quot;https://github.com/mongodb/mongo/blob/v4.0/src/mongo/db/s/config/sharding_catalog_manager_chunk_operations.cpp#L853&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;IncompatibleShardingMetadata&lt;/a&gt; error.&lt;/li&gt;
&lt;/ol&gt;


&lt;p&gt;To solve 1, we should do a simpler version of&#160;&lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-42106&quot; title=&quot;Use auto-generated _ids for config.chunks and config.tags&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-42106&quot;&gt;&lt;del&gt;SERVER-42106&lt;/del&gt;&lt;/a&gt;. where we&#160;&lt;a href=&quot;https://github.com/mongodb/mongo/blob/c68a391f8f1ce0390ee019997625c06eb43aea6b/src/mongo/s/catalog/type_chunk.cpp#L214-L230&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;store _id that was loaded from the config database&lt;/a&gt;&#160;in ChunkType and use it for &lt;a href=&quot;https://github.com/mongodb/mongo/blob/v4.4/src/mongo/db/s/config/sharding_catalog_manager_chunk_operations.cpp#L258&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;oplog entry query&lt;/a&gt;. If _id is not present (because the ChunkType object was constructed through other ways), we can just fall back to using &lt;a href=&quot;https://github.com/mongodb/mongo/blob/v4.0/src/mongo/s/catalog/type_chunk.cpp#L375-L377&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;genID&lt;/a&gt;. To solve 2, we should change the query in _findChunkOnConfig to include just the namespace and minKey &lt;a href=&quot;https://github.com/mongodb/mongo/blob/c68a391f8f1ce0390ee019997625c06eb43aea6b/src/mongo/db/s/config/sharding_catalog_manager_chunk_operations.cpp#L953&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;just like in 4.4&lt;/a&gt;. A multiversion test should be added to test that these chunk operations work for the chunks described above.&#160;&#160;&lt;/p&gt;</description>
                <environment></environment>
        <key id="1327915">SERVER-47745</key>
            <summary>Make chunk query in ShardingCatalogManager compatible with chunks created in 3.4</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="13201">Fixed</resolution>
                                        <assignee username="cheahuychou.mao@mongodb.com">Cheahuychou Mao</assignee>
                                    <reporter username="cheahuychou.mao@mongodb.com">Cheahuychou Mao</reporter>
                        <labels>
                    </labels>
                <created>Fri, 24 Apr 2020 09:48:21 +0000</created>
                <updated>Sun, 29 Oct 2023 22:09:06 +0000</updated>
                            <resolved>Wed, 29 Apr 2020 17:47:49 +0000</resolved>
                                                    <fixVersion>4.0.19</fixVersion>
                    <fixVersion>4.2.7</fixVersion>
                                    <component>Sharding</component>
                                        <votes>0</votes>
                                    <watches>6</watches>
                                                                                                                <comments>
                            <comment id="3060959" author="xgen-internal-githook" created="Wed, 29 Apr 2020 17:40:50 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Cheahuychou Mao&apos;, &apos;email&apos;: &apos;cheahuychou.mao@mongodb.com&apos;, &apos;username&apos;: &apos;cheahuychou&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-47745&quot; title=&quot;Make chunk query in ShardingCatalogManager compatible with chunks created in 3.4&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-47745&quot;&gt;&lt;del&gt;SERVER-47745&lt;/del&gt;&lt;/a&gt; Make chunk query in ShardingCatalogManager compatible with chunks created in 3.4&lt;/p&gt;

&lt;p&gt;(cherry picked from commit 55ea26e1ad7c01038b73551ba483194967567311)&lt;br/&gt;
Branch: v4.0&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/33fc1326ee16fdf01aab21098697551f60fd05bb&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/33fc1326ee16fdf01aab21098697551f60fd05bb&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="3060408" author="chou.mao" created="Wed, 29 Apr 2020 14:22:38 +0000"  >&lt;p&gt;Author:&lt;/p&gt;

{&apos;name&apos;: &apos;Cheahuychou Mao&apos;, &apos;email&apos;: &apos;cheahuychou.mao@mongodb.com&apos;, &apos;username&apos;: &apos;cheahuychou&apos;}

&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-45844&quot; title=&quot;UUID shard key values cause failed chunk migrations&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-45844&quot;&gt;&lt;del&gt;SERVER-45844&lt;/del&gt;&lt;/a&gt; UUID shard key values cause failed chunk migrations&lt;br/&gt;
 Branch: v4.2&lt;br/&gt;
 &lt;a href=&quot;https://github.com/mongodb/mongo/commit/55ea26e1ad7c01038b73551ba483194967567311&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/55ea26e1ad7c01038b73551ba483194967567311&lt;/a&gt;&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10420">
                    <name>Backports</name>
                                            <outwardlinks description="backported by">
                                                        </outwardlinks>
                                                        </issuelinktype>
                            <issuelinktype id="10010">
                    <name>Duplicate</name>
                                                                <inwardlinks description="is duplicated by">
                                        <issuelink>
            <issuekey id="1120432">SERVER-45844</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                                                <inwardlinks description="is related to">
                                        <issuelink>
            <issuekey id="1327905">SERVER-47744</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18555" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname># of Sprints</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_12450" key="com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes">
                        <customfieldname>Backport Requested</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="15640"><![CDATA[v4.0]]></customfieldvalue>
    <customfieldvalue key="15141"><![CDATA[v3.6]]></customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10011" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Backwards Compatibility</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10038"><![CDATA[Fully Compatible]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Wed, 29 Apr 2020 17:40:50 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        3 years, 41 weeks ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_17050" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Downstream Team Attention</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="16941"><![CDATA[Not Needed]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>luke.bonanomi@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            3 years, 41 weeks ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>cheahuychou.mao@mongodb.com</customfieldvalue>
            <customfieldvalue>xgen-internal-githook</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hxhhqv:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hx4w9j:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10557" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="3841">Sharding 2020-05-04</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hxh407:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>