<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 04:22:32 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-30058] Balancer policy should not move chunks off shards on &apos;size exceeded&apos; conditions</title>
                <link>https://jira.mongodb.org/browse/SERVER-30058</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;The inclusion of the shard &lt;b&gt;size exceeded&lt;/b&gt; check as a pre-condition for deciding whether to move chunks off a shard is a bug, which was introduced in 3.4 as part of &lt;a href=&quot;https://github.com/mongodb/mongo/commit/5dbe9c097231652f8eee97a66e24d8c448a3f9a1&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;this&lt;/a&gt; commit.&lt;/p&gt;

&lt;p&gt;Such a policy has the potential to cause chunks to move off a shard and then back to it on subsequent rounds and should be removed.&lt;/p&gt;</description>
                <environment></environment>
        <key id="401701">SERVER-30058</key>
            <summary>Balancer policy should not move chunks off shards on &apos;size exceeded&apos; conditions</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="13201">Fixed</resolution>
                                        <assignee username="kaloian.manassiev@mongodb.com">Kaloian Manassiev</assignee>
                                    <reporter username="kaloian.manassiev@mongodb.com">Kaloian Manassiev</reporter>
                        <labels>
                    </labels>
                <created>Fri, 7 Jul 2017 20:26:10 +0000</created>
                <updated>Mon, 30 Oct 2023 23:15:23 +0000</updated>
                            <resolved>Thu, 13 Jul 2017 18:08:51 +0000</resolved>
                                    <version>3.4.6</version>
                    <version>3.5.9</version>
                                    <fixVersion>3.4.7</fixVersion>
                    <fixVersion>3.5.10</fixVersion>
                                    <component>Sharding</component>
                                        <votes>0</votes>
                                    <watches>14</watches>
                                                                                                                <comments>
                            <comment id="1624099" author="xgen-internal-githook" created="Mon, 17 Jul 2017 20:37:10 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{u&apos;username&apos;: u&apos;kaloianm&apos;, u&apos;name&apos;: u&apos;Kaloian Manassiev&apos;, u&apos;email&apos;: u&apos;kaloian.manassiev@mongodb.com&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-30058&quot; title=&quot;Balancer policy should not move chunks off shards on &amp;#39;size exceeded&amp;#39; conditions&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-30058&quot;&gt;&lt;del&gt;SERVER-30058&lt;/del&gt;&lt;/a&gt; Balancer policy should not move chunks off shards on &apos;size exceeded&apos; conditions&lt;/p&gt;

&lt;p&gt;(cherry picked from commit 411114cb3ec3119bb159b29b8ef65292e4d20de3)&lt;br/&gt;
Branch: v3.4&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/03f5fa3484cf001c21d48230590a97fafc1a89ec&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/03f5fa3484cf001c21d48230590a97fafc1a89ec&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="1621002" author="alyson.cabral" created="Thu, 13 Jul 2017 14:08:26 +0000"  >&lt;p&gt;Yes, Kal. We will continue checking the other policies with the exception of maxSize.&lt;/p&gt;</comment>
                            <comment id="1620953" author="xgen-internal-githook" created="Thu, 13 Jul 2017 13:19:26 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{u&apos;username&apos;: u&apos;kaloianm&apos;, u&apos;name&apos;: u&apos;Kaloian Manassiev&apos;, u&apos;email&apos;: u&apos;kaloian.manassiev@mongodb.com&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-30058&quot; title=&quot;Balancer policy should not move chunks off shards on &amp;#39;size exceeded&amp;#39; conditions&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-30058&quot;&gt;&lt;del&gt;SERVER-30058&lt;/del&gt;&lt;/a&gt; Balancer policy should not move chunks off shards on &apos;size exceeded&apos; conditions&lt;br/&gt;
Branch: master&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/411114cb3ec3119bb159b29b8ef65292e4d20de3&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/411114cb3ec3119bb159b29b8ef65292e4d20de3&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="1619856" author="kaloian.manassiev" created="Wed, 12 Jul 2017 14:16:25 +0000"  >&lt;p&gt;After discussion with &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=asya&quot; class=&quot;user-hover&quot; rel=&quot;asya&quot;&gt;asya&lt;/a&gt; and &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=alyson.cabral&quot; class=&quot;user-hover&quot; rel=&quot;alyson.cabral&quot;&gt;alyson.cabral&lt;/a&gt;, we found out that the inclusion of the shard &lt;b&gt;size exceeded&lt;/b&gt; check as a condition to move chunks off a shard is a bug, which was introduced in 3.4 as part of &lt;a href=&quot;https://github.com/mongodb/mongo/commit/5dbe9c097231652f8eee97a66e24d8c448a3f9a1&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;this&lt;/a&gt; commit. Such a policy has the potential to cause chunks to move off a shard and then back to it on subsequent rounds.&lt;/p&gt;

&lt;p&gt;With the exception of the above condition, we decided that manual &lt;tt&gt;moveChunks&lt;/tt&gt; should be performing the remaining policy checks, such as not moving to draining shards and not violating zones.&lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=asya&quot; class=&quot;user-hover&quot; rel=&quot;asya&quot;&gt;asya&lt;/a&gt;/&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=alyson.cabral&quot; class=&quot;user-hover&quot; rel=&quot;alyson.cabral&quot;&gt;alyson.cabral&lt;/a&gt;, can you please confirm this?&lt;/p&gt;</comment>
                            <comment id="1618063" author="kaloian.manassiev" created="Mon, 10 Jul 2017 19:00:45 +0000"  >&lt;p&gt;Looks like this was accidentally introduced as part of the fix for &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-26579&quot; title=&quot;Sharding balancer moves chunks to shards whose utilization is above the cluster average&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-26579&quot;&gt;&lt;del&gt;SERVER-26579&lt;/del&gt;&lt;/a&gt; and is a bug. As part of the changes for this bug we will remove this check.&lt;/p&gt;</comment>
                            <comment id="1618029" author="asya" created="Mon, 10 Jul 2017 18:34:00 +0000"  >&lt;p&gt;Why is it checking &quot;size is not exceeded&quot; on a manual moveChunk command?&lt;/p&gt;

&lt;p&gt;According to our docs, maxSize is only considered by the &lt;b&gt;balancer&lt;/b&gt; when selecting a target shard, it shouldn&apos;t be considered for manual chunk migrations, should it?  &lt;a href=&quot;https://docs.mongodb.com/manual/tutorial/manage-sharded-cluster-balancer/#change-the-maximum-storage-size-for-a-given-shard&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://docs.mongodb.com/manual/tutorial/manage-sharded-cluster-balancer/#change-the-maximum-storage-size-for-a-given-shard&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="1617673" author="kaloian.manassiev" created="Mon, 10 Jul 2017 14:58:26 +0000"  >&lt;p&gt;Yes, it will try to move them to a conformant place on the next round. The conformance precedence order is:&lt;/p&gt;
&lt;ol&gt;
	&lt;li&gt;Move chunks out of draining shards&lt;/li&gt;
	&lt;li&gt;Fix shard max size violations&lt;/li&gt;
	&lt;li&gt;Fix zone policy violations&lt;/li&gt;
	&lt;li&gt;Fix imbalance&lt;/li&gt;
&lt;/ol&gt;
</comment>
                            <comment id="1617668" author="alyson.cabral" created="Mon, 10 Jul 2017 14:55:20 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=kaloian.manassiev&quot; class=&quot;user-hover&quot; rel=&quot;kaloian.manassiev&quot;&gt;kaloian.manassiev&lt;/a&gt; After making manual chunk moves, what&apos;s the behavior of the balancer? Would the balancer prioritize moving these chunks to conform with the balancer policies?  &lt;/p&gt;</comment>
                            <comment id="1616684" author="kaloian.manassiev" created="Fri, 7 Jul 2017 20:37:01 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=alyson.cabral&quot; class=&quot;user-hover&quot; rel=&quot;alyson.cabral&quot;&gt;alyson.cabral&lt;/a&gt; - do you think this policy check is something we should continue doing or we should remove it for parity with pre-3.4?&lt;/p&gt;

&lt;p&gt;If we end up doing &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-30060&quot; title=&quot;Make the balancer gather storage statistics only for shards which have `maxSize` set&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-30060&quot;&gt;&lt;del&gt;SERVER-30060&lt;/del&gt;&lt;/a&gt;, this might be less of a performance problem, but I am curious as to whether this proactive policy check on manual moves is something beneficial for customers or it causes more harm than good.&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10420">
                    <name>Backports</name>
                                            <outwardlinks description="backported by">
                                                        </outwardlinks>
                                                        </issuelinktype>
                            <issuelinktype id="10011">
                    <name>Depends</name>
                                                                <inwardlinks description="is depended on by">
                                                        </inwardlinks>
                                    </issuelinktype>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                            <outwardlinks description="related to">
                                        <issuelink>
            <issuekey id="403534">DOCS-12029</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18555" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname># of Sprints</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_12450" key="com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes">
                        <customfieldname>Backport Requested</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="14340"><![CDATA[v3.4]]></customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10011" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Backwards Compatibility</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10038"><![CDATA[Fully Compatible]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Mon, 10 Jul 2017 14:55:20 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        6 years, 30 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>luke.bonanomi@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            6 years, 30 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>alyson.cabral@mongodb.com</customfieldvalue>
            <customfieldvalue>asya.kamsky@mongodb.com</customfieldvalue>
            <customfieldvalue>xgen-internal-githook</customfieldvalue>
            <customfieldvalue>kaloian.manassiev@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|htain3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|ht2f5z:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10557" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="1727">Sharding 2017-07-31</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11861" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>User Summary</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="11856"><![CDATA[Not Needed]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hta4pr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>