<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 04:31:00 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-32692] Make zbigMapReduce.js, sharding_balance4.js, and bulk_shard_insert.js more resilient under slow machines</title>
                <link>https://jira.mongodb.org/browse/SERVER-32692</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;&lt;tt&gt;zbigMapReduce.js&lt;/tt&gt; fails occasionally because more than 5 migrations manage finish since the beginning of either of the two bulk writes it executes, causing the test to fail since the write never establishes a shard version. Similarly to &lt;tt&gt;sharding_balance4.js&lt;/tt&gt; as of &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-28697&quot; title=&quot;Ignore some NoProgressMade errors in sharding_balance4.js&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-28697&quot;&gt;&lt;del&gt;SERVER-28697&lt;/del&gt;&lt;/a&gt;, we should ignore a certain number of NoProgressMade errors to make the test fail less frequently.&lt;/p&gt;

&lt;p&gt;&lt;tt&gt;sharding_balance4.js&lt;/tt&gt; and &lt;tt&gt;bulk_shard_insert.js&lt;/tt&gt; occasionally fail because more than 10 migrations complete during the course of a find command exhausting mongos&apos;s retry attempts and failing the test. Modifying the test to retry a couple times on StaleShardVersion should make it fail less often.&lt;/p&gt;

&lt;p&gt;We can also consider making a generic override for read commands that retry on StaleShardVersion errors, so it can be &lt;tt&gt;load&lt;/tt&gt;-ed into tests that involve frequent migrations.&lt;/p&gt;</description>
                <environment></environment>
        <key id="482521">SERVER-32692</key>
            <summary>Make zbigMapReduce.js, sharding_balance4.js, and bulk_shard_insert.js more resilient under slow machines</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="13201">Fixed</resolution>
                                        <assignee username="matthew.saltz@mongodb.com">Matthew Saltz</assignee>
                                    <reporter username="jack.mulrow@mongodb.com">Jack Mulrow</reporter>
                        <labels>
                            <label>gm-ack</label>
                    </labels>
                <created>Fri, 12 Jan 2018 23:31:32 +0000</created>
                <updated>Mon, 30 Oct 2023 23:09:19 +0000</updated>
                            <resolved>Mon, 23 Sep 2019 17:59:48 +0000</resolved>
                                                    <fixVersion>4.3.1</fixVersion>
                                    <component>Sharding</component>
                                        <votes>1</votes>
                                    <watches>6</watches>
                                                                                                                <comments>
                            <comment id="2547614" author="xgen-internal-githook" created="Mon, 18 Nov 2019 20:19:19 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;username&apos;: &apos;saltzm&apos;, &apos;email&apos;: &apos;matthew.saltz@mongodb.com&apos;, &apos;name&apos;: &apos;Matthew Saltz&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-32692&quot; title=&quot;Make zbigMapReduce.js, sharding_balance4.js, and bulk_shard_insert.js more resilient under slow machines&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-32692&quot;&gt;&lt;del&gt;SERVER-32692&lt;/del&gt;&lt;/a&gt; Make zbigMapReduce.js, sharding_balance4.js, and bulk_shard_insert.js more resilient under slow machines&lt;/p&gt;

&lt;p&gt;(cherry picked from commit 1e0f4f8136e640d90093476695bb07b851da2da9)&lt;br/&gt;
(cherry picked from commit a17bb0d5dcf4294954c4b2468216335a5e9b9023)&lt;br/&gt;
Branch: v4.0&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/b7f72c287e1ab9a92b784697a80211e3f365cd08&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/b7f72c287e1ab9a92b784697a80211e3f365cd08&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="2517312" author="xgen-internal-githook" created="Mon, 4 Nov 2019 22:47:44 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;username&apos;: &apos;saltzm&apos;, &apos;email&apos;: &apos;matthew.saltz@mongodb.com&apos;, &apos;name&apos;: &apos;Matthew Saltz&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-32692&quot; title=&quot;Make zbigMapReduce.js, sharding_balance4.js, and bulk_shard_insert.js more resilient under slow machines&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-32692&quot;&gt;&lt;del&gt;SERVER-32692&lt;/del&gt;&lt;/a&gt; Make zbigMapReduce.js, sharding_balance4.js, and bulk_shard_insert.js more resilient under slow machines&lt;/p&gt;

&lt;p&gt;(cherry picked from commit 1e0f4f8136e640d90093476695bb07b851da2da9)&lt;br/&gt;
Branch: v3.6&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/a17bb0d5dcf4294954c4b2468216335a5e9b9023&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/a17bb0d5dcf4294954c4b2468216335a5e9b9023&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="2428506" author="xgen-internal-githook" created="Mon, 23 Sep 2019 16:44:56 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Matthew Saltz&apos;, &apos;username&apos;: &apos;saltzm&apos;, &apos;email&apos;: &apos;matthew.saltz@mongodb.com&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-32692&quot; title=&quot;Make zbigMapReduce.js, sharding_balance4.js, and bulk_shard_insert.js more resilient under slow machines&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-32692&quot;&gt;&lt;del&gt;SERVER-32692&lt;/del&gt;&lt;/a&gt; Make zbigMapReduce.js, sharding_balance4.js, and bulk_shard_insert.js more resilient under slow machines&lt;br/&gt;
Branch: master&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/1e0f4f8136e640d90093476695bb07b851da2da9&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/1e0f4f8136e640d90093476695bb07b851da2da9&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="2354985" author="jack.mulrow" created="Thu, 1 Aug 2019 20:03:27 +0000"  >&lt;p&gt;Yeah I think throttling the balancer for these tests would help.&lt;/p&gt;</comment>
                            <comment id="2354935" author="matthew.saltz" created="Thu, 1 Aug 2019 19:34:53 +0000"  >&lt;p&gt;Being able to throttle the balancer actually seems like a useful feature in general - some parameter that lets you specify max migrations per second or a parameter that says how long to sleep in between rounds. Should be easy to implement and backportable too. Let me know if I should create a ticket for that.&lt;/p&gt;

&lt;p&gt;Not sure if there&apos;s a good way to do it client side? &lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=jack.mulrow&quot; class=&quot;user-hover&quot; rel=&quot;jack.mulrow&quot;&gt;jack.mulrow&lt;/a&gt; does that seem like it&apos;d help?&lt;/p&gt;</comment>
                            <comment id="2354889" author="kaloian.manassiev" created="Thu, 1 Aug 2019 19:04:23 +0000"  >&lt;blockquote&gt;&lt;p&gt;By &quot;lowering constants&quot; do you mean e.g. inserting less data?&lt;/p&gt;&lt;/blockquote&gt;
&lt;p&gt;Yes, this is what I meant. However what Randolph proposes above also seems legit.&lt;/p&gt;</comment>
                            <comment id="2354697" author="renctan" created="Thu, 1 Aug 2019 17:57:33 +0000"  >&lt;p&gt;If there is a way to throttle the balancer to take a small pause after each migration, then I think that would help too.&lt;/p&gt;</comment>
                            <comment id="2354672" author="matthew.saltz" created="Thu, 1 Aug 2019 17:47:43 +0000"  >&lt;p&gt;By &quot;lowering constants&quot; do you mean e.g. inserting less data?&lt;/p&gt;</comment>
                            <comment id="2354656" author="matthew.saltz" created="Thu, 1 Aug 2019 17:46:56 +0000"  >&lt;p&gt;If kMaxNumStaleVersionRetries were a server parameter I&apos;d say we should increase that value in the test, but it&apos;s not &lt;img class=&quot;emoticon&quot; src=&quot;https://jira.mongodb.org/images/icons/emoticons/smile.png&quot; height=&quot;16&quot; width=&quot;16&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt; I was thinking we&apos;d just have the tests themselves retry a few times on the error code for StaleShardVersion, as I believe Jack was suggesting. Bumping kMaxNumStaleVersionRetries would be easier since it&apos;s all in once place, didn&apos;t know if that was acceptable or not.&lt;/p&gt;</comment>
                            <comment id="2354527" author="kaloian.manassiev" created="Thu, 1 Aug 2019 16:48:46 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=matthew.saltz&quot; class=&quot;user-hover&quot; rel=&quot;matthew.saltz&quot;&gt;matthew.saltz&lt;/a&gt;, are you suggesting bumping the &lt;a href=&quot;https://github.com/mongodb/mongo/blob/19c0b59c3a5d6e5d2d7177cf4e9c83713c93cd68/src/mongo/s/catalog_cache.h#L53&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;&lt;tt&gt;kMaxNumStaleVersionRetries&lt;/tt&gt;&lt;/a&gt;? I have no recollection how this value was reached (&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=renctan&quot; class=&quot;user-hover&quot; rel=&quot;renctan&quot;&gt;renctan&lt;/a&gt;, do you?), but I don&apos;t think it is out of the question doubling it as long as we also obey the &lt;tt&gt;MaxTimeMS&lt;/tt&gt;.&lt;/p&gt;

&lt;p&gt;Alternatively, can we just lower some constants in the test so it is more lightweight?&lt;/p&gt;</comment>
                            <comment id="1778502" author="kaloian.manassiev" created="Thu, 18 Jan 2018 23:17:02 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=jack.mulrow&quot; class=&quot;user-hover&quot; rel=&quot;jack.mulrow&quot;&gt;jack.mulrow&lt;/a&gt;, I am not sure that retries for these tests is the right solution, because then I think it defeats their purpose, which is to make sure no anomalies are happening under some form of stress. It is a different question how useful these tests are.&lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=max.hirschhorn&quot; class=&quot;user-hover&quot; rel=&quot;max.hirschhorn&quot;&gt;max.hirschhorn&lt;/a&gt;, can we just blacklist these two tests in the DEBUG suites so we clear some red?&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10420">
                    <name>Backports</name>
                                            <outwardlinks description="backported by">
                                                        </outwardlinks>
                                                        </issuelinktype>
                            <issuelinktype id="10011">
                    <name>Depends</name>
                                            <outwardlinks description="depends on">
                                        <issuelink>
            <issuekey id="901102">SERVER-42914</issuekey>
        </issuelink>
                            </outwardlinks>
                                                                <inwardlinks description="is depended on by">
                                                        </inwardlinks>
                                    </issuelinktype>
                            <issuelinktype id="10010">
                    <name>Duplicate</name>
                                                                <inwardlinks description="is duplicated by">
                                        <issuelink>
            <issuekey id="482534">SERVER-32694</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                            <outwardlinks description="related to">
                                        <issuelink>
            <issuekey id="1584600">SERVER-53670</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>11.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18555" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname># of Sprints</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>3.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_12450" key="com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes">
                        <customfieldname>Backport Requested</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="15640"><![CDATA[v4.0]]></customfieldvalue>
    <customfieldvalue key="15141"><![CDATA[v3.6]]></customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10011" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Backwards Compatibility</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10038"><![CDATA[Fully Compatible]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Thu, 18 Jan 2018 23:17:02 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        4 years, 12 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[<s><a href='https://jira.mongodb.org/browse/SERVER-42914'>SERVER-42914</a></s>]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_17050" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Downstream Team Attention</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="16941"><![CDATA[Not Needed]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>luke.bonanomi@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            4 years, 12 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_16465" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Linked BF Score</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>37.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>xgen-internal-githook</customfieldvalue>
            <customfieldvalue>jack.mulrow@mongodb.com</customfieldvalue>
            <customfieldvalue>kaloian.manassiev@mongodb.com</customfieldvalue>
            <customfieldvalue>matthew.saltz@mongodb.com</customfieldvalue>
            <customfieldvalue>randolph@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|htnxs7:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hv2pmn:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10557" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="3198">Sharding 2019-09-09</customfieldvalue>
    <customfieldvalue id="3199">Sharding 2019-09-23</customfieldvalue>
    <customfieldvalue id="3305">Sharding 2019-10-07</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|htnjwn:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>