<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 04:32:31 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-33162] Make the update fuzzer run faster</title>
                <link>https://jira.mongodb.org/browse/SERVER-33162</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;The update fuzzer runs at up to 15x slower on the 3.6 branch compare with master. This is especially pronounced in the OS X and Code Coverage variants. (Enterprise OS X MMAP1, SSL OS X, RHEL 6.2 DEBUG Code Coverage), causing timeouts in the &lt;tt&gt;update_fuzzer_replication&lt;/tt&gt; suite on these variants. The other variants all suffer between a 2x to 5x slowdown, but not enough to trigger a timeout.&lt;/p&gt;

&lt;p&gt;The slowdown is likely caused by the additional work of resetting the database and running more JavaScript in the shell to handle blacklisting. 3.7 has not had a similar problem so far, but it should experience a similar slowdown as more known differences are discovered between 3.7 and 3.6.&lt;/p&gt;

&lt;p&gt;It might be a good idea to proactively reduce the number of fuzzer generated files and the size of each file to prevent sporadic failures in the future, especially for the &lt;tt&gt;update_fuzzer_replication&lt;/tt&gt; suite.&lt;/p&gt;</description>
                <environment></environment>
        <key id="493832">SERVER-33162</key>
            <summary>Make the update fuzzer run faster</summary>
                <type id="4" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14710&amp;avatarType=issuetype">Improvement</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="2">Won&apos;t Fix</resolution>
                                        <assignee username="backlog-server-stm">Backlog - Server Tooling and Methods (STM)</assignee>
                                    <reporter username="robert.guo@mongodb.com">Robert Guo</reporter>
                        <labels>
                            <label>stm</label>
                    </labels>
                <created>Wed, 7 Feb 2018 16:48:18 +0000</created>
                <updated>Tue, 6 Dec 2022 03:38:45 +0000</updated>
                            <resolved>Fri, 3 Dec 2021 18:39:46 +0000</resolved>
                                    <version>3.6.2</version>
                                                    <component>Testing Infrastructure</component>
                                        <votes>0</votes>
                                    <watches>2</watches>
                                                                                                                <comments>
                            <comment id="4230151" author="brooke.miller" created="Fri, 3 Dec 2021 18:39:46 +0000"  >&lt;p&gt;STM doesn&apos;t have bandwidth to pick this up, so we&apos;re closing as won&apos;t fix. However, if other teams have capacity and would like to pursue this, please feel free to pick this up.&lt;/p&gt;</comment>
                            <comment id="1799086" author="max.hirschhorn@10gen.com" created="Thu, 8 Feb 2018 05:56:24 +0000"  >&lt;blockquote&gt;
&lt;p&gt;Max Hirschhorn I didn&apos;t think of setting &lt;tt&gt;continue_on_failure=true&lt;/tt&gt;, is the goal to ensure we have some coverage data even if the task times out? &lt;/p&gt;&lt;/blockquote&gt;

&lt;p&gt;Sorry, I managed to type &lt;tt&gt;continue_on_failure=true&lt;/tt&gt; when looking to see what defaults are set via the &lt;tt&gt;&amp;amp;jstestfuzz_config_vars&lt;/tt&gt; anchor. What I really meant to say is &quot;Should we start out with setting &lt;tt&gt;run_multiple_jobs=true&lt;/tt&gt; for the update fuzzer because each of the tests start their own MongoDB deployment?&quot;&lt;/p&gt;

&lt;p&gt;Even when the Evergreen task times out, the code coverage generated thus far is still uploaded to S3. I don&apos;t think there&apos;s a lot of value in running with &lt;tt&gt;continue_on_failure=true&lt;/tt&gt; because any failure in one of the generated files is signal that something has gone wrong and knowing that five more generated files would have failed as well doesn&apos;t seem particularly helpful as more signal. I think Evergreen&apos;s stepback should be &quot;good enough&quot; to help identify the problematic commit.&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;Lowering the number of generated files for OS X and ARM sounds good. But we&apos;d probably have to introduce a new &quot;setMultiplier&quot; on the fuzzer&apos;s side since the number of generated files is different for different suites.&lt;/p&gt;&lt;/blockquote&gt;

&lt;p&gt;I was thinking of just having an expansion that defines a fixed number of generated files to create and used it in each of the task definitions. We could also define a ratio but I&apos;m not sure it is worth introducing the complexity equivalent to how the number of resmoke.py jobs are determined by the &quot;run tests&quot; function.&lt;/p&gt;</comment>
                            <comment id="1798908" author="robert.guo" created="Thu, 8 Feb 2018 00:01:40 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=max.hirschhorn&quot; class=&quot;user-hover&quot; rel=&quot;max.hirschhorn&quot;&gt;max.hirschhorn&lt;/a&gt; I didn&apos;t think of setting &lt;tt&gt;continue_on_failure=true&lt;/tt&gt;, is the goal to ensure we have some coverage data even if the task times out? &lt;/p&gt;

&lt;p&gt;Lowering the number of generated files for OS X and ARM sounds good. But we&apos;d probably have to introduce a new &quot;setMultiplier&quot; on the fuzzer&apos;s side since the number of generated files is different for different suites.&lt;/p&gt;</comment>
                            <comment id="1798859" author="max.hirschhorn@10gen.com" created="Wed, 7 Feb 2018 22:59:15 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=robert.guo&quot; class=&quot;user-hover&quot; rel=&quot;robert.guo&quot;&gt;robert.guo&lt;/a&gt;, should we start out with setting &lt;tt&gt;continue_on_failure=true&lt;/tt&gt; for the update fuzzer because each of the tests start their own MongoDB deployment? It won&apos;t address any issues with the OS X machines, but I&apos;ve been debating whether we should lower the number of generated files we run on the OS X and ARM machines altogether (i.e. even for &lt;tt&gt;jstestfuzz*&lt;/tt&gt; Evergreen tasks).&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>4.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                <customfield id="customfield_12751" key="com.atlassian.jira.plugin.system.customfieldtypes:multiselect">
                        <customfieldname>Assigned Teams</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="25142"><![CDATA[Server Tooling & Methods]]></customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Wed, 7 Feb 2018 22:59:15 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        2 years, 9 weeks, 5 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>alexander.golin@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            2 years, 9 weeks, 5 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>backlog-server-stm</customfieldvalue>
            <customfieldvalue>brooke.miller@mongodb.com</customfieldvalue>
            <customfieldvalue>max.hirschhorn@mongodb.com</customfieldvalue>
            <customfieldvalue>robert.guo@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|htptw7:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hthc3j:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|htpg0v:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>