<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 04:26:02 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-31112] Create dedicated &quot;slow&quot; machine evergreen variants</title>
                <link>https://jira.mongodb.org/browse/SERVER-31112</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;For teams like sharding and replication, Javascript test reliability is often dependent on the hardware speed of the machines they run on, since there are multiple nodes that are in communication with each other. In the past, slow machines have exposed either flaky tests or actual bugs that wouldn&apos;t manifest themselves on a high performance machine. It seems that having a dedicated set of variants, with controllable levels of &quot;slowness&quot; could be a useful part of our test infrastructure. The slowness parameters could include disk, network, CPU, etc, with potentially separate variants for different types. This could expose our system and tests to varying types of stress that may or may not be explicitly tested currently. Tests which &lt;em&gt;are&lt;/em&gt; dependent on timing and machine speed could likely be ignored by such a variant.&lt;/p&gt;

&lt;p&gt;The main goals of these &quot;slow&quot; variants would be the following:&lt;/p&gt;

&lt;p&gt;1. &lt;b&gt;Expose Test Flakiness&lt;/b&gt;: Provide stronger and more explicit verification that tests aren&apos;t &quot;flaky&quot;. That is, tests that &lt;em&gt;shouldn&apos;t&lt;/em&gt; be dependent on machine speed should not fail due to a machine speed issue.&lt;br/&gt;
2. &lt;b&gt;Expose Timing Dependent Server Bugs&lt;/b&gt;: Provide a more efficient and potentially reproducible way of exposing bugs in the server that only manifest as a result of non-standard system conditions i.e. extremely slow network, disk, CPU.&lt;/p&gt;

&lt;p&gt;To achieve the above two goals, we would likely need to determine which of our tests are to be considered &quot;timing-agnostic&quot;, and run only those tests on the slow variants, so that we don&apos;t produce extra noise from tests that &lt;em&gt;are&lt;/em&gt; timing dependent. If these &quot;timing-agnostic&quot; tests truly are valid tests, then they should never fail due to criteria 1 and 2 noted above. That is, they are not flaky, and there are no timing dependent bugs that they would ever expose. &lt;/p&gt;

&lt;p&gt;If these slow variants were also integrated into patch build workflows from an early stage, they could act as an extra guard against tests that may introduce flakiness or intermittent failures into the Evergreen master branch.&lt;/p&gt;</description>
                <environment></environment>
        <key id="428339">SERVER-31112</key>
            <summary>Create dedicated &quot;slow&quot; machine evergreen variants</summary>
                <type id="4" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14710&amp;avatarType=issuetype">Improvement</type>
                                            <priority id="4" iconUrl="https://jira.mongodb.org/images/icons/priorities/minor.svg">Minor - P4</priority>
                        <status id="10038" iconUrl="https://jira.mongodb.org/images/icons/subtask.gif" description="">Backlog</status>
                    <statusCategory id="2" key="new" colorName="default"/>
                                    <resolution id="-1">Unresolved</resolution>
                                        <assignee username="backlog-server-stm">Backlog - Server Tooling and Methods (STM)</assignee>
                                    <reporter username="william.schultz@mongodb.com">William Schultz</reporter>
                        <labels>
                            <label>stm</label>
                    </labels>
                <created>Fri, 15 Sep 2017 21:09:32 +0000</created>
                <updated>Tue, 6 Dec 2022 03:51:52 +0000</updated>
                                                                            <component>Testing Infrastructure</component>
                                        <votes>0</votes>
                                    <watches>5</watches>
                                                                                                                <comments>
                            <comment id="4539977" author="steven.vannelli" created="Tue, 10 May 2022 21:32:19 +0000"  >&lt;p&gt;Moving this ticket to the Backlog and removing the &quot;Backlog&quot; fixVersion as per our latest policy for using fixVersions. &lt;/p&gt;</comment>
                            <comment id="1674576" author="william.schultz" created="Fri, 15 Sep 2017 22:00:47 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=max.hirschhorn&quot; class=&quot;user-hover&quot; rel=&quot;max.hirschhorn&quot;&gt;max.hirschhorn&lt;/a&gt; Do the above goals seem rational to you?&lt;/p&gt;</comment>
                            <comment id="1674530" author="max.hirschhorn@10gen.com" created="Fri, 15 Sep 2017 21:18:10 +0000"  >&lt;p&gt;Scott had an idea around doing this in &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-21558&quot; title=&quot;Add evergreen variant that uses a single core&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-21558&quot;&gt;&lt;del&gt;SERVER-21558&lt;/del&gt;&lt;/a&gt; with controlling CPU resources. &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=william.schultz&quot; class=&quot;user-hover&quot; rel=&quot;william.schultz&quot;&gt;william.schultz&lt;/a&gt;, could you clarify what you view the goals of this new Evergreen build variant would be? Is it (a) that tests shouldn&apos;t fail even when run on a &quot;slow&quot; host, (b) that we identify tests which &lt;em&gt;can&lt;/em&gt; fail when run on a &quot;slow&quot; host, or (c) something else?&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>3.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                <customfield id="customfield_12751" key="com.atlassian.jira.plugin.system.customfieldtypes:multiselect">
                        <customfieldname>Assigned Teams</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="25142"><![CDATA[Server Tooling & Methods]]></customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Fri, 15 Sep 2017 21:18:10 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        1 year, 39 weeks, 1 day ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>alexander.golin@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            1 year, 39 weeks, 1 day ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>backlog-server-stm</customfieldvalue>
            <customfieldvalue>max.hirschhorn@mongodb.com</customfieldvalue>
            <customfieldvalue>steven.vannelli@mongodb.com</customfieldvalue>
            <customfieldvalue>william.schultz@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hteylj:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|ht6t0f:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|htekov:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>