<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 05:40:32 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-56921] Task generation should depend on the completion of compile_dist_test</title>
                <link>https://jira.mongodb.org/browse/SERVER-56921</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;If task generation is not constrained to depend on the completion of &lt;tt&gt;compile_dist_test&lt;/tt&gt;, then the task generation tasks can end up queued in front of &lt;tt&gt;compile_dist_test&lt;/tt&gt;. That&apos;s essentially a priority inversion, since the tasks generated by the task generation tasks can&apos;t actually execute until after &lt;tt&gt;archive_dist_test_&lt;span class=&quot;error&quot;&gt;&amp;#91;debug&amp;#93;&lt;/span&gt;&lt;/tt&gt; runs, and that task depends on &lt;tt&gt;compile_dist_test&lt;/tt&gt;. Worse, other tasks which depend on &lt;tt&gt;compile_dist_test&lt;/tt&gt;, like &lt;tt&gt;compile_unittests&lt;/tt&gt;, are also delayed if task generation preempts &lt;tt&gt;compile_dist_test&lt;/tt&gt;, despite the fact that they could run in parallel with task generation, since the generated tasks don&apos;t depend on those artifacts.&lt;/p&gt;

&lt;p&gt;Another factor to consider is that if &lt;tt&gt;compile_dist_test&lt;/tt&gt; fails, then all of the task generation work was entirely wasted. While that may not be that common an occurrence in the commit queue or waterfall, it is a very common occurrence in patch builds.&lt;/p&gt;

&lt;p&gt;The best way to address this would be to make task generation depend on the start of &lt;tt&gt;archive_dist_test&lt;span class=&quot;error&quot;&gt;&amp;#91;_debug&amp;#93;&lt;/span&gt;&lt;/tt&gt;. That way, task generation would run in parallel with archiving the results of &lt;tt&gt;compile_dist_test&lt;/tt&gt;. If &lt;tt&gt;compile_dist_test&lt;/tt&gt; fails, then &lt;tt&gt;archive_dist_test&lt;/tt&gt; will never start and no task generation will happen. If &lt;tt&gt;compile_dist_test&lt;/tt&gt; passes, then task generation would proceed in parallel with archiving up the results if &lt;tt&gt;compile_dist_test&lt;/tt&gt;, and that task has a very low failure rate, so there is little chance of wasted work. Unfortunately, we can&apos;t make task generation wait on the start of a task until we have EVG-14537.&lt;/p&gt;

&lt;p&gt;Since we don&apos;t currently have the ability to make task generation wait on the start of &lt;tt&gt;archive_dist_test&lt;span class=&quot;error&quot;&gt;&amp;#91;_debug&amp;#93;&lt;/span&gt;&lt;/tt&gt;, we should do the next best thing, and make it wait on the completion of &lt;tt&gt;compile_dist_test&lt;/tt&gt;, which is very nearly the same thing.&lt;/p&gt;


</description>
                <environment></environment>
        <key id="1714730">SERVER-56921</key>
            <summary>Task generation should depend on the completion of compile_dist_test</summary>
                <type id="4" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14710&amp;avatarType=issuetype">Improvement</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="3">Duplicate</resolution>
                                        <assignee username="david.bradford@mongodb.com">David Bradford</assignee>
                                    <reporter username="andrew.morrow@mongodb.com">Andrew Morrow</reporter>
                        <labels>
                            <label>tig-diag-patch-build</label>
                            <label>tig-evgconfig</label>
                    </labels>
                <created>Thu, 13 May 2021 16:04:11 +0000</created>
                <updated>Wed, 7 Jul 2021 20:55:29 +0000</updated>
                            <resolved>Wed, 7 Jul 2021 20:55:17 +0000</resolved>
                                                                    <component>Testing Infrastructure</component>
                                        <votes>0</votes>
                                    <watches>2</watches>
                                                                                                                <comments>
                            <comment id="3921706" author="david.bradford" created="Wed, 7 Jul 2021 20:55:17 +0000"  >&lt;p&gt;With the changes to &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-57003&quot; title=&quot;Generate all tasks for a build variant in a single task&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-57003&quot;&gt;&lt;del&gt;SERVER-57003&lt;/del&gt;&lt;/a&gt;, the situation described in this tickets goes away. We changed how task generation works, so only a single task in each build variant will do the task generation. The single &quot;*&lt;em&gt;gen&quot; still exist and are needed to activate the generated tasks, but they have all been marked as dependent on `archive_dist_test&lt;/em&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;debug&amp;#93;&lt;/span&gt;`. &lt;/p&gt;</comment>
                            <comment id="3872862" author="maria.vankeulen" created="Fri, 11 Jun 2021 12:10:35 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=david.bradford&quot; class=&quot;user-hover&quot; rel=&quot;david.bradford&quot;&gt;david.bradford&lt;/a&gt; Could we consider blocking this on &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-57003&quot; title=&quot;Generate all tasks for a build variant in a single task&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-57003&quot;&gt;&lt;del&gt;SERVER-57003&lt;/del&gt;&lt;/a&gt;, to reduce the number of moving parts in flight here? IIRC, we were leaning towards running generators on all commits without scheduling the generated tasks in order to accommodate stepback in this new single-generator approach. If the generators must run only after compile, the UX for &apos;inactive&apos; commits would be tricky and we&apos;d end up consuming an even larger amount of host resources by default. I see we&apos;re now doing a scope + design for this, so perhaps the approach might change, but could we finalize the generator story before proceeding with the dependency change? CC &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=brian.samek&quot; class=&quot;user-hover&quot; rel=&quot;brian.samek&quot;&gt;brian.samek&lt;/a&gt; &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=annie.black&quot; class=&quot;user-hover&quot; rel=&quot;annie.black&quot;&gt;annie.black&lt;/a&gt;&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10011">
                    <name>Depends</name>
                                                                <inwardlinks description="is depended on by">
                                        <issuelink>
            <issuekey id="1714747">SERVER-56922</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                            <issuelinktype id="10010">
                    <name>Duplicate</name>
                                                                <inwardlinks description="is duplicated by">
                                        <issuelink>
            <issuekey id="1718899">SERVER-57003</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                            <outwardlinks description="related to">
                                        <issuelink>
            <issuekey id="1718899">SERVER-57003</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18555" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname># of Sprints</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Fri, 11 Jun 2021 12:10:35 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        2 years, 31 weeks ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                            <customfield id="customfield_10857" key="com.pyxis.greenhopper.jira:gh-epic-link">
                        <customfieldname>Epic Link</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>PM-2318</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>david.bradford@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            2 years, 31 weeks ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>andrew.morrow@mongodb.com</customfieldvalue>
            <customfieldvalue>david.bradford@mongodb.com</customfieldvalue>
            <customfieldvalue>maria.vankeulen@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hzal4n:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hz6o2v:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10557" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="4866">DAG 2021-06-28</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10555" key="com.atlassian.jira.plugin.system.customfieldtypes:float">
                        <customfieldname>Story Points</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hza7dr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>