<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 04:41:57 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-36076] Create new resmoke.py test suite for running mongoebench on a desktop</title>
                <link>https://jira.mongodb.org/browse/SERVER-36076</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;It should run &lt;tt&gt;mongoebench&lt;/tt&gt; with the various JSON config files that live in the &lt;tt&gt;src/third_party/mongo-perf/mongoebench/&lt;/tt&gt; directory that have been vendored into the source tree as part of the changes from &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-36069&quot; title=&quot;Vendor mongoebench-compatible JSON config files from mongodb/mongo-perf into src/third_party&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-36069&quot;&gt;&lt;del&gt;SERVER-36069&lt;/del&gt;&lt;/a&gt;.&lt;/p&gt;

&lt;p&gt;This involves creating a new &lt;tt&gt;buildscripts/resmokelib/testing/testcases/mongoebench_test.py&lt;/tt&gt; test case that executes &lt;tt&gt;mongoebench&lt;/tt&gt; with the appropriate arguments. For example, the value for the &lt;tt&gt;&amp;#45;&amp;#45;benchmarkMinTimeSecs&lt;/tt&gt; command line option should be forwarded as the &lt;tt&gt;&amp;#45;&amp;#45;time&lt;/tt&gt; command line option to &lt;tt&gt;mongoebench&lt;/tt&gt;.&lt;/p&gt;

&lt;p&gt;This also involves creating a new hook similar to &lt;a href=&quot;https://github.com/mongodb/mongo/blob/r4.0.0/buildscripts/resmokelib/testing/hooks/combine_benchmark_results.py&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;the &lt;tt&gt;CombineBenchmarkResults&lt;/tt&gt; hook&lt;/a&gt; that parses the JSON stats file specified as the &lt;tt&gt;&amp;#45;&amp;#45;output&lt;/tt&gt; command line option (from &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-36073&quot; title=&quot;Save stats from BenchRunner::finish() to a JSON file in mongoebench&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-36073&quot;&gt;&lt;del&gt;SERVER-36073&lt;/del&gt;&lt;/a&gt;) to &lt;tt&gt;mongoebench&lt;/tt&gt;. The new hook should accumulate benchmark results of all the test cases we run as part of the test suite and serialize them as a JSON file (taking its name from the &lt;tt&gt;&lt;br class=&quot;atl-forced-newline&quot; /&gt;--perfReportFile&lt;/tt&gt; command line option) that can be used for the &lt;tt&gt;json.send&lt;/tt&gt; Evergreen command to display the performance results. The test case should also handle the &lt;tt&gt;&amp;#45;&amp;#45;benchmarkRepetitions&lt;/tt&gt; command line option (in Python, as there is no equivalent option to forward to &lt;tt&gt;mongoebench&lt;/tt&gt;) and accumulate the benchmark results of multiple executions.&lt;/p&gt;

&lt;p&gt;We may find it beneficial to define separate test suites that each run a subset of the test cases &lt;a href=&quot;https://evergreen.mongodb.com/build/performance_linux_wt_standalone_80c7c825a44cf99b17e81f4233445c7ab1927706_18_07_11_01_45_09&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;similar to what is done in the performance Evergreen project when these test cases are run with benchrun.py&lt;/a&gt; to avoid having an Evergreen task run for a long time.&lt;/p&gt;</description>
                <environment></environment>
        <key id="570436">SERVER-36076</key>
            <summary>Create new resmoke.py test suite for running mongoebench on a desktop</summary>
                <type id="2" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14711&amp;avatarType=issuetype">New Feature</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="13201">Fixed</resolution>
                                        <assignee username="jonathan.abrahams">Jonathan Abrahams</assignee>
                                    <reporter username="max.hirschhorn@mongodb.com">Max Hirschhorn</reporter>
                        <labels>
                    </labels>
                <created>Wed, 11 Jul 2018 18:34:15 +0000</created>
                <updated>Sun, 29 Oct 2023 22:29:55 +0000</updated>
                            <resolved>Mon, 13 Aug 2018 16:24:39 +0000</resolved>
                                                    <fixVersion>4.0.3</fixVersion>
                    <fixVersion>4.1.2</fixVersion>
                                    <component>Performance</component>
                    <component>Testing Infrastructure</component>
                                        <votes>0</votes>
                                    <watches>3</watches>
                                                                                                                <comments>
                            <comment id="2011273" author="xgen-internal-githook" created="Sat, 22 Sep 2018 19:47:41 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Jonathan Abrahams&apos;, &apos;email&apos;: &apos;jonathan@mongodb.com&apos;, &apos;username&apos;: &apos;hptabster&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-36076&quot; title=&quot;Create new resmoke.py test suite for running mongoebench on a desktop&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-36076&quot;&gt;&lt;del&gt;SERVER-36076&lt;/del&gt;&lt;/a&gt; Create new resmoke.py test suite for running mongoebench on a desktop&lt;/p&gt;

&lt;p&gt;(cherry picked from commit a444720202d97795b71cf2daaaa2bea94b430ef9)&lt;br/&gt;
Branch: v4.0&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/1b0a962b03696784741ff9f4e83b2f084d1d88d7&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/1b0a962b03696784741ff9f4e83b2f084d1d88d7&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="1974221" author="xgen-internal-githook" created="Mon, 13 Aug 2018 16:24:15 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Jonathan Abrahams&apos;, &apos;email&apos;: &apos;jonathan@mongodb.com&apos;, &apos;username&apos;: &apos;hptabster&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-36076&quot; title=&quot;Create new resmoke.py test suite for running mongoebench on a desktop&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-36076&quot;&gt;&lt;del&gt;SERVER-36076&lt;/del&gt;&lt;/a&gt; Create new resmoke.py test suite for running mongoebench on a desktop&lt;br/&gt;
Branch: master&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/a444720202d97795b71cf2daaaa2bea94b430ef9&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/a444720202d97795b71cf2daaaa2bea94b430ef9&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="1951171" author="max.hirschhorn@10gen.com" created="Thu, 19 Jul 2018 14:45:59 +0000"  >&lt;p&gt;I think we should just run these on the centos6-perf distro as part of a daily or non-required build variant.&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10420">
                    <name>Backports</name>
                                            <outwardlinks description="backported by">
                                                        </outwardlinks>
                                                        </issuelinktype>
                            <issuelinktype id="10011">
                    <name>Depends</name>
                                            <outwardlinks description="depends on">
                                        <issuelink>
            <issuekey id="570272">SERVER-36069</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="570338">SERVER-36073</issuekey>
        </issuelink>
                            </outwardlinks>
                                                                <inwardlinks description="is depended on by">
                                        <issuelink>
            <issuekey id="570442">SERVER-36077</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                            <issuelinktype id="10520">
                    <name>Problem/Incident</name>
                                            <outwardlinks description="causes">
                                        <issuelink>
            <issuekey id="601662">SERVER-37060</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>3.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18555" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname># of Sprints</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_12450" key="com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes">
                        <customfieldname>Backport Requested</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="15640"><![CDATA[v4.0]]></customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10011" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Backwards Compatibility</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10038"><![CDATA[Fully Compatible]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Tue, 31 Jul 2018 20:37:54 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        5 years, 20 weeks, 4 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[<s><a href='https://jira.mongodb.org/browse/SERVER-36073'>SERVER-36073</a></s>, <s><a href='https://jira.mongodb.org/browse/SERVER-36069'>SERVER-36069</a></s>]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                            <customfield id="customfield_10857" key="com.pyxis.greenhopper.jira:gh-epic-link">
                        <customfieldname>Epic Link</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>PM-989</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>luke.bonanomi@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            5 years, 20 weeks, 4 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>xgen-internal-githook</customfieldvalue>
            <customfieldvalue>jonathan.abrahams</customfieldvalue>
            <customfieldvalue>max.hirschhorn@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hu2ga7:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|htj7e7:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10557" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="2422">TIG 2018-08-27</customfieldvalue>
    <customfieldvalue id="2453">TIG 2018-08-13</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10555" key="com.atlassian.jira.plugin.system.customfieldtypes:float">
                        <customfieldname>Story Points</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>5.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hu22jj:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>