<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 09:02:07 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[JAVA-4454] Introduce checking benchmark results as part of the release process</title>
                <link>https://jira.mongodb.org/browse/JAVA-4454</link>
                <project id="10006" key="JAVA">Java Driver</project>
                    <description>&lt;p&gt;We have some &lt;a href=&quot;https://evergreen.mongodb.com/task/mongo_java_driver_perf__version~latest_os~linux_topology~standalone_auth~noauth_ssl~nossl_jdk~jdk17_perf_8ecee9af378cb20c5d042fc78d0dc3c447053987_22_01_26_00_04_29##threads=all&amp;amp;selected.GridFS+multi-file+download=1&amp;amp;selected.GridFS+multi-file+upload=1&amp;amp;selected.LDJSON+multi-file+export=1&amp;amp;selected.LDJSON+multi-file+import=1&amp;amp;selected.GridFS+download=1&amp;amp;selected.GridFS+upload=1&amp;amp;selected.Large+doc+bulk+insert=1&amp;amp;selected.Small+doc+bulk+insert=1&amp;amp;selected.Find+many+and+empty+the+cursor=1&amp;amp;selected.Large+doc+insertOne=1&amp;amp;selected.Small+doc+insertOne=1&amp;amp;selected.Find+one+by+ID=1&amp;amp;selected.Run+command=1&amp;amp;selected.Full+BSON+Decoding=1&amp;amp;selected.Deep+BSON+Decoding=1&amp;amp;selected.Flat+BSON+Decoding=1&amp;amp;selected.Full+BSON+Encoding=1&amp;amp;selected.Deep+BSON+Encoding=1&amp;amp;selected.Flat+BSON+Encoding=1&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;cross-language driver benchmarks run by Evergreen&lt;/a&gt;, but there is no automatic detection of regressions, and our release process does not include analyzing manually whether the results are fine or not.&lt;/p&gt;

&lt;p&gt;Checking the results of benchmarks before releasing a new version, and making a decision whether it is acceptable to release based on the results may help us to avoid regressions like &lt;a href=&quot;https://jira.mongodb.org/browse/JAVA-4452&quot; title=&quot;Improve performance characteristics of the connection pool to be on par with the driver 4.2.0&quot; class=&quot;issue-link&quot; data-issue-key=&quot;JAVA-4452&quot;&gt;&lt;del&gt;JAVA-4452&lt;/del&gt;&lt;/a&gt;. When done, adding more benchmarks may further increase our chances of spotting a regression before releasing a version.&lt;/p&gt;

&lt;p&gt;The relevant Evergreen docs:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;&lt;a href=&quot;https://github.com/evergreen-ci/evergreen/wiki/Project-Commands#perfsend&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;&lt;tt&gt;perf.send&lt;/tt&gt; project command&lt;/a&gt;&lt;/li&gt;
	&lt;li&gt;&lt;a href=&quot;https://wiki.corp.mongodb.com/display/DBDEVPROD/Performance+Plugins+in+Evergreen&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;performance plugins&lt;/a&gt;&lt;/li&gt;
	&lt;li&gt;&lt;a href=&quot;https://github.com/10gen/performance-tooling-docs/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;performance tooling&lt;/a&gt; (likely, the most useful link)&lt;/li&gt;
	&lt;li&gt;a new &lt;a href=&quot;https://github.com/10gen/performance-tooling-docs/blob/main/data_analysis/performance_discovery_docs.md&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;performance discovery tool&lt;/a&gt; from performance tooling, that ironically discovers benchmark regressions (see the &quot;Performance Test Results&quot; tab) when &lt;a href=&quot;https://dag-metrics-webapp.server-tig.staging.corp.mongodb.com/perf-analyzer-viz/dag-metrics-webapp.server-tig.staging.corp.mongodb.com/perf-analyzer-viz/dag-metrics-webapp.server-tig.staging.corp.mongodb.com/perf-analyzer-viz/dag-metrics-webapp.server-tig.staging.corp.mongodb.com/perf-analyzer-viz/?&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;comparing 4.5 against 4.4&lt;/a&gt; &lt;img class=&quot;emoticon&quot; src=&quot;https://jira.mongodb.org/images/icons/emoticons/smile.png&quot; height=&quot;16&quot; width=&quot;16&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt; But that is because the existing benchmarks are not able to feel the degradation&lt;sup&gt;1&lt;/sup&gt; in &lt;a href=&quot;https://jira.mongodb.org/browse/JAVA-4452&quot; title=&quot;Improve performance characteristics of the connection pool to be on par with the driver 4.2.0&quot; class=&quot;issue-link&quot; data-issue-key=&quot;JAVA-4452&quot;&gt;&lt;del&gt;JAVA-4452&lt;/del&gt;&lt;/a&gt; which was fixed in 4.5.&lt;/li&gt;
&lt;/ul&gt;


&lt;hr /&gt;

&lt;p&gt;&lt;sup&gt;1&lt;/sup&gt; It does not seem like the existing &lt;a href=&quot;https://evergreen.mongodb.com/task/mongo_java_driver_perf__version~latest_os~linux_topology~standalone_auth~noauth_ssl~nossl_jdk~jdk11_perf_40719ce0c81f30520da1fc50d025a6b285470e89_21_07_19_13_53_18##threads=all&amp;amp;selected.Flat+BSON+Encoding=1&amp;amp;selected.Deep+BSON+Encoding=1&amp;amp;selected.Full+BSON+Encoding=1&amp;amp;selected.Flat+BSON+Decoding=1&amp;amp;selected.Deep+BSON+Decoding=1&amp;amp;selected.Full+BSON+Decoding=1&amp;amp;selected.Run+command=1&amp;amp;selected.Find+one+by+ID=1&amp;amp;selected.Small+doc+insertOne=1&amp;amp;selected.Large+doc+insertOne=1&amp;amp;selected.Find+many+and+empty+the+cursor=1&amp;amp;selected.Small+doc+bulk+insert=1&amp;amp;selected.Large+doc+bulk+insert=1&amp;amp;selected.GridFS+upload=1&amp;amp;selected.GridFS+download=1&amp;amp;selected.LDJSON+multi-file+import=1&amp;amp;selected.LDJSON+multi-file+export=1&amp;amp;selected.GridFS+multi-file+upload=1&amp;amp;selected.GridFS+multi-file+download=1&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;driver benchmarks&lt;/a&gt; show the &lt;a href=&quot;https://jira.mongodb.org/browse/JAVA-4452&quot; title=&quot;Improve performance characteristics of the connection pool to be on par with the driver 4.2.0&quot; class=&quot;issue-link&quot; data-issue-key=&quot;JAVA-4452&quot;&gt;&lt;del&gt;JAVA-4452&lt;/del&gt;&lt;/a&gt; regression. There is no data before May 18, but based on the Jira tickets that caused &lt;a href=&quot;https://jira.mongodb.org/browse/JAVA-4452&quot; title=&quot;Improve performance characteristics of the connection pool to be on par with the driver 4.2.0&quot; class=&quot;issue-link&quot; data-issue-key=&quot;JAVA-4452&quot;&gt;&lt;del&gt;JAVA-4452&lt;/del&gt;&lt;/a&gt;, the commits to master happened on Apr 14, May 1, Jun 8, Sep 27, and I don&apos;t see charts having a stair step shape near those dates.&lt;/p&gt;</description>
                <environment></environment>
        <key id="1971802">JAVA-4454</key>
            <summary>Introduce checking benchmark results as part of the release process</summary>
                <type id="3" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14718&amp;avatarType=issuetype">Task</type>
                                            <priority id="10300" iconUrl="https://jira.mongodb.org/images/icons/priorities/medium.svg">Unknown</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="3">Duplicate</resolution>
                                        <assignee username="-1">Unassigned</assignee>
                                    <reporter username="valentin.kovalenko@mongodb.com">Valentin Kavalenka</reporter>
                        <labels>
                    </labels>
                <created>Wed, 26 Jan 2022 21:36:16 +0000</created>
                <updated>Thu, 28 Sep 2023 14:15:44 +0000</updated>
                            <resolved>Thu, 28 Sep 2023 14:14:46 +0000</resolved>
                                                                    <component>Performance</component>
                                        <votes>0</votes>
                                    <watches>3</watches>
                                                                                                                    <issuelinks>
                            <issuelinktype id="10010">
                    <name>Duplicate</name>
                                            <outwardlinks description="duplicates">
                                        <issuelink>
            <issuekey id="2388801">JAVA-5065</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                                                <inwardlinks description="is related to">
                                        <issuelink>
            <issuekey id="1974218">JAVA-4462</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="1970791">JAVA-4452</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_14266" key="com.atlassian.jira.plugin.system.customfieldtypes:textarea">
                        <customfieldname>Documentation Changes Summary</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>&lt;p&gt;1.  What would you like to communicate to the user about this feature?&lt;br/&gt;
2.  Would you like the user to see examples of the syntax and/or executable code and its output?&lt;br/&gt;
3.  Which versions of the driver/connector does this apply to?&lt;/p&gt;</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_21553" key="com.atlassian.jira.plugin.system.customfieldtypes:labels">
                        <customfieldname>Quarter</customfieldname>
                        <customfieldvalues>
                                        <label>FY24Q3</label>
    
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|i01av3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            </customfields>
    </item>
</channel>
</rss>