<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 05:40:13 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-56793] running dbtest with no suites should be an error</title>
                <link>https://jira.mongodb.org/browse/SERVER-56793</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Long ago, dbtest could be run with no args, and all the suites inside dbtest would run.  This was how buildbot tested dbtest.  &lt;br/&gt;
After the introduction of Evergreen, we switched the testing of dbtest to run each suite with a separate invocation of dbtest, in order to parallelize the run and make it faster.  This means we lost test coverage of running dbtest with no arguments, and thus today dbtest actually fails if you run it with no arguments, since some tests leave behind state that cause subsequent tests to fail.&lt;br/&gt;
Since we have no plans to ever add back an Evergreen suite that runs dbtest with no arguments, we should make it an error to operate dbtest in this way, to prevent engineer confusion in the future.  The error message should provide guidance as to how to run dbtest correctly (using resmoke will run dbtest separately for each suite, for example).&lt;/p&gt;</description>
                <environment></environment>
        <key id="1708501">SERVER-56793</key>
            <summary>running dbtest with no suites should be an error</summary>
                <type id="4" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14710&amp;avatarType=issuetype">Improvement</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="13201">Fixed</resolution>
                                        <assignee username="mikhail.shchatko@mongodb.com">Mikhail Shchatko</assignee>
                                    <reporter username="milkie@mongodb.com">Eric Milkie</reporter>
                        <labels>
                    </labels>
                <created>Mon, 10 May 2021 14:02:24 +0000</created>
                <updated>Sun, 29 Oct 2023 21:53:49 +0000</updated>
                            <resolved>Wed, 9 Jun 2021 09:38:49 +0000</resolved>
                                                    <fixVersion>5.1.0-rc0</fixVersion>
                                                        <votes>2</votes>
                                    <watches>5</watches>
                                                                                                                <comments>
                            <comment id="4108151" author="JIRAUSER1259052" created="Wed, 6 Oct 2021 18:58:29 +0000"  >&lt;p&gt;Updating the fixversion since branching activities occurred yesterday. This ticket will be in rc0 when it&#8217;s been triggered. For more active release information, please keep an eye on #server-release. Thank you!&lt;/p&gt;</comment>
                            <comment id="3868025" author="xgen-internal-githook" created="Wed, 9 Jun 2021 09:34:15 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Mikhail Shchatko&apos;, &apos;email&apos;: &apos;mikhail.shchatko@mongodb.com&apos;, &apos;username&apos;: &apos;MikhailShchatko&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-56793&quot; title=&quot;running dbtest with no suites should be an error&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-56793&quot;&gt;&lt;del&gt;SERVER-56793&lt;/del&gt;&lt;/a&gt; running dbtest with no suites should be an error&lt;br/&gt;
Branch: master&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/46713337424f8d6c1541a5cb004a4364cf94f615&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/46713337424f8d6c1541a5cb004a4364cf94f615&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="3860011" author="louis.williams" created="Fri, 4 Jun 2021 15:29:02 +0000"  >&lt;p&gt;I don&apos;t know if waterfall and build failures are a good measure of the usefulness of &lt;tt&gt;dbtest&lt;/tt&gt;. Like unit tests, &lt;tt&gt;dbtest&lt;/tt&gt; is required for patch builds and are mostly deterministic. Commits with failures are often due to negligence or unexpected interactions with non-required builders (like ephemeralForTest).&lt;/p&gt;

&lt;p&gt;I think we have quite a few dbtests that provide value. For example, proving that our WT &lt;a href=&quot;https://github.com/mongodb/mongo/blob/master/src/mongo/dbtests/storage_timestamp_tests.cpp&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;timestamping logic  works&lt;/a&gt;, and that our &lt;a href=&quot;https://github.com/mongodb/mongo/blob/master/src/mongo/dbtests/validate_tests.cpp&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;validate implementation works&lt;/a&gt;.&lt;/p&gt;

&lt;p&gt;This is not to say that these tests need to stay in &lt;tt&gt;dbtest&lt;/tt&gt;, as they could be moved to be unit tests, but I don&apos;t think we can delete these tests entirely. That timestamping test pulls in the entire system, so it would also be a hassle to migrate. &lt;/p&gt;</comment>
                            <comment id="3859880" author="acm" created="Fri, 4 Jun 2021 14:52:36 +0000"  >&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;How many BFs resolved as &quot;fixed&quot; have been due to a waterfall failure in &lt;tt&gt;dbtest&lt;/tt&gt; in the past year?&lt;/li&gt;
	&lt;li&gt;How many commit queue merge failures have been because of a failure in &lt;tt&gt;dbtest&lt;/tt&gt; in the past year?&lt;/li&gt;
	&lt;li&gt;What percent of patch runs of &lt;tt&gt;dbtest&lt;/tt&gt; have failed in the past year?&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;If we don&apos;t want to invest the energy to keep this monolith functioning correctly, I think we should consider whether it is actually delivering value. If not, perhaps we should delete it.&lt;/p&gt;</comment>
                            <comment id="3857441" author="milkie" created="Thu, 3 Jun 2021 14:42:35 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=robert.guo&quot; class=&quot;user-hover&quot; rel=&quot;robert.guo&quot;&gt;robert.guo&lt;/a&gt; sorry I should have been more exact in my report; we need to error out if dbtest is started with nothing for &quot;suite&quot; in the following:&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;usage: build/install/bin/dbtest [options] [suite]...&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;(All the options start with a hyphen.) So I think you need to go to the place where the suites are parsed out of the command line and error out there instead.&lt;/p&gt;</comment>
                            <comment id="3857416" author="robert.guo" created="Thu, 3 Jun 2021 14:35:35 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=mikhail.shchatko&quot; class=&quot;user-hover&quot; rel=&quot;mikhail.shchatko&quot;&gt;mikhail.shchatko&lt;/a&gt;&#160;We can check if &lt;tt&gt;argc == 1&lt;/tt&gt; &lt;a href=&quot;https://github.com/mongodb/mongo/blob/fbc4a0423c4930139b719ed5fee985af52b92e90/src/mongo/dbtests/dbtests.cpp#L232&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;here&lt;/a&gt;&#160;and error out with a detailed message if so.&lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=acm&quot; class=&quot;user-hover&quot; rel=&quot;acm&quot;&gt;acm&lt;/a&gt;&#160;Feel free to set up something with interested audience to discuss the future of dbtest and include me. I don&apos;t have a lot of context at the moment on its status and history beyond what Eric said.&lt;/p&gt;</comment>
                            <comment id="3766094" author="acm" created="Tue, 11 May 2021 12:00:27 +0000"  >&lt;p&gt;I dislike that we are in a position where the build system produces a binary which doesn&apos;t actually function. It means, for instance, that techniques like the &lt;tt&gt;prove-&lt;/tt&gt; aliases cannot be applied to &lt;tt&gt;dbtest&lt;/tt&gt; because it can&apos;t be executed as a whole.&lt;/p&gt;

&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;Does &lt;tt&gt;dbtest&lt;/tt&gt; still provide real value? Could we measure the differential coverage data between a run of the unit tests and a run of the unit tests and dbtest? Maybe we don&apos;t even need it anymore and we could just delete it.&lt;/li&gt;
&lt;/ul&gt;


&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;If &lt;tt&gt;dbtest&lt;/tt&gt; does still provide value, could we identify the bad tests and either fix them, or split them out into standalone dbtests?&lt;/li&gt;
&lt;/ul&gt;


&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;Have we examined whether the current split-up of execution of &lt;tt&gt;dbtest&lt;/tt&gt; really buys us anything? The tasks all seem to run in seconds. Would we even notice the difference if we just had resmoke run it as monolith rather than running multiple tasks? That would allow us to keep it functioning.&lt;/li&gt;
&lt;/ul&gt;
</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                                                <inwardlinks description="is related to">
                                        <issuelink>
            <issuekey id="860118">SERVER-42265</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="1774095">SERVER-57563</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>7.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18555" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname># of Sprints</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10011" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Backwards Compatibility</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10038"><![CDATA[Fully Compatible]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Tue, 11 May 2021 12:00:27 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        2 years, 18 weeks ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_17050" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Downstream Team Attention</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="16941"><![CDATA[Not Needed]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>luke.bonanomi@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            2 years, 18 weeks ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>andrew.morrow@mongodb.com</customfieldvalue>
            <customfieldvalue>milkie@mongodb.com</customfieldvalue>
            <customfieldvalue>xgen-internal-githook</customfieldvalue>
            <customfieldvalue>louis.williams@mongodb.com</customfieldvalue>
            <customfieldvalue>mikhail.shchatko@mongodb.com</customfieldvalue>
            <customfieldvalue>robert.guo@mongodb.com</customfieldvalue>
            <customfieldvalue>vivian.ge@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hz9iuf:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hyubfb:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10557" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="4928">STM 2021-06-14</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10555" key="com.atlassian.jira.plugin.system.customfieldtypes:float">
                        <customfieldname>Story Points</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hz953j:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>