<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 06:31:08 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-75814] MDB compact commands running in testing aren&apos;t actually exercising WT compact because the data size is too small and WT skips it</title>
                <link>https://jira.mongodb.org/browse/SERVER-75814</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;WT::compact skips compaction if the data size is too small&lt;br/&gt;
&quot;skipping because the file size must be greater than 1MB&quot;&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:index_version_autoupgrade] d50050| {&quot;t&quot;:{&quot;$date&quot;:&quot;2023-04-06T20:06:52.860+00:00&quot;},&quot;s&quot;:&quot;I&quot;,&#160; &quot;c&quot;:&quot;WTCMPCT&quot;,&#160; &quot;id&quot;:22430, &#160; &quot;ctx&quot;:&quot;conn1&quot;,&quot;msg&quot;:&quot;WiredTiger message&quot;,&quot;attr&quot;:{&quot;message&quot;:{&quot;ts_sec&quot;:1680811612,&quot;ts_usec&quot;:860738,&quot;thread&quot;:&quot;11893:0x7f3546e11700&quot;,&quot;session_dhandle_name&quot;:&quot;file:collection-15--5349796768648330457.wt&quot;,&quot;session_name&quot;:&quot;WT_SESSION.compact&quot;,&quot;category&quot;:&quot;WT_VERB_COMPACT&quot;,&quot;category_id&quot;:7,&quot;verbose_level&quot;:&quot;INFO&quot;,&quot;verbose_level_id&quot;:0,&quot;msg&quot;:&quot;collection-15--5349796768648330457.wt: skipping because the file size must be greater than 1MB: 4096B.&quot;}}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;
&lt;p&gt;MDB layer JS tests calling the compact command aren&apos;t actually testing compaction because compaction is skipped due to too little data. For reference &lt;a href=&quot;https://github.com/mongodb/mongo/blob/9595ffb2b2a270c2038f01737131d0d015464633/src/third_party/wiredtiger/src/btree/bt_compact.c#L301&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;this is the WT::compact code&lt;/a&gt;.&lt;/p&gt;

&lt;p&gt;This is the list of effected tests:&lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://github.com/mongodb/mongo/blob/master/jstests/noPassthrough/index_version_autoupgrade.js&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;jstests/noPassthrough/index_version_autoupgrade.js&lt;/a&gt;.&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/blob/9595ffb2b2a270c2038f01737131d0d015464633/jstests/replsets/read_committed_with_catalog_changes.js#L183&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;jstests/replsets/read_committed_with_catalog_changes.js&lt;/a&gt;&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/blob/master/jstests/concurrency/fsm_workloads/compact.js&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;jstests/concurrency/fsm_workloads/compact.js&lt;/a&gt;&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/blob/master/jstests/concurrency/fsm_workloads/compact_while_creating_indexes.js&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;jstests/concurrency/fsm_workloads/compact_while_creating_indexes.js &lt;/a&gt;&lt;/p&gt;

&lt;p&gt;There are other tests call the MDB compact command, but the intent in those tests are things like auth, allowed to run on a secondary, view namespace handling, etc.&lt;/p&gt;</description>
                <environment></environment>
        <key id="2309127">SERVER-75814</key>
            <summary>MDB compact commands running in testing aren&apos;t actually exercising WT compact because the data size is too small and WT skips it</summary>
                <type id="3" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14718&amp;avatarType=issuetype">Task</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="1" iconUrl="https://jira.mongodb.org/images/icons/statuses/open.png" description="">Open</status>
                    <statusCategory id="2" key="new" colorName="default"/>
                                    <resolution id="-1">Unresolved</resolution>
                                        <assignee username="backlog-server-storage-engines">Backlog - Storage Engines Team</assignee>
                                    <reporter username="dianna.hohensee@mongodb.com">Dianna Hohensee</reporter>
                        <labels>
                    </labels>
                <created>Thu, 6 Apr 2023 20:39:09 +0000</created>
                <updated>Mon, 4 Dec 2023 10:13:05 +0000</updated>
                                                                                                <votes>0</votes>
                                    <watches>6</watches>
                                                                                                                <comments>
                            <comment id="5911517" author="JIRAUSER1257954" created="Wed, 29 Nov 2023 06:57:46 +0000"  >&lt;p&gt;I&apos;ve taken a look through the jstests that use the compact command and many of them just test the usage of the server API and don&apos;t intend on compact doing any particular work.&lt;/p&gt;

&lt;p&gt;In response to the tests linked in the description:&lt;/p&gt;
&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;index_version_auoupgrade.js
	&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
		&lt;li&gt;Tests whether various MongoDB commands automatically upgrade the index version of existing indexes when they are rebuilt on a collection.&lt;/li&gt;
		&lt;li&gt;Since this is testing server functionality when calling commands, I don&apos;t think it&apos;s necessary for compact to do work.&lt;/li&gt;
	&lt;/ul&gt;
	&lt;/li&gt;
	&lt;li&gt;read_committed_with_catalog_changes
	&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
		&lt;li&gt;It&apos;s possible to make compact do some work here. I&apos;ll continue investigating this one.&lt;/li&gt;
	&lt;/ul&gt;
	&lt;/li&gt;
	&lt;li&gt;compact.js
	&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
		&lt;li&gt;This has been updated in &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-80120&quot; title=&quot;Add the new compaction &amp;quot;freeSpaceTargetMB&amp;quot; option to the compact API&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-80120&quot;&gt;&lt;del&gt;SERVER-80120&lt;/del&gt;&lt;/a&gt; and is now the main functional test for the compact algorithm in the jstests.&lt;/li&gt;
	&lt;/ul&gt;
	&lt;/li&gt;
	&lt;li&gt;compact_while_creating_indexes
	&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
		&lt;li&gt;This one is currently disabled and should be fixed in &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-81114&quot; title=&quot;compact_while_creating_indexes fails due to cache eviction pressure&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-81114&quot;&gt;SERVER-81114&lt;/a&gt;. That fix should also consider ensuring compact rewrites data.&lt;/li&gt;
	&lt;/ul&gt;
	&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;A few other compact tests to consider are:&lt;/p&gt;
&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;interupt_compact_commands.js
	&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
		&lt;li&gt;This one already creates large enough free space.&lt;/li&gt;
	&lt;/ul&gt;
	&lt;/li&gt;
	&lt;li&gt;compact_keep_index.js
	&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
		&lt;li&gt;This is a simple one and could be combined into the existing `compact.js` test.&lt;/li&gt;
	&lt;/ul&gt;
	&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;In summary the only tests worthwhile changing are&lt;/p&gt;
&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;read_committed_with_catalog_changes&lt;/li&gt;
	&lt;li&gt;compact_keep_index.js&lt;/li&gt;
&lt;/ul&gt;
</comment>
                            <comment id="5573320" author="JIRAUSER1258229" created="Tue, 18 Jul 2023 10:09:47 +0000"  >&lt;p&gt;As &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=keith.smith%40mongodb.com&quot; class=&quot;user-hover&quot; rel=&quot;keith.smith@mongodb.com&quot;&gt;keith.smith@mongodb.com&lt;/a&gt; said above, we have a set of tests dedicated to compact. However, with PM-3091, we would like MDB to introduce more testing in this area, especially with the new API that will be implemented. &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=gregory.wlodarek%40mongodb.com&quot; class=&quot;user-hover&quot; rel=&quot;gregory.wlodarek@mongodb.com&quot;&gt;gregory.wlodarek@mongodb.com&lt;/a&gt; is the POC for those new tests.&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                            <outwardlinks description="related to">
                                        <issuelink>
            <issuekey id="2412672">SERVER-79869</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="2151243">SERVER-70201</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18555" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname># of Sprints</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_12751" key="com.atlassian.jira.plugin.system.customfieldtypes:multiselect">
                        <customfieldname>Assigned Teams</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="25135"><![CDATA[Storage Engines]]></customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Thu, 20 Apr 2023 15:44:09 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        10 weeks ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>etienne.petrel@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            10 weeks ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>backlog-server-storage-engines</customfieldvalue>
            <customfieldvalue>dianna.hohensee@mongodb.com</customfieldvalue>
            <customfieldvalue>etienne.petrel@mongodb.com</customfieldvalue>
            <customfieldvalue>sean.watt@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i23raf:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|i1x9nr:so</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10557" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="6062">StorEng - Defined Pipeline</customfieldvalue>
    <customfieldvalue id="7931">2023-11-28 - Anthill Tiger</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10555" key="com.atlassian.jira.plugin.system.customfieldtypes:float">
                        <customfieldname>Story Points</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>5.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i23dfr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>