<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 06:03:58 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-65910] the server tests attempt to set illegal durable and oldest timestamps</title>
                <link>https://jira.mongodb.org/browse/SERVER-65910</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;In &lt;a href=&quot;https://jira.mongodb.org/browse/WT-9042&quot; title=&quot;commit/durability timestamps can race, perform potentially unnecessary checks&quot; class=&quot;issue-link&quot; data-issue-key=&quot;WT-9042&quot;&gt;WT-9042&lt;/a&gt;, the WT code to set the global timestamps was simplified, but also changed to eliminate possible races and to validate the final state of the timestamps. Running an MDB server build reported some errors.&lt;/p&gt;

&lt;p&gt;The MDB server build is here:&lt;br/&gt;
&lt;a href=&quot;https://spruce.mongodb.com/version/626427e83e8e866de9dca260/tasks?limit=20&amp;amp;page=0&amp;amp;sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://spruce.mongodb.com/version/626427e83e8e866de9dca260/tasks?limit=20&amp;amp;page=0&amp;amp;sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;There are complaints about setting the oldest timestamp after stable, here&apos;s an example from &lt;tt&gt;replica_sets_large_txns_format_2_enterprise-rhel-80-64-bit-dynamic-all-feature-flags-required&lt;/tt&gt;, at: &lt;a href=&quot;https://logkeeper.mongodb.org/build/3f81046&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://logkeeper.mongodb.org/build/3f81046&lt;/a&gt;&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;ts_sec&quot;:1650735882,&quot;ts_usec&quot;:511535,&quot;thread&quot;:&quot;22910:0x7f53ff400500&quot;,&quot;session_name&quot;:&quot;WT_CONNECTION.set_timestamp&quot;,&quot;category&quot;:&quot;WT_VERB_DEFAULT&quot;,&quot;category_id&quot;:9,&quot;verbose_level&quot;:&quot;ERROR&quot;,&quot;verbose_level_id&quot;:-3,&quot;msg&quot;:&quot;__wt_txn_global_set_timestamp:421:set_timestamp: oldest timestamp (1650735870, 106) must not be after the stable timestamp (1650735870, 6)&quot;,&quot;error_str&quot;:&quot;Invalid argument&quot;,&quot;error_code&quot;:22}}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:startup_recovery_for_restore_needs_rollback] d20521| {&quot;t&quot;:{&quot;$date&quot;:&quot;2022-04-23T17:44:42.511+00:00&quot;},&quot;s&quot;:&quot;F&quot;,  &quot;c&quot;:&quot;ASSERT&quot;,   &quot;id&quot;:23083,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Invariant failure&quot;,&quot;attr&quot;:{&quot;expr&quot;:&quot;_conn-&amp;gt;set_timestamp(_conn, oldestTSConfigString.c_str())&quot;,&quot;error&quot;:&quot;BadValue: 22: Invalid argument&quot;,&quot;file&quot;:&quot;src/mongo/db/storage/wiredtiger/wiredtiger_kv_engine.cpp&quot;,&quot;line&quot;:2282}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:startup_recovery_for_restore_needs_rollback] d20521| {&quot;t&quot;:{&quot;$date&quot;:&quot;2022-04-23T17:44:42.511+00:00&quot;},&quot;s&quot;:&quot;F&quot;,  &quot;c&quot;:&quot;ASSERT&quot;,   &quot;id&quot;:23084,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;\n\n***aborting after invariant() failure\n\n&quot;}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;
&lt;p&gt;There are complaints about setting the durable timestamp before stable, here&apos;s an example from &lt;tt&gt;disk_wiredtiger&lt;/tt&gt;, at: &lt;a href=&quot;https://logkeeper.mongodb.org/build/ec4076fcbe010429d5ba553821902f95/test/62642f26be07c42af4119b16?raw=1&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://logkeeper.mongodb.org/build/ec4076fcbe010429d5ba553821902f95/test/62642f26be07c42af4119b16?raw=1&lt;/a&gt;&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;ts_sec&quot;:1650732901,&quot;ts_usec&quot;:804554,&quot;thread&quot;:&quot;11348:0x7fbc01cb3700&quot;,&quot;session_name&quot;:&quot;WT_CONNECTION.set_timestamp&quot;,&quot;category&quot;:&quot;WT_VERB_DEFAULT&quot;,&quot;category_id&quot;:9,&quot;verbose_level&quot;:&quot;ERROR&quot;,&quot;verbose_level_id&quot;:-3,&quot;msg&quot;:&quot;__wt_txn_global_set_timestamp:409:set_timestamp: durable timestamp (0, 1) must not be before the stable timestamp (1650732887, 2)&quot;,&quot;error_str&quot;:&quot;Invalid argument&quot;,&quot;error_code&quot;:22}}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:repair_invalidates_replica_set_config] d20021| {&quot;t&quot;:{&quot;$date&quot;:&quot;2022-04-23T16:55:01.804+00:00&quot;},&quot;s&quot;:&quot;F&quot;,  &quot;c&quot;:&quot;ASSERT&quot;,   &quot;id&quot;:23083,   &quot;ctx&quot;:&quot;ReplCoordExtern-0&quot;,&quot;msg&quot;:&quot;Invariant failure&quot;,&quot;attr&quot;:{&quot;expr&quot;:&quot;_conn-&amp;gt;set_timestamp(_conn, oldestTSConfigString.c_str())&quot;,&quot;error&quot;:&quot;BadValue: 22: Invalid argument&quot;,&quot;file&quot;:&quot;src/mongo/db/storage/wiredtiger/wiredtiger_kv_engine.cpp&quot;,&quot;line&quot;:2282}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;</description>
                <environment></environment>
        <key id="2031685">SERVER-65910</key>
            <summary>the server tests attempt to set illegal durable and oldest timestamps</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="2">Won&apos;t Fix</resolution>
                                        <assignee username="keith.bostic@mongodb.com">Keith Bostic</assignee>
                                    <reporter username="keith.bostic@mongodb.com">Keith Bostic</reporter>
                        <labels>
                    </labels>
                <created>Sat, 23 Apr 2022 19:21:05 +0000</created>
                <updated>Tue, 26 Apr 2022 14:21:40 +0000</updated>
                            <resolved>Tue, 26 Apr 2022 14:21:40 +0000</resolved>
                                                                                        <votes>0</votes>
                                    <watches>3</watches>
                                                                                                                <comments>
                            <comment id="4504767" author="keith.bostic" created="Mon, 25 Apr 2022 19:23:10 +0000"  >&lt;p&gt;Thanks, &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=daniel.gottlieb%40mongodb.com&quot; class=&quot;user-hover&quot; rel=&quot;daniel.gottlieb@mongodb.com&quot;&gt;daniel.gottlieb@mongodb.com&lt;/a&gt; &#160;&#8211; yes, this one is mine for now.&lt;/p&gt;</comment>
                            <comment id="4504741" author="daniel.gottlieb@10gen.com" created="Mon, 25 Apr 2022 19:14:42 +0000"  >&lt;p&gt;There are two states which cause the majority of failures:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;startupRecoveryForRestore&lt;/li&gt;
	&lt;li&gt;File based initial sync&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;Both states are capable of setting &lt;a href=&quot;https://github.com/mongodb/mongo/blob/e7544180078415f6dd6bce44b90033f2599abf52/src/mongo/db/repl/replication_recovery.cpp#L730&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;&lt;tt&gt;advanceTimestampsEachBatch&lt;/tt&gt;&lt;/a&gt; which will advance the oldest timestamp as batches complete without advancing the stable timestamp.&lt;/p&gt;

&lt;p&gt;Those cases (I claim) are ultimately benign. We&apos;re only taking checkpoints with &lt;tt&gt;use_timestamp=false&lt;/tt&gt;. The history preserved by the oldest timestamp is not needed for readers. And historical values are not needed for fuzzy checkpoints restoring a stable checkpoint.&lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=keith.bostic%40mongodb.com&quot; class=&quot;user-hover&quot; rel=&quot;keith.bostic@mongodb.com&quot;&gt;keith.bostic@mongodb.com&lt;/a&gt; and I talked offline about the relationships between the oldest vs stable timestamps and came up with a more precise set of assertions. Keith is going to run a follow-up patch to see if there&apos;s anything leftover which looks concerning (correct me if I&apos;m wrong Keith!)&lt;/p&gt;</comment>
                            <comment id="4501833" author="keith.bostic" created="Sat, 23 Apr 2022 19:24:35 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=daniel.gottlieb%40mongodb.com&quot; class=&quot;user-hover&quot; rel=&quot;daniel.gottlieb@mongodb.com&quot;&gt;daniel.gottlieb@mongodb.com&lt;/a&gt;, &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=geert.bosch%40mongodb.com&quot; class=&quot;user-hover&quot; rel=&quot;geert.bosch@mongodb.com&quot;&gt;geert.bosch@mongodb.com&lt;/a&gt;, I&apos;m seeing unexpected results when I tighten down setting global timestamps, can I please ask for some server assistance here?&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;Dan, we could easily drop core if there&apos;s an attempt to set an illegal timestamp combination in &lt;tt&gt;HAVE_DIAGNOSTIC&lt;/tt&gt; mode, just like we do when checking timestamps at commit time, if that would help with debugging.&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10020">
                    <name>Gantt Dependency</name>
                                            <outwardlinks description="has to be done before">
                                        <issuelink>
            <issuekey id="2013618">WT-9042</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>3.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Mon, 25 Apr 2022 19:14:42 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        1 year, 41 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>keith.bostic@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            1 year, 41 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>daniel.gottlieb@mongodb.com</customfieldvalue>
            <customfieldvalue>keith.bostic@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i0sbcv:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|i0b9kg:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i0rxi7:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>