<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:53:52 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-20322] Wiredtiger develop can lose records following stop even with log enabled</title>
                <link>https://jira.mongodb.org/browse/SERVER-20322</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;I was testing a merge of WT develop into MongoDB master. This caused the jstest &lt;tt&gt;&lt;a href=&quot;https://github.com/mongodb/mongo/blob/master/jstests/auth/auth_helpers.js#L13&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;auth/auth_helpers.js&lt;/a&gt;&lt;/tt&gt; to fail. &lt;/p&gt;

&lt;p&gt;The failure here was due to a user being inserted into &lt;tt&gt;admin.system.users&lt;/tt&gt; not being found following a restart of MongoDB. The user could be found initially after insertion but cannot be found following the restart.&lt;/p&gt;

&lt;p&gt;The underlying issue presented on with LSM in this test case, since creating an LSM table involves creating the LSM tree and a separate LSM chunk (the first chunk). The table create needs to come before the chunk create in the log. When creating an LSM table as part of a larger transaction, the chunk can be created before the table in the log. Which leads to recovery not seeing the first chunk in the LSM tree.&lt;/p&gt;

&lt;p&gt;This issue could also affect non-LSM WiredTiger tables, but is more difficult to trigger. It would require a system crash during an index create call. Could be the cause of &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-19274&quot; title=&quot;DB fails to recover after system crash,  with &amp;quot;No such file or directory&amp;quot;&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-19274&quot;&gt;&lt;del&gt;SERVER-19274&lt;/del&gt;&lt;/a&gt;.&lt;/p&gt;</description>
                <environment>*Command to Reproduce*&lt;br/&gt;
{code}&lt;br/&gt;
./buildscripts/resmoke.py jstests/auth/auth_helpers.js --wiredTigerCollectionConfigString=&amp;quot;type=lsm&amp;quot; --wiredTigerIndexConfigString=&amp;quot;type=lsm&amp;quot; --wiredTigerEngineConfigString=&amp;quot;verbose=[log]&lt;br/&gt;
{code}</environment>
        <key id="228429">SERVER-20322</key>
            <summary>Wiredtiger develop can lose records following stop even with log enabled</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="alexander.gorrod@mongodb.com">Alexander Gorrod</assignee>
                                    <reporter username="david.hows">David Hows</reporter>
                        <labels>
                    </labels>
                <created>Fri, 4 Sep 2015 06:47:59 +0000</created>
                <updated>Sun, 28 Feb 2016 13:32:17 +0000</updated>
                            <resolved>Thu, 10 Sep 2015 21:56:16 +0000</resolved>
                                                    <fixVersion>3.0.7</fixVersion>
                    <fixVersion>3.1.8</fixVersion>
                                    <component>WiredTiger</component>
                                        <votes>0</votes>
                                    <watches>5</watches>
                                                                                                                <comments>
                            <comment id="1026902" author="alexander.gorrod" created="Thu, 10 Sep 2015 22:51:26 +0000"  >&lt;p&gt;Diagnostic information from &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=david.hows&quot; class=&quot;user-hover&quot; rel=&quot;david.hows&quot;&gt;david.hows&lt;/a&gt; when originally diagnosing the issue:&lt;/p&gt;

&lt;p&gt;I&apos;ve dived into this and found that adding a one second sleep before the restart of MongoDB on line 13 of the test (&lt;tt&gt;&lt;a href=&quot;https://github.com/mongodb/mongo/blob/master/jstests/auth/auth_helpers.js#L13&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;auth/auth_helpers.js&lt;/a&gt;&lt;/tt&gt;) will stop the test from failing.&lt;/p&gt;

&lt;p&gt;Diving into extra diagnostics with with MongoDB found that the following line is seen before the stop of MongoDB in cases where the issue does not occur.&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[js_test:auth_helpers] 2015-09-04T12:59:36.258+1000  m27000| 2015-09-04T12:59:36.258+1000 I STORAGE  [thread1] WiredTiger [1441335576:258691][19039:0x7f632e5b8700], log-server: log_archive: archive to log number 1&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;The stop in question is from a SIGTERM, which is a graceful stop of MongoDB&lt;/p&gt;</comment>
                            <comment id="1026360" author="xgen-internal-githook" created="Thu, 10 Sep 2015 15:01:23 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{u&apos;username&apos;: u&apos;agorrod&apos;, u&apos;name&apos;: u&apos;Alex Gorrod&apos;, u&apos;email&apos;: u&apos;alexg@wiredtiger.com&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-20322&quot; title=&quot;Wiredtiger develop can lose records following stop even with log enabled&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-20322&quot;&gt;&lt;del&gt;SERVER-20322&lt;/del&gt;&lt;/a&gt; Fixup lint from last push.&lt;br/&gt;
Branch: v3.0&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/292aafc2c05b7075353f8c49f205361958188ab0&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/292aafc2c05b7075353f8c49f205361958188ab0&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="1026359" author="xgen-internal-githook" created="Thu, 10 Sep 2015 15:01:22 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{u&apos;username&apos;: u&apos;agorrod&apos;, u&apos;name&apos;: u&apos;Alex Gorrod&apos;, u&apos;email&apos;: u&apos;alexg@wiredtiger.com&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-20322&quot; title=&quot;Wiredtiger develop can lose records following stop even with log enabled&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-20322&quot;&gt;&lt;del&gt;SERVER-20322&lt;/del&gt;&lt;/a&gt; Use a separate session when creating new indexes in WiredTiger.&lt;br/&gt;
Branch: v3.0&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/300c3dbc97781c452dfb1bf403c888d6def03359&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/300c3dbc97781c452dfb1bf403c888d6def03359&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="1025991" author="xgen-internal-githook" created="Thu, 10 Sep 2015 03:14:09 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{u&apos;username&apos;: u&apos;agorrod&apos;, u&apos;name&apos;: u&apos;Alex Gorrod&apos;, u&apos;email&apos;: u&apos;alexg@wiredtiger.com&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-20322&quot; title=&quot;Wiredtiger develop can lose records following stop even with log enabled&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-20322&quot;&gt;&lt;del&gt;SERVER-20322&lt;/del&gt;&lt;/a&gt; Fixup lint from last push.&lt;br/&gt;
Branch: master&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/9b4250dc957f6cf75435606dccfd16f617b9cd33&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/9b4250dc957f6cf75435606dccfd16f617b9cd33&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="1025990" author="alexander.gorrod" created="Thu, 10 Sep 2015 03:00:44 +0000"  >&lt;p&gt;Code review: &lt;a href=&quot;https://mongodbcr.appspot.com/15990001/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://mongodbcr.appspot.com/15990001/&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="1025851" author="xgen-internal-githook" created="Wed, 9 Sep 2015 23:48:19 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{u&apos;username&apos;: u&apos;agorrod&apos;, u&apos;name&apos;: u&apos;Alex Gorrod&apos;, u&apos;email&apos;: u&apos;alexg@wiredtiger.com&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-20322&quot; title=&quot;Wiredtiger develop can lose records following stop even with log enabled&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-20322&quot;&gt;&lt;del&gt;SERVER-20322&lt;/del&gt;&lt;/a&gt; Use a separate session when creating new indexes in WiredTiger.&lt;br/&gt;
Branch: master&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/278338486d13816a0e2d5dbe3b9f2d8ab2df80cb&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/278338486d13816a0e2d5dbe3b9f2d8ab2df80cb&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="1024875" author="alexander.gorrod" created="Wed, 9 Sep 2015 06:24:24 +0000"  >&lt;p&gt;The root cause is that MongoDB is creating indexes using transactions that are also being used for other operations.&lt;/p&gt;

&lt;p&gt;In WiredTiger table create calls should be auto-commit. There is a semantic internally where we checkpoint the metadata when committing a transaction used for a create - and that checkpoint makes the create durable.&lt;/p&gt;

&lt;p&gt;What was happening in this case was that the metadata from the create ends up being written after the first LSM file has been created, which meant that the LSM metadata gets written as having 0 chunks, when there is actually 1 chunk.&lt;/p&gt;

&lt;p&gt;The solution is to use a separate WiredTiger session when creating indexes in MongoDB. I&apos;ll create a code review.&lt;/p&gt;</comment>
                            <comment id="1024870" author="alexander.gorrod" created="Wed, 9 Sep 2015 06:20:46 +0000"  >&lt;p&gt;I&apos;ve moved this to a server ticket, since the behavior is due to how MongoDB is creating indexes in WiredTiger.&lt;/p&gt;</comment>
                            <comment id="1023848" author="alexander.gorrod" created="Tue, 8 Sep 2015 07:40:00 +0000"  >&lt;p&gt;I can reproduce this. It doesn&apos;t appear to be directly related to the commit mentioned above. I&apos;ll dig deeper tomorrow.&lt;/p&gt;</comment>
                            <comment id="1023200" author="david.hows" created="Mon, 7 Sep 2015 00:08:23 +0000"  >&lt;p&gt;Still broken with the inclusions in pull #2172.&lt;/p&gt;

&lt;p&gt;Git bisect says &lt;a href=&quot;https://github.com/wiredtiger/wiredtiger/commit/05015655982f6a5312559420e44452032186ba09&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/wiredtiger/wiredtiger/commit/05015655982f6a5312559420e44452032186ba09&lt;/a&gt; is the cause.&lt;/p&gt;</comment>
                            <comment id="1023186" author="alexander.gorrod" created="Sun, 6 Sep 2015 23:09:59 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=david.hows&quot; class=&quot;user-hover&quot; rel=&quot;david.hows&quot;&gt;david.hows&lt;/a&gt; Could you retest this with the latest develop please? This change may fix the issue:&lt;br/&gt;
&lt;a href=&quot;https://github.com/wiredtiger/wiredtiger/pull/2172&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/wiredtiger/wiredtiger/pull/2172&lt;/a&gt;&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>11.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_12451" key="com.atlassian.jira.plugin.system.customfieldtypes:multiversion">
                        <customfieldname>Backport Completed</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="15689">3.0.7</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10011" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Backwards Compatibility</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10038"><![CDATA[Fully Compatible]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Sun, 6 Sep 2015 23:09:59 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        8 years, 22 weeks, 6 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            8 years, 22 weeks, 6 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>alexander.gorrod@mongodb.com</customfieldvalue>
            <customfieldvalue>david.hows</customfieldvalue>
            <customfieldvalue>xgen-internal-githook</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrkva7:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hscwz3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrll8f:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>