<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 06:52:29 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-83537] Investigate removal of side transaction for multikey</title>
                <link>https://jira.mongodb.org/browse/SERVER-83537</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;During recovery of a node we perform oplog replay in order to reconstruct the node. As part of this, we reconstruct the prepared transactions so that we might commit them later.&lt;/p&gt;

&lt;p&gt;If at this point the transaction should set the multikey flag to be true we might encounter an error with WT in the following case:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;The internal durable timestamp for the catalog page advances to T=2&lt;/li&gt;
	&lt;li&gt;The prepared transaction at time T=1 attempts to set the multikey flag using a side transaction&lt;/li&gt;
	&lt;li&gt;The side transaction fails to commit due to WT returning an error to avoid data inconsistencies since we&apos;re writing back in time, thus potentially invalidating all values from that point onwards since they could&apos;ve read a stale value.&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;Ideally we should try to avoid doing a side transaction and just accumulate the change with the original recovery unit. This would lead to prepare conflicts until the operation commits which is what&apos;s happening with the primary now. On secondaries however, this operation isn&apos;t symmetric as explained by &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-41766&quot; title=&quot;Secondary may encounter prepare conflict when applying write that sets the multikey flag&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-41766&quot;&gt;&lt;del&gt;SERVER-41766&lt;/del&gt;&lt;/a&gt;.&lt;/p&gt;

&lt;p&gt;We should investigate whether it is safe to remove the side transaction or if the write is safe to do without concerns for potential data inconsistencies.&lt;/p&gt;</description>
                <environment></environment>
        <key id="2507493">SERVER-83537</key>
            <summary>Investigate removal of side transaction for multikey</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="2">Won&apos;t Fix</resolution>
                                        <assignee username="jordi.olivares-provencio@mongodb.com">Jordi Olivares Provencio</assignee>
                                    <reporter username="jordi.olivares-provencio@mongodb.com">Jordi Olivares Provencio</reporter>
                        <labels>
                    </labels>
                <created>Wed, 22 Nov 2023 16:31:21 +0000</created>
                <updated>Wed, 20 Dec 2023 09:04:30 +0000</updated>
                            <resolved>Wed, 20 Dec 2023 09:04:16 +0000</resolved>
                                                                                        <votes>0</votes>
                                    <watches>4</watches>
                                                                                                                <comments>
                            <comment id="5962225" author="JIRAUSER1264163" created="Wed, 20 Dec 2023 09:03:58 +0000"  >&lt;p&gt;As a side transaction is deemed necessary for secondary replication the next best thing that we could do is to modify the side transaction to actually force the index to become multikey. However, in the absence of a specific new command or a new collMod option the most compatible form without implying an FCV change is to force an implicit multikey setting by inserting and then deleting a special document that enables the flag. This would functionally be a no-op but would trigger the multikey flag setting during oplog replication/recovery.&lt;/p&gt;

&lt;p&gt;The problem with this approach is that we can&apos;t generate such document with confidence that it won&apos;t cause issues. If the index is specified with {{&lt;/p&gt;

{unique: true}

&lt;p&gt;}} then we must synthetically produce a value that doesn&apos;t exist in the entire collection. Failure to do so would cause secondary replication to fail.&lt;/p&gt;

&lt;p&gt;&lt;b&gt;As we want to refactor multikey in the future to not be as special with explicit replication via the oplog I&apos;m closing this ticket as Won&apos;t Fix&lt;/b&gt;. Fixing this would require a very large effort that would have to be scrapped altogether when we refactor multikey.&lt;/p&gt;</comment>
                            <comment id="5948713" author="JIRAUSER1264163" created="Wed, 13 Dec 2023 18:06:54 +0000"  >&lt;p&gt;Not using the side-transaction isn&apos;t as safe as we would wish. Suppose we have a multi-document transaction that has prepared and changed the multikey metadata. Any operation that comes afterwards that does an insert and modifies the multikey metadata will get a prepare conflict until the transaction commits. This effectively deadlocks the server.&lt;/p&gt;

&lt;p&gt;Note that this is an issue with secondary replication since it would effectively stop replication from making forward progress. The secondary would prepare the transaction and then impede the applier thread from making forward progress.&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                            <outwardlinks description="related to">
                                                        </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18555" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname># of Sprints</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>3.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_12751" key="com.atlassian.jira.plugin.system.customfieldtypes:multiselect">
                        <customfieldname>Assigned Teams</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="26387"><![CDATA[Catalog and Routing]]></customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                <customfield id="customfield_23577" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>CAR Impact</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="25718"><![CDATA[5 BF w/evergreen redness]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        7 weeks ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>jordi.olivares-provencio@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            7 weeks ago
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_16465" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Linked BF Score</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>3.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>jordi.olivares-provencio@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i31nzz:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|i2jh2s:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10557" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="7889">CAR Team 2023-11-27</customfieldvalue>
    <customfieldvalue id="7890">CAR Team 2023-12-11</customfieldvalue>
    <customfieldvalue id="7891">CAR Team 2023-12-25</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10555" key="com.atlassian.jira.plugin.system.customfieldtypes:float">
                        <customfieldname>Story Points</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>3.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i31a5b:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>