<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 05:34:18 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-54720] Make --system-wiredtiger work again</title>
                <link>https://jira.mongodb.org/browse/SERVER-54720</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;WiredTiger team used &lt;tt&gt;--system-wiredtiger&lt;/tt&gt; flag a lot to externally build and link MongoDB, instead of recompiling MongoDB with changes to WiredTiger. The flag stopped working some time back.&lt;/p&gt;

&lt;p&gt;I am creating this ticket to help us with:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;get the flag working again OR&lt;/li&gt;
	&lt;li&gt;remove the flag altogether&lt;/li&gt;
	&lt;li&gt;get a wiki / document explaining the steps in how to get external WiredTiger working with MongoDB, if possible.&lt;/li&gt;
&lt;/ul&gt;
</description>
                <environment></environment>
        <key id="1630224">SERVER-54720</key>
            <summary>Make --system-wiredtiger work again</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="4" iconUrl="https://jira.mongodb.org/images/icons/priorities/minor.svg">Minor - P4</priority>
                        <status id="1" iconUrl="https://jira.mongodb.org/images/icons/statuses/open.png" description="">Open</status>
                    <statusCategory id="2" key="new" colorName="default"/>
                                    <resolution id="-1">Unresolved</resolution>
                                        <assignee username="backlog-server-storage-engines">Backlog - Storage Engines Team</assignee>
                                    <reporter username="sulabh.mahajan@mongodb.com">Sulabh Mahajan</reporter>
                        <labels>
                            <label>dev-prod</label>
                    </labels>
                <created>Tue, 23 Feb 2021 00:43:42 +0000</created>
                <updated>Mon, 5 Dec 2022 20:25:27 +0000</updated>
                                                                                                <votes>0</votes>
                                    <watches>3</watches>
                                                                                                                <comments>
                            <comment id="3961807" author="sulabh.mahajan" created="Mon, 26 Jul 2021 00:31:03 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=acm&quot; class=&quot;user-hover&quot; rel=&quot;acm&quot;&gt;acm&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Thanks for responding. I will create a change for the attached diff as a part of the separate ticket and cc you.&lt;/p&gt;

&lt;p&gt;Sorry, I am being kept busy with several other things, so I am slow at getting back to this ticket.&lt;/p&gt;</comment>
                            <comment id="3949301" author="acm" created="Mon, 19 Jul 2021 13:19:35 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=sulabh.mahajan&quot; class=&quot;user-hover&quot; rel=&quot;sulabh.mahajan&quot;&gt;sulabh.mahajan&lt;/a&gt; - &lt;/p&gt;

&lt;p&gt;I think there are definitely things that can be done to improve the situation.&lt;/p&gt;

&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;First, let&apos;s get that patch merged, as it looks pretty uncontroversial to me.&lt;/li&gt;
	&lt;li&gt;Next, I think there is probably a way to get rid of the need for &lt;tt&gt;LD_LIBRARY_PATH&lt;/tt&gt; being set in the environment by building the server sources with an augmented &lt;tt&gt;DT_RUNPATH&lt;/tt&gt; so that the installation directory for wiredteger is always searched. If wiredtiger installs a &lt;tt&gt;pkgconfig&lt;/tt&gt; file that includes the runpath requirements, that would be even better, as we could probably write a SCons variables file for the server build that could set &lt;tt&gt;CPPPATH&lt;/tt&gt; and &lt;tt&gt;LIBPATH&lt;/tt&gt; and &lt;tt&gt;LIBFLAGS&lt;/tt&gt; for rpath appropriately.&lt;/li&gt;
	&lt;li&gt;Finally, I think it would be pretty reasonable to stand up a compile only evergreen waterfall builder that built the server sources against system wiredtiger to ensure that support does not regress.&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;The tricky part here though is the checksum library. The procedure above appears to me to be made significantly more complex due to the fact that the checksum library can only be produced by the server build. If the wiredtiger build system could be updated to build a separated wiredtiger and wiredtiger_checksum library, then that complexity would be eliminated.&lt;/p&gt;

&lt;p&gt;Alternatively, we could find a way to eliminate the need to build a separated wiredtiger_checksum library in the mongo build. To be quite honest I don&apos;t entirely remember what forces converged to require it. Perhaps we can or should revisit that decision?&lt;/p&gt;</comment>
                            <comment id="3948729" author="sulabh.mahajan" created="Mon, 19 Jul 2021 01:55:14 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=acm&quot; class=&quot;user-hover&quot; rel=&quot;acm&quot;&gt;acm&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;The current process - as we follow in the wiki - is:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;Build WiredTiger&lt;/li&gt;
	&lt;li&gt;Patch MongoDB with the attached diff&lt;/li&gt;
	&lt;li&gt;Build MongoDB normally to get &quot;src/third_party/wiredtiger/libwiredtiger_checksum.a&quot;&lt;/li&gt;
	&lt;li&gt;Rebuild MongoDB with &quot;--use-system-wiredtiger&quot; option&lt;/li&gt;
	&lt;li&gt;Execute MongoDB with LD_LIBRARY_PATH to WiredTiger&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;Assuming someone has installed wired tiger to a path they by default include in &lt;tt&gt;LD_LIBRARY_PATH&lt;/tt&gt;, ideally, the process should look like this:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;Build and install WiredTiger to the path&lt;/li&gt;
	&lt;li&gt;Build MongoDB with &quot;--use-system-wiredtiger&quot; option&lt;/li&gt;
	&lt;li&gt;Execute MongoDB with LD_LIBRARY_PATH to WiredTiger&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;To get there I suppose we will need to get the attached diff checked-in and figure out a way to let MongoDB share &lt;tt&gt;libwiredtiger_checksum&lt;/tt&gt; with system wired tiger. I only vaguely recall that at some point MongoDB got exposed to using &lt;tt&gt;libwiredtiger_checksum&lt;/tt&gt; directly, and we ended up having to build it separately through MongoDB-scons.&lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=mjc%40wiredtiger.com&quot; class=&quot;user-hover&quot; rel=&quot;mjc@wiredtiger.com&quot;&gt;mjc@wiredtiger.com&lt;/a&gt;, you have been using this option far longer than anyone else I know. Do you want to add anything here, or have ideas on improvements?&lt;/p&gt;</comment>
                            <comment id="3939813" author="acm" created="Wed, 14 Jul 2021 15:29:04 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=sulabh.mahajan&quot; class=&quot;user-hover&quot; rel=&quot;sulabh.mahajan&quot;&gt;sulabh.mahajan&lt;/a&gt; - Sure we can take a look. Can you provide a summary of what you would like to see improved or changed?&lt;/p&gt;</comment>
                            <comment id="3932117" author="sulabh.mahajan" created="Wed, 14 Jul 2021 03:01:40 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=acm&quot; class=&quot;user-hover&quot; rel=&quot;acm&quot;&gt;acm&lt;/a&gt;, can someone from your team help with getting &lt;tt&gt;--system-wiredtiger&lt;/tt&gt; work smoothly again. &lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                            <attachment id="325704" name="system-wiredtiger-master.diff" size="1217" author="sulabh.mahajan@mongodb.com" created="Mon, 19 Jul 2021 01:44:27 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>5.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18555" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname># of Sprints</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_12751" key="com.atlassian.jira.plugin.system.customfieldtypes:multiselect">
                        <customfieldname>Assigned Teams</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="25135"><![CDATA[Storage Engines]]></customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Wed, 14 Jul 2021 15:29:04 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        2 years, 28 weeks, 3 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>alexander.golin@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            2 years, 28 weeks, 3 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>andrew.morrow@mongodb.com</customfieldvalue>
            <customfieldvalue>backlog-server-storage-engines</customfieldvalue>
            <customfieldvalue>sulabh.mahajan@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hywabj:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|i11pr6:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10557" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="6497">StorEng - Refinement Pipeline</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10555" key="com.atlassian.jira.plugin.system.customfieldtypes:float">
                        <customfieldname>Story Points</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>8.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hyvwkn:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>