<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:33:11 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-13879] Yield Fsync Lock with tunable frequency</title>
                <link>https://jira.mongodb.org/browse/SERVER-13879</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;This case covers changing the fsync lock from being a single monolithic lock of an entire shard&apos;s data at once, to a system where, say, 10% of the memory is sync&apos;d to disk, then the next 10%, and so on.  in between each set of 10%, the write lock could yield for some duration.  &lt;/p&gt;

&lt;p&gt;Background:  MongoDB has a setting for how often dirty pages are sync&apos;d to disk.  This is a command line setting --syncdelay, which defaults to 60 seconds.  A typical write-heavy use case generates performance characteristics of a flat line of no disk writes for 60 seconds, then a write lock that lasts n seconds until the dirty pages of memory are flushed out to disk, then flat again for the next (60 - n) seconds.  &lt;/p&gt;

&lt;p&gt;This kind of performance is very choppy.  Since the write lock is global, this interferes with and thus degrades common write performance characteristics.&lt;/p&gt;

&lt;p&gt;SUGGESTION:&lt;/p&gt;

&lt;p&gt;Mongod issues the fsync command to the vmm system.  This command specifies, &apos;do an fsync on this entire file.&apos;  Instead of doing this, divide the file in half and say, &quot;Fsync the first half of the file&quot;.  Once that fsync is done, yield the write lock for a configurable amount of time, or perhaps until the queued writes are cleared with a max of, say several seconds, and then repeat this process with the second half of the file.&lt;/p&gt;

&lt;p&gt;This feature would have complications of record relocation from one area of memory to another.  However, on average this wouldn&apos;t happen that often, so it could just be ignored and the relocated record would be sync&apos;d the next time through.  The only inimical cases would be a record / document that kept bouncing around from place to place in the file and not getting sync&apos;d for a long time period.&lt;/p&gt;

&lt;p&gt;If I am profoundly incorrect in the way MongoDB works and interacts with the VMM, this ticket may be classified as impossible.  However, if it is possible, it might create significantly reduced locking percentages and much greater performance consistency.&lt;/p&gt;</description>
                <environment></environment>
        <key id="135526">SERVER-13879</key>
            <summary>Yield Fsync Lock with tunable frequency</summary>
                <type id="4" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14710&amp;avatarType=issuetype">Improvement</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="2">Won&apos;t Fix</resolution>
                                        <assignee username="backlog-server-execution">Backlog - Storage Execution Team</assignee>
                                    <reporter username="justanyone">Kevin J. Rice</reporter>
                        <labels>
                    </labels>
                <created>Thu, 8 May 2014 16:06:21 +0000</created>
                <updated>Tue, 6 Dec 2022 05:06:20 +0000</updated>
                            <resolved>Mon, 11 Jul 2016 20:23:50 +0000</resolved>
                                                                    <component>Performance</component>
                                        <votes>2</votes>
                                    <watches>12</watches>
                                                                                                                <comments>
                            <comment id="1320610" author="ian@10gen.com" created="Mon, 11 Jul 2016 20:23:50 +0000"  >&lt;p&gt;Thanks for the request, but this is no longer as relevant for the WiredTiger storage engine and we do not plan on doing this work for the MMAPv1 storage engine, so we are resolving as Won&apos;t Fix.&lt;/p&gt;</comment>
                            <comment id="584795" author="kaloian.manassiev" created="Thu, 15 May 2014 13:14:11 +0000"  >&lt;p&gt;Hi Kevin,&lt;/p&gt;

&lt;p&gt;We can certainly do better at optimizing the flush behaviour and what you are suggesting is not impossible at all, but will require significant changes to our storage engine - in particular to how &lt;a href=&quot;http://blog.mongodb.org/post/33700094220/how-mongodbs-journaling-works&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;journal truncation and memory re-mapping&lt;/a&gt; are implemented.&lt;/p&gt;

&lt;p&gt;I am putting this ticket into a planning bucket pending design and resources.&lt;/p&gt;

&lt;p&gt;Thanks for your input.&lt;/p&gt;

&lt;p&gt;-Kal.&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                <customfield id="customfield_12751" key="com.atlassian.jira.plugin.system.customfieldtypes:multiselect">
                        <customfieldname>Assigned Teams</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="25136"><![CDATA[Storage Execution]]></customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Mon, 12 May 2014 21:55:41 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        7 years, 31 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>alexander.golin@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            7 years, 31 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10000" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Old_Backport</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10000"><![CDATA[No]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>backlog-server-execution</customfieldvalue>
            <customfieldvalue>ian@mongodb.com</customfieldvalue>
            <customfieldvalue>kaloian.manassiev@mongodb.com</customfieldvalue>
            <customfieldvalue>justanyone</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrlvbz:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hryoqf:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>116587</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hsgxfr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>