<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 04:29:17 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-32132] db.fsyncLock() does not stop writes to FTDC / diagnostic.data files</title>
                <link>https://jira.mongodb.org/browse/SERVER-32132</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;As documented &lt;a href=&quot;https://docs.mongodb.com/manual/reference/method/db.fsyncLock/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;here&lt;/a&gt;, I expect Mongodb&apos;s db.fsyncLock() to ensure the data files do not change for Mongodb instance using WiredTiger storage engine. &lt;/p&gt;

&lt;p&gt;We are using mongodb version 3.4 and low level file backup strategy via file copy (Python  Shutil.copytree). &lt;/p&gt;

&lt;p&gt;The problem I am facing intermittently is that sometimes my backup fails with error such as &lt;br/&gt;
&amp;lt;mongo_data_dir&amp;gt;/diagnostic.data/metrics.interim is unavailable to be copied to the destination path. &lt;/p&gt;

&lt;p&gt;Sequence of steps which I am following :&lt;br/&gt;
1. First I use the atomic operation db.fsyncLock() to fsync the data and take a lock.  &lt;br/&gt;
2. Then I use a low level file backup strategy via files copy. Exactly I am using a python util Shutil.copytree() to copy the entire data directory to another location. &lt;br/&gt;
3. Then I unlock using db.fsyncUnlock(). &lt;/p&gt;

&lt;p&gt;The problem I am facing is in second step. This problem is coming intermittently (once in 20 times) &lt;/p&gt;</description>
                <environment></environment>
        <key id="466807">SERVER-32132</key>
            <summary>db.fsyncLock() does not stop writes to FTDC / diagnostic.data files</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="13202">Works as Designed</resolution>
                                        <assignee username="mark.agarunov">Mark Agarunov</assignee>
                                    <reporter username="nikhil578">NIKHIL </reporter>
                        <labels>
                    </labels>
                <created>Fri, 1 Dec 2017 07:04:39 +0000</created>
                <updated>Fri, 27 Oct 2023 13:54:05 +0000</updated>
                            <resolved>Sat, 2 Dec 2017 13:14:44 +0000</resolved>
                                                                    <component>Admin</component>
                                        <votes>0</votes>
                                    <watches>11</watches>
                                                                                                                <comments>
                            <comment id="1740793" author="ramon.fernandez" created="Sat, 2 Dec 2017 13:14:44 +0000"  >&lt;p&gt;I&apos;ve adjusted the summary to more accurately reflect the issue and also updated the resolution.&lt;/p&gt;</comment>
                            <comment id="1740791" author="ramon.fernandez" created="Sat, 2 Dec 2017 13:13:06 +0000"  >&lt;p&gt;To add to Mark&apos;s answer, the &lt;tt&gt;diagnostic.data/metrics.interim&lt;/tt&gt; file is where each node stores diagnostic data until it reaches a certain size, then it gets renamed to something like &lt;tt&gt;metrics.2016-11-01T06-54-27Z-00000&lt;/tt&gt;. It is because of this rename that you may get errors around this file not being available.&lt;/p&gt;

&lt;p&gt;As Mark said above, you can safely ignore the &lt;tt&gt;diagnostic.data&lt;/tt&gt; directory altogether. If you also want to make a backup copy of the files there, then you can configure your backup code to ignore the &lt;tt&gt;metrics.interim&lt;/tt&gt; file and the errors you describe should go away.&lt;/p&gt;

&lt;p&gt;Regards,&lt;br/&gt;
Ram&#243;n.&lt;/p&gt;</comment>
                            <comment id="1740235" author="mark.agarunov" created="Fri, 1 Dec 2017 17:39:50 +0000"  >&lt;p&gt;Hello &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=nikhil578&quot; class=&quot;user-hover&quot; rel=&quot;nikhil578&quot;&gt;nikhil578&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Thank you for the report. The behavior you&apos;re seeing is due to the fact that &lt;tt&gt;fsyncLock&lt;/tt&gt; doesn&apos;t affect the diagnostic data directory. However, you should be able to safely exclude this file from the backup, as it only contains diagnostic metrics and does not contain any user or database data.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Mark&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>3.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Fri, 1 Dec 2017 14:33:50 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        6 years, 10 weeks, 4 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>luke.bonanomi@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            6 years, 10 weeks, 4 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>mark.agarunov</customfieldvalue>
            <customfieldvalue>nikhil578</customfieldvalue>
            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|htlcy7:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|htcywf:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10750" key="com.atlassian.jira.plugin.system.customfieldtypes:textarea">
                        <customfieldname>Steps To Reproduce</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>&lt;p&gt;Sequence of steps to be followed to reproduce this is mentioned below. Execute these steps on a running mongodb server. &lt;br/&gt;
1. First use db.fsyncLock() to fsync the data and take a lock.  &lt;br/&gt;
2. Then use python util Shutil.copytree() to copy the entire data directory to another location. &lt;br/&gt;
3. Then I unlock using db.fsyncUnlock(). &lt;/p&gt;

&lt;p&gt;This is not reproducible every time. This problem is coming intermittently (once in 20 times) &lt;/p&gt;</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|htkz1z:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>