<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 04:32:36 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-33187] Journal data are not cleared by WiredTiger</title>
                <link>https://jira.mongodb.org/browse/SERVER-33187</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Hi Team,&lt;/p&gt;

&lt;p&gt;Thanks for your continuous support !!&lt;br/&gt;
*We have a production issue as in , the journal data is not cleared till mongoServer is restarted!! This folder has reached approximately 75GB!!!!&lt;br/&gt;
 and occupied almost entire Drive !!!!&lt;br/&gt;
&lt;b&gt;&lt;ins&gt;&lt;font color=&quot;#d04437&quot;&gt;Query:&lt;/font&gt;&lt;/ins&gt;&lt;/b&gt;&lt;br/&gt;
*&lt;br/&gt;
We would like to here from you that&lt;font color=&quot;red&quot;&gt;*_,&lt;br/&gt;
If MongoDB Server is never restarted , will  the binary log data under data/db/journal will not be cleared ?&lt;br/&gt;
What is the Max number of journal files or max sixe of journal folder allowed to be created under Journal folder ?&lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;We undertood from journal file sixe is 100MB&amp;#93;&lt;/span&gt;&lt;br/&gt;
_*&lt;/font&gt;&lt;/p&gt;

&lt;p&gt;&lt;b&gt;&lt;ins&gt;&lt;font color=&quot;#d04437&quot;&gt;Reference links&lt;/font&gt;&lt;/ins&gt;&lt;/b&gt;&lt;br/&gt;
We have gone through the site:&lt;font color=&quot;#205081&quot;&gt;*&lt;a href=&quot;https://docs.mongodb.com/manual/core/journaling/*&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://docs.mongodb.com/manual/core/journaling/*&lt;/a&gt;&lt;/font&gt;&lt;/p&gt;

&lt;p&gt;It has mentioned that &lt;br/&gt;
+&quot;A clean shutdown removes all the files in the journal directory. A dirty shutdown (crash) leaves files in the journal directory; &lt;br/&gt;
these are used to automatically recover the database to a consistent state when the mongod process is restarted&quot;+&lt;/p&gt;

&lt;p&gt;Above statement implies that journal folder will keep on growing and never gets cleared ,&lt;br/&gt;
until ,&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;Mongo server is not restarted or&lt;/li&gt;
	&lt;li&gt;One has to perform clean shutdown&lt;br/&gt;
Please Clarify  and address the above mentioned query&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;Thanks &amp;amp; Regards&lt;br/&gt;
Sandeep KS&lt;/p&gt;</description>
                <environment>MongoServer:3.4 version &lt;br/&gt;
OS:Windows 7 Professional ,Version 6.1 &lt;br/&gt;
Processor:Intel(r) Core(TM) i5-4430 CPU @3.00GHz 3.00GHz&lt;br/&gt;
RAM:8.00GB&lt;br/&gt;
Systemtype:64-bit OS&lt;br/&gt;
&lt;br/&gt;
</environment>
        <key id="494216">SERVER-33187</key>
            <summary>Journal data are not cleared by WiredTiger</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="3">Duplicate</resolution>
                                        <assignee username="backlog-server-execution">Backlog - Storage Execution Team</assignee>
                                    <reporter username="Urs">Sandeep [X]</reporter>
                        <labels>
                            <label>Bug</label>
                            <label>Cleanup</label>
                    </labels>
                <created>Thu, 8 Feb 2018 06:08:45 +0000</created>
                <updated>Tue, 6 Dec 2022 03:38:40 +0000</updated>
                            <resolved>Fri, 9 Feb 2018 15:09:31 +0000</resolved>
                                    <version>3.4.0</version>
                                                                        <votes>0</votes>
                                    <watches>11</watches>
                                                                                                                <comments>
                            <comment id="1800750" author="milkie" created="Fri, 9 Feb 2018 15:09:31 +0000"  >&lt;p&gt;Please follow the linked WT ticket for updates.&lt;/p&gt;</comment>
                            <comment id="1800408" author="urs" created="Fri, 9 Feb 2018 06:10:28 +0000"  >&lt;p&gt;Dear Team,&lt;/p&gt;

&lt;p&gt;I&apos;ve attached file list of journal directory &lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/attachment/178770/178770_journal_dir_listfiles.txt&quot; title=&quot;journal_dir_listfiles.txt attached to SERVER-33187&quot;&gt;journal_dir_listfiles.txt&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.mongodb.org/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt; to further aid your investigation.&lt;/p&gt;

&lt;p&gt;Thanks &amp;amp; Regards&lt;br/&gt;
Sandeep KS&lt;/p&gt;</comment>
                            <comment id="1799821" author="sue.loverso" created="Thu, 8 Feb 2018 18:54:53 +0000"  >&lt;p&gt;I opened &lt;a href=&quot;https://jira.mongodb.org/browse/WT-3904&quot; title=&quot;Reconsider error path in log server thread&quot; class=&quot;issue-link&quot; data-issue-key=&quot;WT-3904&quot;&gt;&lt;del&gt;WT-3904&lt;/del&gt;&lt;/a&gt; to discuss possible future changes to how internal threads handle errors.&lt;/p&gt;</comment>
                            <comment id="1799767" author="sue.loverso" created="Thu, 8 Feb 2018 18:25:20 +0000"  >&lt;p&gt;There are no known issues that I&apos;m aware of (at least looking back on changes/fixes to relevant files). Archiving log files no longer needed is determined by checkpoints. Looking at FTDC checkpoints are happening regularly and nothing looks out of the ordinary there. &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=bruce.lucas&quot; class=&quot;user-hover&quot; rel=&quot;bruce.lucas&quot;&gt;bruce.lucas&lt;/a&gt;&apos;s analysis provides a clue.&lt;/p&gt;

&lt;p&gt;Looking at the mongod logs, the log server thread that is responsible for both pre-allocating log files and archiving old ones got an error and exited:&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2018-02-01T20:41:07.083-0500 E STORAGE  [thread2] WiredTiger error (0) [1517535667:83051][4752:140716872831104], log-server: C:\SRDM\SRDM2.5.0.11094.31\SRDM\Svr\DBService\bin64\..\data\db\journal/WiredTigerLog.0000000023: file-remove: DeleteFileW: Access is denied&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;MongoDbLog-2018-02-01_1132 AM.log:2018-02-01T20:41:07.083-0500 E STORAGE  [thread2] WiredTiger error (13) [1517535667:83051][4752:140716872831104], log-server: log server error: Permission denied&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;Therefore once that happened and the thread exited with an error, it never archived nor pre-allocated log files. I&apos;ll open a ticket to consider whether that should be a fatal error, but in 3.4.0 it is and the only way to restart that internal thread is a restart.&lt;/p&gt;</comment>
                            <comment id="1799620" author="sue.loverso" created="Thu, 8 Feb 2018 16:38:18 +0000"  >&lt;p&gt;Can you attach an &lt;tt&gt;ls -l&lt;/tt&gt; of the journal directory please? &lt;/p&gt;</comment>
                            <comment id="1799459" author="bruce.lucas@10gen.com" created="Thu, 8 Feb 2018 15:21:32 +0000"  >&lt;p&gt;&lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;img src=&quot;https://jira.mongodb.org/secure/attachment/178317/178317_logfiles.png&quot; width=&quot;100%&quot; style=&quot;border: 0px solid black&quot; /&gt;&lt;/span&gt;&lt;/p&gt;

&lt;p&gt;It looks like up until about A we are recycling old log files, but at A we stop doing that and so starting at B we are having to create new log files. This condition persists throughout the rest of the FTDC data, and as expected the number of &quot;pre-allocated log files not ready&quot; matches the number of existing log files. There are one or two other things that change at about the same time, relevance TBD.&lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=sue.loverso&quot; class=&quot;user-hover&quot; rel=&quot;sue.loverso&quot;&gt;sue.loverso&lt;/a&gt; does this match any known issued in 3.4.0?&lt;/p&gt;</comment>
                            <comment id="1799385" author="urs" created="Thu, 8 Feb 2018 14:24:22 +0000"  >&lt;p&gt;Sorry Team,&lt;br/&gt;
By mistake i mentioned  Affected Versions as :3.4.12, &lt;b&gt;&lt;ins&gt;But the MongoDB Server Version we are using is :3.4.0&lt;/ins&gt;&lt;/b&gt;&lt;/p&gt;</comment>
                            <comment id="1799336" author="urs" created="Thu, 8 Feb 2018 13:29:32 +0000"  >&lt;p&gt;Dear Team,&lt;br/&gt;
Further to aid your investigation we are attaching below data logs also&lt;/p&gt;

&lt;ol&gt;
	&lt;li&gt;_mdb_catalog.wt&lt;/li&gt;
	&lt;li&gt;sizeStorer.wt&lt;/li&gt;
	&lt;li&gt;mongod.logs&lt;/li&gt;
	&lt;li&gt;diagnostic.data &lt;span class=&quot;error&quot;&gt;&amp;#91;already shared above&amp;#93;&lt;/span&gt;&lt;/li&gt;
&lt;/ol&gt;


&lt;p&gt;Thanks &amp;amp; Regards&lt;br/&gt;
Sandeep KS&lt;/p&gt;</comment>
                            <comment id="1799205" author="urs" created="Thu, 8 Feb 2018 09:25:53 +0000"  >&lt;p&gt; &lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/attachment/178302/178302_diagnostic.data.rar&quot; title=&quot;diagnostic.data.rar attached to SERVER-33187&quot;&gt;diagnostic.data.rar&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.mongodb.org/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt; &lt;br/&gt;
Hi Team,&lt;/p&gt;

&lt;p&gt;Also i have attached the* &quot;$dbpath/diagnostic.data* for your analysis &lt;br/&gt;
&lt;b&gt;There are around *&lt;font color=&quot;#d04437&quot;&gt;686&lt;/font&gt;&lt;/b&gt; files under &amp;lt;&amp;lt;data\db\journal&amp;gt;&amp;gt; folder *&lt;br/&gt;
*Files=&amp;gt; &lt;font color=&quot;#d04437&quot;&gt;&lt;b&gt;WiredTigerLog.0000000024 -to -WiredTigerLog.0000000709&lt;/b&gt;*&lt;/font&gt;&lt;br/&gt;
Attachment Name::&amp;lt;&amp;lt;diagnostic.data.rar&amp;gt;&amp;gt;&lt;/p&gt;

&lt;p&gt;Thanks &amp;amp; awaiting for your reply &lt;/p&gt;

&lt;p&gt;Thanks &amp;amp; Regards&lt;br/&gt;
Sandeep KS&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                            <outwardlinks description="related to">
                                        <issuelink>
            <issuekey id="495198">WT-3904</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                            <attachment id="178310" name="_mdb_catalog.wt" size="40960" author="Urs" created="Thu, 8 Feb 2018 13:11:40 +0000"/>
                            <attachment id="178302" name="diagnostic.data.rar" size="31704777" author="Urs" created="Thu, 8 Feb 2018 09:05:05 +0000"/>
                            <attachment id="178325" name="ftdc.tar" size="32432640" author="bruce.lucas@mongodb.com" created="Thu, 8 Feb 2018 16:51:22 +0000"/>
                            <attachment id="178770" name="journal_dir_listfiles.txt" size="44655" author="Urs" created="Fri, 9 Feb 2018 06:07:00 +0000"/>
                            <attachment id="178317" name="logfiles.png" size="151636" author="bruce.lucas@mongodb.com" created="Thu, 8 Feb 2018 15:17:38 +0000"/>
                            <attachment id="178311" name="mongod-logs.7z" size="49687015" author="Urs" created="Thu, 8 Feb 2018 13:23:29 +0000"/>
                            <attachment id="178312" name="sizeStorer.wt" size="45056" author="Urs" created="Thu, 8 Feb 2018 13:11:40 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                <customfield id="customfield_12751" key="com.atlassian.jira.plugin.system.customfieldtypes:multiselect">
                        <customfieldname>Assigned Teams</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="25136"><![CDATA[Storage Execution]]></customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Thu, 8 Feb 2018 15:21:32 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        6 years, 5 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>false</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>alexander.golin@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            6 years, 5 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>backlog-server-execution</customfieldvalue>
            <customfieldvalue>bruce.lucas@mongodb.com</customfieldvalue>
            <customfieldvalue>milkie@mongodb.com</customfieldvalue>
            <customfieldvalue>Urs</customfieldvalue>
            <customfieldvalue>sue.loverso@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|htpw7r:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hthe6v:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|htpicf:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>