<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:16:56 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-8253] MongoD is spamming with hundreds of gigabytes of logs</title>
                <link>https://jira.mongodb.org/browse/SERVER-8253</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Hi! &lt;br/&gt;
I&apos;m using mongoDB 2.2.1&lt;br/&gt;
I tried to make initial sync for the one of secondaries, but it failed with following exceptions:&lt;/p&gt;

&lt;p&gt;Mon Jan 21 07:22:07 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; SocketException: remote: 192.168.1.101:27017 error: 9001 socket exception &lt;span class=&quot;error&quot;&gt;&amp;#91;0&amp;#93;&lt;/span&gt; server &lt;span class=&quot;error&quot;&gt;&amp;#91;192.168.1.101:27017&amp;#93;&lt;/span&gt; &lt;br/&gt;
Mon Jan 21 07:22:07 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; Socket recv() conn closed? 192.168.1.101:27017&lt;br/&gt;
Mon Jan 21 07:22:07 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; SocketException: remote: 192.168.1.101:27017 error: 9001 socket exception &lt;span class=&quot;error&quot;&gt;&amp;#91;0&amp;#93;&lt;/span&gt; server &lt;span class=&quot;error&quot;&gt;&amp;#91;192.168.1.101:27017&amp;#93;&lt;/span&gt; &lt;br/&gt;
Mon Jan 21 07:22:07 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; Socket recv() conn closed? 192.168.1.101:27017&lt;br/&gt;
Mon Jan 21 07:22:07 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; SocketException: remote: 192.168.1.101:27017 error: 9001 socket exception &lt;span class=&quot;error&quot;&gt;&amp;#91;0&amp;#93;&lt;/span&gt; server &lt;span class=&quot;error&quot;&gt;&amp;#91;192.168.1.101:27017&amp;#93;&lt;/span&gt; &lt;br/&gt;
Mon Jan 21 07:22:07 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; Socket recv() conn closed? 192.168.1.101:27017&lt;br/&gt;
Mon Jan 21 07:22:07 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; SocketException: remote: 192.168.1.101:27017 error: 9001 socket exception &lt;span class=&quot;error&quot;&gt;&amp;#91;0&amp;#93;&lt;/span&gt; server &lt;span class=&quot;error&quot;&gt;&amp;#91;192.168.1.101:27017&amp;#93;&lt;/span&gt; &lt;br/&gt;
Mon Jan 21 07:22:07 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; Socket recv() conn closed? 192.168.1.101:27017&lt;br/&gt;
Mon Jan 21 07:22:07 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; SocketException: remote: 192.168.1.101:27017 error: 9001 socket exception &lt;span class=&quot;error&quot;&gt;&amp;#91;0&amp;#93;&lt;/span&gt; server &lt;span class=&quot;error&quot;&gt;&amp;#91;192.168.1.101:27017&amp;#93;&lt;/span&gt; &lt;br/&gt;
Mon Jan 21 07:22:07 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; Socket recv() conn closed? 192.168.1.101:27017&lt;br/&gt;
Mon Jan 21 07:22:07 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; SocketException: remote: 192.168.1.101:27017 error: 9001 socket exception &lt;span class=&quot;error&quot;&gt;&amp;#91;0&amp;#93;&lt;/span&gt; server &lt;span class=&quot;error&quot;&gt;&amp;#91;192.168.1.101:27017&amp;#93;&lt;/span&gt; &lt;br/&gt;
Mon Jan 21 07:22:07 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; Socket recv() conn closed? 192.168.1.101:27017&lt;br/&gt;
Mon Jan 21 07:22:07 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; SocketException: remote: 192.168.1.101:27017 error: 9001 socket exception &lt;span class=&quot;error&quot;&gt;&amp;#91;0&amp;#93;&lt;/span&gt; server &lt;span class=&quot;error&quot;&gt;&amp;#91;192.168.1.101:27017&amp;#93;&lt;/span&gt; &lt;br/&gt;
Mon Jan 21 07:22:07 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; Socket recv() conn closed? 192.168.1.101:27017&lt;br/&gt;
Mon Jan 21 07:22:07 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; SocketException: remote: 192.168.1.101:27017 error: 9001 socket exception &lt;span class=&quot;error&quot;&gt;&amp;#91;0&amp;#93;&lt;/span&gt; server &lt;span class=&quot;error&quot;&gt;&amp;#91;192.168.1.101:27017&amp;#93;&lt;/span&gt; &lt;br/&gt;
Mon Jan 21 07:22:07 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; Socket recv() conn closed? 192.168.1.101:27017&lt;/p&gt;

&lt;p&gt;Logfile raised to 200gb size in 6 hours, with 0 logLevel.&lt;br/&gt;
The machine at 192.168.1.101 is primary now.&lt;/p&gt;</description>
                <environment></environment>
        <key id="62738">SERVER-8253</key>
            <summary>MongoD is spamming with hundreds of gigabytes of logs</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="james.wahlin@mongodb.com">James Wahlin</assignee>
                                    <reporter username="gabol">Anton V. Volokhov</reporter>
                        <labels>
                    </labels>
                <created>Mon, 21 Jan 2013 11:03:37 +0000</created>
                <updated>Mon, 11 Jul 2016 17:59:43 +0000</updated>
                            <resolved>Tue, 28 May 2013 15:22:15 +0000</resolved>
                                                                                        <votes>0</votes>
                                    <watches>8</watches>
                                                                                                                <comments>
                            <comment id="346909" author="james.wahlin@10gen.com" created="Tue, 28 May 2013 15:22:15 +0000"  >&lt;p&gt;Resolving ticket. Anton, feel free to reopen with any further questions.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
James&lt;/p&gt;</comment>
                            <comment id="346865" author="milkie" created="Tue, 28 May 2013 14:30:30 +0000"  >&lt;p&gt;Replication batch size is unrelated to ulimits.&lt;/p&gt;</comment>
                            <comment id="346854" author="gabol" created="Tue, 28 May 2013 14:17:58 +0000"  >&lt;p&gt;Thanks!&lt;br/&gt;
One little question before closing the thread.&lt;br/&gt;
Could you briefly explain how replication batch size is related to ulimits?&lt;/p&gt;</comment>
                            <comment id="346848" author="james.wahlin@10gen.com" created="Tue, 28 May 2013 14:07:12 +0000"  >&lt;p&gt;Hi Anton,&lt;/p&gt;

&lt;p&gt;I have created &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-9791&quot; title=&quot;Move &amp;quot;replication batch size is&amp;quot; log message from level 1 to 2&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-9791&quot;&gt;&lt;del&gt;SERVER-9791&lt;/del&gt;&lt;/a&gt;, requesting that the &quot;replication batch size is ...&quot; message be moved to log level 2. I have made you the requestor on it. Please track &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-9791&quot; title=&quot;Move &amp;quot;replication batch size is&amp;quot; log message from level 1 to 2&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-9791&quot;&gt;&lt;del&gt;SERVER-9791&lt;/del&gt;&lt;/a&gt; for status. &lt;/p&gt;

&lt;p&gt;Let me know if you have any further questions for this ticket, otherwise let&apos;s close out given your initial problem appears to have been ulimit related and we have a new ticket for the replication batch size statement.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
James&lt;/p&gt;</comment>
                            <comment id="345046" author="gabol" created="Fri, 24 May 2013 23:18:45 +0000"  >&lt;p&gt;We use more frequent logrotate.&lt;br/&gt;
Debug data can be useful, so loglevel 0 is undesirable.&lt;/p&gt;</comment>
                            <comment id="344819" author="james.wahlin@10gen.com" created="Fri, 24 May 2013 18:39:52 +0000"  >&lt;p&gt;Hi Anton,&lt;/p&gt;

&lt;p&gt;Sorry about the delay on this. The &quot;replication batch size&quot; message in 2.2.2 is only printed at log level one. If you change logging to level 0 this will go away.&lt;/p&gt;

&lt;p&gt;Can you give me an idea on your current status? Can we still be of help on this?&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
James&lt;/p&gt;</comment>
                            <comment id="248619" author="gabol" created="Thu, 24 Jan 2013 13:22:48 +0000"  >&lt;p&gt;one more issue with logging.&lt;br/&gt;
We upgraded to mongoDB 2.2.2&lt;br/&gt;
Trying to make initial resync for one instance.&lt;br/&gt;
we have thousands of duplicate strings &quot;replication batch size is 1&quot;&lt;br/&gt;
$ grep &apos;replication batch size is 1&apos; mongodb.log | wc -l&lt;br/&gt;
4854584&lt;br/&gt;
$ grep &apos;Thu\ Jan\ 24\ 08:45:06\ [rsSync]\ replication\ batch\ size\ is\ 1&apos; mongodb.log | wc -l&lt;br/&gt;
862&lt;/p&gt;</comment>
                            <comment id="245735" author="gabol" created="Mon, 21 Jan 2013 17:31:51 +0000"  >&lt;p&gt;We are making dump of a whole cluster and use it only if whole cluster is corrupted. We hoped, that secondaries can recover without any manual tuning.&lt;br/&gt;
We have about 200GB on two shards. Replicated only 15GBs. Graph of the dataSize(dataSize parameter of db.stats() for the corresponding database) looks weird:&lt;br/&gt;
&lt;a href=&quot;http://yadi.sk/d/LyYVRmjl20vlL&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://yadi.sk/d/LyYVRmjl20vlL&lt;/a&gt;&lt;br/&gt;
Cluster architecture is following:&lt;br/&gt;
1st shard : cs-mongodb01* machines&lt;br/&gt;
2nd shard : cs-mongodb02* machines&lt;br/&gt;
second shard is lagging.&lt;/p&gt;</comment>
                            <comment id="245724" author="gregor" created="Mon, 21 Jan 2013 17:10:59 +0000"  >&lt;p&gt;Hi&lt;br/&gt;
Initial sync over the network can be slow. How large is your database? Are you in MMS?&lt;br/&gt;
Have you considered seeding the secondary with a &lt;a href=&quot;http://docs.mongodb.org/manual/administration/backups/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;backup&lt;/a&gt; of the data files? &lt;br/&gt;
Thanks&lt;br/&gt;
Gregor&lt;/p&gt;</comment>
                            <comment id="245720" author="gabol" created="Mon, 21 Jan 2013 17:05:57 +0000"  >&lt;p&gt;Initial sync is in progress now, but it crawls slowly.&lt;br/&gt;
Load average on master and the other secondary jumps up to 2000. &lt;/p&gt;</comment>
                            <comment id="245689" author="gabol" created="Mon, 21 Jan 2013 16:29:56 +0000"  >&lt;p&gt;Yes, connectivity is ok.&lt;br/&gt;
There were problems with open connections(max 819 open connections with ulimits 1024)&lt;br/&gt;
Then I raised ulimits, restarted machines and the issue has gone. But still, 200GB of logs looks scary.&lt;/p&gt;</comment>
                            <comment id="245661" author="eliot" created="Mon, 21 Jan 2013 16:02:04 +0000"  >&lt;p&gt;Seems like there is a networking issue?&lt;br/&gt;
Have you checked connectivity?&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                            <outwardlinks description="related to">
                                        <issuelink>
            <issuekey id="76783">SERVER-9791</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>12.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Mon, 21 Jan 2013 16:02:04 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        10 years, 38 weeks, 1 day ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>false</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            10 years, 38 weeks, 1 day ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10000" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Old_Backport</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10000"><![CDATA[No]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>gabol</customfieldvalue>
            <customfieldvalue>eliot</customfieldvalue>
            <customfieldvalue>milkie@mongodb.com</customfieldvalue>
            <customfieldvalue>gregor</customfieldvalue>
            <customfieldvalue>james.wahlin@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrnanr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hrlq33:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>40280</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hs4pxr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>