<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:57:15 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-21402] Mongodb memory usage keep on increasing</title>
                <link>https://jira.mongodb.org/browse/SERVER-21402</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Configured Cache size: 20GB&lt;br/&gt;
MongoDB Ram usage: 114GB&lt;/p&gt;

&lt;p&gt;MongoDB Ram utilization is keep on increasing and take all my ram (114 of 128) and it make Load average very high(sometimes above 250).&lt;/p&gt;

&lt;p&gt;We need to restart mongod inorder to recover from there and within 2 days it takes all my ram.&lt;/p&gt;

&lt;p&gt;I am using mongodb 3.0.6, WiredTiger with 1.5TB data and testing under High Read &amp;amp; Write application.&lt;br/&gt;
Server details Red Hat Enterprise Linux Server release 6.5&lt;br/&gt;
which is having 128GB Ram and 64 core processor.&lt;/p&gt;</description>
                <environment></environment>
        <key id="238802">SERVER-21402</key>
            <summary>Mongodb memory usage keep on increasing</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="2" iconUrl="https://jira.mongodb.org/images/icons/priorities/critical.svg">Critical - P2</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="-1">Unassigned</assignee>
                                    <reporter username="samanderson">sam anderson</reporter>
                        <labels>
                    </labels>
                <created>Wed, 11 Nov 2015 07:28:56 +0000</created>
                <updated>Mon, 25 Mar 2019 08:10:41 +0000</updated>
                            <resolved>Mon, 14 Dec 2015 23:23:23 +0000</resolved>
                                    <version>3.0.6</version>
                                                    <component>WiredTiger</component>
                                        <votes>0</votes>
                                    <watches>8</watches>
                                                                                                                <comments>
                            <comment id="2190104" author="siddhu2206@gmail.com" created="Mon, 25 Mar 2019 08:10:41 +0000"  >&lt;p&gt;Hi,&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;Even in the current release of mongodb(4.0.4) still having the large number of open connection can utilise maximum if its memory.&lt;/p&gt;</comment>
                            <comment id="1114299" author="thomas.schubert" created="Mon, 14 Dec 2015 23:23:23 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=samanderson%40rishoncomm.in&quot; class=&quot;user-hover&quot; rel=&quot;samanderson@rishoncomm.in&quot;&gt;samanderson@rishoncomm.in&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Sorry for the delay getting back to you. Each &lt;a href=&quot;https://docs.mongodb.org/v3.0/faq/diagnostics/#how-do-i-calculate-how-much-ram-i-need-for-my-application&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;open connection&lt;/a&gt; and &lt;a href=&quot;https://docs.mongodb.org/v3.0/core/cursors/#cursor-batches&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;cursor&lt;/a&gt; increases the memory utilized by MongoDB.&lt;/p&gt;

&lt;p&gt;The large number of connections and open cursors likely explains the behavior you are seeing.&lt;/p&gt;

&lt;p&gt;For MongoDB-related support discussion please post on the &lt;a href=&quot;http://groups.google.com/group/mongodb-user&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;mongodb-users group&lt;/a&gt; or &lt;a href=&quot;http://stackoverflow.com/questions/tagged/mongodb&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;Stack Overflow with the &lt;tt&gt;mongodb&lt;/tt&gt; tag&lt;/a&gt;. A question like this involving more discussion would be best posted on the mongodb-users group.&lt;/p&gt;

&lt;p&gt;Kind regards,&lt;br/&gt;
Thomas&lt;/p&gt;</comment>
                            <comment id="1101799" author="samanderson" created="Tue, 1 Dec 2015 11:34:14 +0000"  >&lt;p&gt;Hi Alex,&lt;/p&gt;

&lt;p&gt;objects : 4185991438&lt;br/&gt;
avgObjSize : 417.1831765815475&lt;br/&gt;
dataSize : 1746325205248&lt;br/&gt;
storageSize : 509287182336&lt;br/&gt;
numExtents : 0&lt;br/&gt;
indexes : 559&lt;br/&gt;
indexSize : 173359013888&lt;/p&gt;

&lt;p&gt;Default connection size for our application is : 5000&lt;/p&gt;

&lt;p&gt;Is the no. of connection affects memory?&lt;/p&gt;

&lt;p&gt;Thanks&lt;br/&gt;
Sam&lt;/p&gt;</comment>
                            <comment id="1101610" author="alexander.gorrod" created="Tue, 1 Dec 2015 06:14:39 +0000"  >&lt;p&gt;Hi Sam,&lt;/p&gt;

&lt;p&gt;From the statistics you uploaded, it appears as though you have a lot of open connections (2,500) and cursors (300+ thousand). It is likely that those connections and cursors are holding a lot of memory. Does your database have a lot of collections and/or indexes? Is your application opening lots of new connections to MongoDB?&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Alex&lt;/p&gt;</comment>
                            <comment id="1099045" author="samanderson" created="Thu, 26 Nov 2015 10:09:27 +0000"  >&lt;p&gt;Hey!, any update....?&lt;/p&gt;</comment>
                            <comment id="1088608" author="samanderson" created="Sat, 14 Nov 2015 09:50:41 +0000"  >&lt;p&gt;ss.log&lt;/p&gt;</comment>
                            <comment id="1088607" author="samanderson" created="Sat, 14 Nov 2015 09:45:20 +0000"  >&lt;p&gt;Ram&#243;n thank u for ur reply.&lt;/p&gt;

&lt;p&gt;I have Uploaded the ss.log file over here and &lt;a href=&quot;https://10gen-httpsupload.s3.amazonaws.com/upload_forms/e412b029-5021-440b-81e4-12126af54974.html&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://10gen-httpsupload.s3.amazonaws.com/upload_forms/e412b029-5021-440b-81e4-12126af54974.html&lt;/a&gt;.&lt;/p&gt;

&lt;p&gt;Is there anything u need?&lt;/p&gt;</comment>
                            <comment id="1085459" author="ramon.fernandez" created="Wed, 11 Nov 2015 12:01:50 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=samanderson&quot; class=&quot;user-hover&quot; rel=&quot;samanderson&quot;&gt;samanderson&lt;/a&gt;, the &lt;tt&gt;wiredTigerCacheSizeGB&lt;/tt&gt; parameter only limits the WiredTiger cache size, &lt;tt&gt;mongod&lt;/tt&gt; needs additional memory to operate. From the information you uploaded I can see that there are not runaway cache issues:&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;                        &quot;bytes currently in the cache&quot; : 21225882917,&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;                        &quot;maximum bytes configured&quot;  : 21474836480,&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;In order to understand what&apos;s going on and whether the memory consumption you&apos;re seeing is expected or not we&apos;ll need additional information. Can you please run the following shell script on the affected node?&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;mongo --eval &quot;while(true) {print(JSON.stringify(db.serverStatus({tcmalloc:1}))); sleep(5000)}&quot; &amp;gt;ss.log &amp;amp;&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;This script collects server status information every 5 seconds in a file called &lt;tt&gt;ss.log&lt;/tt&gt;. Ideally it would be useful to collect data from a restart until memory grows past 100G for example. Once the data is collected please &lt;a href=&quot;https://10gen-httpsupload.s3.amazonaws.com/upload_forms/e412b029-5021-440b-81e4-12126af54974.html&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;upload it here&lt;/a&gt; along with the server logs for the same period of time.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Ram&#243;n.&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                            <attachment id="97920" name="db.serverStatus()" size="13477" author="samanderson" created="Wed, 11 Nov 2015 07:28:56 +0000"/>
                            <attachment id="98308" name="ss.log.tar.gz" size="39251178" author="samanderson" created="Sat, 14 Nov 2015 09:50:40 +0000"/>
                            <attachment id="97921" name="top" size="674" author="samanderson" created="Wed, 11 Nov 2015 07:28:56 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>8.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Wed, 11 Nov 2015 12:01:50 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        4 years, 46 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>siddhu2206@gmail.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            4 years, 46 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>alexander.gorrod@mongodb.com</customfieldvalue>
            <customfieldvalue>kelsey.schubert@mongodb.com</customfieldvalue>
            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>
            <customfieldvalue>samanderson</customfieldvalue>
            <customfieldvalue>siddhu2206@gmail.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrkp5b:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hseb7z:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hsfgp3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>