<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 05:06:50 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-44740] huge oplog configuration causes memory use to grow without bound</title>
                <link>https://jira.mongodb.org/browse/SERVER-44740</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;In a customer case&#160;configuring the oplog to 3TB resulted in memory usage growing over time, apparently without bound.&lt;/p&gt;

&lt;p&gt;Reducing the oplog size resolved the customer issue, but doing some testing around huge oplog configurations seems warranted.&lt;/p&gt;

&lt;p&gt;EDIT:&lt;br/&gt;
 Apparently the size of the oplog was not reduced, however, metrics show the application reduced the amount of oplog GB/Hr. Obviously this introduces the possibility that oplog deletion is lagging, it&apos;s not the size of the oplog that is the principle concern.&#160;&lt;/p&gt;</description>
                <environment></environment>
        <key id="1012158">SERVER-44740</key>
            <summary>huge oplog configuration causes memory use to grow without bound</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="5">Cannot Reproduce</resolution>
                                        <assignee username="rachelle.palmer@mongodb.com">Rachelle Palmer</assignee>
                                    <reporter username="keith.bostic@mongodb.com">Keith Bostic</reporter>
                        <labels>
                    </labels>
                <created>Tue, 19 Nov 2019 20:07:24 +0000</created>
                <updated>Fri, 10 Apr 2020 14:15:43 +0000</updated>
                            <resolved>Thu, 9 Apr 2020 20:09:12 +0000</resolved>
                                                                    <component>Storage</component>
                                        <votes>0</votes>
                                    <watches>11</watches>
                                                                                                                <comments>
                            <comment id="2658097" author="bruce.lucas@10gen.com" created="Fri, 20 Dec 2019 17:03:50 +0000"  >&lt;p&gt;So yeah, no sign of the leak in this repro - &quot;allocated minus wt cache&quot; remains steady.&lt;/p&gt;

&lt;p&gt;Maybe smaller entries and/or 2-node repl set for another try?&lt;/p&gt;</comment>
                            <comment id="2657766" author="milkie" created="Fri, 20 Dec 2019 16:27:45 +0000"  >&lt;p&gt; &lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/attachment/241122/241122_diag.zip&quot; title=&quot;diag.zip attached to SERVER-44740&quot;&gt;diag.zip&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.mongodb.org/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt; Attaching new diagnostics data with longer run.&lt;/p&gt;</comment>
                            <comment id="2634414" author="milkie" created="Mon, 16 Dec 2019 16:43:45 +0000"  >&lt;p&gt;Thanks Bruce.  This was indeed compiled locally from the 3.4.23 tag.  I ran a single node replica set, which I figured would have the same behavior in the oplog, except for the read load (standalone would not have an oplog at all).&lt;br/&gt;
It&apos;s an interesting observation about the oplog entry sizes.  I could try trimming those down.  I didn&apos;t keep running the experiment but I can run it longer now and give more ftdc data.&lt;/p&gt;</comment>
                            <comment id="2634191" author="bruce.lucas@10gen.com" created="Mon, 16 Dec 2019 15:45:58 +0000"  >&lt;p&gt;Thanks Eric. There does seem to be a very slight increase in allocated minus cache; will be interested to see results after running for a few days. Can you attach latest ftdc data?&lt;/p&gt;

&lt;p&gt;I spotted a couple of differences between this and the customer issue, significance unknown:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;Customer was running 3.4.23, this is identified as 0.0.0 - was it built from 3.4.23 codebase?&lt;/li&gt;
	&lt;li&gt;Customer was running a replica set, this looks like a standalone? Given that the issue only happened on the primary of the replica set for the customer and not on the secondary, it seems possible that this might not reproduce standalone either.&lt;/li&gt;
	&lt;li&gt;Average oplog entry size for customer was about 79 kB, vs about 1 MB for the repro.&lt;/li&gt;
&lt;/ul&gt;
</comment>
                            <comment id="2607136" author="milkie" created="Fri, 13 Dec 2019 17:09:31 +0000"  >&lt;p&gt; &lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/attachment/241122/241122_diag.zip&quot; title=&quot;diag.zip attached to SERVER-44740&quot;&gt;diag.zip&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.mongodb.org/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt;   Adding diagnostics from my running instance.&lt;/p&gt;</comment>
                            <comment id="2602296" author="milkie" created="Thu, 12 Dec 2019 18:51:43 +0000"  >&lt;p&gt;That&apos;s a good idea, I&apos;ll rerun and collect that for you.&lt;/p&gt;</comment>
                            <comment id="2601646" author="bruce.lucas@10gen.com" created="Thu, 12 Dec 2019 14:46:01 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=milkie&quot; class=&quot;user-hover&quot; rel=&quot;milkie&quot;&gt;milkie&lt;/a&gt;, do you have the ftdc data from this run? I&apos;d be interested in comparing it with the data from the customer that hit this issue.&lt;/p&gt;</comment>
                            <comment id="2601526" author="milkie" created="Thu, 12 Dec 2019 13:38:36 +0000"  >&lt;p&gt;I set up a 3.4.23 server and ran it with a 3 GB oplog, then set up several shell workloads to fill up the oplog.  I ran it for a couple days and ran the VTune memory allocation analyzer on it.  Unfortunately, I was unable to reproduce any heap memory growth.&lt;/p&gt;</comment>
                            <comment id="2553367" author="bruce.lucas@10gen.com" created="Wed, 20 Nov 2019 13:53:18 +0000"  >&lt;p&gt;&#160;Is this a duplicate of&#160;&lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-44646&quot; title=&quot;Test oplog stone behavior with very very large oplogs&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-44646&quot;&gt;&lt;del&gt;SERVER-44646&lt;/del&gt;&lt;/a&gt;&#160;(or vice versa)?&#160;&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10011">
                    <name>Depends</name>
                                                                <inwardlinks description="is depended on by">
                                                        </inwardlinks>
                                    </issuelinktype>
                            <issuelinktype id="10010">
                    <name>Duplicate</name>
                                                                <inwardlinks description="is duplicated by">
                                        <issuelink>
            <issuekey id="1003537">SERVER-44646</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                            <attachment id="241122" name="diag.zip" size="133897242" author="milkie@mongodb.com" created="Fri, 20 Dec 2019 16:27:37 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18555" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname># of Sprints</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_13552" key="com.go2group.jira.plugin.crm:crm_generic_field">
                        <customfieldname>Case</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[[5002K00000huxoLQAQ]]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Wed, 20 Nov 2019 13:51:17 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        4 years, 7 weeks, 5 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>rachelle.palmer@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            4 years, 7 weeks, 5 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>bruce.lucas@mongodb.com</customfieldvalue>
            <customfieldvalue>milkie@mongodb.com</customfieldvalue>
            <customfieldvalue>keith.bostic@mongodb.com</customfieldvalue>
            <customfieldvalue>rachelle.palmer@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hw4cxr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hr5iv3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10557" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="3401">Execution Team 2019-12-16</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hw3z73:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>