<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 08:38:11 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[GODRIVER-2259] Excess memory consumption from Zstd compression</title>
                <link>https://jira.mongodb.org/browse/GODRIVER-2259</link>
                <project id="14289" key="GODRIVER">Go Driver</project>
                    <description>&lt;p&gt;Original description:&lt;/p&gt;
&lt;blockquote&gt;
&lt;h4&gt;&lt;a name=&quot;Summary&quot;&gt;&lt;/a&gt;Summary&lt;/h4&gt;
&lt;p&gt;We enabled zLib compression on ADL frontends and saw a large increase in memory consumed in the Go driver. A pprof heap profile taken while consumption was high is attached.&lt;/p&gt;

&lt;p&gt;ADL was not under particularly heavy load however memory consumption remained high. A Grafana chart of our memory consumption is also attached. The left side shows memory consumption with compression enabled; the right side shows memory consumption after disabling compression and restarting. The pprof snapshot was taken at one of the peaks on the left side.&lt;/p&gt;

&lt;h4&gt;&lt;a name=&quot;Pleaseprovidetheversionofthedriver.Ifapplicable%2CpleaseprovidetheMongoDBserverversionandtopology%28standalone%2Creplicaset%2Corshardedcluster%29.&quot;&gt;&lt;/a&gt;Please provide the version of the driver. If applicable, please provide the MongoDB server version and topology (standalone, replica set, or sharded cluster).&lt;/h4&gt;
&lt;p&gt;Driver was v1.7.4. Server version and topology varies widely.&lt;/p&gt;

&lt;h4&gt;&lt;a name=&quot;HowtoReproduce&quot;&gt;&lt;/a&gt;How to Reproduce&lt;/h4&gt;
&lt;p&gt;Unknown. Perhaps run a large number of find / match / count queries over time with zLib compression enabled.&lt;/p&gt;

&lt;h4&gt;&lt;a name=&quot;AdditionalBackground&quot;&gt;&lt;/a&gt;Additional Background&lt;/h4&gt;
&lt;p&gt;The linked ticket, MHOUSE-3597, contains a discussion around enabling / disabling compression. There was also some benchmarking results for all compression included in ticket comments that you may find interesting, although it is unlikely to shed any light on this ticket.&lt;/p&gt;&lt;/blockquote&gt;

&lt;p&gt;&lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;a id=&quot;351748_thumb&quot; href=&quot;https://jira.mongodb.org/secure/attachment/351748/351748_profile006.png&quot; title=&quot;profile006.png&quot; file-preview-type=&quot;image&quot; file-preview-id=&quot;351748&quot; file-preview-title=&quot;profile006.png&quot;&gt;&lt;img src=&quot;https://jira.mongodb.org/secure/thumbnail/351748/_thumb_351748.png&quot; style=&quot;border: 0px solid black&quot; role=&quot;presentation&quot;/&gt;&lt;/a&gt;&lt;/span&gt; and &lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;a id=&quot;351747_thumb&quot; href=&quot;https://jira.mongodb.org/secure/attachment/351747/351747_Screen+Shot+2021-12-20+at+11.00.58+AM.png&quot; title=&quot;Screen Shot 2021-12-20 at 11.00.58 AM.png&quot; file-preview-type=&quot;image&quot; file-preview-id=&quot;351747&quot; file-preview-title=&quot;Screen Shot 2021-12-20 at 11.00.58 AM.png&quot;&gt;&lt;img src=&quot;https://jira.mongodb.org/secure/thumbnail/351747/_thumb_351747.png&quot; style=&quot;border: 0px solid black&quot; role=&quot;presentation&quot;/&gt;&lt;/a&gt;&lt;/span&gt; were also attached with the original request.&lt;/p&gt;

&lt;p&gt;The original request was to investigate excess memory usage when using zlib compression. However, the attached pprof snapshot, profile006.png, indicated the memory usage of zstd. Our initial investigation and profiling on a minimal reproduction running zlib and zstd side by side also implied that zstd consumed memory more significantly as shown in diagrams zstd.png and zlib.png. Thus, this ticket was amended to investigate excess memory usage when using zstd compression.&lt;/p&gt;</description>
                <environment></environment>
        <key id="1954325">GODRIVER-2259</key>
            <summary>Excess memory consumption from Zstd compression</summary>
                <type id="4" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14710&amp;avatarType=issuetype">Improvement</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="13201">Fixed</resolution>
                                        <assignee username="qingyang.hu@mongodb.com">Qingyang Hu</assignee>
                                    <reporter username="thomas.henretty@mongodb.com">Thomas Henretty</reporter>
                        <labels>
                    </labels>
                <created>Mon, 20 Dec 2021 16:19:55 +0000</created>
                <updated>Sat, 28 Oct 2023 11:37:40 +0000</updated>
                            <resolved>Wed, 22 Jun 2022 20:06:03 +0000</resolved>
                                                    <fixVersion>1.10.0</fixVersion>
                                                        <votes>0</votes>
                                    <watches>4</watches>
                                                                                                                <comments>
                            <comment id="4633506" author="xgen-internal-githook" created="Wed, 22 Jun 2022 19:58:59 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Qingyang Hu&apos;, &apos;email&apos;: &apos;103950869+qingyang-hu@users.noreply.github.com&apos;, &apos;username&apos;: &apos;qingyang-hu&apos;}
&lt;p&gt;Message: Godriver-2259 Reduce memory consumption. (#985)&lt;br/&gt;
Branch: master&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo-go-driver/commit/27a230bae97e894d08015e3b8a548698fbf21dce&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo-go-driver/commit/27a230bae97e894d08015e3b8a548698fbf21dce&lt;/a&gt;&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                                                <inwardlinks description="is related to">
                                                        </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                            <attachment id="351747" name="Screen Shot 2021-12-20 at 11.00.58 AM.png" size="145069" author="thomas.henretty@mongodb.com" created="Mon, 20 Dec 2021 16:01:18 +0000"/>
                            <attachment id="351748" name="profile006.png" size="789993" author="thomas.henretty@mongodb.com" created="Mon, 20 Dec 2021 15:59:13 +0000"/>
                            <attachment id="385614" name="zlib.png" size="152312" author="qingyang.hu@mongodb.com" created="Fri, 17 Jun 2022 20:35:30 +0000"/>
                            <attachment id="385615" name="zstd.png" size="191721" author="qingyang.hu@mongodb.com" created="Fri, 17 Jun 2022 20:35:41 +0000"/>
                            <attachment id="385617" name="zstd_encodeall.png" size="171432" author="qingyang.hu@mongodb.com" created="Fri, 17 Jun 2022 20:35:57 +0000"/>
                            <attachment id="385616" name="zstd_fixed.png" size="197507" author="qingyang.hu@mongodb.com" created="Fri, 17 Jun 2022 20:35:52 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10857" key="com.pyxis.greenhopper.jira:gh-epic-link">
                        <customfieldname>Epic Link</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>GODRIVER-1693</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_21553" key="com.atlassian.jira.plugin.system.customfieldtypes:labels">
                        <customfieldname>Quarter</customfieldname>
                        <customfieldvalues>
                                        <label>FY23Q2</label>
            <label>FY23Q3</label>
    
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hzyfqv:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            </customfields>
    </item>
</channel>
</rss>