<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 05:11:50 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-46562] Shard Crashes with out of memory</title>
                <link>https://jira.mongodb.org/browse/SERVER-46562</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Hi&lt;/p&gt;

&lt;p&gt;We face an issue when we do many map reduce operations on a sharded cluster.&lt;br/&gt;
The used memory increases more and more and when it is on the limit of the host memory, the mongod process crashes with an out of memry exception.&lt;/p&gt;

&lt;p&gt;Environment:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;24 shards, 80 GByte RAM each&lt;/li&gt;
	&lt;li&gt;Default value for&#160;storage.wiredTiger.engineConfig.cacheSizeGB (no value set in the config)&lt;/li&gt;
	&lt;li&gt;Continuous parallel running map reduce operations on different input and output collections (Java applicaton with 10 threads)&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;We believe that the memory can be used by mongo up to the max availabe RAM.&#160;&lt;br/&gt;
But the mongod process should never crash.&lt;/p&gt;

&lt;p&gt;Many thank for a feedback!&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;</description>
                <environment></environment>
        <key id="1215733">SERVER-46562</key>
            <summary>Shard Crashes with out of memory</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="13204">Community Answered</resolution>
                                        <assignee username="dmitry.agranat@mongodb.com">Dmitry Agranat</assignee>
                                    <reporter username="hermann.jaun@comfone.com">Hermann Jaun</reporter>
                        <labels>
                    </labels>
                <created>Tue, 3 Mar 2020 10:10:50 +0000</created>
                <updated>Fri, 27 Oct 2023 15:56:36 +0000</updated>
                            <resolved>Sun, 31 May 2020 11:59:20 +0000</resolved>
                                                                    <component>MapReduce</component>
                                        <votes>1</votes>
                                    <watches>8</watches>
                                                                                                                <comments>
                            <comment id="3060162" author="hermann.jaun@gmail.com" created="Wed, 29 Apr 2020 12:14:20 +0000"  >&lt;p&gt;Hi Dmitry&lt;br/&gt;
No, we have a much more stable situation after the new setting for&#160;&lt;b&gt;storage.wiredTiger.engineConfig.cacheSizeGB&lt;/b&gt;. &lt;br/&gt;
I propose you close te ticket and we will re-open it in case we have again a server crash.&lt;/p&gt;

&lt;p&gt;Thanks!&lt;/p&gt;

&lt;p&gt;Hermann&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;</comment>
                            <comment id="3058122" author="dmitry.agranat" created="Tue, 28 Apr 2020 10:13:22 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=hermann.jaun%40comfone.com&quot; class=&quot;user-hover&quot; rel=&quot;hermann.jaun@comfone.com&quot;&gt;hermann.jaun@comfone.com&lt;/a&gt;, did this issue reoccur again?&lt;/p&gt;</comment>
                            <comment id="3022852" author="dmitry.agranat" created="Thu, 2 Apr 2020 11:51:08 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=rui.ribeiro%40comfone.com&quot; class=&quot;user-hover&quot; rel=&quot;rui.ribeiro@comfone.com&quot;&gt;rui.ribeiro@comfone.com&lt;/a&gt;, I believe my answer is very similar to what was discussed in &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-46562?focusedCommentId=2979062&amp;amp;page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-2979062&quot; class=&quot;external-link&quot; rel=&quot;nofollow&quot;&gt;this comment&lt;/a&gt;. In short, if there is no &quot;pressure&quot; from the cache/memory pov, that index that you&apos;ve mentioned should not be flushed. Of course, the LRU algorithm is not that simple but I just wanted to provide you with a very short and simplistic explanation. For such questions, I encourage you to ask our community by posting on the &lt;a href=&quot;http://community.mongodb.com&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;MongoDB Community Forums&lt;/a&gt; or on &lt;a href=&quot;https://stackoverflow.com/questions/tagged/mongodb&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;Stack Overflow with the &lt;tt&gt;mongodb&lt;/tt&gt; tag&lt;/a&gt;.&lt;/p&gt;</comment>
                            <comment id="3012600" author="rui.ribeiro@comfone.com" created="Mon, 30 Mar 2020 12:45:21 +0000"  >&lt;p&gt;Hi&lt;br/&gt;
&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=dmitry.agranat&quot; class=&quot;user-hover&quot; rel=&quot;dmitry.agranat&quot;&gt;dmitry.agranat&lt;/a&gt;&#160;&lt;br/&gt;
&#160;&lt;br/&gt;
I work with Hermann and it is true that none of the server crashed.&lt;br/&gt;
&#160;&lt;br/&gt;
But the memory used started to increase (indexes cached) with queries and map reduce. After the memory reached almost the limit, the servers didn&apos;t crashed, but everything (queries, map reduces, etc) was much more slower.&lt;br/&gt;
&#160;&lt;br/&gt;
My question to you is very simple, I understand that MongoDB caches indexes so queries are faster, but if an index is not being used for the last X days, should&#160;MongoDB not release the memory cached for that index? In this case the only way to release that memory, was to restart all the nodes. Do we have a way (configuration) that MongoDB releases memory. Similar like in Java with the&#160;&lt;b&gt;Garbage Collector &lt;img class=&quot;emoticon&quot; src=&quot;https://jira.mongodb.org/images/icons/emoticons/smile.png&quot; height=&quot;16&quot; width=&quot;16&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;.&lt;/b&gt;&lt;br/&gt;
&#160;&lt;br/&gt;
&lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;img src=&quot;https://jira.mongodb.org/secure/attachment/254120/254120_image-2020-03-30-14-40-23-844.png&quot; style=&quot;border: 0px solid black&quot; /&gt;&lt;/span&gt;&lt;br/&gt;
&#160;&lt;br/&gt;
Thank you.&lt;/p&gt;

&lt;p&gt;Cheers&lt;br/&gt;
&#160;&lt;br/&gt;
Rui&lt;/p&gt;</comment>
                            <comment id="3012588" author="hermann.jaun@gmail.com" created="Mon, 30 Mar 2020 12:30:25 +0000"  >&lt;p&gt;Ok,I agree.&lt;br/&gt;
Thanky you!&lt;/p&gt;

&lt;p&gt;Hermann&lt;/p&gt;</comment>
                            <comment id="3012577" author="dmitry.agranat" created="Mon, 30 Mar 2020 12:22:05 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=hermann.jaun%40comfone.com&quot; class=&quot;user-hover&quot; rel=&quot;hermann.jaun@comfone.com&quot;&gt;hermann.jaun@comfone.com&lt;/a&gt;, I suggest we&apos;ll wait for another 2 weeks in this ticket just in case this issue occurs again. If it doesn&apos;t, we&apos;ll close this ticket and will review new data in a new ticket if it reoccurs sometime in the future. Does it make sense?&lt;/p&gt;</comment>
                            <comment id="3012571" author="hermann.jaun@gmail.com" created="Mon, 30 Mar 2020 12:14:44 +0000"  >&lt;p&gt;Hi @Dmitry&lt;/p&gt;

&lt;p&gt;None of the server did crash after setting the&#160;&lt;b&gt;storage.wiredTiger.engineConfig.cacheSizeGB&lt;/b&gt;&#160;to&#160;&lt;b&gt;35 GByte.&lt;/b&gt;&lt;/p&gt;

&lt;p&gt;I don&apos;t know if you want close this ticket and we open a new one as soon as we get the error again?&lt;/p&gt;

&lt;p&gt;Best Regards,&lt;/p&gt;

&lt;p&gt;Hermann&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;</comment>
                            <comment id="3007533" author="dmitry.agranat" created="Sun, 29 Mar 2020 07:25:13 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=hermann.jaun%40comfone.com&quot; class=&quot;user-hover&quot; rel=&quot;hermann.jaun@comfone.com&quot;&gt;hermann.jaun@comfone.com&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Has the issue reoccured again since the last time you&apos;ve initially reported it? If so, were you able to collect the requested information and upload it to the &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-46562?focusedCommentId=2935503&amp;amp;page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-2935503&quot; class=&quot;external-link&quot; rel=&quot;nofollow&quot;&gt;secure portal&lt;/a&gt;?&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Dima&lt;/p&gt;</comment>
                            <comment id="2979062" author="dmitry.agranat" created="Fri, 13 Mar 2020 17:21:28 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=hermann.jaun%40comfone.com&quot; class=&quot;user-hover&quot; rel=&quot;hermann.jaun@comfone.com&quot;&gt;hermann.jaun@comfone.com&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;The SERVER project is for bugs and feature suggestions for the MongoDB server. If you need further assistance with understanding how MongoDB manages memory, I encourage you to ask our community by posting on the &lt;a href=&quot;http://community.mongodb.com&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;MongoDB Community Forums&lt;/a&gt; or on &lt;a href=&quot;https://stackoverflow.com/questions/tagged/mongodb&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;Stack Overflow with the &lt;tt&gt;mongodb&lt;/tt&gt; tag&lt;/a&gt;.&lt;/p&gt;

&lt;p&gt;In short, OS manages allocation and deallocation of process memory and its OS which decides when/if to release memory, for example, when there is a &quot;memory pressure&quot;. I assume this is not the case in your example. As for the MongoDB cache, we keep MongoDB data in the cache because it might be needed again, and it&apos;s most efficient to retrieve it from the cache. Releasing cached data back to the OS defeats the purpose of a cache. Also, please keep in mind that apart from the WT cache (which is 50% of the total RAM by default), there is memory we consume outside the WT cache (connections, in-memory sorts, buffers for intermediate data sets and sorting in aggregate pipelines, memory for de-duplicating results with $in or $or conditions, memory for scoring full text index results, cursors, plan cache...). &lt;/p&gt;

&lt;p&gt;There is no parameter to release MongoDB memory on a running process.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Dima&lt;/p&gt;</comment>
                            <comment id="2962599" author="rui.ribeiro@comfone.com" created="Wed, 11 Mar 2020 00:16:13 +0000"  >&lt;p&gt;Hi @Dmitry Agranat&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;I would like also to understand how MongoDB manage the memory. Even if I am not running any operation the memory is never full released. As you can see in the graphic below from one of my shards. As you can see the memory is never full released to the initial value. Which parameters we can set, to force MongoDB to release all the memory when nothing is running?&lt;/p&gt;

&lt;p&gt;Thank you.&lt;/p&gt;

&lt;p&gt;&lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;img src=&quot;https://jira.mongodb.org/secure/attachment/251863/251863_image-2020-03-11-01-14-31-322.png&quot; style=&quot;border: 0px solid black&quot; /&gt;&lt;/span&gt;&lt;/p&gt;</comment>
                            <comment id="2945184" author="dmitry.agranat" created="Thu, 5 Mar 2020 16:05:44 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=hermann.jaun%40comfone.com&quot; class=&quot;user-hover&quot; rel=&quot;hermann.jaun@comfone.com&quot;&gt;hermann.jaun@comfone.com&lt;/a&gt;, looking at the mongod logs together with &lt;tt&gt;diagnostic.data&lt;/tt&gt; is the key here to identify the root cause. If the issue happens again, please grab both and upload to the secure portal.&lt;/p&gt;</comment>
                            <comment id="2939652" author="hermann.jaun@comfone.com" created="Thu, 5 Mar 2020 10:07:12 +0000"  >&lt;p&gt;Hi Dmitry&lt;/p&gt;

&lt;p&gt;I have uploaded the requested diagnostic date. In addition a screenshot showing the memory usage, when the crash happened on 1.3.2020 17:30 CET (UTC + 1).&lt;br/&gt;
The server runs in UTC timezone.&lt;/p&gt;

&lt;p&gt;The Logs are unfortunately already deleted, we have too much transactions to keep them so long. But we will save the next time the respective log file.&lt;/p&gt;

&lt;p&gt;I would like to mention, that we meanwhile set on in the meantime on 3.3.2020 the parameter&#160;&#160;&lt;b&gt;storage.wiredTiger.engineConfig.cacheSizeGB&lt;/b&gt; to &lt;b&gt;35 GByte.&lt;/b&gt;&lt;br/&gt;
 It looks like&#160;**&#160;since then the memory consumption stays much lower than before (same load). It is since 2 days quite stable at around 58 GByte.&lt;br/&gt;
 But we have to observe the behaviour for a longer period.&lt;br/&gt;
 Can this be the solution?&lt;br/&gt;
 For what is Mongo server using the RAM above the cache size?&lt;/p&gt;

&lt;p&gt;Best Rgards,&lt;br/&gt;
 Hermann&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;</comment>
                            <comment id="2935503" author="dmitry.agranat" created="Wed, 4 Mar 2020 23:14:41 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=hermann.jaun%40comfone.com&quot; class=&quot;user-hover&quot; rel=&quot;hermann.jaun@comfone.com&quot;&gt;hermann.jaun@comfone.com&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Would you please archive (tar or zip) the mongod.log files and the &lt;tt&gt;$dbpath/diagnostic.data&lt;/tt&gt; directory (the contents are described &lt;a href=&quot;https://docs.mongodb.com/manual/administration/analyzing-mongodb-performance/#full-time-diagnostic-data-capture&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;here&lt;/a&gt;) from the server in question and upload them to this &lt;a href=&quot;https://10gen-httpsupload.s3.amazonaws.com/upload_forms/8aeeb23f-11e8-4018-9233-45edc983a20b.html&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;support uploader&lt;/a&gt; location?&lt;/p&gt;

&lt;p&gt;Please also clarify the exact time and the time zone of the reported issue.&lt;/p&gt;

&lt;p&gt;Files uploaded to this portal are visible only to MongoDB employees and are routinely deleted after some time.&lt;/p&gt;

&lt;p&gt;Thank you&lt;br/&gt;
Dima&lt;/p&gt;</comment>
                            <comment id="2933083" author="hermann.jaun@comfone.com" created="Tue, 3 Mar 2020 20:15:46 +0000"  >&lt;p&gt;Hi Dmitry&lt;/p&gt;

&lt;p&gt;Hereafter the additional info:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;MongoDB server version 4.0.16&lt;/li&gt;
	&lt;li&gt;We use 1 mongod process only on each server&lt;/li&gt;
	&lt;li&gt;No other applications on the server (standard Linux installation)&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;&#160;&lt;/p&gt;</comment>
                            <comment id="2932623" author="dmitry.agranat" created="Tue, 3 Mar 2020 17:33:53 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=hermann.jaun%40comfone.com&quot; class=&quot;user-hover&quot; rel=&quot;hermann.jaun@comfone.com&quot;&gt;hermann.jaun@comfone.com&lt;/a&gt;, what MongoDB version do you use and how many mongod processes each server runs?&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                            <attachment id="251863" name="image-2020-03-11-01-14-31-322.png" size="105706" author="rui.ribeiro@comfone.com" created="Wed, 11 Mar 2020 00:14:32 +0000"/>
                            <attachment id="254120" name="image-2020-03-30-14-40-23-844.png" size="103627" author="rui.ribeiro@comfone.com" created="Mon, 30 Mar 2020 12:40:25 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>15.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10011" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Backwards Compatibility</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10038"><![CDATA[Fully Compatible]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Tue, 3 Mar 2020 17:33:53 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        3 years, 41 weeks ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_17050" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Downstream Team Attention</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="16941"><![CDATA[Not Needed]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>luke.bonanomi@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            3 years, 41 weeks ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>dmitry.agranat@mongodb.com</customfieldvalue>
            <customfieldvalue>hermann.jaun@comfone.com</customfieldvalue>
            <customfieldvalue>hermann.jaun@gmail.com</customfieldvalue>
            <customfieldvalue>rui.ribeiro@comfone.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hwyyb3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hwmunj:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                    <customfieldvalue><![CDATA[dmitry.agranat@mongodb.com]]></customfieldvalue>
    

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hwykkf:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>