<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:19:12 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-9048] Out of memory leads to crash and node corruption.</title>
                <link>https://jira.mongodb.org/browse/SERVER-9048</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;I am pretty sure this is a memory problem.  We have a 4GB+4GBswap system and we will try resolving by increasing to 8GB+8GBswap.&lt;/p&gt;

&lt;p&gt;This has happened to us a couple times and results in needing to rebuild the node.  Both times, it wiped out 2 of 3 nodes in the cluster.  This leads to the remaining server downgrading itself from primary to secondary.  I am worried about what would happen if this happened on all 3 nodes at the same time.&lt;/p&gt;

&lt;p&gt;Is there any way to make Mongo more resilient about these problems and fail more gracefully.&lt;/p&gt;

&lt;p&gt;This is what we get in the mongo.log file:&lt;br/&gt;
Thu Mar 21 15:14:01 &lt;span class=&quot;error&quot;&gt;&amp;#91;journal&amp;#93;&lt;/span&gt;   warning assertion failure a &amp;lt;= 256*1024*1024 src/mongo/util/alignedbuilder.cpp 90&lt;br/&gt;
0xade6e1 0x802c5a 0x77dc73 0x753da5 0x7540b4 0xa09950 0xa0a779 0xa0ae24 0x7c3659 0x7f38ad18a8ca 0x7f38ac53db6d &lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xade6e1&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo9wassertedEPKcS1_j+0x11a) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x802c5a&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo14AlignedBuilder14growReallocateEj+0x63) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x77dc73&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod() &lt;span class=&quot;error&quot;&gt;&amp;#91;0x753da5&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo3dur13PREPLOGBUFFERERNS0_11JSectHeaderERNS_14AlignedBuilderE+0x214) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7540b4&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo3dur27groupCommitWithLimitedLocksEv+0xa0) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa09950&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod() &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa0a779&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo3dur9durThreadEv+0x364) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa0ae24&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod() &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7c3659&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libpthread.so.0(+0x68ca) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7f38ad18a8ca&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(clone+0x6d) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7f38ac53db6d&amp;#93;&lt;/span&gt;&lt;br/&gt;
Thu Mar 21 15:14:02 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn94583&amp;#93;&lt;/span&gt; end connection 10.1.7.11:50309 (7 connections now open)&lt;br/&gt;
Thu Mar 21 15:14:02 &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; connection accepted from 10.1.7.11:50314 #94585 (8 connections now open)&lt;br/&gt;
Thu Mar 21 15:14:10 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn94584&amp;#93;&lt;/span&gt; end connection 10.1.7.13:43214 (7 connections now open)&lt;br/&gt;
Thu Mar 21 15:14:10 &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; connection accepted from 10.1.7.13:43216 #94586 (8 connections now open)&lt;br/&gt;
Thu Mar 21 15:14:12 &lt;span class=&quot;error&quot;&gt;&amp;#91;journal&amp;#93;&lt;/span&gt;   warning assertion failure a &amp;lt;= 256*1024*1024 src/mongo/util/alignedbuilder.cpp 90&lt;br/&gt;
0xade6e1 0x802c5a 0x77dc73 0x753da5 0x7540b4 0xa09950 0xa0a779 0xa0ae24 0x7c3659 0x7f38ad18a8ca 0x7f38ac53db6d &lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xade6e1&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo9wassertedEPKcS1_j+0x11a) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x802c5a&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo14AlignedBuilder14growReallocateEj+0x63) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x77dc73&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod() &lt;span class=&quot;error&quot;&gt;&amp;#91;0x753da5&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo3dur13PREPLOGBUFFERERNS0_11JSectHeaderERNS_14AlignedBuilderE+0x214) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7540b4&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo3dur27groupCommitWithLimitedLocksEv+0xa0) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa09950&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod() &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa0a779&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo3dur9durThreadEv+0x364) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa0ae24&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod() &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7c3659&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libpthread.so.0(+0x68ca) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7f38ad18a8ca&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(clone+0x6d) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7f38ac53db6d&amp;#93;&lt;/span&gt;&lt;br/&gt;
Thu Mar 21 15:14:12 &lt;span class=&quot;error&quot;&gt;&amp;#91;journal&amp;#93;&lt;/span&gt;   Assertion failure a &amp;lt;= 512*1024*1024 src/mongo/util/alignedbuilder.cpp 91&lt;br/&gt;
0xade6e1 0x803dfd 0x77dc8d 0x753da5 0x7540b4 0xa09950 0xa0a779 0xa0ae24 0x7c3659 0x7f38ad18a8ca 0x7f38ac53db6d &lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xade6e1&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo12verifyFailedEPKcS1_j+0xfd) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x803dfd&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo14AlignedBuilder14growReallocateEj+0x7d) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x77dc8d&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod() &lt;span class=&quot;error&quot;&gt;&amp;#91;0x753da5&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo3dur13PREPLOGBUFFERERNS0_11JSectHeaderERNS_14AlignedBuilderE+0x214) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7540b4&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo3dur27groupCommitWithLimitedLocksEv+0xa0) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa09950&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod() &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa0a779&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo3dur9durThreadEv+0x364) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa0ae24&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod() &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7c3659&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libpthread.so.0(+0x68ca) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7f38ad18a8ca&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(clone+0x6d) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7f38ac53db6d&amp;#93;&lt;/span&gt;&lt;br/&gt;
Thu Mar 21 15:14:13 &lt;span class=&quot;error&quot;&gt;&amp;#91;journal&amp;#93;&lt;/span&gt; dbexception in groupCommitLL causing immediate shutdown: 0 assertion src/mongo/util/alignedbuilder.cpp:91&lt;br/&gt;
Thu Mar 21 15:14:13 dur1&lt;br/&gt;
Thu Mar 21 15:14:13 Got signal: 6 (Aborted).&lt;/p&gt;

&lt;p&gt;Thu Mar 21 15:14:14 Backtrace:&lt;br/&gt;
0xade6e1 0x5582d9 0x7f38ac4a0230 0x7f38ac4a01b5 0x7f38ac4a2fc0 0xb503f7 0xa09e1f 0xa0a779 0xa0ae24 0x7c3659 0x7f38ad18a8ca 0x7f38ac53db6d &lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xade6e1&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x5582d9&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(+0x32230) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7f38ac4a0230&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(gsignal+0x35) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7f38ac4a01b5&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(abort+0x180) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7f38ac4a2fc0&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo10mongoAbortEPKc+0x47) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xb503f7&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo3dur27groupCommitWithLimitedLocksEv+0x56f) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa09e1f&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod() &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa0a779&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod(_ZN5mongo3dur9durThreadEv+0x364) &lt;span class=&quot;error&quot;&gt;&amp;#91;0xa0ae24&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /usr/bin/mongod() &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7c3659&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libpthread.so.0(+0x68ca) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7f38ad18a8ca&amp;#93;&lt;/span&gt;&lt;br/&gt;
 /lib/libc.so.6(clone+0x6d) &lt;span class=&quot;error&quot;&gt;&amp;#91;0x7f38ac53db6d&amp;#93;&lt;/span&gt;&lt;/p&gt;</description>
                <environment>&lt;a href=&apos;mailto:root@x-test2&apos;&gt;root@x-test2&lt;/a&gt;:/opt/y-cn# uname -a&lt;br/&gt;
Linux x-test2.tsl.local 2.6.32-5-amd64 #1 SMP Mon Oct 3 03:59:20 UTC 2011 x86_64 GNU/Linux&lt;br/&gt;
&lt;a href=&apos;mailto:root@x-test2&apos;&gt;root@x-test2&lt;/a&gt;:/opt/y-cn# ulimit -a&lt;br/&gt;
core file size          (blocks, -c) 0&lt;br/&gt;
data seg size           (kbytes, -d) unlimited&lt;br/&gt;
scheduling priority             (-e) 0&lt;br/&gt;
file size               (blocks, -f) unlimited&lt;br/&gt;
pending signals                 (-i) 16382&lt;br/&gt;
max locked memory       (kbytes, -l) 64&lt;br/&gt;
max memory size         (kbytes, -m) unlimited&lt;br/&gt;
open files                      (-n) 1024&lt;br/&gt;
pipe size            (512 bytes, -p) 8&lt;br/&gt;
POSIX message queues     (bytes, -q) 819200&lt;br/&gt;
real-time priority              (-r) 0&lt;br/&gt;
stack size              (kbytes, -s) 8192&lt;br/&gt;
cpu time               (seconds, -t) unlimited&lt;br/&gt;
max user processes              (-u) unlimited&lt;br/&gt;
virtual memory          (kbytes, -v) unlimited&lt;br/&gt;
file locks                      (-x) unlimited&lt;br/&gt;
</environment>
        <key id="69215">SERVER-9048</key>
            <summary>Out of memory leads to crash and node corruption.</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="3">Duplicate</resolution>
                                        <assignee username="-1">Unassigned</assignee>
                                    <reporter username="leif">Leif Mortenson</reporter>
                        <labels>
                    </labels>
                <created>Thu, 21 Mar 2013 07:21:09 +0000</created>
                <updated>Wed, 10 Dec 2014 23:06:52 +0000</updated>
                            <resolved>Thu, 21 Mar 2013 14:38:37 +0000</resolved>
                                    <version>2.2.0</version>
                                                                        <votes>0</votes>
                                    <watches>4</watches>
                                                                                                                <comments>
                            <comment id="295381" author="leif" created="Thu, 21 Mar 2013 23:14:11 +0000"  >&lt;p&gt;Andy,&lt;br/&gt;
Thank you for the quick response.  We upgraded to 2.4.0 last night and are currently rebuilding the failed nodes.  It seems to be going smoothly so far.&lt;br/&gt;
Cheers&lt;/p&gt;</comment>
                            <comment id="294902" author="schwerin" created="Thu, 21 Mar 2013 14:38:00 +0000"  >&lt;p&gt;This appears to be a duplicate of &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-6816&quot; title=&quot;Improve journal data handling after multithreaded batch writing&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-6816&quot;&gt;&lt;del&gt;SERVER-6816&lt;/del&gt;&lt;/a&gt;, which an upgrade to a newer 2.2 release would fix.  &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-6816&quot; title=&quot;Improve journal data handling after multithreaded batch writing&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-6816&quot;&gt;&lt;del&gt;SERVER-6816&lt;/del&gt;&lt;/a&gt; only manifests on nodes acting as secondaries, which sounds consistent with your experience.&lt;/p&gt;</comment>
                            <comment id="294819" author="scotthernandez" created="Thu, 21 Mar 2013 12:39:52 +0000"  >&lt;p&gt;There are many fixes in the 2.2 stable release between 2.2.0 and 2.2.3 (and soon 2.2.4) which might be helpful. Please upgrade to 2.2.3 at the very least. &lt;/p&gt;

&lt;p&gt;Are these nodes monitored with MMS? If so, can you please post the link to them?&lt;/p&gt;

&lt;p&gt;Why do you need to rebuild the nodes and how are you doing this? With journaling on all that you need to do is to restart the servers and they should immediately catch up and recovery as an active member in the replica set.&lt;/p&gt;

&lt;p&gt;Please include the full logs from one of these failures from well before the error and after the node has been restarted.&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10010">
                    <name>Duplicate</name>
                                            <outwardlinks description="duplicates">
                                        <issuelink>
            <issuekey id="47789">SERVER-6816</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>3.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Thu, 21 Mar 2013 12:39:52 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        10 years, 47 weeks, 6 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            10 years, 47 weeks, 6 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10000" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Old_Backport</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10000"><![CDATA[No]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10020"><![CDATA[Linux]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>schwerin@mongodb.com</customfieldvalue>
            <customfieldvalue>leif</customfieldvalue>
            <customfieldvalue>scotthernandez</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrn0pz:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hrmubj:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>47000</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|ht03sv:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>