<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 02:54:56 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-712] Slave locks up</title>
                <link>https://jira.mongodb.org/browse/SERVER-712</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Slave database locks up. Pasting email thread so far.&lt;/p&gt;

&lt;p&gt;On Sun, Mar 7, 2010 at 8:45 PM, Ianiv Schweber &amp;lt;ischweber@nowpublic.com&amp;gt; wrote:&lt;br/&gt;
iostat shows nothing much is happening, mostly 0s all the time.&lt;/p&gt;

&lt;p&gt;top now shows&lt;br/&gt;
13084 mongodb   18   0 8656m 7.1g 6.8g T  0.0 11.3 460:31.78 mongod&lt;/p&gt;

&lt;p&gt;I&apos;m pretty sure status was S before running gdb. That scrolled out of screen&apos;s buffer so I can&apos;t double check anymore.&lt;/p&gt;

&lt;p&gt;Would you like me to open a new ticket and paste the conversation so far?&lt;/p&gt;




&lt;p&gt;Ianiv Schweber&lt;br/&gt;
Software Developer&lt;br/&gt;
NowPublic.com&lt;/p&gt;


&lt;p&gt;Public Key: &lt;a href=&quot;http://www.blogaholics.ca/ianivpubkey.asc&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://www.blogaholics.ca/ianivpubkey.asc&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;On 2010-03-07, at 5:26 PM, Eliot Horowitz wrote:&lt;/p&gt;

&lt;p&gt;Just added you to commercial support on jira.&lt;br/&gt;
is anything happening in top?  what about &quot;iostat -x 2&quot;&lt;/p&gt;


&lt;p&gt;On Sun, Mar 7, 2010 at 8:16 PM, Ianiv Schweber &amp;lt;ischweber@nowpublic.com&amp;gt; wrote:&lt;br/&gt;
I don&apos;t have access to the commercial support section yet. I do have an account at jira.mongodb.org with username ianiv.&lt;/p&gt;

&lt;p&gt;I can&apos;t even start the JS console. It prints this and then just sits there.&lt;/p&gt;

&lt;p&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;root@mongo2 ~&amp;#93;&lt;/span&gt;# mongo scan_stats&lt;br/&gt;
MongoDB shell version: 1.3.3&lt;br/&gt;
url: scan_stats&lt;br/&gt;
connecting to: scan_stats&lt;/p&gt;

&lt;p&gt;Likewise, the web console doesn&apos;t repsond.&lt;/p&gt;

&lt;p&gt;ctrl-c on gdb does nothing. The output of the gdb session is&lt;/p&gt;

&lt;p&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;root@mongo2 mongodb&amp;#93;&lt;/span&gt;# gdb bin/mongod --pid 13084&lt;br/&gt;
&amp;lt;snip gdb version info&amp;gt;&lt;br/&gt;
(no debugging symbols found)&lt;br/&gt;
Attaching to program: /usr/local/mongodb/bin/mongod, process 13084&lt;br/&gt;
Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done.&lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;Thread debugging using libthread_db enabled&amp;#93;&lt;/span&gt;&lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;New Thread 0x2b3bb0eddc40 (LWP 13084)&amp;#93;&lt;/span&gt;&lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;New Thread 0x4425b940 (LWP 13091)&amp;#93;&lt;/span&gt;&lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;New Thread 0x4385a940 (LWP 13090)&amp;#93;&lt;/span&gt;&lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;New Thread 0x42e59940 (LWP 13089)&amp;#93;&lt;/span&gt;&lt;/p&gt;




&lt;p&gt;Ianiv Schweber&lt;br/&gt;
Software Developer&lt;br/&gt;
NowPublic.com&lt;/p&gt;


&lt;p&gt;Public Key: &lt;a href=&quot;http://www.blogaholics.ca/ianivpubkey.asc&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://www.blogaholics.ca/ianivpubkey.asc&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;On 2010-03-07, at 4:49 PM, Eliot Horowitz wrote:&lt;/p&gt;

&lt;p&gt;Can you connect with a shell and do db.currentOp()&lt;/p&gt;

&lt;p&gt;Can you view the web console?&lt;/p&gt;

&lt;p&gt;in gdb, what happens if you hit ctrl-c?&lt;/p&gt;

&lt;p&gt;do you have access to the commercial support section of jira yet?&lt;br/&gt;
would be great if we could move discussion there so its easier to track.&lt;/p&gt;

&lt;p&gt;On Sun, Mar 7, 2010 at 7:26 PM, Ianiv Schweber &amp;lt;ischweber@nowpublic.com&amp;gt; wrote:&lt;br/&gt;
I attached gdb to the running mongod but I cannot interrupt it to run the&lt;br/&gt;
commands.&lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;root@mongo2 ~&amp;#93;&lt;/span&gt;# mount&lt;br/&gt;
/dev/sda5 on / type ext3 (rw,noatime)&lt;br/&gt;
proc on /proc type proc (rw)&lt;br/&gt;
sysfs on /sys type sysfs (rw)&lt;br/&gt;
devpts on /dev/pts type devpts (rw,gid=5,mode=620)&lt;br/&gt;
/dev/sda3 on /tmp type ext3 (rw)&lt;br/&gt;
/dev/sda1 on /boot type ext3 (rw)&lt;br/&gt;
tmpfs on /dev/shm type tmpfs (rw)&lt;br/&gt;
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)&lt;br/&gt;
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)&lt;br/&gt;
nfsd on /proc/fs/nfsd type nfsd (rw)&lt;br/&gt;
&lt;span class=&quot;error&quot;&gt;&amp;#91;root@mongo2 ~&amp;#93;&lt;/span&gt;# df -h&lt;br/&gt;
Filesystem            Size  Used Avail Use% Mounted on&lt;br/&gt;
/dev/sda5             807G  406G  359G  54% /&lt;br/&gt;
/dev/sda3             2.0G   36M  1.9G   2% /tmp&lt;br/&gt;
/dev/sda1             251M   22M  216M  10% /boot&lt;br/&gt;
tmpfs                  32G     0   32G   0% /dev/shm&lt;br/&gt;
Ianiv Schweber&lt;br/&gt;
Software Developer&lt;br/&gt;
NowPublic.com&lt;/p&gt;

&lt;p&gt;Public Key: &lt;a href=&quot;http://www.blogaholics.ca/ianivpubkey.asc&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://www.blogaholics.ca/ianivpubkey.asc&lt;/a&gt;&lt;br/&gt;
On 2010-03-07, at 11:16 AM, Dwight Merriman wrote:&lt;/p&gt;

&lt;p&gt;hi,&lt;/p&gt;

&lt;p&gt;can you do the following with gdb:&lt;/p&gt;

&lt;p&gt;$ gdb mongod --pid=&amp;lt;slave process mongod pid&amp;gt;&lt;br/&gt;
(gdb) bt&lt;br/&gt;
(gdb) info threads&lt;/p&gt;

&lt;p&gt;then also can you run&lt;/p&gt;

&lt;p&gt;mount&lt;br/&gt;
df -h&lt;/p&gt;

&lt;p&gt;and email the above?&lt;/p&gt;

&lt;p&gt;thanks&lt;/p&gt;


&lt;p&gt;On Sun, Mar 7, 2010 at 1:28 PM, Ianiv Schweber &amp;lt;ischweber@nowpublic.com&amp;gt;&lt;br/&gt;
wrote:&lt;/p&gt;

&lt;p&gt;Hi Dwight,&lt;/p&gt;

&lt;p&gt;It looks like the slave locked up again, 1 hour 35 minutes ago. Last lines&lt;br/&gt;
in log:&lt;/p&gt;

&lt;p&gt;Sun Mar  7 17:05:36 repl:   applied 269 operations&lt;br/&gt;
Sun Mar  7 17:05:36 repl: end sync_pullOpLog syncedTo: Sun Mar  7 16:52:18&lt;br/&gt;
2010 4b93d9c2:26&lt;br/&gt;
Sun Mar  7 17:05:38 allocating new datafile&lt;br/&gt;
/usr/local/mongodb/data/scan_stats.8, filling with zeroes...&lt;/p&gt;

&lt;p&gt;Just like before.&lt;/p&gt;

&lt;p&gt;I&apos;ll keep it in this state for now in case it helps you figure out what is&lt;br/&gt;
going on. If not, let me know and I&apos;ll restart it.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;/p&gt;

&lt;p&gt;Ianiv Schweber&lt;br/&gt;
Software Developer&lt;br/&gt;
NowPublic.com&lt;/p&gt;


&lt;p&gt;Public Key: &lt;a href=&quot;http://www.blogaholics.ca/ianivpubkey.asc&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://www.blogaholics.ca/ianivpubkey.asc&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;On 2010-03-04, at 1:26 PM, Narayan Newton wrote:&lt;/p&gt;

&lt;p&gt;Ianiv will chime in here soon, but:&lt;/p&gt;

&lt;p&gt;AMD 2352&lt;br/&gt;
62G RAM&lt;br/&gt;
CentOS 5.4&lt;br/&gt;
Mongo 1.3.3-64bit builds from mongodb.org&lt;/p&gt;

&lt;p&gt;On Thu, Mar 4, 2010 at 1:18 PM, Dwight Merriman &amp;lt;dwight@10gen.com&amp;gt;&lt;br/&gt;
wrote:&lt;br/&gt;
ok.&lt;br/&gt;
what is your OS platform and rough versions of mongo?&lt;/p&gt;


&lt;p&gt;On Thu, Mar 4, 2010 at 4:16 PM, Narayan Newton&lt;br/&gt;
&amp;lt;nnewton@tag1consulting.com&amp;gt;&lt;br/&gt;
wrote:&lt;/p&gt;

&lt;p&gt;Nice to meet you Dwight,&lt;/p&gt;

&lt;p&gt;We have had two issues recently, I&apos;m currently investigating one (a&lt;br/&gt;
slave hung on filling a data file with 0s and appeared to deadlock)&lt;br/&gt;
and Ianiv has been working on the other, a corruption issue we have&lt;br/&gt;
had on multiple versions causing exceptions in the log.&lt;/p&gt;

&lt;p&gt;We have &quot;started over&quot; with a new DB and the exceptions have not&lt;br/&gt;
recurred so far, however, we have kept the old data files around to&lt;br/&gt;
figure out what went wrong there. I&apos;ve added Ianiv to the thread and&lt;br/&gt;
he can explain this issue in more detail.&lt;/p&gt;

&lt;p&gt;Thanks!&lt;/p&gt;

&lt;p&gt;-N&lt;/p&gt;</description>
                <environment>AMD 2352&lt;br/&gt;
62G RAM&lt;br/&gt;
CentOS 5.4</environment>
        <key id="11439">SERVER-712</key>
            <summary>Slave locks up</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="5">Cannot Reproduce</resolution>
                                        <assignee username="eliot">Eliot Horowitz</assignee>
                                    <reporter username="ianiv">Ianiv Schweber</reporter>
                        <labels>
                    </labels>
                <created>Sun, 7 Mar 2010 21:23:21 +0000</created>
                <updated>Thu, 17 Mar 2011 19:13:07 +0000</updated>
                            <resolved>Sun, 16 Jan 2011 04:58:16 +0000</resolved>
                                    <version>1.3.3</version>
                                                                        <votes>0</votes>
                                    <watches>2</watches>
                                                                                                                <comments>
                            <comment id="13027" author="ianiv" created="Tue, 16 Mar 2010 00:15:14 +0000"  >&lt;p&gt;I&apos;m watching the issue but for some reason I didn&apos;t get an email (and not in spam folder) so I just saw this.&lt;/p&gt;

&lt;p&gt;Tomorrow I&apos;ll recompile as you suggest. I&apos;ll see about getting you access to the server once it locks up again.&lt;/p&gt;</comment>
                            <comment id="12958" author="eliot" created="Fri, 12 Mar 2010 22:37:42 +0000"  >&lt;p&gt;is there anyway we can get access to the server when this is happening?&lt;/p&gt;</comment>
                            <comment id="12941" author="eliot" created="Fri, 12 Mar 2010 12:05:51 +0000"  >&lt;p&gt;This is very weird...&lt;/p&gt;

&lt;p&gt;Could you try building from source with --d (will get us debugging symbols when attach with gdb)&lt;/p&gt;</comment>
                            <comment id="12927" author="ianiv" created="Thu, 11 Mar 2010 18:43:37 +0000"  >&lt;p&gt;&amp;gt; db.currentOp()&lt;/p&gt;
{ &quot;inprog&quot; : [ ] }

&lt;p&gt;Then I tried &lt;br/&gt;
&amp;gt; show dbs;&lt;br/&gt;
which hung. now:&lt;/p&gt;

&lt;p&gt;&amp;gt; db.currentOp()&lt;br/&gt;
{&lt;br/&gt;
        &quot;inprog&quot; : [&lt;br/&gt;
                {&lt;br/&gt;
                        &quot;opid&quot; : 332129,&lt;br/&gt;
                        &quot;active&quot; : false,&lt;br/&gt;
                        &quot;lockType&quot; : &quot;write&quot;,&lt;br/&gt;
                        &quot;waitingForLock&quot; : true,&lt;br/&gt;
                        &quot;op&quot; : &quot;query&quot;,&lt;br/&gt;
                        &quot;ns&quot; : &quot;?&quot;,&lt;br/&gt;
                        &quot;query&quot; : &lt;/p&gt;
{
                                &quot;listDatabases&quot; : 1
                        }
&lt;p&gt;,&lt;br/&gt;
                        &quot;client&quot; : &quot;127.0.0.1:30723&quot;,&lt;br/&gt;
                        &quot;desc&quot; : &quot;conn&quot;&lt;br/&gt;
                }&lt;br/&gt;
        ]&lt;br/&gt;
}&lt;/p&gt;

&lt;p&gt;output from mongostat:&lt;/p&gt;

&lt;p&gt;insert/s query/s update/s delete/s getmore/s command/s mapped  vsize    res % locked % idx miss &lt;br/&gt;
       0       0        0        0         0         2  36959  35362  15839        0          0&lt;br/&gt;
same line keeps repeating&lt;/p&gt;</comment>
                            <comment id="12926" author="ianiv" created="Thu, 11 Mar 2010 18:39:01 +0000"  >&lt;p&gt;output of slave&apos;s web console&lt;/p&gt;</comment>
                            <comment id="12919" author="eliot" created="Thu, 11 Mar 2010 14:42:57 +0000"  >&lt;p&gt;Can you connect with the shell and db.currentOp()&lt;br/&gt;
Or try the web console?&lt;br/&gt;
Also - can you try hitting it with mongostat (the one included in the distro)&lt;/p&gt;</comment>
                            <comment id="12918" author="ianiv" created="Thu, 11 Mar 2010 14:39:51 +0000"  >&lt;p&gt;Slave has locked up again. The last few log entries are:&lt;/p&gt;

&lt;p&gt;Thu Mar 11 17:20:24 repl:   applied 376 operations&lt;br/&gt;
Thu Mar 11 17:20:24 repl: end sync_pullOpLog syncedTo: Thu Mar 11 17:07:01 2010 4b992335:42&lt;br/&gt;
Thu Mar 11 17:20:24 repl: sync_pullOpLog local.oplog.$main syncedTo:Thu Mar 11 17:07:01 2010 4b992335:42&lt;br/&gt;
Thu Mar 11 17:20:24 repl: tailing=true&lt;br/&gt;
Thu Mar 11 17:20:24 repl: first op time received: 4b992335:43&lt;br/&gt;
Thu Mar 11 17:20:24 updated _lastSavedLocalTs to: 0:0&lt;br/&gt;
Thu Mar 11 17:20:24 Saving repl source: &lt;/p&gt;
{ host: &quot;192.168.1.130&quot;, source: &quot;main&quot;, syncedTo: Timestamp 1268327221000|67, localLogTs: 
Timestamp 0|0 }
&lt;p&gt;Thu Mar 11 17:20:24 repl:   applied 1 operations&lt;br/&gt;
Thu Mar 11 17:20:24 repl: end sync_pullOpLog syncedTo: Thu Mar 11 17:07:01 2010 4b992335:43&lt;br/&gt;
Thu Mar 11 17:20:25 repl: sync_pullOpLog local.oplog.$main syncedTo:Thu Mar 11 17:07:01 2010 4b992335:43&lt;br/&gt;
Thu Mar 11 17:20:25 repl: tailing=true&lt;br/&gt;
Thu Mar 11 17:20:25 repl: first op time received: 4b992335:44&lt;br/&gt;
Thu Mar 11 17:20:26 btree _insert: reusing unused key&lt;br/&gt;
Thu Mar 11 17:20:26 btree _insert: reusing unused key&lt;br/&gt;
Thu Mar 11 17:20:26 allocating new extent for scan_stats.url padding:1.7 lenWHdr: 334&lt;br/&gt;
Thu Mar 11 17:20:26 allocating new datafile /usr/local/mongodb/data/scan_stats.21, filling with zeroes...&lt;br/&gt;
Thu Mar 11 17:20:39 flushing mmmap&lt;br/&gt;
Thu Mar 11 17:21:39 flushing mmmap&lt;br/&gt;
Thu Mar 11 17:22:39 flushing mmmap&lt;br/&gt;
Thu Mar 11 17:23:39 flushing mmmap&lt;br/&gt;
Thu Mar 11 17:24:39 flushing mmmap&lt;br/&gt;
Thu Mar 11 17:25:39 flushing mmmap&lt;br/&gt;
Thu Mar 11 17:26:39 flushing mmmap&lt;/p&gt;

&lt;p&gt;And the last entry repeats every minute. I&apos;ll keep it running so we can attempt to debug it again.&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                            <attachment id="10172" name="webconsole.html" size="1615" author="ianiv" created="Thu, 11 Mar 2010 18:39:01 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>7.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Thu, 11 Mar 2010 14:42:57 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        13 years, 49 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ian@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            13 years, 49 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10000" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Old_Backport</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10000"><![CDATA[No]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                            <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>eliot</customfieldvalue>
            <customfieldvalue>ianiv</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrpr0n:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hrint3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>22509</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|ht0gz3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>