<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 04:28:19 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-31832] Getting error while taking backup or selecting a record in a collection</title>
                <link>https://jira.mongodb.org/browse/SERVER-31832</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description></description>
                <environment></environment>
        <key id="454765">SERVER-31832</key>
            <summary>Getting error while taking backup or selecting a record in a collection</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="mark.agarunov">Mark Agarunov</assignee>
                                    <reporter username="sumit.jain@iongroup.com">Sumit</reporter>
                        <labels>
                            <label>envh</label>
                            <label>rns</label>
                            <label>rpu</label>
                            <label>trcf</label>
                            <label>wtc</label>
                    </labels>
                <created>Sat, 4 Nov 2017 15:12:36 +0000</created>
                <updated>Tue, 14 Aug 2018 18:37:25 +0000</updated>
                            <resolved>Tue, 14 Nov 2017 16:41:15 +0000</resolved>
                                    <version>3.4.0</version>
                                                                        <votes>0</votes>
                                    <watches>5</watches>
                                                                                                                <comments>
                            <comment id="1725319" author="mark.agarunov" created="Tue, 14 Nov 2017 16:41:02 +0000"  >&lt;p&gt;Hello &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=sumit.jain%40iongroup.com&quot; class=&quot;user-hover&quot; rel=&quot;sumit.jain@iongroup.com&quot;&gt;sumit.jain@iongroup.com&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;I&apos;m sorry to hear that the repair didn&apos;t fix the issue. Unfortunately this indicates that there is irreparable corruption on the disk, so the only course of action would be to &lt;a href=&quot;https://docs.mongodb.com/manual/tutorial/resync-replica-set-member/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;resync the affected node&lt;/a&gt; or &lt;a href=&quot;https://docs.mongodb.com/manual/core/backups/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;restore from a backup&lt;/a&gt; if possible.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Mark&lt;/p&gt;</comment>
                            <comment id="1722694" author="sumit.jain@iongroup.com" created="Fri, 10 Nov 2017 16:38:06 +0000"  >&lt;p&gt;Hi Mark,&lt;/p&gt;

&lt;p&gt;The repair files didn&apos;t resolve the issue. Not sure if there any any other options that we can try.&lt;/p&gt;

&lt;p&gt;Thanks&lt;br/&gt;
Sumit&lt;/p&gt;</comment>
                            <comment id="1721800" author="sumit.jain@iongroup.com" created="Thu, 9 Nov 2017 18:25:24 +0000"  >&lt;p&gt;Thanks Mark. We are working on it. I will let you know the status soon.&lt;br/&gt;
Do you know if this issue is common to MongoDB and was faced by so many other users? I am worried if it is more frequent in Production, we will not be able to use MongoDB nosql.&lt;/p&gt;</comment>
                            <comment id="1721728" author="mark.agarunov" created="Thu, 9 Nov 2017 17:33:12 +0000"  >&lt;p&gt;Hello &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=sumit.jain%40iongroup.com&quot; class=&quot;user-hover&quot; rel=&quot;sumit.jain@iongroup.com&quot;&gt;sumit.jain@iongroup.com&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;I&apos;ve attached a repair attempt of the files you&apos;ve provided as  &lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/attachment/170585/170585_repair-SERVER-31832-2.tar.gz&quot; title=&quot;repair-SERVER-31832-2.tar.gz attached to SERVER-31832&quot;&gt;repair-SERVER-31832-2.tar.gz&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.mongodb.org/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt;. Please extract these files and replace them in your &lt;tt&gt;$dbpath&lt;/tt&gt; and let us know if it resolves the issue.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Mark&lt;/p&gt;</comment>
                            <comment id="1721423" author="sumit.jain@iongroup.com" created="Thu, 9 Nov 2017 14:10:40 +0000"  >&lt;p&gt;Hi Mark,&lt;/p&gt;

&lt;p&gt;Thanks for getting back to us. I attached another set of WT files, right now out Mongo databases are offline. Will be great if you please send another set of repair files, and will try to restart the MongoDB service. The attached rar file is &lt;b&gt;Nov-09-2017.rar&lt;/b&gt;&lt;br/&gt;
We are worried if these issues can happen in production and if we are not able to recover the databases if will be a big issue for us.&lt;/p&gt;

&lt;p&gt;Thanks&lt;br/&gt;
Sumit&lt;/p&gt;</comment>
                            <comment id="1719687" author="mark.agarunov" created="Tue, 7 Nov 2017 19:57:19 +0000"  >&lt;p&gt;Hello &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=sumit.jain%40iongroup.com&quot; class=&quot;user-hover&quot; rel=&quot;sumit.jain@iongroup.com&quot;&gt;sumit.jain@iongroup.com&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Thank you for the response. Unfortunately, this error indicates that there was corruption on the disk. In this situation, my best recommendation would be to &lt;a href=&quot;https://docs.mongodb.com/manual/tutorial/resync-replica-set-member/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;resync the affected node&lt;/a&gt; or &lt;a href=&quot;https://docs.mongodb.com/manual/core/backups/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;restore from a backup&lt;/a&gt; if possible.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Mark&lt;/p&gt;</comment>
                            <comment id="1718991" author="sumit.jain@iongroup.com" created="Tue, 7 Nov 2017 06:54:29 +0000"  >&lt;p&gt;Thanks Mark.&lt;/p&gt;

&lt;p&gt;Even after copying the files, we still got the below error, can you please look into this on priority. Its in our Production environment.&lt;/p&gt;

&lt;p&gt;2017-11-06T16:23:29.889-0500 E STORAGE  &lt;span class=&quot;error&quot;&gt;&amp;#91;conn10&amp;#93;&lt;/span&gt; WiredTiger error (0) &lt;span class=&quot;error&quot;&gt;&amp;#91;1510003409:889971&amp;#93;&lt;/span&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;13956:2008429440&amp;#93;&lt;/span&gt;, &lt;a href=&quot;file:Prod01/collection-0--7662079245466072202.wt&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;file:Prod01/collection-0--7662079245466072202.wt&lt;/a&gt;, WT_CURSOR.next: read checksum error for 901120B block at offset 163971072: calculated block checksum of 3779091760 doesn&apos;t match expected checksum of 1400883067&lt;br/&gt;
2017-11-06T16:23:29.889-0500 E STORAGE  &lt;span class=&quot;error&quot;&gt;&amp;#91;conn10&amp;#93;&lt;/span&gt; WiredTiger error (0) &lt;span class=&quot;error&quot;&gt;&amp;#91;1510003409:889971&amp;#93;&lt;/span&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;13956:2008429440&amp;#93;&lt;/span&gt;, &lt;a href=&quot;file:Prod01/collection-0--7662079245466072202.wt&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;file:Prod01/collection-0--7662079245466072202.wt&lt;/a&gt;, WT_CURSOR.next: Prod01/collection-0--7662079245466072202.wt: encountered an illegal file format or internal value&lt;br/&gt;
2017-11-06T16:23:29.889-0500 E STORAGE  &lt;span class=&quot;error&quot;&gt;&amp;#91;conn10&amp;#93;&lt;/span&gt; WiredTiger error (-31804) &lt;span class=&quot;error&quot;&gt;&amp;#91;1510003409:889971&amp;#93;&lt;/span&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;13956:2008429440&amp;#93;&lt;/span&gt;, &lt;a href=&quot;file:Prod01/collection-0--7662079245466072202.wt&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;file:Prod01/collection-0--7662079245466072202.wt&lt;/a&gt;, WT_CURSOR.next: the process must exit and restart: WT_PANIC: WiredTiger library panic&lt;br/&gt;
2017-11-06T16:23:29.889-0500 I -        &lt;span class=&quot;error&quot;&gt;&amp;#91;conn10&amp;#93;&lt;/span&gt; Fatal Assertion 28558 at src\mongo\db\storage\wiredtiger\wiredtiger_util.cpp 361&lt;br/&gt;
2017-11-06T16:23:29.889-0500 I -        &lt;span class=&quot;error&quot;&gt;&amp;#91;conn10&amp;#93;&lt;/span&gt; &lt;/p&gt;

&lt;p&gt;***aborting after fassert() failure&lt;/p&gt;


&lt;p&gt;2017-11-06T16:23:29.891-0500 I -        &lt;span class=&quot;error&quot;&gt;&amp;#91;conn9&amp;#93;&lt;/span&gt; Fatal Assertion 28559 at src\mongo\db\storage\wiredtiger\wiredtiger_util.cpp 64&lt;br/&gt;
2017-11-06T16:23:29.891-0500 I -        &lt;span class=&quot;error&quot;&gt;&amp;#91;conn9&amp;#93;&lt;/span&gt;&lt;/p&gt;

&lt;p&gt;-----------------------------&lt;br/&gt;
-----------------------------&lt;/p&gt;

&lt;ul&gt;
	&lt;li&gt;What kind of underlying storage mechanism are you using? Are the storage devices attached locally or over the network? Are the disks SSDs or HDDs? What kind of RAID and/or volume management system are you using?&lt;br/&gt;
[Sumit}: We use pure array disks which are on SAN server.&lt;/li&gt;
	&lt;li&gt;Would you please check the integrity of your disks?&lt;br/&gt;
[Sumit}: Our netops team already checked that&lt;/li&gt;
	&lt;li&gt;Has the database always been running this version of MongoDB? If not please describe the upgrade/downgrade cycles the database has been through.&lt;br/&gt;
[Sumit}: Yes it is 3.4. We recently installed this version in production for the first time.&lt;/li&gt;
	&lt;li&gt;Have you manipulated (copied or moved) the underlying database files? If so, was mongod running?&lt;br/&gt;
[Sumit}: No, we do take the disk snapshots but that should not impact the MongoDB&lt;/li&gt;
	&lt;li&gt;Have you ever restored this instance from backups?&lt;br/&gt;
[Sumit}: Yes we did&lt;/li&gt;
	&lt;li&gt;What method do you use to create backups?&lt;br/&gt;
[Sumit}: We use MongoDump&lt;/li&gt;
	&lt;li&gt;When was the underlying filesystem last checked and is it currently marked clean?&lt;br/&gt;
[Sumit}: Its a new installation in production we did last month. I believe yes&lt;/li&gt;
&lt;/ul&gt;
</comment>
                            <comment id="1717758" author="mark.agarunov" created="Mon, 6 Nov 2017 16:58:24 +0000"  >&lt;p&gt;Hello &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=sumit.jain%40iongroup.com&quot; class=&quot;user-hover&quot; rel=&quot;sumit.jain@iongroup.com&quot;&gt;sumit.jain@iongroup.com&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Thank you for the report. I&apos;ve attached a repair attempt of the files you&apos;ve provided. Would you please extract these files and replace them in your &lt;tt&gt;$dbpath&lt;/tt&gt; and let us know if it resolves the issue? If you are still seeing errors after replacing these files, please provide the complete logs from mongod so that we can further investigate. Additionally, if this issue persists, please provide the following information:&lt;/p&gt;

&lt;ol&gt;
	&lt;li&gt;What kind of underlying storage mechanism are you using? Are the storage devices attached locally or over the network? Are the disks SSDs or HDDs? What kind of RAID and/or volume management system are you using?&lt;/li&gt;
	&lt;li&gt;Would you please check the integrity of your disks?&lt;/li&gt;
	&lt;li&gt;Has the database always been running this version of MongoDB? If not please describe the upgrade/downgrade cycles the database has been through.&lt;/li&gt;
	&lt;li&gt;Have you manipulated (copied or moved) the underlying database files? If so, was mongod running?&lt;/li&gt;
	&lt;li&gt;Have you ever restored this instance from backups?&lt;/li&gt;
	&lt;li&gt;What method do you use to create backups?&lt;/li&gt;
	&lt;li&gt;When was the underlying filesystem last checked and is it currently marked clean?&lt;/li&gt;
&lt;/ol&gt;


&lt;p&gt;Thanks,&lt;br/&gt;
Mark&lt;/p&gt;</comment>
                            <comment id="1717110" author="sumit.jain@iongroup.com" created="Sat, 4 Nov 2017 15:23:08 +0000"  >&lt;p&gt;Please help this is in Production environment.&lt;/p&gt;

&lt;p&gt;This is what I can see in the log file, attached are the WiredTiger files:&lt;/p&gt;

&lt;p&gt;2017-11-03T22:21:37.846-0400 E STORAGE  &lt;span class=&quot;error&quot;&gt;&amp;#91;conn71&amp;#93;&lt;/span&gt; WiredTiger error (0) &lt;span class=&quot;error&quot;&gt;&amp;#91;1509762097:846341&amp;#93;&lt;/span&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;4664:140733117239424&amp;#93;&lt;/span&gt;, &lt;a href=&quot;file:Prod01/collection-0--7662079245466072202.wt&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;file:Prod01/collection-0--7662079245466072202.wt&lt;/a&gt;, WT_CURSOR.next: read checksum error for 901120B block at offset 163971072: calculated block checksum of 233622082 doesn&apos;t match expected checksum of 1400883067&lt;br/&gt;
2017-11-03T22:21:37.847-0400 E STORAGE  &lt;span class=&quot;error&quot;&gt;&amp;#91;conn71&amp;#93;&lt;/span&gt; WiredTiger error (0) &lt;span class=&quot;error&quot;&gt;&amp;#91;1509762097:846341&amp;#93;&lt;/span&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;4664:140733117239424&amp;#93;&lt;/span&gt;, &lt;a href=&quot;file:Prod01/collection-0--7662079245466072202.wt&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;file:Prod01/collection-0--7662079245466072202.wt&lt;/a&gt;, WT_CURSOR.next: Prod01/collection-0--7662079245466072202.wt: encountered an illegal file format or internal value&lt;br/&gt;
2017-11-03T22:21:37.847-0400 E STORAGE  &lt;span class=&quot;error&quot;&gt;&amp;#91;conn71&amp;#93;&lt;/span&gt; WiredTiger error (-31804) &lt;span class=&quot;error&quot;&gt;&amp;#91;1509762097:846341&amp;#93;&lt;/span&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;4664:140733117239424&amp;#93;&lt;/span&gt;, &lt;a href=&quot;file:Prod01/collection-0--7662079245466072202.wt&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;file:Prod01/collection-0--7662079245466072202.wt&lt;/a&gt;, WT_CURSOR.next: the process must exit and restart: WT_PANIC: WiredTiger library panic&lt;br/&gt;
2017-11-03T22:21:37.847-0400 I -        &lt;span class=&quot;error&quot;&gt;&amp;#91;conn71&amp;#93;&lt;/span&gt; Fatal Assertion 28558 at src\mongo\db\storage\wiredtiger\wiredtiger_util.cpp 361&lt;br/&gt;
2017-11-03T22:21:37.847-0400 I -        &lt;span class=&quot;error&quot;&gt;&amp;#91;conn71&amp;#93;&lt;/span&gt; &lt;/p&gt;

&lt;p&gt;***aborting after fassert() failure&lt;/p&gt;


&lt;p&gt;2017-11-03T22:21:37.878-0400 I -        &lt;span class=&quot;error&quot;&gt;&amp;#91;WTJournalFlusher&amp;#93;&lt;/span&gt; Fatal Assertion 28559 at src\mongo\db\storage\wiredtiger\wiredtiger_util.cpp 64&lt;br/&gt;
2017-11-03T22:21:37.878-0400 I -        &lt;span class=&quot;error&quot;&gt;&amp;#91;WTJournalFlusher&amp;#93;&lt;/span&gt; &lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                            <attachment id="170562" name="Nov-09-2017.rar" size="16587" author="sumit.jain@iongroup.com" created="Thu, 9 Nov 2017 14:10:49 +0000"/>
                            <attachment id="170192" name="WiredTiger" size="49" author="sumit.jain@iongroup.com" created="Sat, 4 Nov 2017 15:23:22 +0000"/>
                            <attachment id="170193" name="WiredTiger.lock" size="21" author="sumit.jain@iongroup.com" created="Sat, 4 Nov 2017 15:23:22 +0000"/>
                            <attachment id="170194" name="WiredTiger.turtle" size="1007" author="sumit.jain@iongroup.com" created="Sat, 4 Nov 2017 15:23:22 +0000"/>
                            <attachment id="170195" name="WiredTiger.wt" size="278528" author="sumit.jain@iongroup.com" created="Sat, 4 Nov 2017 15:23:23 +0000"/>
                            <attachment id="170196" name="WiredTigerLAS.wt" size="4096" author="sumit.jain@iongroup.com" created="Sat, 4 Nov 2017 15:23:22 +0000"/>
                            <attachment id="170197" name="_mdb_catalog.wt" size="45056" author="sumit.jain@iongroup.com" created="Sat, 4 Nov 2017 15:23:23 +0000"/>
                            <attachment id="170585" name="repair-SERVER-31832-2.tar.gz" size="18869" author="mark.agarunov" created="Thu, 9 Nov 2017 17:31:43 +0000"/>
                            <attachment id="170265" name="repair-SERVER-31832.tar.gz" size="13079" author="mark.agarunov" created="Mon, 6 Nov 2017 16:57:51 +0000"/>
                            <attachment id="170198" name="sizeStorer.wt" size="53248" author="sumit.jain@iongroup.com" created="Sat, 4 Nov 2017 15:23:22 +0000"/>
                            <attachment id="170191" name="storage.bson" size="95" author="sumit.jain@iongroup.com" created="Sat, 4 Nov 2017 15:23:22 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Mon, 6 Nov 2017 16:58:24 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        6 years, 13 weeks, 1 day ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>nick.brewer</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            6 years, 13 weeks, 1 day ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>mark.agarunov</customfieldvalue>
            <customfieldvalue>sumit.jain@iongroup.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|htjbmv:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|htb3d3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|htixqn:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>