<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:46:50 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-18190] Secondary reads may block replication </title>
                <link>https://jira.mongodb.org/browse/SERVER-18190</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;div class=&quot;panel&quot; style=&quot;background-color: #EEEEEE;border-color: #ccc;border-width: 1px;&quot;&gt;&lt;div class=&quot;panelHeader&quot; style=&quot;border-bottom-width: 1px;border-bottom-color: #ccc;background-color: #6CB33F;&quot;&gt;&lt;b&gt;Issue Status as of Jun 09, 2015&lt;/b&gt;&lt;/div&gt;&lt;div class=&quot;panelContent&quot; style=&quot;background-color: #EEEEEE;&quot;&gt;
&lt;p&gt;&lt;b&gt;ISSUE SUMMARY&lt;/b&gt;&lt;br/&gt;
Reading from secondary nodes in a replica set may block the application of replication write operations, because longer read operations may not yield appropriately.&lt;/p&gt;

&lt;p&gt;&lt;b&gt;USER IMPACT&lt;/b&gt;&lt;br/&gt;
High volume read operations on secondary nodes may cause the nodes to experience increased replication lag, which may make read operations return old data.&lt;/p&gt;

&lt;p&gt;In extreme cases the affected node may become &quot;stale&quot;. &lt;a href=&quot;http://docs.mongodb.org/manual/tutorial/resync-replica-set-member/#resync-a-member-of-a-replica-set&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;Stale nodes need to be resynchronized&lt;/a&gt;. If enough nodes in a replica set become stale availability may be impacted.&lt;/p&gt;

&lt;p&gt;&lt;b&gt;WORKAROUNDS&lt;/b&gt;&lt;br/&gt;
The preferred workaround is to suspend all read operations on secondary nodes.&lt;/p&gt;

&lt;p&gt;Alternatively, the &lt;a href=&quot;http://docs.mongodb.org/manual/tutorial/change-oplog-size/#change-the-size-of-the-oplog&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;oplog size can be increased&lt;/a&gt; on secondary nodes. This is only a suitable workaround if the nodes undergo periods of no reads so replication can catch up.&lt;/p&gt;

&lt;p&gt;&lt;b&gt;AFFECTED VERSIONS&lt;/b&gt;&lt;br/&gt;
MongoDB 3.0.0 through 3.0.3. &lt;/p&gt;

&lt;p&gt;&lt;b&gt;FIX VERSION&lt;/b&gt;&lt;br/&gt;
The fix is included in the 3.0.4 production release.&lt;/p&gt;
&lt;/div&gt;&lt;/div&gt;

&lt;h6&gt;&lt;a name=&quot;Originaldescription&quot;&gt;&lt;/a&gt;Original description&lt;/h6&gt;

&lt;p&gt;&lt;span class=&quot;image-wrap&quot; style=&quot;&quot;&gt;&lt;img src=&quot;https://jira.mongodb.org/secure/attachment/71721/71721_secondary_reads.png&quot; width=&quot;900&quot; style=&quot;border: 0px solid black&quot; /&gt;&lt;/span&gt;&lt;/p&gt;

&lt;ul&gt;
	&lt;li&gt;3 table scans each taking 5-10 seconds (and returning no results) were done on a collection of about 12M documents on the secondary, marked A-B, C-D, E-F above. At the same time documents were inserted into the same collection on the primary, driving replication traffic.&lt;/li&gt;
	&lt;li&gt;During the table scans replication rate falls to 0, replication lag builds.&lt;/li&gt;
	&lt;li&gt;Graphs show straight lines between the beginning and end of the stalls, indicating that the serverStatus command that the data collection depends on was blocked as well.&lt;/li&gt;
	&lt;li&gt;Primary is not similarly affected by the same table scan.&lt;/li&gt;
	&lt;li&gt;Problem reproduces on both WiredTiger and mmapv1&lt;/li&gt;
&lt;/ul&gt;
</description>
                <environment></environment>
        <key id="199857">SERVER-18190</key>
            <summary>Secondary reads may block replication </summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="2" iconUrl="https://jira.mongodb.org/images/icons/priorities/critical.svg">Critical - P2</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="geert.bosch@mongodb.com">Geert Bosch</assignee>
                                    <reporter username="bruce.lucas@mongodb.com">Bruce Lucas</reporter>
                        <labels>
                            <label>ET</label>
                    </labels>
                <created>Thu, 23 Apr 2015 14:34:39 +0000</created>
                <updated>Sat, 19 Sep 2015 00:03:03 +0000</updated>
                            <resolved>Fri, 8 May 2015 14:49:36 +0000</resolved>
                                    <version>3.0.2</version>
                                    <fixVersion>3.0.4</fixVersion>
                    <fixVersion>3.1.3</fixVersion>
                                    <component>Concurrency</component>
                    <component>Querying</component>
                                        <votes>2</votes>
                                    <watches>28</watches>
                                                                                                                <comments>
                            <comment id="937576" author="ramon.fernandez" created="Thu, 11 Jun 2015 13:00:53 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=m.cuk&quot; class=&quot;user-hover&quot; rel=&quot;m.cuk&quot;&gt;m.cuk&lt;/a&gt;, apologies for the inaccuracies, I&apos;ll update JIRA. 3.0.4 was delayed about a week, but the 3.0.4-rc0 release candidate contains a fix for this issue and is &lt;a href=&quot;https://www.mongodb.org/downloads#development&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;available for download&lt;/a&gt;. If you were affected by this bug it would be very helpful if you could try 3.0.4-rc0 out and confirm that your problem is indeed fixed.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Ram&#243;n.&lt;/p&gt;</comment>
                            <comment id="937538" author="bruce.lucas@10gen.com" created="Thu, 11 Jun 2015 12:12:15 +0000"  >&lt;p&gt;A release candidate 3.0.4-rc0 is available for testing (only) in the &quot;development releases&quot; section of the download site. It is not ready for production use yet, but if this release candidate passes our tests it will become the production 3.0.4 release.&lt;/p&gt;</comment>
                            <comment id="937390" author="m.cuk" created="Thu, 11 Jun 2015 07:44:06 +0000"  >&lt;p&gt;So the JIRA versions page says :&lt;br/&gt;
 	3.0.4 		09/Jun/15 	Stable&lt;/p&gt;

&lt;p&gt;Today is 11/Jun/15 and under downloads there is still only 3.0.3. &lt;/p&gt;</comment>
                            <comment id="913093" author="xgen-internal-githook" created="Wed, 13 May 2015 17:38:22 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{u&apos;username&apos;: u&apos;GeertBosch&apos;, u&apos;name&apos;: u&apos;Geert Bosch&apos;, u&apos;email&apos;: u&apos;geert@mongodb.com&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-18190&quot; title=&quot;Secondary reads may block replication &quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-18190&quot;&gt;&lt;del&gt;SERVER-18190&lt;/del&gt;&lt;/a&gt;: Make ParallelBatchWriterMode use a LockManager managed lock&lt;/p&gt;

&lt;p&gt;(cherry picked from commit 465ba933e8d6f5ad9173c4c806686b915bfffe1c)&lt;/p&gt;

&lt;p&gt;Conflicts:&lt;br/&gt;
	src/mongo/db/concurrency/lock_state.cpp&lt;br/&gt;
	src/mongo/db/stats/fill_locker_info.cpp&lt;br/&gt;
	src/mongo/db/stats/fill_locker_info.h&lt;br/&gt;
Branch: v3.0&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/1a4f1719af7b4959564df7c22d72ec03f3938a91&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/1a4f1719af7b4959564df7c22d72ec03f3938a91&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="910140" author="ramon.fernandez" created="Mon, 11 May 2015 16:53:26 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=m.cuk&quot; class=&quot;user-hover&quot; rel=&quot;m.cuk&quot;&gt;m.cuk&lt;/a&gt;, we&apos;re currently working on 3.0.3. Once we have a timeframe for 3.0.4 we&apos;ll update &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER?selectedTab=com.atlassian.jira.jira-projects-plugin:versions-panel&amp;amp;subset=-1&quot; class=&quot;external-link&quot; rel=&quot;nofollow&quot;&gt;the JIRA versions page&lt;/a&gt;.&lt;/p&gt;</comment>
                            <comment id="909810" author="m.cuk" created="Mon, 11 May 2015 12:32:01 +0000"  >&lt;p&gt;Hi,&lt;/p&gt;

&lt;p&gt;do you have any time estimates when 3.04 will be released?&lt;/p&gt;</comment>
                            <comment id="908919" author="xgen-internal-githook" created="Fri, 8 May 2015 18:05:04 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{u&apos;username&apos;: u&apos;GeertBosch&apos;, u&apos;name&apos;: u&apos;Geert Bosch&apos;, u&apos;email&apos;: u&apos;geert@mongodb.com&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-18190&quot; title=&quot;Secondary reads may block replication &quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-18190&quot;&gt;&lt;del&gt;SERVER-18190&lt;/del&gt;&lt;/a&gt;: Fix constant for fillLockerInfo array size&lt;br/&gt;
Branch: master&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/5f719f5266b64fe0e35fa38d842bbca2319720f3&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/5f719f5266b64fe0e35fa38d842bbca2319720f3&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="908102" author="xgen-internal-githook" created="Thu, 7 May 2015 21:09:21 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{u&apos;username&apos;: u&apos;GeertBosch&apos;, u&apos;name&apos;: u&apos;Geert Bosch&apos;, u&apos;email&apos;: u&apos;geert@mongodb.com&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-18190&quot; title=&quot;Secondary reads may block replication &quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-18190&quot;&gt;&lt;del&gt;SERVER-18190&lt;/del&gt;&lt;/a&gt;: Make ParallelBatchWriterMode use a LockManager managed lock&lt;br/&gt;
Branch: master&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/465ba933e8d6f5ad9173c4c806686b915bfffe1c&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/465ba933e8d6f5ad9173c4c806686b915bfffe1c&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="900886" author="dan@10gen.com" created="Wed, 29 Apr 2015 14:13:48 +0000"  >&lt;p&gt;The patch is in progress.  The commit will show up as a comment on this ticket as usual.&lt;/p&gt;</comment>
                            <comment id="900838" author="dmurphy" created="Wed, 29 Apr 2015 13:13:40 +0000"  >&lt;p&gt;Is there a  github commit on this yet? We are trying to do some testing  with 3.0 but this is a blocker for a test, even a  manual patch so the test can proceed would be appreciated until 3.0.4 is a tag in the github.&lt;/p&gt;

&lt;p&gt;Thanks&lt;br/&gt;
David &lt;/p&gt;</comment>
                            <comment id="896479" author="kaloian.manassiev" created="Thu, 23 Apr 2015 18:03:39 +0000"  >&lt;p&gt;From looking at the stacks, I think the problem is that yielding (QueryYield::yieldAllLocks) does not know about the parallel-batch-writer lock, which is acquired by the RAII objects and is not off the lock manager. That way even though all other locks get yielded, the PBWR lock is still held.&lt;/p&gt;

&lt;p&gt;I think the only way to fix this would be to move the PBWR lock to be on the lock manager, so that Locker::saveLockStateAndUnlock would release it as well.&lt;/p&gt;

&lt;p&gt;This is definitely a regression from 2.6, because back then the yielding code was going directly through the RAII objects on the context.&lt;/p&gt;</comment>
                            <comment id="896384" author="bruce.lucas@10gen.com" created="Thu, 23 Apr 2015 16:55:04 +0000"  >&lt;p&gt;Log shows that the table scans are yielding, but that does not seem to be sufficient to avoid blocking replications.&lt;/p&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2015-04-23T12:52:11.122-0400 I QUERY    [conn4] query test.c query: { x: true } planSummary: COLLSCAN ntoskip:0 nscanned:0 nscannedObjects:14490813 keyUpdates:0 writeConflicts:0 numYields:113210 nreturned:0 reslen:20 locks:{ Global: { acquireCount: { r: 113211 } }, Database: { acquireCount: { r: 113211 } }, Collection: { acquireCount: { r: 113211 } } } 10843ms&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;</comment>
                            <comment id="896224" author="milkie" created="Thu, 23 Apr 2015 14:46:23 +0000"  >&lt;p&gt;I would have expected the behavior to be that the table scans should have yielded to other operations, including replication applier.  The investigation may want to start by examining the behavior there.&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10011">
                    <name>Depends</name>
                                            <outwardlinks description="depends on">
                                                        </outwardlinks>
                                                        </issuelinktype>
                            <issuelinktype id="10010">
                    <name>Duplicate</name>
                                                                <inwardlinks description="is duplicated by">
                                        <issuelink>
            <issuekey id="200053">SERVER-18200</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="202052">SERVER-18325</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                            <outwardlinks description="related to">
                                                        </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                            <attachment id="71737" name="gdbmon.html" size="1258574" author="bruce.lucas@mongodb.com" created="Thu, 23 Apr 2015 17:46:33 +0000"/>
                            <attachment id="71721" name="secondary_reads.png" size="108642" author="bruce.lucas@mongodb.com" created="Thu, 23 Apr 2015 14:34:39 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>13.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18555" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname># of Sprints</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_12451" key="com.atlassian.jira.plugin.system.customfieldtypes:multiversion">
                        <customfieldname>Backport Completed</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="15419">3.0.4</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10011" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Backwards Compatibility</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10038"><![CDATA[Fully Compatible]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Thu, 23 Apr 2015 14:46:23 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        8 years, 35 weeks, 6 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[<s><a href='https://jira.mongodb.org/browse/WRITING-1335'>WRITING-1335</a></s>]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            8 years, 35 weeks, 6 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>bruce.lucas@mongodb.com</customfieldvalue>
            <customfieldvalue>dan@mongodb.com</customfieldvalue>
            <customfieldvalue>david.b.murphy.tx@gmail.com</customfieldvalue>
            <customfieldvalue>milkie@mongodb.com</customfieldvalue>
            <customfieldvalue>geert.bosch@mongodb.com</customfieldvalue>
            <customfieldvalue>xgen-internal-githook</customfieldvalue>
            <customfieldvalue>kaloian.manassiev@mongodb.com</customfieldvalue>
            <customfieldvalue>m.cuk</customfieldvalue>
            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrl7if:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hreus7:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                <customfield id="customfield_10557" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="490">Quint Iteration 3</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11861" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>User Summary</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="11858"><![CDATA[Completed]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrk6nj:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>