<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 06:07:52 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-67334] Accessing the opCtx decoration &apos;tenantIdToDeleteDecoration&apos; from the on-commit hook of TenantMigrationRecipientOpObserver::onDelete() is not safe after the ttl batch deletion feature.</title>
                <link>https://jira.mongodb.org/browse/SERVER-67334</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;PM-2227 made the ttl to perform batch deletes. As a result we might end up crashing the system while trying to access the &lt;a href=&quot;https://github.com/10gen/mongo/blob/aa29c7f642c4729e7892a3f08c2ecc42094c4ca3/src/mongo/db/repl/tenant_migration_recipient_op_observer.cpp#L294&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;uninitialized boost::optional &apos;tenantIdToDeleteDecoration&apos;&lt;/a&gt; value (an opCtx decoration ) from the TenantMigrationRecipientOpObserver::onDelete()&apos;s on-commit hook. Consider the below scenario.&lt;/p&gt;

&lt;p&gt;Assume, we started 2 migrations for tenant T1 &amp;amp; T2 with donor replica set rs0 and recipient replica set rs1. &lt;br/&gt;
1) Migration T1 is committed successfully and R state doc was updated to get garbage collected and set the expiry time for that state doc as timestamp TS1 . This migration should have an R access blocker installed for T1.&lt;br/&gt;
2) Assume Migration T2 is still in-progress, the cloud decided to abort and R primary ended up receiving recipientForgetMigration cmd before recipientSyncData cmd. This &lt;a href=&quot;https://github.com/10gen/mongo/blob/aa29c7f642c4729e7892a3f08c2ecc42094c4ca3/src/mongo/db/commands/tenant_migration_recipient_cmds.cpp#L280-L283&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;would not create a recipient access blocker&lt;/a&gt; for the migration T2. And, the R state doc for this migration is also updated to get garbage collected and the expiry time for this state doc is also set as&#160; timestamp TS1 . &lt;br/&gt;
3) Now, when TTL monitor scans for any expired documents in the recipient state doc collection, it would see 2 documents needed to be deleted. So, it would do the batch deletion by doing those &lt;b&gt;2 deletes in &lt;a href=&quot;https://github.com/10gen/mongo/blob/aa29c7f642c4729e7892a3f08c2ecc42094c4ca3/src/mongo/db/exec/batched_delete_stage.cpp#L305-L404&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;a single recovery unit&lt;/a&gt; using the same opCtx&lt;/b&gt; and assuming the order of the state doc deletion is &lt;br/&gt;
&#160; &#160; i) Delete state doc for T1 - This would would &lt;a href=&quot;https://github.com/10gen/mongo/blob/aa29c7f642c4729e7892a3f08c2ecc42094c4ca3/src/mongo/db/repl/tenant_migration_recipient_op_observer.cpp#L275&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;set&lt;/a&gt; the `tenantIdToDeleteDecoration` on the opctx to be T1 and registers the &lt;a href=&quot;https://github.com/10gen/mongo/blob/aa29c7f642c4729e7892a3f08c2ecc42094c4ca3/src/mongo/db/repl/tenant_migration_recipient_op_observer.cpp#L290-L296&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;on-commit hook&lt;/a&gt; to delete the T1&apos;s R access blocker as part of the tenant recipient op observer imp.&lt;br/&gt;
&#160; &#160;ii) Delete state doc for T2 - This would would set the `tenantIdToDeleteDecoration` on the opctx to be &lt;a href=&quot;https://github.com/10gen/mongo/blob/aa29c7f642c4729e7892a3f08c2ecc42094c4ca3/src/mongo/db/repl/tenant_migration_recipient_op_observer.cpp#L276&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;boost::none&lt;/a&gt; and don&apos;t register the on-commit hook as we don&apos;t have the R tenant access blocker for T2.&lt;br/&gt;
4) When the recovery unit of TTL batch deletion commits, we would run the T1&apos;s on-commit hook and leading to accessing &lt;a href=&quot;https://github.com/10gen/mongo/blob/aa29c7f642c4729e7892a3f08c2ecc42094c4ca3/src/mongo/db/repl/tenant_migration_recipient_op_observer.cpp#L294&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;uninitialized&lt;/a&gt; boost::optional `tenantIdToDeleteDecoration` value, leading to invariant failure and crashing the system.&lt;/p&gt;</description>
                <environment></environment>
        <key id="2070758">SERVER-67334</key>
            <summary>Accessing the opCtx decoration &apos;tenantIdToDeleteDecoration&apos; from the on-commit hook of TenantMigrationRecipientOpObserver::onDelete() is not safe after the ttl batch deletion feature.</summary>
                <type id="3" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14718&amp;avatarType=issuetype">Task</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="13201">Fixed</resolution>
                                        <assignee username="christopher.caplinger@mongodb.com">Christopher Caplinger</assignee>
                                    <reporter username="suganthi.mani@mongodb.com">Suganthi Mani</reporter>
                        <labels>
                    </labels>
                <created>Thu, 16 Jun 2022 16:58:25 +0000</created>
                <updated>Sun, 29 Oct 2023 21:36:45 +0000</updated>
                            <resolved>Wed, 22 Jun 2022 14:52:54 +0000</resolved>
                                                    <fixVersion>6.1.0-rc0</fixVersion>
                                                        <votes>0</votes>
                                    <watches>4</watches>
                                                                                                                <comments>
                            <comment id="4636737" author="xgen-internal-githook" created="Thu, 23 Jun 2022 21:16:15 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Christopher Caplinger&apos;, &apos;email&apos;: &apos;christopher.caplinger@mongodb.com&apos;, &apos;username&apos;: &apos;UnicodeSnowman&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-67334&quot; title=&quot;Accessing the opCtx decoration &amp;#39;tenantIdToDeleteDecoration&amp;#39; from the on-commit hook of TenantMigrationRecipientOpObserver::onDelete() is not safe after the ttl batch deletion feature.&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-67334&quot;&gt;&lt;del&gt;SERVER-67334&lt;/del&gt;&lt;/a&gt;: Pass tenantId directly to onCommit hook&lt;br/&gt;
Branch: davish/&lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-63099&quot; title=&quot;Constant folding should not assume arithmetic is associative or commutative in the general case&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-63099&quot;&gt;&lt;del&gt;SERVER-63099&lt;/del&gt;&lt;/a&gt;&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/09f7596e084c12ffe154f9e8466d1239b5efe389&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/09f7596e084c12ffe154f9e8466d1239b5efe389&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="4632376" author="xgen-internal-githook" created="Wed, 22 Jun 2022 14:50:06 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Christopher Caplinger&apos;, &apos;email&apos;: &apos;christopher.caplinger@mongodb.com&apos;, &apos;username&apos;: &apos;UnicodeSnowman&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-67334&quot; title=&quot;Accessing the opCtx decoration &amp;#39;tenantIdToDeleteDecoration&amp;#39; from the on-commit hook of TenantMigrationRecipientOpObserver::onDelete() is not safe after the ttl batch deletion feature.&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-67334&quot;&gt;&lt;del&gt;SERVER-67334&lt;/del&gt;&lt;/a&gt;: Pass tenantId directly to onCommit hook&lt;br/&gt;
Branch: master&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/09f7596e084c12ffe154f9e8466d1239b5efe389&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/09f7596e084c12ffe154f9e8466d1239b5efe389&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="4630776" author="steven.vannelli" created="Tue, 21 Jun 2022 21:58:04 +0000"  >&lt;p&gt;Much appreciated!&lt;/p&gt;</comment>
                            <comment id="4630704" author="christopher.caplinger" created="Tue, 21 Jun 2022 21:23:44 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=steven.vannelli%40mongodb.com&quot; class=&quot;user-hover&quot; rel=&quot;steven.vannelli@mongodb.com&quot;&gt;steven.vannelli@mongodb.com&lt;/a&gt; on it, will get a patch up for this shortly&lt;/p&gt;</comment>
                            <comment id="4624118" author="esha.maharishi@10gen.com" created="Fri, 17 Jun 2022 16:02:25 +0000"  >&lt;p&gt;Ah I see, that solves the issue since the tenant id would be captured into the onCommit hook separately for each delete. Cool, that sounds good to me!&lt;/p&gt;</comment>
                            <comment id="4623935" author="suganthi.mani" created="Fri, 17 Jun 2022 15:17:43 +0000"  >&lt;p&gt;first half  - &quot;pass the tenant id directly just to the onCommit hook&quot;.&lt;/p&gt;</comment>
                            <comment id="4623902" author="esha.maharishi@10gen.com" created="Fri, 17 Jun 2022 15:11:57 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=suganthi.mani%40mongodb.com&quot; class=&quot;user-hover&quot; rel=&quot;suganthi.mani@mongodb.com&quot;&gt;suganthi.mani@mongodb.com&lt;/a&gt; do you mean we should pass the tenant id directly just to the onCommit hook, or also pass the tenant id directly to onDelete?&lt;/p&gt;</comment>
                            <comment id="4623723" author="suganthi.mani" created="Fri, 17 Jun 2022 14:32:50 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=esha.maharishi%40mongodb.com&quot; class=&quot;user-hover&quot; rel=&quot;esha.maharishi@mongodb.com&quot;&gt;esha.maharishi@mongodb.com&lt;/a&gt; Hopefully &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-65236&quot; title=&quot;Make tenant migration donor delete its state doc in its run method&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-65236&quot;&gt;&lt;del&gt;SERVER-65236&lt;/del&gt;&lt;/a&gt; should be able the remove TTL dependency.  My opinion is that irrespective of &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-65236&quot; title=&quot;Make tenant migration donor delete its state doc in its run method&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-65236&quot;&gt;&lt;del&gt;SERVER-65236&lt;/del&gt;&lt;/a&gt; fix, we shouldn&apos;t pass the opCtx to &lt;a href=&quot;https://github.com/10gen/mongo/blob/aa29c7f642c4729e7892a3f08c2ecc42094c4ca3/src/mongo/db/repl/tenant_migration_recipient_op_observer.cpp#L292&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;this&lt;/a&gt; onCommit hook to access the opCtx decoration, instead directly pass the decoration value (tenant id to be deleted) as we don&apos;t want to make assumption about the opCtx responsible to delete only one state document.&lt;/p&gt;</comment>
                            <comment id="4621962" author="esha.maharishi@10gen.com" created="Thu, 16 Jun 2022 19:51:56 +0000"  >&lt;p&gt;Hmm, this problem will go away once we remove the tenant migration donor&apos;s dependency on the TTL index. I am thinking about if it will completely go away with &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-65236&quot; title=&quot;Make tenant migration donor delete its state doc in its run method&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-65236&quot;&gt;&lt;del&gt;SERVER-65236&lt;/del&gt;&lt;/a&gt;.&lt;/p&gt;</comment>
                            <comment id="4621899" author="esha.maharishi@10gen.com" created="Thu, 16 Jun 2022 19:30:53 +0000"  >&lt;p&gt;Ah, those two deletes share the same opCtx...&lt;/p&gt;

&lt;p&gt;Yes, I think we should prioritize fixing this before releasing 6.1, so that we don&apos;t introduce these crashes in production.&lt;/p&gt;</comment>
                            <comment id="4621753" author="suganthi.mani" created="Thu, 16 Jun 2022 18:47:28 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=esha.maharishi%40mongodb.com&quot; class=&quot;user-hover&quot; rel=&quot;esha.maharishi@mongodb.com&quot;&gt;esha.maharishi@mongodb.com&lt;/a&gt; This crash bug is caused due to PM-2227 whose Fix version is 6.0 &amp;amp; 6.1, but the &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-63040&quot; title=&quot;Batch TTL deletions&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-63040&quot;&gt;&lt;del&gt;SERVER-63040&lt;/del&gt;&lt;/a&gt; which really changed TTL behavior is 6.1 version. Do you think we would be backporting this fix to 6.1 version as well?  Also, do you think we should prioritize this ticket as it seems to be a regression?&lt;/p&gt;

&lt;p&gt;CC &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=steven.vannelli%40mongodb.com&quot; class=&quot;user-hover&quot; rel=&quot;steven.vannelli@mongodb.com&quot;&gt;steven.vannelli@mongodb.com&lt;/a&gt; &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=christopher.caplinger%40mongodb.com&quot; class=&quot;user-hover&quot; rel=&quot;christopher.caplinger@mongodb.com&quot;&gt;christopher.caplinger@mongodb.com&lt;/a&gt;&lt;/p&gt;



</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10011">
                    <name>Depends</name>
                                                                <inwardlinks description="is depended on by">
                                                        </inwardlinks>
                                    </issuelinktype>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                                                <inwardlinks description="is related to">
                                        <issuelink>
            <issuekey id="1972351">SERVER-63040</issuekey>
        </issuelink>
            <issuelink>
            <issuekey id="2070048">SERVER-67322</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>11.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18555" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname># of Sprints</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10011" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Backwards Compatibility</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10038"><![CDATA[Fully Compatible]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Thu, 16 Jun 2022 19:30:53 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        1 year, 32 weeks, 6 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_17050" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Downstream Team Attention</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="16941"><![CDATA[Not Needed]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>luke.bonanomi@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            1 year, 32 weeks, 6 days ago
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_16465" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Linked BF Score</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>143.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>christopher.caplinger@mongodb.com</customfieldvalue>
            <customfieldvalue>esha.maharishi@mongodb.com</customfieldvalue>
            <customfieldvalue>xgen-internal-githook</customfieldvalue>
            <customfieldvalue>steven.vannelli@mongodb.com</customfieldvalue>
            <customfieldvalue>suganthi.mani@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i0yytr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|i0htxc:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                            <customfield id="customfield_22250" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Special Downgrade Instructions Required</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="23343"><![CDATA[Not Needed]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10557" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="6269">Server Serverless 2022-06-27</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|i0ykz3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>