<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 05:23:32 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-50769] server restarted after expr&#65306;{&quot;expr&quot;:&quot;_currentApplyOps.getArrayLength() &gt; 0&quot;,&quot;file&quot;:&quot;src/mongo/db/pipeline/document_source_change_stream_transform.cpp&quot;,&quot;line&quot;:535}}</title>
                <link>https://jira.mongodb.org/browse/SERVER-50769</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;We used an application named monstache with mongo-go-driver v1.4.1 to watch change streams from replica ret with mongods of&#160; v4.4.0. And the whole system works well for a few weeks but the primary mongod restarted frequently after we started to use transaction with java-go-driver.&lt;/p&gt;

&lt;p&gt;We tried the following conditions to check the cause:&lt;/p&gt;
&lt;ol&gt;
	&lt;li&gt;when the server restarted frequently, we check the connection status between host:post and not this&lt;/li&gt;
	&lt;li&gt;We checked and ensured that the wach apis of mongo-go-driver are used correctly&lt;/li&gt;
	&lt;li&gt;The mongo processes are started with systemd and we add the remommended ulimits in the systemd service.&#160; And we created 500 mongoClient instances and ran our transaction unit tests with monstache running but the mongo didn&apos;t restart.&#160;&lt;/li&gt;
&lt;/ol&gt;


&lt;p&gt;However sometimes the mongod restarted all of a sudden.&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;Below are the logs and the key words are &quot;SERVER RESTARTED&quot; and the&#160;&quot;ctx&quot;:&quot;connXXX&quot; which is generated by mongo-go-driver used by monstache and the printed&#160;BACKTRACE and&#160;Invariant failure.&lt;/p&gt;

&lt;p&gt;&lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/attachment/277139/277139_mongod-shard2.log&quot; title=&quot;mongod-shard2.log attached to SERVER-50769&quot;&gt;mongod-shard2.log&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.mongodb.org/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt;&lt;/p&gt;

&lt;p&gt;&lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/attachment/277140/277140_mongod-data-1-shard2.log&quot; title=&quot;mongod-data-1-shard2.log attached to SERVER-50769&quot;&gt;mongod-data-1-shard2.log&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.mongodb.org/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt;&lt;/p&gt;</description>
                <environment></environment>
        <key id="1462815">SERVER-50769</key>
            <summary>server restarted after expr&#65306;{&quot;expr&quot;:&quot;_currentApplyOps.getArrayLength() &gt; 0&quot;,&quot;file&quot;:&quot;src/mongo/db/pipeline/document_source_change_stream_transform.cpp&quot;,&quot;line&quot;:535}}</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="1" iconUrl="https://jira.mongodb.org/images/icons/priorities/blocker.svg">Blocker - P1</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="13201">Fixed</resolution>
                                        <assignee username="justin.seyster@mongodb.com">Justin Seyster</assignee>
                                    <reporter username="jeasonchanupup@gmail.com">jeason chan</reporter>
                        <labels>
                            <label>qexec-team</label>
                    </labels>
                <created>Fri, 4 Sep 2020 02:05:20 +0000</created>
                <updated>Sun, 29 Oct 2023 22:03:33 +0000</updated>
                            <resolved>Tue, 12 Jan 2021 18:21:06 +0000</resolved>
                                    <version>4.4.0</version>
                                    <fixVersion>4.9.0</fixVersion>
                    <fixVersion>4.2.12</fixVersion>
                    <fixVersion>4.4.4</fixVersion>
                                    <component>Querying</component>
                                        <votes>0</votes>
                                    <watches>16</watches>
                                                                                                                <comments>
                            <comment id="3560859" author="xgen-internal-githook" created="Tue, 12 Jan 2021 18:44:03 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Justin Seyster&apos;, &apos;email&apos;: &apos;justin.seyster@mongodb.com&apos;, &apos;username&apos;: &apos;jseyster&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-50769&quot; title=&quot;server restarted after expr&#65306;{&amp;quot;expr&amp;quot;:&amp;quot;_currentApplyOps.getArrayLength() &amp;gt; 0&amp;quot;,&amp;quot;file&amp;quot;:&amp;quot;src/mongo/db/pipeline/document_source_change_stream_transform.cpp&amp;quot;,&amp;quot;line&amp;quot;:535}}&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-50769&quot;&gt;&lt;del&gt;SERVER-50769&lt;/del&gt;&lt;/a&gt; Change streams no longer balk at empty applyOps&lt;/p&gt;

&lt;p&gt;(cherry picked from commit e9122ba5078eca4fbc7ea858221dba6af00e90a9)&lt;br/&gt;
Branch: v4.2&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/5593fd8e33b60c75802edab304e23998fa0ce8a5&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/5593fd8e33b60c75802edab304e23998fa0ce8a5&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="3560854" author="xgen-internal-githook" created="Tue, 12 Jan 2021 18:41:59 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Justin Seyster&apos;, &apos;email&apos;: &apos;justin.seyster@mongodb.com&apos;, &apos;username&apos;: &apos;jseyster&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-50769&quot; title=&quot;server restarted after expr&#65306;{&amp;quot;expr&amp;quot;:&amp;quot;_currentApplyOps.getArrayLength() &amp;gt; 0&amp;quot;,&amp;quot;file&amp;quot;:&amp;quot;src/mongo/db/pipeline/document_source_change_stream_transform.cpp&amp;quot;,&amp;quot;line&amp;quot;:535}}&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-50769&quot;&gt;&lt;del&gt;SERVER-50769&lt;/del&gt;&lt;/a&gt; Change streams no longer balk at empty applyOps&lt;/p&gt;

&lt;p&gt;(cherry picked from commit e9122ba5078eca4fbc7ea858221dba6af00e90a9)&lt;br/&gt;
Branch: v4.4&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/41db39acbe673041c487daa83bb9d14791016b93&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/41db39acbe673041c487daa83bb9d14791016b93&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="3559162" author="xgen-internal-githook" created="Tue, 12 Jan 2021 05:00:39 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Justin Seyster&apos;, &apos;email&apos;: &apos;justin.seyster@mongodb.com&apos;, &apos;username&apos;: &apos;jseyster&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-50769&quot; title=&quot;server restarted after expr&#65306;{&amp;quot;expr&amp;quot;:&amp;quot;_currentApplyOps.getArrayLength() &amp;gt; 0&amp;quot;,&amp;quot;file&amp;quot;:&amp;quot;src/mongo/db/pipeline/document_source_change_stream_transform.cpp&amp;quot;,&amp;quot;line&amp;quot;:535}}&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-50769&quot;&gt;&lt;del&gt;SERVER-50769&lt;/del&gt;&lt;/a&gt; Change streams no longer balk at empty applyOps&lt;br/&gt;
Branch: master&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/e9122ba5078eca4fbc7ea858221dba6af00e90a9&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/e9122ba5078eca4fbc7ea858221dba6af00e90a9&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="3378234" author="bernard.gorman" created="Tue, 8 Sep 2020 13:08:40 +0000"  >&lt;p&gt;Hey &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=jeasonchanupup%40gmail.com&quot; class=&quot;user-hover&quot; rel=&quot;jeasonchanupup@gmail.com&quot;&gt;jeasonchanupup@gmail.com&lt;/a&gt;, thank you for bringing this issue to our attention. If you could answer the following questions, it will really help our investigation:&lt;/p&gt;

&lt;p&gt;1. In your original description, you say that you&apos;re using monstache to &quot;watch change streams from a replica set&quot;, but you are running in a sharded cluster. Is monstache opening a change stream through the &lt;tt&gt;mongoS&lt;/tt&gt;, or is it opening change streams directly on each shard?&lt;/p&gt;

&lt;p&gt;2. What kind of change stream (single-collection, whole-database, or whole-cluster) are you running? From the documentation &lt;a href=&quot;https://rwynn.github.io/monstache-site/start/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;here&lt;/a&gt; it seems that &lt;tt&gt;monstache&lt;/tt&gt; &quot;defaults to opening the change stream against the entire deployment.&quot; Did you configure it to run against a single database or single collection instead? If you have any logs that show the actual &lt;tt&gt;$changeStream&lt;/tt&gt; command, please post them here.&lt;/p&gt;

&lt;p&gt;3. Could you provide some examples of the kind of transactions your application is running on this cluster?&lt;/p&gt;

&lt;p&gt;4. Has your oplog rolled over yet? If not, then the oplog entries which caused this issue should still be present - it would be very helpful if we could examine them. From the logs, it appears that the earliest incident occurred at &lt;tt&gt;2020-09-03T10:00:46.229+08:00&lt;/tt&gt;:&lt;/p&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;&#10095; grep -m 1 Invariant mongod-data-1-shard2.log&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-09-03T10:00:46.229+08:00&quot;},&quot;s&quot;:&quot;F&quot;,  &quot;c&quot;:&quot;-&quot;,        &quot;id&quot;:23079,   &quot;ctx&quot;:&quot;conn855&quot;,&quot;msg&quot;:&quot;Invariant failure&quot;,&quot;attr&quot;:{&quot;expr&quot;:&quot;_currentApplyOps.getArrayLength() &amp;gt; 0&quot;,&quot;file&quot;:&quot;src/mongo/db/pipeline/document_source_change_stream_transform.cpp&quot;,&quot;line&quot;:535}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;Assuming that the change stream was keeping pace with the rate of oplog generation, it is very likely that the oplog entry which caused this issue was written shortly before this time. The following command will use the &lt;tt&gt;mongo&lt;/tt&gt; shell to connect to the host and will dump 50 seconds of its oplog around the time of the incident to a logfile (please note that you may need to add appropriate authentication credentials to this command):&lt;/p&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;mongo --host &amp;lt;host&amp;gt; --port &amp;lt;port&amp;gt; --eval &apos;rs.slaveOk(); db.getSiblingDB(&quot;local&quot;).oplog.rs.find({ts: {$gte: Timestamp(1599098400, 1), $lte: Timestamp(1599098450, 1)}}).forEach(printjson)&apos; &amp;gt; SERVER-50769_oplog.log&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;Please do not post this log on the ticket, since it may contain some sensitive information. We have created &lt;a href=&quot;https://10gen-httpsupload.s3.amazonaws.com/upload_forms/2a9d2e18-8333-4693-bc02-680c7e3f11fe.html&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;a secure upload portal for you at this link&lt;/a&gt;; please upload the oplog file there instead. Files uploaded to this portal are visible only to MongoDB employees, and are routinely deleted after some time.&lt;/p&gt;

&lt;p&gt;Thanks!&lt;br/&gt;
Bernard&lt;/p&gt;</comment>
                            <comment id="3377792" author="JIRAUSER1256577" created="Tue, 8 Sep 2020 00:58:24 +0000"  >&lt;p&gt;Hi, if more details are required, leave a messga and I will reply as soon as possible. Thx.&lt;/p&gt;</comment>
                            <comment id="3375939" author="JIRAUSER1256577" created="Fri, 4 Sep 2020 02:15:36 +0000"  >&lt;p&gt;Here are the resource limit params in the systemd service&#65306;&lt;/p&gt;

&lt;p&gt;#file size&lt;br/&gt;
LimitFSIZE=infinity&lt;/p&gt;
&lt;ol&gt;
	&lt;li&gt;Restart type&lt;br/&gt;
Restart=on-failure&lt;/li&gt;
	&lt;li&gt;cpu time&lt;br/&gt;
LimitCPU=infinity&lt;/li&gt;
	&lt;li&gt;virtual memory size&lt;br/&gt;
LimitAS=infinity&lt;/li&gt;
	&lt;li&gt;open files&lt;br/&gt;
LimitNOFILE=1640000&lt;/li&gt;
	&lt;li&gt;processes/threads&lt;br/&gt;
LimitNPROC=164000&lt;/li&gt;
	&lt;li&gt;locked memory&lt;br/&gt;
LimitMEMLOCK=infinity&lt;/li&gt;
	&lt;li&gt;total threads (user+kernel)&lt;br/&gt;
TasksMax=infinity&lt;br/&gt;
TasksAccounting=false&lt;/li&gt;
&lt;/ol&gt;


&lt;p&gt;And our hosts have 64 cores and 64gb ram and 1T ssd&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10420">
                    <name>Backports</name>
                                            <outwardlinks description="backported by">
                                                        </outwardlinks>
                                                        </issuelinktype>
                            <issuelinktype id="10520">
                    <name>Problem/Incident</name>
                                            <outwardlinks description="causes">
                                                        </outwardlinks>
                                                        </issuelinktype>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                                                <inwardlinks description="is related to">
                                                        </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                            <attachment id="277140" name="mongod-data-1-shard2.log" size="11868913" author="jeasonchanupup@gmail.com" created="Fri, 4 Sep 2020 02:05:12 +0000"/>
                            <attachment id="277139" name="mongod-shard2.log" size="12835847" author="jeasonchanupup@gmail.com" created="Fri, 4 Sep 2020 02:04:10 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>6.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18555" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname># of Sprints</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>5.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_12450" key="com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes">
                        <customfieldname>Backport Requested</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="18953"><![CDATA[v4.4]]></customfieldvalue>
    <customfieldvalue key="16775"><![CDATA[v4.2]]></customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10011" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Backwards Compatibility</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10038"><![CDATA[Fully Compatible]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_13552" key="com.go2group.jira.plugin.crm:crm_generic_field">
                        <customfieldname>Case</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[[5002K00000pDcOIQA0, 5002K00000s1dcKQAQ, 5002K00000saLchQAE, 5002K00000saf8iQAA, 5002K000011fFQwQAM]]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Sun, 6 Sep 2020 11:23:52 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        3 years, 4 weeks, 1 day ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_17050" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Downstream Team Attention</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="16941"><![CDATA[Not Needed]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>luke.bonanomi@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            3 years, 4 weeks, 1 day ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>bernard.gorman@mongodb.com</customfieldvalue>
            <customfieldvalue>xgen-internal-githook</customfieldvalue>
            <customfieldvalue>jeasonchanupup@gmail.com</customfieldvalue>
            <customfieldvalue>justin.seyster@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hy3wnr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hr4ypj:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10557" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="3620">Query 2020-11-30</customfieldvalue>
    <customfieldvalue id="3621">Query 2020-12-14</customfieldvalue>
    <customfieldvalue id="3622">Query 2020-12-28</customfieldvalue>
    <customfieldvalue id="4459">Query 2021-01-11</customfieldvalue>
    <customfieldvalue id="4460">Query 2021-01-25</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hy3ix3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>