<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:58:52 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-21942] Make WiredTiger better suited for testing scenarios</title>
                <link>https://jira.mongodb.org/browse/SERVER-21942</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;WiredTiger is not very fast for testing scenarios in which a potentially large number of tests read and write relatively small amounts of data.&lt;/p&gt;

&lt;p&gt;Using ephemeralForTest is hardly any faster.&lt;/p&gt;

&lt;p&gt;I suggest a --forTest mode for mongod with WiredTiger. This mode must be optimized for speed for the testing scenario. Data can be &quot;persisted&quot; in RAM.&lt;/p&gt;</description>
                <environment>Windows</environment>
        <key id="244445">SERVER-21942</key>
            <summary>Make WiredTiger better suited for testing scenarios</summary>
                <type id="4" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14710&amp;avatarType=issuetype">Improvement</type>
                                            <priority id="4" iconUrl="https://jira.mongodb.org/images/icons/priorities/minor.svg">Minor - P4</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="4">Incomplete</resolution>
                                        <assignee username="backlog-server-execution">Backlog - Storage Execution Team</assignee>
                                    <reporter username="itwebtf@saxobank.com">ITWEBTF SAXOBANK</reporter>
                        <labels>
                    </labels>
                <created>Fri, 18 Dec 2015 08:05:46 +0000</created>
                <updated>Tue, 6 Dec 2022 04:37:17 +0000</updated>
                            <resolved>Mon, 28 Mar 2016 18:12:54 +0000</resolved>
                                    <version>3.2.0</version>
                                                    <component>WiredTiger</component>
                                        <votes>0</votes>
                                    <watches>11</watches>
                                                                                                                <comments>
                            <comment id="1217006" author="ramon.fernandez" created="Mon, 28 Mar 2016 18:12:45 +0000"  >&lt;p&gt;Since this is no longer an issue, and no further information can be provided at the moment to enhance WiredTiger in the requested manner I&apos;m going to close this ticket for the time being. We can always reopen it in the future if there&apos;s renewed interest in the matter.&lt;/p&gt;

&lt;p&gt;Regards,&lt;br/&gt;
Ram&#243;n.&lt;/p&gt;</comment>
                            <comment id="1206401" author="itwebtf@saxobank.com" created="Thu, 17 Mar 2016 07:57:13 +0000"  >&lt;p&gt;Thanks, sending you the statistics is a good suggestion. &lt;/p&gt;

&lt;p&gt;However, due to problems with backwards compatibility with Mongo 3.x we have been forced to refocus, so we will not upgrade to WT right now and I have not tried a RAM drive.&lt;/p&gt;

&lt;p&gt;So, this is not a problem for us right now. Out of personal interest I would like to do it anyway, but I cannot promise an exact ETA.&lt;/p&gt;

&lt;p&gt;If you feel that this will most likely help other users as well, I will try to do it soon?&lt;/p&gt;

&lt;p&gt;BTW, right now I cannot send you logs, not even from a test run, as you have not signed an NDA with us. Perhaps you could push whoever is stalling that in your end so we can get rid of that obstacle?&lt;/p&gt;

&lt;p&gt;Regards,&lt;br/&gt;
Brian&lt;/p&gt;</comment>
                            <comment id="1206311" author="michael.cahill" created="Thu, 17 Mar 2016 03:54:37 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=itwebtf%40saxobank.com&quot; class=&quot;user-hover&quot; rel=&quot;itwebtf@saxobank.com&quot;&gt;itwebtf@saxobank.com&lt;/a&gt;, have you had a chance to test with a RAM drive?&lt;/p&gt;

&lt;p&gt;If test speed is still an issue for you, another thing we could do is take a look at statistics during the test run to see whether anything jumps out.  Can you upload a MongoDB log file and zipped &lt;tt&gt;diagnostic.data&lt;/tt&gt; directory from inside the database path after a test run?&lt;/p&gt;</comment>
                            <comment id="1176877" author="michael.cahill" created="Thu, 18 Feb 2016 03:21:51 +0000"  >&lt;p&gt;Hi Brian,&lt;/p&gt;

&lt;p&gt;There is a list of choices here:&lt;/p&gt;

&lt;p&gt;  &lt;a href=&quot;https://en.wikipedia.org/wiki/List_of_RAM_drive_software&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://en.wikipedia.org/wiki/List_of_RAM_drive_software&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;In particular, this one is free:&lt;/p&gt;

&lt;p&gt;  &lt;a href=&quot;http://www.ltr-data.se/opencode.html/#ImDisk&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;http://www.ltr-data.se/opencode.html/#ImDisk&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="1170361" author="itwebtf@saxobank.com" created="Thu, 11 Feb 2016 08:03:57 +0000"  >&lt;p&gt;Hi,&lt;/p&gt;

&lt;p&gt;I certainly expect that WiredTiger has been designed for big data, not for few documents in few collections.&lt;/p&gt;

&lt;p&gt;However, I specifically do not drop collections until after the last test, so that is hardly the issue.&lt;/p&gt;

&lt;p&gt;It might be that the fsync calls are still relevant, but I am not sure how that relates to &lt;b&gt;Windows&lt;/b&gt;. A --forTest option could surely  &lt;em&gt;eat my data&lt;/em&gt; &lt;img class=&quot;emoticon&quot; src=&quot;https://jira.mongodb.org/images/icons/emoticons/smile.png&quot; height=&quot;16&quot; width=&quot;16&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;.&lt;/p&gt;

&lt;p&gt;I could try a RAM-disk of some sort. Can you recommend one for Windows?&lt;/p&gt;

&lt;p&gt;Regards,&lt;br/&gt;
Brian&lt;/p&gt;</comment>
                            <comment id="1170035" author="michael.cahill" created="Thu, 11 Feb 2016 00:45:21 +0000"  >&lt;p&gt;Hi Brian,&lt;/p&gt;

&lt;p&gt;Thanks for the extra information.&lt;/p&gt;

&lt;p&gt;In CS-26613 you mention the following as appearing in profiles:&lt;/p&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;MongoDB.Driver.Internal.MongoConnection.ReceiveMessage&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;MongoDB.Bson.IO.ByteBufferFactory.LoadFrom&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;MongoDB.Driver.MongoCursorEnumerator`1.MoveNext&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;MongoDB.Driver.MongoCursorEnumerator`1.GetFirst&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;MongoDB.Driver.MongoCursorEnumerator`1.GetReply&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;None of those relate directly to storage engine I/O.  It may be that the strong persistence guarantees from WiredTiger, which involve &lt;tt&gt;fsync&lt;/tt&gt; calls during collection create and drop operations, are causing tests to run slower.  That would not necessarily appear in CPU profiles.&lt;/p&gt;

&lt;p&gt;One way to confirm would be to set up &lt;tt&gt;mongod&lt;/tt&gt; to run on an in-memory filesystem (e.g., &lt;tt&gt;tmpfs&lt;/tt&gt; on Linux) during testing.  Another option would be to use something like &lt;a href=&quot;https://www.flamingspork.com/projects/libeatmydata/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://www.flamingspork.com/projects/libeatmydata/&lt;/a&gt; to avoid durability guarantees during testing.&lt;/p&gt;

&lt;p&gt;Please let us know whether either of those options helps.&lt;/p&gt;</comment>
                            <comment id="1164677" author="itwebtf@saxobank.com" created="Fri, 5 Feb 2016 08:24:25 +0000"  >&lt;p&gt;Hi Michael,&lt;/p&gt;

&lt;p&gt;The workload consists of a few hundred tests. Before running the entire set, indexes are ensured on all collections. At this time the database is empty, most collections are not there and the few collections that may be there are populated with very few documents, typically 1 to 3 documents.&lt;/p&gt;

&lt;p&gt;For each test, all documents are removed from all collections. Each test run will populate a few collections with documents, typically 1 to 5 collections with each 1 to 3 documents from JSon text. When the test runs, these collections will be read and possibly written to. Also a few more collections will be written to in any test.&lt;/p&gt;

&lt;p&gt;After the last test has run, collections with no documents are dropped.&lt;/p&gt;

&lt;p&gt;As you can see in CS-26613 I profiled this once, and I found that the read operations in the database engine might be the bottle neck?&lt;/p&gt;

&lt;p&gt;Let me know if you need more details.&lt;/p&gt;

&lt;p&gt;Regarding a --forTest flag, I suggest that it will instruct the engine to work 100% in memory (with 0% I/O overhead), if the assumption about I/O being the bottle neck is true. Naturally, this will only work for very small amounts of data, which is quite OK.&lt;/p&gt;

&lt;p&gt;Best regards,&lt;br/&gt;
Brian Elgaard Bennett&lt;/p&gt;</comment>
                            <comment id="1164581" author="michael.cahill" created="Fri, 5 Feb 2016 03:30:14 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=itwebtf%40saxobank.com&quot; class=&quot;user-hover&quot; rel=&quot;itwebtf@saxobank.com&quot;&gt;itwebtf@saxobank.com&lt;/a&gt;, can you please explain the workload you mention above that completes in 1.21 on MMAPv1 but takes longer with WiredTiger?  What operations are included in this measurement: is most of the time involved in starting / stopping &lt;tt&gt;mongod&lt;/tt&gt;?  Have you measured on any platforms other than Windows?&lt;/p&gt;

&lt;p&gt;What would you expect a &quot;--forTest&quot; flag to do differently to regular mode in order to go faster?  Is your sense that a lot of time in your tests is spent writing data to disk for a clean shutdown when you are about to delete it?&lt;/p&gt;</comment>
                            <comment id="1124969" author="itwebtf@saxobank.com" created="Mon, 4 Jan 2016 09:28:38 +0000"  >&lt;p&gt;Hi Dan,&lt;/p&gt;

&lt;p&gt;Surely,these engines have different characteristics that will affect integration test differently from the production web site. &lt;/p&gt;

&lt;p&gt;The tests are mostly single-threaded, so they will not benefit from enhanced concurrency support in WT. In fact, as you suggest, the overhead may have an impact in the testing usage scenario. However, I did not expect such a significant impact since I see no reason for significant optimistic concurrency retries in these tests.&lt;/p&gt;

&lt;p&gt;We do not have large, in-place updates in these tests.&lt;/p&gt;

&lt;p&gt;As I mentioned before, it is quite OK for developers to do the first wave of initial testing using whatever engine is the fastest for that purpose.&lt;/p&gt;

&lt;p&gt;But I am slightly worried about the performance of WT which we will probably switch to in the near future.&lt;/p&gt;

&lt;p&gt;I suggest that the MongoDb Engine Team,&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;Verifies the performance of the usage scenario that I have outlined.
	&lt;ul&gt;
		&lt;li&gt;If as designed, i.e. no performance problems for the important usage scenarios for which WT was designed, then not a problem.&lt;/li&gt;
		&lt;li&gt;If not as designed, then go fix&lt;img class=&quot;emoticon&quot; src=&quot;https://jira.mongodb.org/images/icons/emoticons/smile.png&quot; height=&quot;16&quot; width=&quot;16&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/li&gt;
	&lt;/ul&gt;
	&lt;/li&gt;
	&lt;li&gt;Considers a --ForTest mode of WT&lt;/li&gt;
&lt;/ul&gt;

</comment>
                            <comment id="1118293" author="dan@10gen.com" created="Fri, 18 Dec 2015 16:59:31 +0000"  >&lt;p&gt;WT and MMAPv1 have some properties which your test case may be tickling in unexpected ways.  For example, MMAPv1 is often more performant in single-threaded applications (because of the overhead of enabling high concurrency applications).  This is also true when you have many workers trying to update a small set of docs, because optimistic concurrency control causes retries in WT.  In addition, large, in-place updates are more efficiently executed in the MMAPv1 engine than in WT because WT uses copy-on-write to allow for concurrent write operations.  These conditions are often the case for small integration test suites.  Could any of these issues be in play?&lt;/p&gt;</comment>
                            <comment id="1118042" author="itwebtf@saxobank.com" created="Fri, 18 Dec 2015 12:05:49 +0000"  >&lt;p&gt;Hi Ramon,&lt;/p&gt;

&lt;p&gt;It made a difference, as execution time with Wired Tiger went from 4:58 with 3.2.0 to 3:58 with 3.2.1-rc0.&lt;/p&gt;

&lt;p&gt;However, with mmapv1 on 3.2.0, execution time is typically 1.21.&lt;/p&gt;

&lt;p&gt;I can live with using another engine for initial testing, but using the engine we are going to go Live with is preferable.&lt;/p&gt;

&lt;p&gt;And potentially, a non-persisting and otherwise optimized-for-test-only mode could make Wired Tiger even faster.&lt;/p&gt;

&lt;p&gt;Best regards,&lt;br/&gt;
Brian&lt;/p&gt;</comment>
                            <comment id="1117993" author="ramon.fernandez" created="Fri, 18 Dec 2015 10:45:27 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=itwebtf%40saxobank.com&quot; class=&quot;user-hover&quot; rel=&quot;itwebtf@saxobank.com&quot;&gt;itwebtf@saxobank.com&lt;/a&gt;, since you&apos;re running 3.2.0 on Windows you may have been affected by &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-21792&quot; title=&quot;Performance regression with directio enabled on Windows with WiredTiger&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-21792&quot;&gt;&lt;del&gt;SERVER-21792&lt;/del&gt;&lt;/a&gt;. Could you please &lt;a href=&quot;https://www.mongodb.org/downloads/#development&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;download 3.2.1-rc0&lt;/a&gt; and re-run your experiments? It would be very useful to see how much direct I/O was affecting your use case, and whether 3.2.1 will meet your specific needs.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Ram&#243;n.&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                            <outwardlinks description="related to">
                                                        </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>12.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                <customfield id="customfield_12751" key="com.atlassian.jira.plugin.system.customfieldtypes:multiselect">
                        <customfieldname>Assigned Teams</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="25136"><![CDATA[Storage Execution]]></customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Fri, 18 Dec 2015 10:45:27 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        7 years, 46 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>alexander.golin@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            7 years, 46 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>backlog-server-execution</customfieldvalue>
            <customfieldvalue>dan@mongodb.com</customfieldvalue>
            <customfieldvalue>itwebtf@saxobank.com</customfieldvalue>
            <customfieldvalue>michael.cahill@mongodb.com</customfieldvalue>
            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrklz3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hsf29z:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrlln3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>