<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:13:16 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-6974] Get Error while reading  &quot;Database could not initialize cursor across all shards because : stale config detected for ns:&quot;</title>
                <link>https://jira.mongodb.org/browse/SERVER-6974</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Hi,&lt;br/&gt;
Setup 1:Mongos&lt;br/&gt;
      3:Config server&lt;br/&gt;
      10: Mongodb with journal enable&lt;/p&gt;

&lt;p&gt;While reading from mongos we got error &quot;Fri Sep  7 16:50:08 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1121&amp;#93;&lt;/span&gt; ns: 00060912.Database could not initialize cursor across all shards because : stale config detected for ns: 00060912.Database ClusteredCursor::_checkCursor @ 192.168.11.103:10000 attempt: 0&quot;  &lt;/p&gt;

&lt;p&gt;Log :&lt;/p&gt;

&lt;p&gt;Fri Sep  7 16:50:08 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1121&amp;#93;&lt;/span&gt; ns: 00060912.Database could not initialize cursor across all shards because : stale config detected for ns: 00060912.Database ClusteredCursor::_checkCursor @ 192.168.11.103:10000 attempt: 0&lt;br/&gt;
Fri Sep  7 16:50:08 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1122&amp;#93;&lt;/span&gt; ns: 00060912.Database could not initialize cursor across all shards because : stale config detected for ns: 00060912.Database ClusteredCursor::_checkCursor @ 192.168.11.103:10000 attempt: 0&lt;br/&gt;
Fri Sep  7 16:50:08 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1122&amp;#93;&lt;/span&gt; ns: 00060912.Database could not initialize cursor across all shards because : stale config detected for ns: 00060912.Database ClusteredCursor::_checkCursor @ 192.168.11.103:10000 attempt: 1&lt;br/&gt;
Fri Sep  7 16:50:08 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1121&amp;#93;&lt;/span&gt; ns: 00060912.Database could not initialize cursor across all shards because : stale config detected for ns: 00060912.Database ClusteredCursor::_checkCursor @ 192.168.11.103:10000 attempt: 1&lt;br/&gt;
Fri Sep  7 16:50:09 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1122&amp;#93;&lt;/span&gt; ns: 00060912.Database could not initialize cursor across all shards because : stale config detected for ns: 00060912.Database ClusteredCursor::_checkCursor @ 192.168.11.103:10000 attempt: 2&lt;br/&gt;
Fri Sep  7 16:50:09 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1121&amp;#93;&lt;/span&gt; ns: 00060912.Database could not initialize cursor across all shards because : stale config detected for ns: 00060912.Database ClusteredCursor::_checkCursor @ 192.168.11.103:10000 attempt: 2&lt;br/&gt;
Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1123&amp;#93;&lt;/span&gt; ns: 00060912.Database could not initialize cursor across all shards because : stale config detected for ns: 00060912.Database ClusteredCursor::_checkCursor @ 192.168.11.103:10000 attempt: 0&lt;br/&gt;
Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1124&amp;#93;&lt;/span&gt; ns: 00060912.Database could not initialize cursor across all shards because : stale config detected for ns: 00060912.Database ClusteredCursor::_checkCursor @ 192.168.11.103:10000 attempt: 0&lt;br/&gt;
Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1123&amp;#93;&lt;/span&gt; ns: 00060912.Database could not initialize cursor across all shards because : stale config detected for ns: 00060912.Database ClusteredCursor::_checkCursor @ 192.168.11.103:10000 attempt: 1&lt;br/&gt;
Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1124&amp;#93;&lt;/span&gt; ns: 00060912.Database could not initialize cursor across all shards because : stale config detected for ns: 00060912.Database ClusteredCursor::_checkCursor @ 192.168.11.103:10000 attempt: 1&lt;/p&gt;


&lt;p&gt;I have following question are:&lt;br/&gt;
 1. Why does above error come??&lt;br/&gt;
 2. does it take more then 3 second ?&lt;/p&gt;

&lt;p&gt;How to resolve this error &lt;br/&gt;
Please help me &lt;br/&gt;
Regards,&lt;br/&gt;
JRV &lt;/p&gt;</description>
                <environment>linux OEL</environment>
        <key id="49949">SERVER-6974</key>
            <summary>Get Error while reading  &quot;Database could not initialize cursor across all shards because : stale config detected for ns:&quot;</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="greg_10gen">Greg Studer</assignee>
                                    <reporter username="jitendra908">jitendra</reporter>
                        <labels>
                    </labels>
                <created>Sat, 8 Sep 2012 14:17:29 +0000</created>
                <updated>Fri, 15 Feb 2013 15:05:51 +0000</updated>
                            <resolved>Mon, 1 Oct 2012 16:56:28 +0000</resolved>
                                    <version>2.0.3</version>
                                                    <component>Sharding</component>
                                        <votes>1</votes>
                                    <watches>4</watches>
                                                                                                                <comments>
                            <comment id="169885" author="greg_10gen" created="Mon, 1 Oct 2012 16:56:09 +0000"  >&lt;p&gt;Opened a new ticket for the config refresh improvement, follow there for any new updates.&lt;/p&gt;</comment>
                            <comment id="166779" author="greg_10gen" created="Fri, 21 Sep 2012 16:47:12 +0000"  >&lt;p&gt;So, here&apos;s what happened (at least at :33) - &lt;/p&gt;

&lt;p&gt;You had a pooled, incoming connection to mongos which validated a version to shard0000:&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;Fri Sep  7 11:41:35 [conn816]     setShardVersion  shard0000 192.168.11.103:10000  00070912.Database  { setShardVersion: &quot;00070912.Database&quot;, configdb: &quot;192.168.11.20:62000,192.168.11.20:65000,192.168.11.21:38000&quot;, version: Timestamp 28000|1, serverID: ObjectId(&apos;5048f7298a1292e3fc592c4d&apos;), shard: &quot;shard0000&quot;, shardHost: &quot;192.168.11.103:10000&quot; } 0x1477ab0&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;Next, for some reason, shard0000 went down (also, you should really double-check your mongod NUMA settings, as that can wreak all kinds of havok, and upgrade to a supported, non-rc release):&lt;/p&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;Fri Sep  7 11:53:40 dbexit: really exiting now&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;***** SERVER RESTARTED *****&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;Mongos cleanly detected this later and re-established a connection, but the version info for the connection on shard0000 got erased.&lt;/p&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;Fri Sep  7 11:45:56 [conn816] trying reconnect to 192.168.11.103:10000&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;Fri Sep  7 11:45:56 [conn816] reconnect 192.168.11.103:10000 ok&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;Mongos doesn&apos;t know the version info is erased, though, because it refreshes this info lazily.  Therefore when you re-use the conn, mongos is confused and refreshes the version more frequently than it otherwise would:&lt;/p&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;Fri Sep  7 16:33:05 [conn816] ns: 00070912.Database could not initialize cursor across all shards because : stale config detected for ns: 00070912.Database ClusteredCursor::_checkCursor @ 192.168.11.103:10000 attempt: 1&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;Fri Sep  7 16:33:06 [conn816] ns: 00070912.Database could not initialize cursor across all shards because : stale config detected for ns: 00070912.Database ClusteredCursor::_checkCursor @ 192.168.11.103:10000 attempt: 2&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;Fri Sep  7 16:33:08 [conn816] warning: chunk manager reload forced for collection &apos;00070912.Database&apos;, config version is 28|1&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;This is all works-as-designed, the problem comes in that there is a backoff delay in mongos when refreshing a version multiple times (to avoid slamming the config servers and mongod).  We&apos;re working to improve config refresh in general, but this type of staleness is inherent to the system.&lt;/p&gt;

&lt;p&gt;Workarounds include the suggestions above (maxConns in particular will avoid the connection slamming if this does happen), running flushRouterConfig on mongoses after mongod failures (which will force version reloads), or if you&apos;re inclined to recompile your own mongo version you can change the hardcoded delays.&lt;/p&gt;</comment>
                            <comment id="166611" author="jitendra908" created="Fri, 21 Sep 2012 06:13:05 +0000"  >&lt;p&gt;Hi Adding mongos and mongod logs&lt;/p&gt;

&lt;p&gt;I had problem at following time&lt;/p&gt;

&lt;p&gt;1. Fri Sep  7 16:33:05&lt;br/&gt;
2. Fri Sep  7 16:50:08 &lt;/p&gt;</comment>
                            <comment id="166517" author="greg_10gen" created="Thu, 20 Sep 2012 21:43:36 +0000"  >&lt;p&gt;So, a few things: &lt;/p&gt;

&lt;p&gt;We really do need to get more details to drill down into where the problem you&apos;re having is coming from.  We have one mongos log, but that log is not for the time period when you had this problem:&lt;/p&gt;

&lt;p&gt;Fri Sep 7 16:50:09 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1121&amp;#93;&lt;/span&gt; ns: 00060912.Database could not initialize cursor across all shards because : stale config detected for ns: 00060912.Database ClusteredCursor::_checkCursor @ 192.168.11.103:10000 attempt: 2&lt;/p&gt;

&lt;p&gt;&amp;gt; cat mongos_35000.log | grep &quot;attempt: 2&quot; | wc -l &lt;br/&gt;
0&lt;br/&gt;
&amp;gt; cat mongos_35000.log | grep &quot;Fri Sep 7&quot; | wc -l&lt;br/&gt;
0&lt;/p&gt;

&lt;p&gt;It&apos;s hard to say what the multiple retries were for here, which may or may not be causing delays, without the mongos logs during these periods.  The mongos logs you provide don&apos;t have any similar multiple-retry portions.  As you mention though, if you can get similar mongod and mongos logs during one of these time periods (and let me know the time of the problem) we&apos;re happy to look again.&lt;/p&gt;

&lt;p&gt;Secondly, for your connection spikes and high fd use - you can prevent mongos from opening more than a certain number of incoming connections - if your app tries to exceed this limit, mongos will not allow it.  You do this by setting --maxConns on the mongos command line.&lt;/p&gt;

&lt;p&gt;mongos --maxConns 200 (some number greater than the maximum number of connections your app should ever open)&lt;/p&gt;

&lt;p&gt;This should prevent the high connection issues, the maximum number of connections open to each mongod will be (roughly) 200 * (# of mongoses) (also a few fds will be used for your databases).&lt;/p&gt;

&lt;p&gt;If there is some problem between the app and mongos causing the high connections, we&apos;ll see it much sooner and the mongods won&apos;t get overloaded and slow down everybody else.&lt;/p&gt;

</comment>
                            <comment id="166350" author="jitendra908" created="Thu, 20 Sep 2012 15:00:28 +0000"  >&lt;p&gt;Hi please update.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
JRV&lt;/p&gt;</comment>
                            <comment id="166240" author="jitendra908" created="Thu, 20 Sep 2012 06:00:45 +0000"  >&lt;p&gt;Hi ,&lt;/p&gt;

&lt;p&gt;1. &quot;Mongos logs at logLevel 2 would show the actual retry process.&quot; &lt;br/&gt;
&amp;gt; We start mongod and mongos with --vv option, than means logLevel 2 the log we provided you, that was  logLevel 2.&lt;br/&gt;
  what logLevel do you required.&lt;/p&gt;

&lt;p&gt;2 &quot;See your out-of-file-descriptor messages - 35000 fds is quite a lot of fds to use.&quot;&lt;br/&gt;
&amp;gt; We had 35000 file-descriptors limit.Now we have increased file-descriptors limit from 35000 to 60000.   &lt;br/&gt;
  please refer link : &quot;https://groups.google.com/forum/?fromgroups=#!topicsearchin/mongodb-user/File$20Descriptor$20Configuration$20for$20MongoDB$20Deployment$20/mongodb-user/J5K0sM5sQZM&quot;&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
JRV&lt;/p&gt;
</comment>
                            <comment id="165882" author="jitendra908" created="Wed, 19 Sep 2012 06:24:31 +0000"  >&lt;p&gt;hi,&lt;br/&gt;
1. I had the problem at following time  &lt;br/&gt;
    1.1 Fri Sep  7 16:33:05&lt;br/&gt;
    1.2 Fri Sep  7 16:50:08&lt;br/&gt;
2.We will provide Mongostat, when same issue come&lt;br/&gt;
3.We will replicate same issue with log level 2 and provide you that log.&lt;/p&gt;

&lt;p&gt;Regards,&lt;br/&gt;
JRV&lt;/p&gt;

</comment>
                            <comment id="164622" author="greg_10gen" created="Fri, 14 Sep 2012 20:37:50 +0000"  >&lt;p&gt;Looked at the mongod log, but was curious more about what mongos was doing - the mongos log seems to be from a different time?  The mongos log (at logLevel 2) would tell us exactly the config refresh operations that were happening at this time.  Is there another time period where you saw the problem?&lt;/p&gt;

&lt;p&gt;I see your out-of-file-descriptor messages - 35000 fds is quite a lot of fds to use.  Do you really have that many incoming connections?  Mongostat will show you this.&lt;/p&gt;

&lt;p&gt;&amp;gt; the namespace is not in cache than disk reading required&lt;br/&gt;
to fetch the name space into cache.this cause multiple retry for setting shard version.Right??&lt;/p&gt;

&lt;p&gt;No, all the config data is stored on the config server.  When the version is not known, mongos has to fetch the information from the config server and retry.  Mongos logs at logLevel 2 would show the actual retry process.&lt;/p&gt;
</comment>
                            <comment id="164355" author="jitendra908" created="Fri, 14 Sep 2012 06:14:03 +0000"  >&lt;p&gt;Hi,&lt;br/&gt;
1. We have 365 databases configured. This is referring as namespace.&lt;br/&gt;
   We insert only today&apos;s namespace. Reading can be only from old namespaces.&lt;br/&gt;
   when we set ShardVersion for namespace, the namespace is not in cache than disk reading required&lt;br/&gt;
   to fetch the name space into cache.this cause multiple retry for setting shard version.Right??&lt;br/&gt;
2. I had the problem at Fri Sep 7 16:50:08.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
JRV&lt;/p&gt;
</comment>
                            <comment id="164249" author="greg_10gen" created="Thu, 13 Sep 2012 22:29:10 +0000"  >&lt;p&gt;&amp;gt; We have 365 databases configured. I think this is what you are referring as namespace in your first point. So 365 databases can cause a delay during re-establishing new connection. Right?? &lt;/p&gt;

&lt;p&gt;The shard versions are only sent lazily, as-needed, - but if you use a lot of different databases over one connection it could be.  Once you&apos;ve contacted a database once, the version should be cached for that connection.&lt;/p&gt;

&lt;p&gt;&amp;gt; We have socket timeout 1 second ,after socket timeout we again create new connection.&lt;br/&gt;
What should be socket timeout for connection to mongos ? &lt;/p&gt;

&lt;p&gt;Socket timeouts can cause problems for the same reason query timeouts do - I&apos;d recommend not setting this value.  If something goes wrong that causes longer response times it&apos;s much easier to fix if retries don&apos;t mask the problem.&lt;/p&gt;

&lt;p&gt;&amp;gt; I am attaching mongos and mongod logs as requested by you in second point.&lt;/p&gt;

&lt;p&gt;Thanks for the logs, but can you tell us the exact time you had the problem?  Otherwise it&apos;s very hard to determine what&apos;s normal behavior and what isn&apos;t.&lt;/p&gt;</comment>
                            <comment id="164245" author="greg_10gen" created="Thu, 13 Sep 2012 22:21:23 +0000"  >&lt;p&gt;&amp;gt; Now again a question. when does set ShardVersion?&lt;/p&gt;

&lt;p&gt;Are you connecting directly from the shell, or through a driver?  Drivers often cache connections for re-use.  I&apos;d suspect that somehow your connection wasn&apos;t being re-established.&lt;/p&gt;

&lt;p&gt;Also, are you sure the queries went to the same mongod each time?  &lt;/p&gt;</comment>
                            <comment id="163844" author="jitendra908" created="Thu, 13 Sep 2012 09:58:59 +0000"  >&lt;p&gt;Hi,&lt;br/&gt;
i did one testcase:&lt;/p&gt;

&lt;p&gt;1&amp;gt; I made new connect to mongos and did query on three different database. I got below logs on mongod:&lt;/p&gt;

&lt;p&gt;      Thu Sep 13 12:28:00 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn9&amp;#93;&lt;/span&gt; command: { setShardVersion: &quot;00211012.Database&quot;&lt;br/&gt;
      Thu Sep 13 12:28:38 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn9&amp;#93;&lt;/span&gt; command: { setShardVersion: &quot;00221012.Database&quot;&lt;br/&gt;
      Thu Sep 13 12:30:36 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn9&amp;#93;&lt;/span&gt; command: { setShardVersion: &quot;00231012.Database&quot;&lt;/p&gt;

&lt;p&gt;2&amp;gt; I disconnect the connection.&lt;/p&gt;

&lt;p&gt;3&amp;gt; Again made new connect to mongos and did query on three different database. I did not get logs on mongod for setShardVersion.&lt;/p&gt;

&lt;p&gt;As your previous reply you said &quot;Shard versions need to be re-established for each new incoming connection and namespace - new connections in mongos&quot;.&lt;/p&gt;

&lt;p&gt;Now again a question. when does set ShardVersion?&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
JRV&lt;/p&gt;</comment>
                            <comment id="163430" author="jitendra908" created="Wed, 12 Sep 2012 14:18:56 +0000"  >&lt;p&gt;Hi ,&lt;br/&gt;
Any updates&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
JRV&lt;/p&gt;</comment>
                            <comment id="163322" author="jitendra908" created="Wed, 12 Sep 2012 08:01:13 +0000"  >&lt;p&gt;Attached mongos and mongod logs&lt;/p&gt;</comment>
                            <comment id="163317" author="jitendra908" created="Wed, 12 Sep 2012 07:54:40 +0000"  >&lt;p&gt;Hi, Thanks for the reply. Now I am able to understand what was actually going on in my server.&lt;/p&gt;

&lt;p&gt;We have 365 databases configured. I think this is what you are referring as namespace in your first point. So 365 databases can cause a delay during re-establishing new connection. Right?? &lt;/p&gt;

&lt;p&gt;We have socket timeout 1 second ,after socket timeout we again create new connection.&lt;br/&gt;
What should be socket timeout for connection to mongos ? &lt;/p&gt;


&lt;p&gt;I am attaching mongos and mongod logs as requested by you in second point.&lt;/p&gt;

&lt;p&gt;regards&lt;br/&gt;
JRV&lt;/p&gt;</comment>
                            <comment id="163231" author="greg_10gen" created="Wed, 12 Sep 2012 01:22:05 +0000"  >&lt;p&gt;Think this may be a bad interaction of your timeouts with the standard version refresh timeouts - if you allow your timeouts to be 100s temporarily, does the issue go away?&lt;/p&gt;

&lt;p&gt;If so, one workaround would be to do an initial read from a database when creating a new connection with no timeout (you may already be doing this) - the config info should be loaded for the next read.&lt;/p&gt;

&lt;p&gt;Another workaround would be to reuse connections as much as possible - it seems like new connections are triggering this problem?&lt;/p&gt;

&lt;p&gt;1&amp;gt; Why does shards version change?&lt;/p&gt;

&lt;p&gt;Shard versions need to be re-established for each new incoming connection and namespace - new connections in mongos are &quot;expensive&quot; in this way if you have many namespaces.&lt;/p&gt;

&lt;p&gt;2&amp;gt;How many retry may be for &quot;connection meta data too old - will retry ns00060912.Database) op:(query) client in sharded mode, but doesn&apos;t have version set for this collection: 00060912.Database myVersion: 28|1:&quot;&lt;/p&gt;

&lt;p&gt;There may be three round-trips as the connection discovers that the metadata needs to be refreshed, depending on the exact type of staleness here.  Can you send a mongos log (at logLevel 2) with a few hours before/after while you are experiencing this problem, along with the time you application experienced timeout errors?  More context will let us be more helpful.&lt;/p&gt;

&lt;p&gt;3&amp;gt; How much read timeout should be? (In my application 3 sec time out is not good)&lt;br/&gt;
We don&apos;t recommend setting timeouts unless absolutely necessary, just because they have the potential to cause cluster instability.  Connections timeout because the server is slow, then more connections are created, making the server slower, and so on...  This may be occurring, as you mention you run out of file descriptors.  I&apos;d recommend removing or raising the read timeout and instead using one of the workarounds above until we&apos;re able to pinpoint the exact version refresh codepath you&apos;re having trouble with.&lt;/p&gt;
</comment>
                            <comment id="162989" author="jitendra908" created="Tue, 11 Sep 2012 15:15:52 +0000"  >&lt;p&gt;Hi ,&lt;br/&gt;
Any updates&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
JRV&lt;/p&gt;
</comment>
                            <comment id="162855" author="jitendra908" created="Tue, 11 Sep 2012 07:57:06 +0000"  >&lt;p&gt;Hi ,&lt;br/&gt;
Any updates&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
JRV&lt;/p&gt;</comment>
                            <comment id="162402" author="jitendra908" created="Mon, 10 Sep 2012 15:41:54 +0000"  >&lt;p&gt;Hi first thanks for reply.&lt;br/&gt;
we are using c++ driver. we see this message in mongos and mongod logs.&lt;/p&gt;

&lt;p&gt;We make 1 Database for one day. And we do this activity once a year. When we try to read data form old database (1 or 2 days before present date) then reading times out(Read timeout is 3 second) in the first read. After first reading, it works fine.&lt;/p&gt;

&lt;p&gt;This first time timeout issue replicates at least 20-30 times daily.&lt;br/&gt;
We have file descriptor max limit 35000. (Sometimes we get too many open files as well)&lt;/p&gt;

&lt;p&gt;I want to know following :&lt;br/&gt;
1&amp;gt; Why does shards version change?&lt;br/&gt;
2&amp;gt;How many retry may be for &quot;connection meta data too old - will retry ns:(00060912.Database) op:(query) client in  sharded mode, but doesn&apos;t have version set for this collection: 00060912.Database myVersion: 28|1:&quot;&lt;br/&gt;
3&amp;gt; How much read timeout should be? (In my application 3 sec time out is not good)&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
JRV&lt;/p&gt;</comment>
                            <comment id="162339" author="greg_10gen" created="Mon, 10 Sep 2012 13:42:17 +0000"  >&lt;p&gt;FYI - upgrading to the latest 2.0 minor version recommended too, to be sure you have all the bugfixes.&lt;/p&gt;</comment>
                            <comment id="162335" author="greg_10gen" created="Mon, 10 Sep 2012 13:41:38 +0000"  >&lt;p&gt;&amp;gt; ns: 00060912.Database could not initialize cursor across all shards because : stale config detected for ns: 00060912.Database ClusteredCursor::_checkCursor @ 192.168.11.103:10000 attempt: 0&lt;/p&gt;

&lt;p&gt;This is not necessarily an error, it&apos;s just mongos attempting to correct a stale version.  It&apos;s a little strange that you get up to three attempts, however.  Are you dropping and re-creating collections with the same name?  The delay is by-design, as you have more attempts we wait longer to avoid spamming the config server.  Do you see an in your application, or just this message in mongos logs.&lt;/p&gt;

&lt;p&gt;&amp;gt; Fri Sep 7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn17&amp;#93;&lt;/span&gt; command admin.$cmd command: { setShardVersion: &quot;00060912.Database&quot;, configdb: &quot;192.168.11.20:62000,192.168.11.20:65000,192.168.11.21:38000&quot;, version: Timestamp 28000|1, serverID: &lt;/p&gt;

&lt;p&gt;This is mongos trying to set the shard version per-connection on mongod.&lt;/p&gt;

&lt;p&gt;What driver are you using, and do you see this type of thing all the time or only when you create new connections or are under heavy migration load?&lt;/p&gt;
</comment>
                            <comment id="162232" author="jitendra908" created="Mon, 10 Sep 2012 06:51:33 +0000"  >&lt;p&gt;hi&lt;br/&gt;
same time logs at mongod are below:&lt;br/&gt;
Fri Sep  7 16:50:08 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn19&amp;#93;&lt;/span&gt; connection meta data too old - will retry ns:(00060912.Database) op:(query) client in sharded mode, but doesn&apos;t have version set for this collection: 00060912.Database myVersion: 28|1&lt;br/&gt;
Fri Sep  7 16:50:08 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn17&amp;#93;&lt;/span&gt; connection meta data too old - will retry ns:(00060912.Database) op:(query) client in sharded mode, but doesn&apos;t have version set for this collection: 00060912.Database myVersion: 28|1&lt;br/&gt;
Fri Sep  7 16:50:08 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn17&amp;#93;&lt;/span&gt; connection meta data too old - will retry ns:(00060912.Database) op:(query) client in sharded mode, but doesn&apos;t have version set for this collection: 00060912.Database myVersion: 28|1&lt;br/&gt;
Fri Sep  7 16:50:08 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn19&amp;#93;&lt;/span&gt; connection meta data too old - will retry ns:(00060912.Database) op:(query) client in sharded mode, but doesn&apos;t have version set for this collection: 00060912.Database myVersion: 28|1&lt;br/&gt;
Fri Sep  7 16:50:09 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn17&amp;#93;&lt;/span&gt; connection meta data too old - will retry ns:(00060912.Database) op:(query) client in sharded mode, but doesn&apos;t have version set for this collection: 00060912.Database myVersion: 28|1&lt;br/&gt;
Fri Sep  7 16:50:09 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn19&amp;#93;&lt;/span&gt; connection meta data too old - will retry ns:(00060912.Database) op:(query) client in sharded mode, but doesn&apos;t have version set for this collection: 00060912.Database myVersion: 28|1&lt;br/&gt;
Fri Sep  7 16:50:10 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1&amp;#93;&lt;/span&gt; insert 00070912.Database 0ms&lt;br/&gt;
Fri Sep  7 16:50:10 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1&amp;#93;&lt;/span&gt; runQuery called admin.$cmd &lt;/p&gt;
{ getlasterror: 1 }
&lt;p&gt;Fri Sep  7 16:50:10 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1&amp;#93;&lt;/span&gt; run command admin.$cmd &lt;/p&gt;
{ getlasterror: 1 }
&lt;p&gt;Fri Sep  7 16:50:10 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn1&amp;#93;&lt;/span&gt; command admin.$cmd command: &lt;/p&gt;
{ getlasterror: 1 }
&lt;p&gt; ntoreturn:1 reslen:67 0ms&lt;br/&gt;
Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn4&amp;#93;&lt;/span&gt; connection meta data too old - will retry ns:(00060912.Database) op:(query) client in sharded mode, but doesn&apos;t have version set for this collection: 00060912.Database myVersion: 28|1&lt;br/&gt;
Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn16&amp;#93;&lt;/span&gt; connection meta data too old - will retry ns:(00060912.Database) op:(query) client in sharded mode, but doesn&apos;t have version set for this collection: 00060912.Database myVersion: 28|1&lt;br/&gt;
Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn4&amp;#93;&lt;/span&gt; connection meta data too old - will retry ns:(00060912.Database) op:(query) client in sharded mode, but doesn&apos;t have version set for this collection: 00060912.Database myVersion: 28|1&lt;br/&gt;
Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn16&amp;#93;&lt;/span&gt; connection meta data too old - will retry ns:(00060912.Database) op:(query) client in sharded mode, but doesn&apos;t have version set for this collection: 00060912.Database myVersion: 28|1&lt;br/&gt;
Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn17&amp;#93;&lt;/span&gt; runQuery called admin.$cmd &lt;/p&gt;
{ setShardVersion: &quot;00060912.Database&quot;, configdb: &quot;192.168.11.20:62000,192.168.11.20:65000,192.168.11.21:38000&quot;, version: Timestamp 28000|1, serverID: ObjectId(&apos;5048f7298a1292e3fc592c4d&apos;), shard: &quot;shard0000&quot;, shardHost: &quot;192.168.11.103:10000&quot; }
&lt;p&gt;Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn17&amp;#93;&lt;/span&gt; run command admin.$cmd &lt;/p&gt;
{ setShardVersion: &quot;00060912.Database&quot;, configdb: &quot;192.168.11.20:62000,192.168.11.20:65000,192.168.11.21:38000&quot;, version: Timestamp 28000|1, serverID: ObjectId(&apos;5048f7298a1292e3fc592c4d&apos;), shard: &quot;shard0000&quot;, shardHost: &quot;192.168.11.103:10000&quot; }
&lt;p&gt;Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn17&amp;#93;&lt;/span&gt; command: &lt;/p&gt;
{ setShardVersion: &quot;00060912.Database&quot;, configdb: &quot;192.168.11.20:62000,192.168.11.20:65000,192.168.11.21:38000&quot;, version: Timestamp 28000|1, serverID: ObjectId(&apos;5048f7298a1292e3fc592c4d&apos;), shard: &quot;shard0000&quot;, shardHost: &quot;192.168.11.103:10000&quot; }
&lt;p&gt;Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn17&amp;#93;&lt;/span&gt; command admin.$cmd command: &lt;/p&gt;
{ setShardVersion: &quot;00060912.Database&quot;, configdb: &quot;192.168.11.20:62000,192.168.11.20:65000,192.168.11.21:38000&quot;, version: Timestamp 28000|1, serverID: ObjectId(&apos;5048f7298a1292e3fc592c4d&apos;), shard: &quot;shard0000&quot;, shardHost: &quot;192.168.11.103:10000&quot; }
&lt;p&gt; ntoreturn:1 reslen:57 0ms&lt;br/&gt;
Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn17&amp;#93;&lt;/span&gt; runQuery called admin.$cmd &lt;/p&gt;
{ setShardVersion: &quot;00060912.Database&quot;, configdb: &quot;192.168.11.20:62000,192.168.11.20:65000,192.168.11.21:38000&quot;, version: Timestamp 28000|1, serverID: ObjectId(&apos;5048f7298a1292e3fc592c4d&apos;), shard: &quot;shard0000&quot;, shardHost: &quot;192.168.11.103:10000&quot; }
&lt;p&gt;Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn17&amp;#93;&lt;/span&gt; run command admin.$cmd &lt;/p&gt;
{ setShardVersion: &quot;00060912.Database&quot;, configdb: &quot;192.168.11.20:62000,192.168.11.20:65000,192.168.11.21:38000&quot;, version: Timestamp 28000|1, serverID: ObjectId(&apos;5048f7298a1292e3fc592c4d&apos;), shard: &quot;shard0000&quot;, shardHost: &quot;192.168.11.103:10000&quot; }
&lt;p&gt;Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn17&amp;#93;&lt;/span&gt; command: &lt;/p&gt;
{ setShardVersion: &quot;00060912.Database&quot;, configdb: &quot;192.168.11.20:62000,192.168.11.20:65000,192.168.11.21:38000&quot;, version: Timestamp 28000|1, serverID: ObjectId(&apos;5048f7298a1292e3fc592c4d&apos;), shard: &quot;shard0000&quot;, shardHost: &quot;192.168.11.103:10000&quot; }
&lt;p&gt;Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn17&amp;#93;&lt;/span&gt; command admin.$cmd command: &lt;/p&gt;
{ setShardVersion: &quot;00060912.Database&quot;, configdb: &quot;192.168.11.20:62000,192.168.11.20:65000,192.168.11.21:38000&quot;, version: Timestamp 28000|1, serverID: ObjectId(&apos;5048f7298a1292e3fc592c4d&apos;), shard: &quot;shard0000&quot;, shardHost: &quot;192.168.11.103:10000&quot; }
&lt;p&gt; ntoreturn:1 reslen:57 0ms&lt;br/&gt;
Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn19&amp;#93;&lt;/span&gt; runQuery called admin.$cmd &lt;/p&gt;
{ setShardVersion: &quot;00060912.Database&quot;, configdb: &quot;192.168.11.20:62000,192.168.11.20:65000,192.168.11.21:38000&quot;, version: Timestamp 28000|1, serverID: ObjectId(&apos;5048f7298a1292e3fc592c4d&apos;), shard: &quot;shard0000&quot;, shardHost: &quot;192.168.11.103:10000&quot; }
&lt;p&gt;Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn19&amp;#93;&lt;/span&gt; run command admin.$cmd &lt;/p&gt;
{ setShardVersion: &quot;00060912.Database&quot;, configdb: &quot;192.168.11.20:62000,192.168.11.20:65000,192.168.11.21:38000&quot;, version: Timestamp 28000|1, serverID: ObjectId(&apos;5048f7298a1292e3fc592c4d&apos;), shard: &quot;shard0000&quot;, shardHost: &quot;192.168.11.103:10000&quot; }
&lt;p&gt;Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn19&amp;#93;&lt;/span&gt; command: &lt;/p&gt;
{ setShardVersion: &quot;00060912.Database&quot;, configdb: &quot;192.168.11.20:62000,192.168.11.20:65000,192.168.11.21:38000&quot;, version: Timestamp 28000|1, serverID: ObjectId(&apos;5048f7298a1292e3fc592c4d&apos;), shard: &quot;shard0000&quot;, shardHost: &quot;192.168.11.103:10000&quot; }
&lt;p&gt;Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn19&amp;#93;&lt;/span&gt; command admin.$cmd command: &lt;/p&gt;
{ setShardVersion: &quot;00060912.Database&quot;, configdb: &quot;192.168.11.20:62000,192.168.11.20:65000,192.168.11.21:38000&quot;, version: Timestamp 28000|1, serverID: ObjectId(&apos;5048f7298a1292e3fc592c4d&apos;), shard: &quot;shard0000&quot;, shardHost: &quot;192.168.11.103:10000&quot; }
&lt;p&gt; ntoreturn:1 reslen:57 0ms&lt;br/&gt;
Fri Sep  7 16:50:11 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn19&amp;#93;&lt;/span&gt; runQuery called 00060912.Database &lt;/p&gt;
{ _sk: 1, _id: BinData }
&lt;p&gt; &lt;/p&gt;


&lt;p&gt;Please help me.&lt;/p&gt;

&lt;p&gt;Regards,&lt;br/&gt;
JRV&lt;/p&gt;

</comment>
                            <comment id="162227" author="jitendra908" created="Mon, 10 Sep 2012 06:27:51 +0000"  >&lt;p&gt;Hi Please update&lt;/p&gt;

&lt;p&gt;Regards,&lt;br/&gt;
JRV &lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10010">
                    <name>Duplicate</name>
                                            <outwardlinks description="duplicates">
                                        <issuelink>
            <issuekey id="51274">SERVER-7135</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                            <attachment id="20157" name="mongod_10000.log_2" size="10486272" author="jitendra908" created="Fri, 21 Sep 2012 06:13:05 +0000"/>
                            <attachment id="19915" name="mongod_10000.log_2" size="10486272" author="jitendra908" created="Wed, 12 Sep 2012 08:01:13 +0000"/>
                            <attachment id="20158" name="mongos_35000.log" size="8124322" author="jitendra908" created="Fri, 21 Sep 2012 06:13:05 +0000"/>
                            <attachment id="19914" name="mongos_35000.log" size="6001841" author="jitendra908" created="Wed, 12 Sep 2012 08:01:13 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>23.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Mon, 10 Sep 2012 13:41:38 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        11 years, 20 weeks, 2 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ian@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            11 years, 20 weeks, 2 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10000" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Old_Backport</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10000"><![CDATA[No]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>greg_10gen</customfieldvalue>
            <customfieldvalue>jitendra908</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrnph3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hrh4nr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>13553</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|ht074v:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>