<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:26:31 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-11697] Mongos crash when moveChunk</title>
                <link>https://jira.mongodb.org/browse/SERVER-11697</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Mongos crash when we are moveChunk. Caused by the following log:&lt;br/&gt;
Tue Nov 12 20:01:12 &lt;span class=&quot;error&quot;&gt;&amp;#91;conn611979&amp;#93;&lt;/span&gt; Assertion: 10429:setShardVersion failed host: 10.38.171.25:7111 &lt;/p&gt;
{ oldVersion: Timestamp
29317000|0, oldVersionEpoch: ObjectId(&apos;522ad499e1814e603d11be30&apos;), ns: &quot;appid250528.meta_infos0&quot;, version: Timestamp 2932
0000|0, versionEpoch: ObjectId(&apos;522ad499e1814e603d11be30&apos;), globalVersion: Timestamp 29321000|0, globalVersionEpoch: Obje
ctId(&apos;522ad499e1814e603d11be30&apos;), reloadConfig: true, errmsg: &quot;shard global version for collection is higher than trying
to set to &apos;appid250528.meta_infos0&apos;&quot;, ok: 0.0 }

&lt;p&gt;When I use gdb debug the coredump file, something must be wrong. The details are:&lt;br/&gt;
1. chunk X move from shardA to shardB, chunkA&apos;s version update to 29363|0, and shardB&apos;s local version ChunkY update to 29363|1. And these updates will send to config server when moveChunk is finished.&lt;br/&gt;
2. When use gdb, the ChunkManager object of this ns is displayed as:&lt;br/&gt;
_version = 29363|1&lt;br/&gt;
_shardVersion&lt;span class=&quot;error&quot;&gt;&amp;#91;shardA&amp;#93;&lt;/span&gt; = 29363|1&lt;br/&gt;
_shardVersion&lt;span class=&quot;error&quot;&gt;&amp;#91;shardB&amp;#93;&lt;/span&gt; = 29362|0&lt;br/&gt;
3. So, when CheckShardVersion for shardB, since _version is the newest, the retry of &apos;conf-&amp;gt;getChunkManager( ns , true )&apos; will skip reload process.&lt;/p&gt;

&lt;p&gt;The key reason is:&lt;br/&gt;
 _version updated to the newest, but   _shardVersion&lt;span class=&quot;error&quot;&gt;&amp;#91;shardB&amp;#93;&lt;/span&gt; is the old version.&lt;/p&gt;

&lt;p&gt;I doubt :&lt;br/&gt;
When we update ChunkManage to version 29363|1, calculateConfigDiff read chunks info from config server , But first read the old version of ChunkX 29362|0, then the updates of step 1 happens, then read the new version of ChunkY 29363|1.&lt;/p&gt;

&lt;p&gt;How to resolve:&lt;br/&gt;
when retry 3 times of &apos;conf-&amp;gt;getChunkManager( ns , true )&apos; in CheckShardVersion, use forceload for getChunkManager.&lt;/p&gt;


&lt;p&gt;Hope your replies. Thank you!&lt;/p&gt;</description>
                <environment>Linux 2.6</environment>
        <key id="98415">SERVER-11697</key>
            <summary>Mongos crash when moveChunk</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="3">Duplicate</resolution>
                                        <assignee username="-1">Unassigned</assignee>
                                    <reporter username="hustchensi">chensi</reporter>
                        <labels>
                    </labels>
                <created>Thu, 14 Nov 2013 09:06:11 +0000</created>
                <updated>Wed, 10 Dec 2014 23:07:09 +0000</updated>
                            <resolved>Wed, 21 May 2014 19:28:17 +0000</resolved>
                                    <version>2.2.4</version>
                                                    <component>Sharding</component>
                                        <votes>3</votes>
                                    <watches>8</watches>
                                                                                                                <comments>
                            <comment id="592079" author="ramon.fernandez" created="Wed, 21 May 2014 19:25:58 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=hustchensi&quot; class=&quot;user-hover&quot; rel=&quot;hustchensi&quot;&gt;hustchensi&lt;/a&gt;, in &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-13089&quot; title=&quot;setShardVersion failed host&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-13089&quot;&gt;&lt;del&gt;SERVER-13089&lt;/del&gt;&lt;/a&gt; an issue that looks very similar to this one is reported as fixed after an upgrade to 2.4.9, so I would recommend you to upgrade to at least 2.4.9, but preferably to 2.4.10.&lt;/p&gt;

&lt;p&gt;I am going to close this ticket now, but if the issue persists after upgrading to a 2.4 release, please re-open this ticket or open a new one.&lt;/p&gt;</comment>
                            <comment id="507932" author="kekefish8" created="Mon, 3 Mar 2014 12:26:57 +0000"  >&lt;p&gt;HI,I also face  this issue&#12290;It happened for four times this month&#12290;&lt;br/&gt;
this error msg:&lt;br/&gt;
setShardVersion failed host: mongo4.mcloud.139.com:20004 &lt;/p&gt;
{ oldVersion: Timestamp 0|0, oldVersionEpoch: ObjectId(&apos;000000000000000000000000&apos;), ns: &quot;mcloud.m_iosyncdetaillog&quot;, version: Timestamp 560000|381, versionEpoch: ObjectId(&apos;51d37afa0b8c2dd3569f5ed6&apos;), globalVersion: Timestamp 561000|0, globalVersionEpoch: ObjectId(&apos;51d37afa0b8c2dd3569f5ed6&apos;), reloadConfig: true, errmsg: &quot;shard global version for collection is higher than trying to set to &apos;mcloud.m_iosyncdetaillog&apos;&quot;, ok: 0.0 }

&lt;p&gt;cause by &quot;One mongos crashed when moveChunk jobs were running. The moveChunk jobs were created one by one on the another mongos node manually&quot; ???  who can reply it? &lt;br/&gt;
thank you...&lt;/p&gt;</comment>
                            <comment id="458296" author="licen" created="Tue, 19 Nov 2013 03:42:35 +0000"  >&lt;p&gt;@Eliot, yes,  the mongos crashed.  Here are some additional infos of this issue:&lt;/p&gt;

&lt;p&gt;1. the cluster topology for this issue: 2 mongos nodes, several replica sets.  &lt;/p&gt;

&lt;p&gt;2. One mongos crashed when moveChunk jobs were running.  The moveChunk jobs were created one by one on the another mongos node manually. &lt;/p&gt;

&lt;p&gt;3. It happened for several times, and should be reproduceable. &lt;/p&gt;

&lt;p&gt;4. chensi has attached the mongos log and the gdb bt info. And if needed we can provide you the coredump file. Let me know if you want any other detail.&lt;/p&gt;

&lt;p&gt;appreciate your reply. thanks a lot&lt;/p&gt;

</comment>
                            <comment id="458252" author="hustchensi" created="Tue, 19 Nov 2013 01:41:20 +0000"  >&lt;p&gt;Crashed with a coredump file&lt;/p&gt;</comment>
                            <comment id="457920" author="eliot" created="Mon, 18 Nov 2013 17:59:06 +0000"  >&lt;p&gt;Did the mongos process actually crash, or just have an error?&lt;/p&gt;</comment>
                            <comment id="457658" author="hustchensi" created="Mon, 18 Nov 2013 05:37:34 +0000"  >&lt;p&gt;I guess one of the reason is :&lt;br/&gt;
When calculateConfigDiff read chunks info from config server , mongod is updating chunks ( two chunks for moveChunk).&lt;/p&gt;</comment>
                            <comment id="457656" author="hustchensi" created="Mon, 18 Nov 2013 05:26:18 +0000"  >&lt;p&gt;the log around the crash time is attached above.&lt;/p&gt;</comment>
                            <comment id="457655" author="hustchensi" created="Mon, 18 Nov 2013 05:22:25 +0000"  >&lt;p&gt;gdb bt output:&lt;br/&gt;
#0  0x000000302c805f4f in ?? () from /lib64/libgcc_s.so.1&lt;br/&gt;
#1  0x000000302c806df7 in _Unwind_Backtrace () from /lib64/libgcc_s.so.1&lt;br/&gt;
#2  0x000000302afd73cf in backtrace () from /lib64/tls/libc.so.6&lt;br/&gt;
#3  0x000000000074d290 in formattedBacktrace (signalNum=11) at src/mongo/util/signal_handlers.cpp:93&lt;br/&gt;
#4  mongo::printStackAndExit (signalNum=11) at src/mongo/util/signal_handlers.cpp:115&lt;br/&gt;
#5  &amp;lt;signal handler called&amp;gt;&lt;br/&gt;
#6  0x000000302c805f4f in ?? () from /lib64/libgcc_s.so.1&lt;br/&gt;
#7  0x000000302c806df7 in _Unwind_Backtrace () from /lib64/libgcc_s.so.1&lt;br/&gt;
#8  0x000000302afd73cf in backtrace () from /lib64/tls/libc.so.6&lt;br/&gt;
#9  0x000000000074e663 in mongo::printStackTrace (os=...) at src/mongo/util/stacktrace.cpp:38&lt;br/&gt;
#10 0x000000000071af94 in mongo::msgasserted (msgid=10429, &lt;br/&gt;
    msg=0x7eff4c816a18 &quot;setShardVersion failed host: 10.38.171.25:7111 { oldVersion: Timestamp 29362000|0, oldVersionEpoch: ObjectId(&apos;522ad499e1814e603d11be30&apos;), ns: \&quot;appid250528.meta_infos0\&quot;, version: Timestamp 29362000|0, &quot;...)&lt;br/&gt;
    at src/mongo/util/assert_util.cpp:153&lt;br/&gt;
#11 0x000000000071b01c in mongo::msgasserted (msgid=&amp;lt;value optimized out&amp;gt;, msg=&amp;lt;value optimized out&amp;gt;)&lt;br/&gt;
    at src/mongo/util/assert_util.cpp:145&lt;br/&gt;
#12 0x00000000006cd579 in mongo::checkShardVersion (conn_in=0x7eff59195b80, ns=..., refManager=..., &lt;br/&gt;
    authoritative=true, tryNumber=7) at src/mongo/s/shard_version.cpp:285&lt;br/&gt;
#13 0x00000000006ccd04 in mongo::checkShardVersion (conn_in=0x7eff59195b80, ns=..., refManager=..., &lt;br/&gt;
    authoritative=true, tryNumber=6) at src/mongo/s/shard_version.cpp:279&lt;br/&gt;
#14 0x00000000006ccd04 in mongo::checkShardVersion (conn_in=0x7eff59195b80, ns=..., refManager=..., &lt;br/&gt;
    authoritative=true, tryNumber=5) at src/mongo/s/shard_version.cpp:279&lt;br/&gt;
#15 0x00000000006ccd04 in mongo::checkShardVersion (conn_in=0x7eff59195b80, ns=..., refManager=..., &lt;br/&gt;
 authoritative=true, tryNumber=4) at src/mongo/s/shard_version.cpp:279&lt;br/&gt;
#16 0x00000000006ccd04 in mongo::checkShardVersion (conn_in=0x7eff59195b80, ns=..., refManager=..., &lt;br/&gt;
    authoritative=true, tryNumber=3) at src/mongo/s/shard_version.cpp:279&lt;br/&gt;
#17 0x00000000006ccd04 in mongo::checkShardVersion (conn_in=0x7eff59195b80, ns=..., refManager=..., &lt;br/&gt;
    authoritative=true, tryNumber=2) at src/mongo/s/shard_version.cpp:279&lt;br/&gt;
#18 0x00000000006ccbdb in mongo::checkShardVersion (conn_in=0x7eff59195b80, ns=..., refManager=..., &lt;br/&gt;
    authoritative=false, tryNumber=1) at src/mongo/s/shard_version.cpp:253&lt;br/&gt;
#19 0x00000000006cd6bc in mongo::VersionManager::checkShardVersionCB (this=&amp;lt;value optimized out&amp;gt;, &lt;br/&gt;
    conn_in=0x7eff54b81900, authoritative=false, tryNumber=1) at src/mongo/s/shard_version.cpp:294&lt;br/&gt;
#20 0x00000000006ced23 in mongo::ShardConnection::_finishInit (this=0x7eff54b81900)&lt;br/&gt;
    at src/mongo/s/shardconnection.cpp:336&lt;br/&gt;
#21 0x000000000058c48b in setVersion (this=0x7eff50acc380, state=..., shard=&amp;lt;value optimized out&amp;gt;, &lt;br/&gt;
    primary=&amp;lt;value optimized out&amp;gt;, ns=&amp;lt;value optimized out&amp;gt;, vinfo=..., manager=...)&lt;br/&gt;
    at src/mongo/client/../s/shard.h:266&lt;br/&gt;
#22 mongo::ParallelSortClusteredCursor::setupVersionAndHandleSlaveOk (this=0x7eff50acc380, state=..., &lt;br/&gt;
    shard=&amp;lt;value optimized out&amp;gt;, primary=&amp;lt;value optimized out&amp;gt;, ns=&amp;lt;value optimized out&amp;gt;, vinfo=..., manager=...)&lt;br/&gt;
    at src/mongo/client/parallel.cpp:736&lt;br/&gt;
#23 0x000000000059a15c in mongo::ParallelSortClusteredCursor::startInit (this=0x7eff50acc380)&lt;br/&gt;
    at src/mongo/client/parallel.cpp:894&lt;br/&gt;
#24 0x000000000059e2c9 in mongo::ParallelSortClusteredCursor::fullInit (this=0x7eff50acc380)&lt;br/&gt;
    at src/mongo/client/parallel.cpp:654&lt;br/&gt;
#25 0x00000000006def9c in mongo::ShardStrategy::queryOp(mongo::Request&amp;amp;) ()&lt;br/&gt;
#26 0x00000000006c3918 in mongo::Request::process (this=0x674cae20, attempt=0) at src/mongo/s/request.cpp:140&lt;br/&gt;
#27 0x000000000053ed92 in mongo::ShardedMessageHandler::process (this=&amp;lt;value optimized out&amp;gt;, m=..., p=0x7eff55e6c700, &lt;br/&gt;
    le=0x7eff55cc3380) at src/mongo/s/server.cpp:104&lt;br/&gt;
#28 0x000000000073cc31 in mongo::pms::threadRun (inPort=0x7eff55e6c700)&lt;br/&gt;
    at src/mongo/util/net/message_server_port.cpp:85&lt;br/&gt;
#29 0x000000302b80610a in start_thread () from /lib64/tls/libpthread.so.0&lt;br/&gt;
#30 0x000000302afc6003 in clone () from /lib64/tls/libc.so.6&lt;br/&gt;
#31 0x0000000000000000 in ?? ()&lt;/p&gt;</comment>
                            <comment id="457648" author="eliot" created="Mon, 18 Nov 2013 04:24:15 +0000"  >&lt;p&gt;Is there a stack trace or something else you can send?&lt;br/&gt;
Hard to tell much from this.&lt;br/&gt;
The full log would be great.&lt;/p&gt;</comment>
                            <comment id="457632" author="hustchensi" created="Mon, 18 Nov 2013 03:06:29 +0000"  >&lt;p&gt;can anybody help me?&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10010">
                    <name>Duplicate</name>
                                                                <inwardlinks description="is duplicated by">
                                        <issuelink>
            <issuekey id="118552">SERVER-13089</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                            <outwardlinks description="related to">
                                        <issuelink>
            <issuekey id="118552">SERVER-13089</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                            <attachment id="33994" name="core.log" size="18219" author="hustchensi" created="Mon, 18 Nov 2013 05:25:47 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>10.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Mon, 18 Nov 2013 04:24:15 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        9 years, 39 weeks ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            9 years, 39 weeks ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10000" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Old_Backport</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10000"><![CDATA[No]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>licen</customfieldvalue>
            <customfieldvalue>hustchensi</customfieldvalue>
            <customfieldvalue>eliot</customfieldvalue>
            <customfieldvalue>kekefish8</customfieldvalue>
            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrm7jr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hrwlfb:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>104205</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hsp52n:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>