<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 04:53:55 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-40061] Chunk move fails due to DuplicateKey error on the `config.chunks` collection at migration commit</title>
                <link>https://jira.mongodb.org/browse/SERVER-40061</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;The ChunkType::genID method uses the BSONElement::toString method, which was &lt;a href=&quot;https://github.com/mongodb/mongo/blob/64bd01c/src/mongo/s/catalog/sharding_catalog_manager_chunk_operations.cpp#L187&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;changed&lt;/a&gt; to provide a better formatting for UUID BinData. Unfortunately, the ChunkType::genID is used all around sharding-related code as a value of &quot;_id&quot; field in &quot;config.chunks&quot; collection. When the chunk minimum field has a value that is an UUID, the value of &quot;_id&quot; for v3.6 and v3.4 (and previous versions) differ.&lt;/p&gt;

&lt;p&gt;We&apos;ve hit it when trying to move chunks manually in a cluser we recently moved from v3.4 to v3.6:&lt;/p&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-10T16:54:39.264+0300 I COMMAND  [conn469729] command admin.$cmd appName: &quot;MongoDB Shell&quot; command: _configsvrMoveChunk { _configsvrMoveChunk: 1, _id: &quot;a.fs.chunks-files_id_UUID(&quot;05660000-0000-e000-96c2-dc81ca6fa911&quot;)n_0&quot;, ns: &quot;a.fs.chunks&quot;, min: { files_id: UUID(&quot;05660000-0000-e000-96c2-dc81ca6fa911&quot;), n: 0 }, max: { files_id: UUID(&quot;05666100-0000-e000-9252-7b82dea0b186&quot;), n: 3 }, shard: &quot;driveFS-2&quot;, lastmod: Timestamp(571033, 1), lastmodEpoch: ObjectId(&apos;51793868331d54dfcf8e0032&apos;), toShard: &quot;driveFS-17&quot;, maxChunkSizeBytes: 536870912, secondaryThrottle: {}, waitForDelete: false, writeConcern: { w: &quot;majority&quot;, wtimeout: 15000 }, lsid: { id: UUID(&quot;605f316b-6296-4010-9f26-835b60f923ff&quot;), uid: BinData(0, EE3A53D0CA965E6112DBEBF842D31DC81E8CE7E7548256DE28D08422B2C59D3B) }, $replData: 1, $clusterTime: { clusterTime: Timestamp(0, 0), signature: { hash: BinData(0, 0000000000000000000000000000000000000000), keyId:0 } }, $client: { application: { name: &quot;MongoDB Shell&quot; }, driver: { name: &quot;MongoDB Internal Client&quot;, version: &quot;3.6.9&quot; }, os: { type: &quot;Windows&quot;, name: &quot;Microsoft Windows 10&quot;, architecture: &quot;x86_64&quot;, version: &quot;10.0 (build 17134)&quot; }, mongos: { host: &quot;dorado2:27017&quot;,client: &quot;10.254.3.70:1334&quot;, version: &quot;3.6.10&quot; } }, $configServerState: { opTime: { ts: Timestamp(1552225736, 38), t: 95 } }, $db: &quot;admin&quot; } exception: Chunk move was not successful due to E11000 duplicate key error collection: config.chunks index: ns_1_min_1 dup key: { : &quot;a.fs.chunks&quot;, : { files_id: UUID(&quot;05660000-0000-e000-96c2-dc81ca6fa911&quot;), n: 0 } } code:DuplicateKey numYields:0 reslen:562 locks:{ Global: { acquireCount: { r: 10, w: 6 } }, Database: { acquireCount: { r: 2, w: 6 } }, Collection: { acquireCount: { r: 2,w: 3 } }, oplog: { acquireCount: { w: 3 } } } protocol:op_msg 340766ms&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;Of course, the &quot;config.chunks&quot; collection contains this:&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;&amp;gt; db.chunks.find({ns:&quot;a.fs.chunks&quot;,min: { files_id: UUID(&quot;05660000-0000-e000-96c2-dc81ca6fa911&quot;), n: 0 } })&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{ &quot;_id&quot; : &quot;a.fs.chunks-files_id_BinData(4, 056600000000E00096C2DC81CA6FA911)n_0&quot;, &quot;lastmod&quot; : Timestamp(539637, 1290), &quot;lastmodEpoch&quot; : ObjectId(&quot;51793868331d54dfcf8e0032&quot;), &quot;ns&quot; : &quot;a.fs.chunks&quot;, &quot;min&quot; : { &quot;files_id&quot; : UUID(&quot;05660000-0000-e000-96c2-dc81ca6fa911&quot;), &quot;n&quot; : 0 }, &quot;max&quot; : { &quot;files_id&quot; : UUID(&quot;05666100-0000-e000-9252-7b82dea0b186&quot;), &quot;n&quot; : 3 }, &quot;shard&quot; : &quot;driveFS-2&quot; }&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;Since I do not know what other operations are using the &quot;_id&quot; field, I cannot estimate the true potential of this problem, but cursory inspection of the codebase shows there are at least some places where the update is performed without checking the number of matched/modified documents, so it may be the case that the metadata (I mean the chunk structure) could be lost/damaged silently.&lt;/p&gt;</description>
                <environment></environment>
        <key id="714419">SERVER-40061</key>
            <summary>Chunk move fails due to DuplicateKey error on the `config.chunks` collection at migration commit</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="3">Duplicate</resolution>
                                        <assignee username="kaloian.manassiev@mongodb.com">Kaloian Manassiev</assignee>
                                    <reporter username="onyxmaster">Aristarkh Zagorodnikov</reporter>
                        <labels>
                    </labels>
                <created>Sun, 10 Mar 2019 15:06:17 +0000</created>
                <updated>Fri, 9 Aug 2019 12:35:04 +0000</updated>
                            <resolved>Fri, 9 Aug 2019 12:34:02 +0000</resolved>
                                    <version>3.6.10</version>
                                                    <component>Sharding</component>
                                        <votes>1</votes>
                                    <watches>19</watches>
                                                                                                                <comments>
                            <comment id="2364371" author="kaloian.manassiev" created="Fri, 9 Aug 2019 12:35:04 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=chenjian%40tmxmall.com&quot; class=&quot;user-hover&quot; rel=&quot;chenjian@tmxmall.com&quot;&gt;chenjian@tmxmall.com&lt;/a&gt;, let&apos;s continue the conversation in &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-42734&quot; title=&quot;when start shard and the error:DuplicateKey: E11000 duplicate key error collection: config.cache.chunks&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-42734&quot;&gt;&lt;del&gt;SERVER-42734&lt;/del&gt;&lt;/a&gt;.&lt;/p&gt;</comment>
                            <comment id="2364370" author="kaloian.manassiev" created="Fri, 9 Aug 2019 12:33:33 +0000"  >&lt;blockquote&gt;&lt;p&gt;We &quot;fixed&quot; the issue by stopping the balancer and rewriting the chunks collection manually, fixing the IDs.&lt;/p&gt;&lt;/blockquote&gt;
&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=onyxmaster&quot; class=&quot;user-hover&quot; rel=&quot;onyxmaster&quot;&gt;onyxmaster&lt;/a&gt;, these are the correct workaround steps for the situation that your cluster ended up in. This is a side effect of &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-8829&quot; title=&quot;String representation for chunk id is not unique&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-8829&quot;&gt;&lt;del&gt;SERVER-8829&lt;/del&gt;&lt;/a&gt;, which causes the _ids of the chunks collection to be string representation of the shard key&apos;s BSON, which is not always unique.&lt;/p&gt;

&lt;p&gt;We recently fixed it in the current master branch (4.3 as of now) and will be exploring whether it is possible to backport it to earlier releases.&lt;/p&gt;

&lt;p&gt;Apologies again for the inconvenience and for the time it took.&lt;/p&gt;</comment>
                            <comment id="2364366" author="chenjian@tmxmall.com" created="Fri, 9 Aug 2019 12:29:42 +0000"  >&lt;p&gt;Thank you, here is the new ticket: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-42734&quot; title=&quot;when start shard and the error:DuplicateKey: E11000 duplicate key error collection: config.cache.chunks&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-42734&quot;&gt;&lt;del&gt;SERVER-42734&lt;/del&gt;&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="2364329" author="chenjian@tmxmall.com" created="Fri, 9 Aug 2019 12:12:05 +0000"  >&lt;p&gt;Thank you for your reply, at the beginning, our problem like this Issue: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-11421&quot; title=&quot;Config server does not invalidate the config.chunks cache&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-11421&quot;&gt;&lt;del&gt;SERVER-11421&lt;/del&gt;&lt;/a&gt;, we got the error log and it didn&apos;t stop, and make our disk out of memory.&lt;/p&gt;

&lt;p&gt;Now one of the primary shard is down and can not start again, could tell me the method to start the stopped shard?&lt;/p&gt;</comment>
                            <comment id="2364316" author="onyxmaster" created="Fri, 9 Aug 2019 12:00:44 +0000"  >&lt;p&gt;We &quot;fixed&quot; the issue by stopping the balancer and rewriting the chunks collection manually, fixing the IDs.&lt;/p&gt;</comment>
                            <comment id="2364290" author="kaloian.manassiev" created="Fri, 9 Aug 2019 11:49:38 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=chenjian%40tmxmall.com&quot; class=&quot;user-hover&quot; rel=&quot;chenjian@tmxmall.com&quot;&gt;chenjian@tmxmall.com&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;My investigation so far has concluded that the issue originally reported here is related to &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-8829&quot; title=&quot;String representation for chunk id is not unique&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-8829&quot;&gt;&lt;del&gt;SERVER-8829&lt;/del&gt;&lt;/a&gt;, which causes two chunks to have duplicated _id value, which fails the committing of the migrated chunk on the primary, but never makes it into the oplog. Also it seems to be specific to GridFS chunks which have UUIDs as shard keys and I am currently working on finding out a workaround.&lt;/p&gt;

&lt;p&gt;The case that you reported seems to be happening on the routing metadata cache collections and during replication startup recovery, so it is likely a different issue. Would it be possible to create a separate ticket and to include the complete latest mongod log of the node you are trying to start?&lt;/p&gt;

&lt;p&gt;Best regards,&lt;br/&gt;
-Kal.&lt;/p&gt;</comment>
                            <comment id="2364289" author="chenjian@tmxmall.com" created="Fri, 9 Aug 2019 11:49:12 +0000"  >&lt;p&gt;Thank you for your reply, at the beginning, our promble like this Issue:&lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-11421&quot; class=&quot;external-link&quot; rel=&quot;nofollow&quot;&gt;https://jira.mongodb.org/browse/SERVER-11421&lt;/a&gt;, we got the error log and it didn&apos;t stop, and make our disk out of memory.&lt;br/&gt;
&#160;&lt;br/&gt;
Now one of the primary shard is down and can not start again, could tell me the method to start the stopped shard?&lt;/p&gt;</comment>
                            <comment id="2364274" author="chenjian@tmxmall.com" created="Fri, 9 Aug 2019 11:23:28 +0000"  >&lt;p&gt;I also find this promble in version 4.0.9. I can&apos;t start my shard, and I get the following error information:&lt;/p&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;[repl writer worker 5] writer worker caught exception: DuplicateKey: E11000 duplicate key error collection: config.cache.chunks.pr_tmxbase.toffs_6.chunks index: _id_ dup key: \{ : { files_id: -8792944871971349461 } } on: \{ op: &quot;i&quot;, ns: &quot;config.cache.chunks.pr_tmxbase.toffs_6.chunks&quot;, ui: UUID(&quot;03c48aff-f98b-4de3-bb08-3248ab7b588f&quot;), o: { _id: { files_id: -8792944871971349461 }, max: \{ files_id: -8700326615160610030 }, shard: &quot;prodShard1&quot;, lastmod: Timestamp(98, 0), history: [ \{ validAfter: Timestamp(1564563326, 26), shard: &quot;prodShard1&quot; } ] }, ts: Timestamp(1565335484, 137), t: 7, h: -6045188019592284924, v: 2, wall: new Date(1565335484859) }&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-08-09T18:50:07.622+0800 F REPL [initandlisten] Failed to apply batch of operations. Number of operations in batch: 4229. First operation: \{ op: &quot;n&quot;, ns: &quot;&quot;, o: { msg: &quot;new primary&quot; }, ts: Timestamp(1565335398, 2), t: 7, h: -153190637679831346, v: 2, wall: new Date(1565335398497) }. Last operation: \{ op: &quot;i&quot;, ns: &quot;pr_tmxbase.stfs_2.chunks&quot;, ui: UUID(&quot;78d50f72-a565-4a31-be18-2354f730743f&quot;), o: { _id: ObjectId(&apos;5d4d1fc44ef55e38430807eb&apos;), files_id: &quot;3f05ae47e29a0704c7407a8c3bdf9df4&quot;, n: 23, data: BinData(0, 693D22687474703A2F2F7777772E77332E6F72672F323030312F584D4C536368656D612D696E7374616E63652220786D6C6E733A7873643D22687474703A2F2F7777772E7733...) }, ts: Timestamp(1565335492, 11), t: 7, h: -791270771233656130, v: 2, wall: new Date(1565335492057) }. Oplog application failed in writer thread 11: DuplicateKey: E11000 duplicate key error collection: config.cache.chunks.pr_tmxbase.toffs_6.chunks index: _id_ dup key: \{ : { files_id: -8792944871971349461 } }&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-08-09T18:50:07.624+0800 F REPL [initandlisten] Caught exception during replication recovery: DuplicateKey: E11000 duplicate key error collection: config.cache.chunks.pr_tmxbase.toffs_6.chunks index: _id_ dup key: \{ : { files_id: -8792944871971349461 } }&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-08-09T18:50:07.625+0800 F - [initandlisten] terminate() called. An exception is active; attempting to gather more information&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-08-09T18:50:07.634+0800 F - [initandlisten] DBException::toString(): DuplicateKey: E11000 duplicate key error collection: config.cache.chunks.pr_tmxbase.toffs_6.chunks index: _id_ dup key: \{ : { files_id: -8792944871971349461 } }&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;Actual exception type: mongo::error_details::ExceptionForImpl&amp;lt;(mongo::ErrorCodes::Error)11000, mongo::AssertionException&amp;gt;&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; 0x5634a5f505e1 0x5634a5f4ffc5 0x5634a6044a46 0x5634a6044a91 0x5634a4841c3f 0x5634a487bf1c 0x5634a487c7e7 0x5634a45be20c 0x5634a45c09ff 0x5634a45522e9 0x7fb3ab98e830 0x5634a45bb3d9&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;----- BEGIN BACKTRACE -----&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;backtrace&quot;:[\{&quot;b&quot;:&quot;5634A3B34000&quot;,&quot;o&quot;:&quot;241C5E1&quot;,&quot;s&quot;:&quot;_ZN5mongo15printStackTraceERSo&quot;},\{&quot;b&quot;:&quot;5634A3B34000&quot;,&quot;o&quot;:&quot;241BFC5&quot;},\{&quot;b&quot;:&quot;5634A3B34000&quot;,&quot;o&quot;:&quot;2510A46&quot;,&quot;s&quot;:&quot;_ZN10__cxxabiv111__terminateEPFvvE&quot;},\{&quot;b&quot;:&quot;5634A3B34000&quot;,&quot;o&quot;:&quot;2510A91&quot;},\{&quot;b&quot;:&quot;5634A3B34000&quot;,&quot;o&quot;:&quot;D0DC3F&quot;,&quot;s&quot;:&quot;_ZN5mongo4repl23ReplicationRecoveryImpl16recoverFromOplogEPNS_16OperationContextEN5boost8optionalINS_9TimestampEEE&quot;},\{&quot;b&quot;:&quot;5634A3B34000&quot;,&quot;o&quot;:&quot;D47F1C&quot;,&quot;s&quot;:&quot;_ZN5mongo4repl26ReplicationCoordinatorImpl21_startLoadLocalConfigEPNS_16OperationContextE&quot;},\{&quot;b&quot;:&quot;5634A3B34000&quot;,&quot;o&quot;:&quot;D487E7&quot;,&quot;s&quot;:&quot;_ZN5mongo4repl26ReplicationCoordinatorImpl7startupEPNS_16OperationContextE&quot;},\{&quot;b&quot;:&quot;5634A3B34000&quot;,&quot;o&quot;:&quot;A8A20C&quot;},\{&quot;b&quot;:&quot;5634A3B34000&quot;,&quot;o&quot;:&quot;A8C9FF&quot;,&quot;s&quot;:&quot;_ZN5mongo11mongoDbMainEiPPcS1_&quot;},\{&quot;b&quot;:&quot;5634A3B34000&quot;,&quot;o&quot;:&quot;A1E2E9&quot;,&quot;s&quot;:&quot;main&quot;},\{&quot;b&quot;:&quot;7FB3AB96E000&quot;,&quot;o&quot;:&quot;20830&quot;,&quot;s&quot;:&quot;__libc_start_main&quot;},\{&quot;b&quot;:&quot;5634A3B34000&quot;,&quot;o&quot;:&quot;A873D9&quot;,&quot;s&quot;:&quot;_start&quot;}],&quot;processInfo&quot;:\{ &quot;mongodbVersion&quot; : &quot;4.0.9&quot;, &quot;gitVersion&quot; : &quot;fc525e2d9b0e4bceff5c2201457e564362909765&quot;, &quot;compiledModules&quot; : [], &quot;uname&quot; : { &quot;sysname&quot; : &quot;Linux&quot;, &quot;release&quot; : &quot;4.4.0-91-generic&quot;, &quot;version&quot; : &quot;#114-Ubuntu SMP Tue Aug 8 11:56:56 UTC 2017&quot;, &quot;machine&quot; : &quot;x86_64&quot; }, &quot;somap&quot; : [ \{ &quot;b&quot; : &quot;5634A3B34000&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;D363637D8649A86A028650E1AE31DD0CCF80723C&quot; }, \{ &quot;b&quot; : &quot;7FFFA4FE6000&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;735D8C7F1005D2D0E443E551BEA48FD5091211DF&quot; }, \{ &quot;b&quot; : &quot;7FB3AD148000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libcurl.so.4&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;5C1A06A89F89E1ADAAA507BC5580C0A7931B0AB2&quot; }, \{ &quot;b&quot; : &quot;7FB3ACF2D000&quot;, &quot;path&quot; : &quot;/lib/x86_64-linux-gnu/libresolv.so.2&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;6EF73266978476EF9F2FD2CF31E57F4597CB74F8&quot; }, \{ &quot;b&quot; : &quot;7FB3ACAE9000&quot;, &quot;path&quot; : &quot;/lib/x86_64-linux-gnu/libcrypto.so.1.0.0&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;B467957BF7E767DD5C0CA92213C2DAF0182765D2&quot; }, \{ &quot;b&quot; : &quot;7FB3AC880000&quot;, &quot;path&quot; : &quot;/lib/x86_64-linux-gnu/libssl.so.1.0.0&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;5A9B9023B6E9ABCEE21DADDB95EF096F505E9E67&quot; }, \{ &quot;b&quot; : &quot;7FB3AC67C000&quot;, &quot;path&quot; : &quot;/lib/x86_64-linux-gnu/libdl.so.2&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;8CC8D0D119B142D839800BFF71FB71E73AEA7BD4&quot; }, \{ &quot;b&quot; : &quot;7FB3AC474000&quot;, &quot;path&quot; : &quot;/lib/x86_64-linux-gnu/librt.so.1&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;89C34D7A182387D76D5CDA1F7718F5D58824DFB3&quot; }, \{ &quot;b&quot; : &quot;7FB3AC16B000&quot;, &quot;path&quot; : &quot;/lib/x86_64-linux-gnu/libm.so.6&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;DFB85DE42DAFFD09640C8FE377D572DE3E168920&quot; }, \{ &quot;b&quot; : &quot;7FB3ABF55000&quot;, &quot;path&quot; : &quot;/lib/x86_64-linux-gnu/libgcc_s.so.1&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;68220AE2C65D65C1B6AAA12FA6765A6EC2F5F434&quot; }, \{ &quot;b&quot; : &quot;7FB3ABD38000&quot;, &quot;path&quot; : &quot;/lib/x86_64-linux-gnu/libpthread.so.0&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;CE17E023542265FC11D9BC8F534BB4F070493D30&quot; }, \{ &quot;b&quot; : &quot;7FB3AB96E000&quot;, &quot;path&quot; : &quot;/lib/x86_64-linux-gnu/libc.so.6&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;B5381A457906D279073822A5CEB24C4BFEF94DDB&quot; }, \{ &quot;b&quot; : &quot;7FB3AD3B7000&quot;, &quot;path&quot; : &quot;/lib64/ld-linux-x86-64.so.2&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;5D7B6259552275A3C17BD4C3FD05F5A6BF40CAA5&quot; }, \{ &quot;b&quot; : &quot;7FB3AB73B000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libidn.so.11&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;F3945D210B52CC973C619CCD08C4394BBC33E07F&quot; }, \{ &quot;b&quot; : &quot;7FB3AB51F000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/librtmp.so.1&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;8D1CC1204D6B6D33BD1D2C5A2A0516A2234322CF&quot; }, \{ &quot;b&quot; : &quot;7FB3AB2D5000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;54EB3E674DB58B5BAEF009CBC4AB02CCF5386CA7&quot; }, \{ &quot;b&quot; : &quot;7FB3AB0C6000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/liblber-2.4.so.2&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;213C3A6756470FF961EE7FD63BAC177BC6B72A49&quot; }, \{ &quot;b&quot; : &quot;7FB3AAE75000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libldap_r-2.4.so.2&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;698C15E7BD2CD96618583CADC6EBCE07B293CEB2&quot; }, \{ &quot;b&quot; : &quot;7FB3AAC5B000&quot;, &quot;path&quot; : &quot;/lib/x86_64-linux-gnu/libz.so.1&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;8D9BD4CE26E45EF16075C67D5F5EEAFD8B562832&quot; }, \{ &quot;b&quot; : &quot;7FB3AA92B000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libgnutls.so.30&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;213041D960C027C8C451F53B9B3143A901322015&quot; }, \{ &quot;b&quot; : &quot;7FB3AA6F8000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libhogweed.so.4&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;B11678F560199547DCF726384EA39153EE0DFABF&quot; }, \{ &quot;b&quot; : &quot;7FB3AA4C2000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libnettle.so.6&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;D6B36C5A463EE0FA84FDD6D5FD3F7726EDB90D54&quot; }, \{ &quot;b&quot; : &quot;7FB3AA242000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libgmp.so.10&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;7B3533D5998D20EE1A1BE3F87789B69041E7F620&quot; }, \{ &quot;b&quot; : &quot;7FB3A9F70000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libkrb5.so.3&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;D60D5A759577E5C477314520EF3D13BDBAED5111&quot; }, \{ &quot;b&quot; : &quot;7FB3A9D41000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libk5crypto.so.3&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;09FA442048F4AA6E701F0B504FEB688F09618E30&quot; },\{ &quot;b&quot; : &quot;7FB3A9B3D000&quot;, &quot;path&quot; : &quot;/lib/x86_64-linux-gnu/libcom_err.so.2&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;1E16CB57F699E215A2A8D4EFEF90883BC749B12D&quot; }, \{ &quot;b&quot; : &quot;7FB3A9932000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libkrb5support.so.0&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;00DFFD025B1AEBFD619FAE9DE01610BA6F209367&quot; }, \{ &quot;b&quot; : &quot;7FB3A9717000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libsasl2.so.2&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;96BCC7EB28D81B1469EED6F24FC083CBD58577BC&quot; }, \{ &quot;b&quot; : &quot;7FB3A94D6000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libgssapi.so.3&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;1FE877BE52A424D0636AFD4D35BB330E41D6E0F3&quot; }, \{ &quot;b&quot; : &quot;7FB3A9271000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libp11-kit.so.0&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;2F170DCF36786FE91EB82D547A42B2DEE2E9DF81&quot; }, \{ &quot;b&quot; : &quot;7FB3A905E000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libtasn1.so.6&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;A6EE7754728D688B04095ACB34F1A071F99ED6C3&quot; }, \{ &quot;b&quot; : &quot;7FB3A8E5A000&quot;, &quot;path&quot; : &quot;/lib/x86_64-linux-gnu/libkeyutils.so.1&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;3364D4BF2113C4E8D17EF533867ECC99A53413D6&quot; }, \{ &quot;b&quot; : &quot;7FB3A8C51000&quot;, &quot;path&quot;: &quot;/usr/lib/x86_64-linux-gnu/libheimntlm.so.0&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;73A8EADBC85860662B24850E71D4AFBE22C33359&quot; }, \{ &quot;b&quot; : &quot;7FB3A89C7000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libkrb5.so.26&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;59E742306A4EA2872E061ECCE92F35FADDA75357&quot; }, \{ &quot;b&quot; : &quot;7FB3A8725000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libasn1.so.8&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;E5C159E415406AE79D21056D752BA949C408B5B1&quot; }, \{ &quot;b&quot; : &quot;7FB3A84F2000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libhcrypto.so.4&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;7D15576E1F096614D360784E4A01A1F5FAF908C9&quot; }, \{ &quot;b&quot; : &quot;7FB3A82DC000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libroken.so.18&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;481DB33C28D88E43DA6BED65E1A7599407D4D818&quot; }, \{ &quot;b&quot; : &quot;7FB3A80D4000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libffi.so.6&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;9D9C958F1F4894AFEF6AECD90D1C430EA29AC34F&quot; }, \{ &quot;b&quot; : &quot;7FB3A7EAB000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libwind.so.0&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;57E25072866B2D30CF02EBE7AE623B84F96FA700&quot; }, \{ &quot;b&quot; : &quot;7FB3A7C9C000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libheimbase.so.1&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;F6F1B4E9F89B716C4A0BA5819BDFFAF4A13EFB91&quot; }, \{ &quot;b&quot; : &quot;7FB3A7A51000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libhx509.so.5&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;C60082E3BB78D0D42868D9B359B89BF66CE5A1A7&quot; }, \{ &quot;b&quot; : &quot;7FB3A777C000&quot;, &quot;path&quot; : &quot;/usr/lib/x86_64-linux-gnu/libsqlite3.so.0&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;D9782BA023CAEC26B15D8676E3A5D07B55E121EF&quot; }, \{ &quot;b&quot; : &quot;7FB3A7544000&quot;, &quot;path&quot; : &quot;/lib/x86_64-linux-gnu/libcrypt.so.1&quot;, &quot;elfType&quot; : 3, &quot;buildId&quot; : &quot;7BDD51353D50310FFA1587E4AA01B40ABE32D582&quot; } ] }}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; mongod(_ZN5mongo15printStackTraceERSo+0x41) [0x5634a5f505e1]&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; mongod(+0x241BFC5) [0x5634a5f4ffc5]&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; mongod(_ZN10__cxxabiv111__terminateEPFvvE+0x6) [0x5634a6044a46]&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; mongod(+0x2510A91) [0x5634a6044a91]&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; mongod(_ZN5mongo4repl23ReplicationRecoveryImpl16recoverFromOplogEPNS_16OperationContextEN5boost8optionalINS_9TimestampEEE+0xC7F) [0x5634a4841c3f]&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; mongod(_ZN5mongo4repl26ReplicationCoordinatorImpl21_startLoadLocalConfigEPNS_16OperationContextE+0x54C) [0x5634a487bf1c]&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; mongod(_ZN5mongo4repl26ReplicationCoordinatorImpl7startupEPNS_16OperationContextE+0x237) [0x5634a487c7e7]&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; mongod(+0xA8A20C) [0x5634a45be20c]&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; mongod(_ZN5mongo11mongoDbMainEiPPcS1_+0xEDF) [0x5634a45c09ff]&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; mongod(main+0x9) [0x5634a45522e9]&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; libc.so.6(__libc_start_main+0xF0) [0x7fb3ab98e830]&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; mongod(_start+0x29) [0x5634a45bb3d9]&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;----- END BACKTRACE -----&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;</comment>
                            <comment id="2313349" author="onyxmaster" created="Fri, 5 Jul 2019 12:22:18 +0000"  >&lt;p&gt;It appears that automatic migrations of chunks that have UUIDs as keys doesn&apos;t work too. The chunk migrates, but commit fails with this:&lt;/p&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;Chunk move failed :: caused by :: DuplicateKey: Chunk move was not successful due to E11000 duplicate key error collection: config.chunks index: ns_1_min_1 dup key: { : &quot;moderation.fs.chunks&quot;, : { files_id: UUID(&quot;00ce8000-0000-e000-bc9b-abac0c772d7d&quot;), n: 0 } }&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;Is there any progress on this issue? Not being able to move chunks either manually or automatically will lead to shards running out of disk space. Is there any workaround available?&lt;/p&gt;</comment>
                            <comment id="2245709" author="onyxmaster" created="Tue, 14 May 2019 13:00:46 +0000"  >&lt;p&gt;Kaloian, thank you for returning back to this issue. I&apos;ve uploaded the fresh zipped dump of the cluster&apos;s config database to the location you provided.&lt;/p&gt;</comment>
                            <comment id="2245695" author="kaloian.manassiev" created="Tue, 14 May 2019 12:50:07 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=onyxmaster&quot; class=&quot;user-hover&quot; rel=&quot;onyxmaster&quot;&gt;onyxmaster&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;I apologise for the delay in looking into this issue. We started investigating it yesterday and found out that due to the time that has passed, the storage on which I saved the dump of the config server that you provided me has expired and the archive was deleted. I am going to have to ask you to please upload it again.&lt;/p&gt;

&lt;p&gt;To make it easier, I&#8217;ve created a &lt;a href=&quot;https://10gen-httpsupload.s3.amazonaws.com/upload_forms/4313c16c-109f-49c2-b28a-ad4734adc357.html&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;secure upload portal&lt;/a&gt; for you to use. Files uploaded to this portal are only visible to MongoDB employees investigating this issue and are routinely deleted after some time.&lt;/p&gt;

&lt;p&gt;Apologies again and many thanks for helping us investigate this issue!&lt;/p&gt;

&lt;p&gt;Best regards,&lt;br/&gt;
-Kal.&lt;/p&gt;</comment>
                            <comment id="2215734" author="daniel.hatcher" created="Tue, 16 Apr 2019 20:41:58 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=amardeepsg%40gmail.com&quot; class=&quot;user-hover&quot; rel=&quot;amardeepsg@gmail.com&quot;&gt;amardeepsg@gmail.com&lt;/a&gt;, we do not currently have a fix prepared but will update this ticket when we do. Regardless, we do not update patch versions like 3.6.7. If we do decide to backport a fix to 3.6, it would be to the latest 3.6.x version.&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;Also, what are the alternate ways for us to ensure shard data balancing, if empty chunks continue to exist and we cant merge them.&lt;/p&gt;&lt;/blockquote&gt;

&lt;p&gt;For advice on shard balancing, I encourage you to ask our community by posting on the &lt;a href=&quot;https://groups.google.com/group/mongodb-user&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;mongodb-user group&lt;/a&gt; or on &lt;a href=&quot;https://stackoverflow.com/questions/tagged/mongodb&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;Stack Overflow with the &lt;tt&gt;mongodb&lt;/tt&gt; tag&lt;/a&gt;.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;/p&gt;

&lt;p&gt;Danny&lt;/p&gt;</comment>
                            <comment id="2213370" author="amardeepsg@gmail.com" created="Mon, 15 Apr 2019 15:07:34 +0000"  >&lt;p&gt;Any change of this getting closed on 3.6.7?&#160; Also, what are the alternate ways for us to ensure shard data balancing, if empty chunks continue to exist and we cant merge them.&lt;/p&gt;</comment>
                            <comment id="2182386" author="onyxmaster" created="Sat, 16 Mar 2019 07:33:16 +0000"  >&lt;p&gt;Kaloian, thank you! I&apos;m feeling relieved knowing that there is no data loss involved. Thank you for investigating this, looking forward to the fix. I hope this gets backported to 3.6 too, since we&apos;re not yet ready to move to 4.x (at least until this summer).&lt;/p&gt;</comment>
                            <comment id="2182193" author="kaloian.manassiev" created="Fri, 15 Mar 2019 20:21:47 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=onyxmaster&quot; class=&quot;user-hover&quot; rel=&quot;onyxmaster&quot;&gt;onyxmaster&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Thank you very much for uploading your config server&apos;s metadata! Thanks to it I was able to reproduce the problem locally and now we have everything we need in order to continue investigating this issue, so feel free to remove the upload.&lt;/p&gt;

&lt;p&gt;For now I don&apos;t have anything to update, but we will post the results of the investigation here.&lt;/p&gt;

&lt;p&gt;Thanks again for your help!&lt;/p&gt;

&lt;p&gt;Best regards,&lt;br/&gt;
-Kal.&lt;/p&gt;

&lt;p&gt;PS: I also edited the ticket title to indicate that there is no actual data loss&lt;/p&gt;</comment>
                            <comment id="2176856" author="onyxmaster" created="Mon, 11 Mar 2019 13:13:12 +0000"  >&lt;p&gt;There is nothing specifically sensitive in this data, so I uploaded it at -&lt;a href=&quot;https://drive-public-eu.s3.amazonaws.com/mongodb/server-40061-config.zip-&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://drive-public-eu.s3.amazonaws.com/mongodb/server-40061-config.zip-&lt;/a&gt; (10MB). Still, I would like to not to keep it up longer than needed, so please tell me when you no longer need it to be online.&lt;/p&gt;</comment>
                            <comment id="2176839" author="kaloian.manassiev" created="Mon, 11 Mar 2019 12:56:48 +0000"  >&lt;p&gt;Thank you very much for the prompt response. From the message, this looks like a duplicate key that was generated in the &lt;tt&gt;ns, min&lt;/tt&gt; index, not the &lt;tt&gt;_id&lt;/tt&gt;.&lt;/p&gt;

&lt;p&gt;Would it be possible to attach a dump of your &lt;tt&gt;config&lt;/tt&gt; database so I can recreate the cluster (without data) and try the move command that you are issuing? If attaching it to this ticket poses any concern on your side, we can provide a secure upload portal to which only MongoDB employees have access.&lt;/p&gt;</comment>
                            <comment id="2176833" author="onyxmaster" created="Mon, 11 Mar 2019 12:51:41 +0000"  >&lt;p&gt;I&apos;d also like to note that this problem reproduces in 100% of the cases for our cluster that was upgraded from v3.4 &amp;#8211; all chunks that have UUID field in &quot;min&quot; key fail at migration commit every time. I believe splits are failing too, because I don&apos;t see any splits in logs after upgrade (although it might be I&apos;m looking in the wrong place since IIRC v3.6 moved a lot of chunk management onto shards themselves).&lt;/p&gt;</comment>
                            <comment id="2176829" author="onyxmaster" created="Mon, 11 Mar 2019 12:48:26 +0000"  >&lt;p&gt;As for my data loss concerns, the Balancer::_splitOrMarkJumbo will probably always silently fail marking chunks as jumbo (no data loss, yet suboptimal) and ShardingCatalogManager::commitChunkSplit will probably never be able to split chunk (not sure how the failure will be handled since it&apos;s an upsert).&lt;/p&gt;</comment>
                            <comment id="2176826" author="onyxmaster" created="Mon, 11 Mar 2019 12:42:55 +0000"  >&lt;p&gt;No, I&apos;m not using the internal command, I&apos;m issuing the sh.moveChunk command from shell (or the &quot;moveChunk&quot; command from our C# application). Consider the following log from one of the shard primaries:&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;...&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-10T16:54:38.231+0300 I SHARDING [conn788179] moveChunk data transfer progress: { waited: true, active: true, sessionId: &quot;driveFS-2_driveFS-17_5c8515ca7bc16fcff631675b&quot;, ns: &quot;a.fs.chunks&quot;, from: &quot;driveFS-2/d1.s2.fs.drive.bru:27022,d2.s2.fs.drive.bru:27022,d3.s2.fs.drive.bru:27022&quot;, min: { files_id: UUID(&quot;05660000-0000-e000-96c2-dc81ca6fa911&quot;), n: 0 }, max: { files_id: UUID(&quot;05666100-0000-e000-9252-7b82dea0b186&quot;), n: 3 }, shardKeyPattern: { files_id: 1.0, n: 1.0 }, state: &quot;clone&quot;, counts: { cloned: 2576, clonedBytes: 346861214, catchup: 0, steady: 0 }, ok: 1.0, $gleStats: { lastOpTime: Timestamp(0, 0), electionId: ObjectId(&apos;7fffffff000000000000000f&apos;) }, $configServerState: { opTime: { ts: Timestamp(1552226074, 5), t: 95 } } } mem used: 0 documents remaining to clone: 0&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-10T16:54:38.598+0300 I SHARDING [conn788179] moveChunk data transfer progress: { waited: true, active: true, sessionId: &quot;driveFS-2_driveFS-17_5c8515ca7bc16fcff631675b&quot;, ns: &quot;a.fs.chunks&quot;, from: &quot;driveFS-2/d1.s2.fs.drive.bru:27022,d2.s2.fs.drive.bru:27022,d3.s2.fs.drive.bru:27022&quot;, min: { files_id: UUID(&quot;05660000-0000-e000-96c2-dc81ca6fa911&quot;), n: 0 }, max: { files_id: UUID(&quot;05666100-0000-e000-9252-7b82dea0b186&quot;), n: 3 }, shardKeyPattern: { files_id: 1.0, n: 1.0 }, state: &quot;steady&quot;, counts: { cloned: 2576, clonedBytes: 346861214, catchup: 0, steady: 0 }, ok: 1.0, $gleStats: { lastOpTime: Timestamp(0, 0), electionId: ObjectId(&apos;7fffffff000000000000000f&apos;) }, $configServerState: { opTime: { ts: Timestamp(1552226074, 5), t: 95 } } } mem used: 0 documents remaining to clone: 0&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-10T16:54:38.635+0300 I SHARDING [conn788179] Migration successfully entered critical section&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-10T16:54:39.011+0300 I SHARDING [conn788179] Error occurred while committing the migration. Performing a majority write against the config server to obtain its latest optime :: caused by :: DuplicateKey: E11000 duplicate key error collection: config.chunks index: ns_1_min_1 dup key: { : &quot;a.fs.chunks&quot;, : { files_id: UUID(&quot;05660000-0000-e000-96c2-dc81ca6fa911&quot;), n: 0 } }&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-10T16:54:39.011+0300 I SHARDING [conn788179] about to log metadata event into changelog: { _id: &quot;dorado3-2019-03-10T16:54:39.011+0300-5c85171f7bc16fcff6319a41&quot;, server: &quot;dorado3&quot;, clientAddr: &quot;10.3.1.11:51332&quot;, time: new Date(1552226079011), what: &quot;moveChunk.validating&quot;, ns: &quot;a.fs.chunks&quot;, details: { min: { files_id: UUID(&quot;05660000-0000-e000-96c2-dc81ca6fa911&quot;), n: 0 }, max: { files_id: UUID(&quot;05666100-0000-e000-9252-7b82dea0b186&quot;), n: 3 }, from: &quot;driveFS-2&quot;, to: &quot;driveFS-17&quot; } }&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-10T16:54:39.187+0300 I SHARDING [conn788179] about to log metadata event into changelog: { _id: &quot;dorado3-2019-03-10T16:54:39.187+0300-5c85171f7bc16fcff6319a4e&quot;, server: &quot;dorado3&quot;, clientAddr: &quot;10.3.1.11:51332&quot;, time: new Date(1552226079187), what: &quot;moveChunk.error&quot;, ns: &quot;a.fs.chunks&quot;, details: { min: { files_id: UUID(&quot;05660000-0000-e000-96c2-dc81ca6fa911&quot;), n: 0 }, max: { files_id: UUID(&quot;05666100-0000-e000-9252-7b82dea0b186&quot;), n: 3 }, from: &quot;driveFS-2&quot;, to: &quot;driveFS-17&quot; } }&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-10T16:54:39.190+0300 W SHARDING [conn788179] Chunk move failed :: caused by :: DuplicateKey: Chunk move was not successful due to E11000 duplicate key error collection: config.chunks index: ns_1_min_1 dup key: { : &quot;a.fs.chunks&quot;, : { files_id: UUID(&quot;05660000-0000-e000-96c2-dc81ca6fa911&quot;), n: 0 } }&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-10T16:54:39.190+0300 I SHARDING [conn788179] about to log metadata event into changelog: { _id: &quot;dorado3-2019-03-10T16:54:39.190+0300-5c85171f7bc16fcff6319a50&quot;, server: &quot;dorado3&quot;, clientAddr: &quot;10.3.1.11:51332&quot;, time: new Date(1552226079190), what: &quot;moveChunk.from&quot;, ns: &quot;a.fs.chunks&quot;, details: { min: { files_id: UUID(&quot;05660000-0000-e000-96c2-dc81ca6fa911&quot;), n: 0 }, max: { files_id: UUID(&quot;05666100-0000-e000-9252-7b82dea0b186&quot;), n: 3 }, step 1 of 6: 0, step 2 of 6: 88, step 3 of 6: 90, step 4 of 6: 339694, step 5 of 6: 386, to: &quot;driveFS-17&quot;, from: &quot;driveFS-2&quot;, note: &quot;aborted&quot; } }&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;</comment>
                            <comment id="2176823" author="kaloian.manassiev" created="Mon, 11 Mar 2019 12:36:20 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=onyxmaster&quot; class=&quot;user-hover&quot; rel=&quot;onyxmaster&quot;&gt;onyxmaster&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Thank you very much for your report and concern.&lt;/p&gt;

&lt;p&gt;First I would like to alleviate your concerns about data loss: The &lt;tt&gt;_id&lt;/tt&gt; field in the &lt;tt&gt;config.chunks&lt;/tt&gt; collection is not used for routing of queries and/or updates, but only for generating chunk modifications internally (&lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-27735&quot; title=&quot;Remove uses of config.chunks&amp;#39; _id field&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-27735&quot;&gt;&lt;del&gt;SERVER-27735&lt;/del&gt;&lt;/a&gt;). So, even if there is change in how it is generated will not cause any operations to be mis-routed or for the balancer to move chunks to wrong shards. So rest assured that there is no data loss.&lt;/p&gt;

&lt;p&gt;For the DuplicateKey error - I notice that the application name for the &lt;tt&gt;_configsvrMoveChunk&lt;/tt&gt; command which encountered it is &quot;MongoDB Shell&quot;. Are you issuing this command directly against the config server? Because this is an internal command which should not be used directly, and instead &lt;a href=&quot;https://docs.mongodb.com/manual/reference/method/sh.moveChunk/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;&lt;tt&gt;moveChunk&lt;/tt&gt;&lt;/a&gt; against MongoS should be used.&lt;/p&gt;

&lt;p&gt;Best regards,&lt;br/&gt;
-Kal.&lt;/p&gt;</comment>
                            <comment id="2176734" author="onyxmaster" created="Mon, 11 Mar 2019 07:28:34 +0000"  >&lt;p&gt;The &quot;changed&quot; link in the description is wrong, it should be &lt;a href=&quot;https://github.com/mongodb/mongo/blame/b21647a5e19e5980186e57f77be0b1e0ef92a087/src/mongo/bson/bsonelement.cpp#L799&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;this one&lt;/a&gt;.&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10010">
                    <name>Duplicate</name>
                                            <outwardlinks description="duplicates">
                                        <issuelink>
            <issuekey id="67056">SERVER-8829</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>22.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18555" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname># of Sprints</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>7.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Mon, 11 Mar 2019 12:36:20 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        4 years, 26 weeks, 5 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>kaloian.manassiev@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            4 years, 26 weeks, 5 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>amardeepsg@gmail.com</customfieldvalue>
            <customfieldvalue>onyxmaster</customfieldvalue>
            <customfieldvalue>chenjian@tmxmall.com</customfieldvalue>
            <customfieldvalue>daniel.hatcher@mongodb.com</customfieldvalue>
            <customfieldvalue>kaloian.manassiev@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|huqehb:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hr858n:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10557" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="2940">Sharding 2019-05-20</customfieldvalue>
    <customfieldvalue id="2967">Sharding 2019-06-03</customfieldvalue>
    <customfieldvalue id="3002">Sharding 2019-06-17</customfieldvalue>
    <customfieldvalue id="3003">Sharding 2019-07-01</customfieldvalue>
    <customfieldvalue id="3061">Sharding 2019-07-15</customfieldvalue>
    <customfieldvalue id="3062">Sharding 2019-07-29</customfieldvalue>
    <customfieldvalue id="3164">Sharding 2019-08-12</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|huq0qn:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>