<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 05:21:50 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-50137] MongoDB crashes with Invariant failure due to oplog entries generated in 3.4</title>
                <link>https://jira.mongodb.org/browse/SERVER-50137</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;In &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-32027&quot; title=&quot;Ensure oplog entry has wallClockTime object regardless of FCV&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-32027&quot;&gt;&lt;del&gt;SERVER-32027&lt;/del&gt;&lt;/a&gt;, MongoDB 3.6 began adding the &quot;wall&quot; field to all oplog entries. The presence of oplog entries lacking this field causes MongoDB 4.4.0 to crash on startup with:&lt;/p&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.616+02:00&quot;},&quot;s&quot;:&quot;F&quot;, &#160;&quot;c&quot;:&quot;-&quot;, &#160;&#160;&#160;&#160;&#160;&#160;&#160;&quot;id&quot;:23079,  &#160;*&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Invariant failure&quot;,&quot;attr&quot;: {&quot;expr&quot;:&quot;_oplogManagerCount &amp;gt; 0&quot;,&quot;file&quot;:&quot;src/mongo/db/storage/wiredtiger/wiredtiger_kv_engine.cpp&quot;,&quot;line&quot;:2467}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;In summary: MongoDB 4.4 crashes if any documents in the oplog have not been generated by versions 3.6+.&lt;/p&gt;

&lt;p&gt;If a rapid upgrade is truly necessary, this issue can be avoided by fully resyncing all nodes after upgrading from 3.4 but before upgrading to 4.4.&lt;/p&gt;

&lt;p&gt;&lt;b&gt;Note:&lt;/b&gt; Because sharded config server replica sets receive relatively few write operations, they can often hold older oplog entries than other replica sets.&lt;/p&gt;

&lt;p&gt;To determine if a deployment is vulnerable, run the following to inspect the oldest document in the oplog:&lt;/p&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;use local&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;db.oplog.rs.findOne().wall&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;
&lt;p&gt;If this command returns a Date (any date), the deployment is not vulnerable:&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;ISODate(&quot;2020-08-10T17:41:26.248Z&quot;)&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;
&lt;p&gt;If this command returns no data, then upgrading to 4.4 will fail.&lt;/p&gt;


&lt;h6&gt;&lt;a name=&quot;originaldescription&quot;&gt;&lt;/a&gt;original description&lt;/h6&gt;

&lt;p&gt;Hello,&lt;/p&gt;

&lt;p&gt;We have a sharded cluster with 1 member config replica set and 2 x 1 member shard replica sets with 1 mongos running in our dvlp env.&lt;/p&gt;

&lt;p&gt;We have successfully upgrade the cluster from 4.0.9 to 4.2.8 following&#160;below document&#160;&lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://docs.mongodb.com/manual/release-notes/4.2-upgrade-sharded-cluster&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://docs.mongodb.com/manual/release-notes/4.2-upgrade-sharded-cluster&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;But when we start the upgrade process&#160; to 4.4 from 4.2.8 we came across following issue.&lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;https://docs.mongodb.com/manual/release-notes/4.4-upgrade-sharded-cluster/#upgrade-process&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://docs.mongodb.com/manual/release-notes/4.4-upgrade-sharded-cluster/#upgrade-process&lt;/a&gt;&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;confirmed fcv is set to 4.2&lt;/li&gt;
	&lt;li&gt;disable balancer&lt;/li&gt;
	&lt;li&gt;stopped config server (1 member) running on 4.2.8 binaries&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;while starting the config servers on 4.4.0 binaries it failed.&lt;/p&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;about to fork child process, waiting until server is ready for connections.&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;forked process: 17863&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;ERROR: child process failed, exited with 51&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;To see additional information in this output, start without the &quot;--fork&quot; option.&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;I looked in the mongo log for config and it errored out with invariant failure.&lt;/p&gt;

&lt;p&gt;Is there anything we else we can look for to fix this?&lt;br/&gt;
&#160;&lt;/p&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:39.624+02:00&quot;},&quot;s&quot;:&quot;W&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:20698, &#160;&#160;&quot;ctx&quot;:&quot;main&quot;,&quot;msg&quot;:&quot;***** SERVER RESTARTED *****&quot;,&quot;tags&quot;:[&quot;startupWarnings&quot;]}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:39.624+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:23285, &#160;&#160;&quot;ctx&quot;:&quot;main&quot;,&quot;msg&quot;:&quot;Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols &apos;none&apos;&quot;}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:39.630+02:00&quot;},&quot;s&quot;:&quot;W&quot;, &#160;&quot;c&quot;:&quot;ASIO&quot;, &#160;&#160;&#160;&#160;&quot;id&quot;:22601, &#160;&#160;&quot;ctx&quot;:&quot;main&quot;,&quot;msg&quot;:&quot;No TransportLayer configured during NetworkInterface startup&quot;}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:39.630+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;NETWORK&quot;, &#160;&quot;id&quot;:4648602, &quot;ctx&quot;:&quot;main&quot;,&quot;msg&quot;:&quot;Implicit TCP FastOpen in use.&quot;}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:39.631+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;STORAGE&quot;, &#160;&quot;id&quot;:4615611, &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;MongoDB starting&quot;,&quot;attr&quot;:{&quot;pid&quot;:8961,&quot;port&quot;:28017,&quot;dbPath&quot;:&quot;/ctr/trademarkrepository/configsvr/data&quot;,&quot;architecture&quot;:&quot;64-bit&quot;,&quot;host&quot;:&quot;deng-pl110&quot;}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:39.631+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:23403, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Build Info&quot;,&quot;attr&quot;:{&quot;buildInfo&quot;:{&quot;version&quot;:&quot;4.4.0&quot;,&quot;gitVersion&quot;:&quot;563487e100c4215e2dce98d0af2a6a5a2d67c5cf&quot;,&quot;openSSLVersion&quot;:&quot;OpenSSL 1.0.1e-fips 11 Feb 2013&quot;,&quot;modules&quot;:[],&quot;allocator&quot;:&quot;tcmalloc&quot;,&quot;environment&quot;:{&quot;distmod&quot;:&quot;rhel62&quot;,&quot;distarch&quot;:&quot;x86_64&quot;,&quot;target_arch&quot;:&quot;x86_64&quot;}}}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:39.631+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:51765, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Operating System&quot;,&quot;attr&quot;: {&quot;os&quot;:{&quot;name&quot;:&quot;Oracle Linux Server release 6.9&quot;,&quot;version&quot;:&quot;Kernel 2.6.32-696.el6.x86_64&quot;}}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:39.631+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:21951, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Options set by command line&quot;,&quot;attr&quot;: {&quot;options&quot;:{&quot;config&quot;:&quot;/ctr/trademarkrepository/configsvr/data/automation-mongod.conf&quot;,&quot;net&quot;:{&quot;bindIp&quot;:&quot;0.0.0.0&quot;,&quot;port&quot;:28017},&quot;processManagement&quot;: {&quot;fork&quot;:true},&quot;replication&quot;: {&quot;replSetName&quot;:&quot;ConfigReplSet&quot;},&quot;sharding&quot;: {&quot;clusterRole&quot;:&quot;configsvr&quot;},&quot;storage&quot;: {&quot;dbPath&quot;:&quot;/ctr/trademarkrepository/configsvr/data&quot;,&quot;engine&quot;:&quot;wiredTiger&quot;,&quot;wiredTiger&quot;:{&quot;engineConfig&quot;:{&quot;cacheSizeGB&quot;:4.0}}},&quot;systemLog&quot;: {&quot;destination&quot;:&quot;file&quot;,&quot;logAppend&quot;:true,&quot;logRotate&quot;:&quot;reopen&quot;,&quot;path&quot;:&quot;/ctr/trademarkrepository/configsvr/log/mongod.log&quot;}}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:39.634+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;STORAGE&quot;, &#160;&quot;id&quot;:22297, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Using the XFS filesystem is strongly recommended with the WiredTiger storage engine. See [http://dochub.mongodb.org/core/prodnotes-filesystem&quot;,&quot;tags&quot;:[&quot;startupWarnings&quot;]}|http://dochub.mongodb.org/core/prodnotes-filesystem%22,%22tags%22:[%22startupWarnings%22]%7D] &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:39.634+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;STORAGE&quot;, &#160;&quot;id&quot;:22315, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Opening WiredTiger&quot;,&quot;attr&quot;: {&quot;config&quot;:&quot;create,cache_size=4096M,session_max=33000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000,close_scan_interval=10,close_handle_minimum=250),statistics_log=(wait=0),verbose=[recovery_progress,checkpoint_progress,compact_progress],&quot;}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.222+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;STORAGE&quot;, &#160;&quot;id&quot;:22430, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger message&quot;,&quot;attr&quot;: {&quot;message&quot;:&quot;[1596711220:222207][8961:0x7fc5477bfb40], txn-recover: [WT_VERB_RECOVERY_PROGRESS] Recovering log 8 through 9&quot;}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.285+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;STORAGE&quot;, &#160;&quot;id&quot;:22430, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger message&quot;,&quot;attr&quot;: {&quot;message&quot;:&quot;[1596711220:285073][8961:0x7fc5477bfb40], txn-recover: [WT_VERB_RECOVERY_PROGRESS] Recovering log 9 through 9&quot;}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.402+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;STORAGE&quot;, &#160;&quot;id&quot;:22430, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger message&quot;,&quot;attr&quot;: {&quot;message&quot;:&quot;[1596711220:402276][8961:0x7fc5477bfb40], txn-recover: [WT_VERB_RECOVERY | WT_VERB_RECOVERY_PROGRESS] Main recovery loop: starting at 8/384 to 9/256&quot;}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.285+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;STORAGE&quot;, &#160;&quot;id&quot;:22430, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger message&quot;,&quot;attr&quot;: {&quot;message&quot;:&quot;[1596711220:285073][8961:0x7fc5477bfb40], txn-recover: [WT_VERB_RECOVERY_PROGRESS] Recovering log 9 through 9&quot;}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.402+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;STORAGE&quot;, &#160;&quot;id&quot;:22430, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger message&quot;,&quot;attr&quot;: {&quot;message&quot;:&quot;[1596711220:402276][8961:0x7fc5477bfb40], txn-recover: [WT_VERB_RECOVERY | WT_VERB_RECOVERY_PROGRESS] Main recovery loop: starting at 8/384 to 9/256&quot;}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.402+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;STORAGE&quot;, &#160;&quot;id&quot;:22430, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger message&quot;,&quot;attr&quot;: {&quot;message&quot;:&quot;[1596711220:402678][8961:0x7fc5477bfb40], txn-recover: [WT_VERB_RECOVERY_PROGRESS] Recovering log 8 through 9&quot;}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.483+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;STORAGE&quot;, &#160;&quot;id&quot;:22430, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger message&quot;,&quot;attr&quot;: {&quot;message&quot;:&quot;[1596711220:483038][8961:0x7fc5477bfb40], txn-recover: [WT_VERB_RECOVERY_PROGRESS] Recovering log 9 through 9&quot;}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.548+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;STORAGE&quot;, &#160;&quot;id&quot;:22430, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger message&quot;,&quot;attr&quot;: {&quot;message&quot;:&quot;[1596711220:548195][8961:0x7fc5477bfb40], txn-recover: [WT_VERB_RECOVERY | WT_VERB_RECOVERY_PROGRESS] Set global recovery timestamp: (1596710764, 2)&quot;}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.614+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;STORAGE&quot;, &#160;&quot;id&quot;:4795906, &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger opened&quot;,&quot;attr&quot;: {&quot;durationMillis&quot;:980}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.614+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;RECOVERY&quot;, &quot;id&quot;:23987, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger recoveryTimestamp&quot;,&quot;attr&quot;: {&quot;recoveryTimestamp&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1596710764,&quot;i&quot;:2}}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.616+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;STORAGE&quot;, &#160;&quot;id&quot;:22383, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;The size storer reports that the oplog contains&quot;,&quot;attr&quot;: {&quot;numRecords&quot;:35593,&quot;dataSize&quot;:5050117}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.616+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;STORAGE&quot;, &#160;&quot;id&quot;:22386, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Sampling the oplog to determine where to place markers for truncation&quot;} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.616+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;STORAGE&quot;, &#160;&quot;id&quot;:22389, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Sampling from the oplog to determine where to place markers for truncation&quot;,&quot;attr&quot;: {&quot;from&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1539197546,&quot;i&quot;:3}},&quot;to&quot;: {&quot;$timestamp&quot;:{&quot;t&quot;:1539249669,&quot;i&quot;:3}}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.616+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;STORAGE&quot;, &#160;&quot;id&quot;:22390, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Taking samples and assuming each oplog section contains&quot;,&quot;attr&quot;: {&quot;numSamples&quot;:96,&quot;containsNumRecords&quot;:3696,&quot;containsNumBytes&quot;:524407}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.616+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;STORAGE&quot;, &#160;&quot;id&quot;:22382, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger record store oplog processing finished&quot;,&quot;attr&quot;: {&quot;durationMillis&quot;:0}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.616+02:00&quot;},&quot;s&quot;:&quot;F&quot;, &#160;&quot;c&quot;:&quot;-&quot;, &#160;&#160;&#160;&#160;&#160;&#160;&#160;&quot;id&quot;:23079,  &#160;*&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Invariant failure&quot;,&quot;attr&quot;: {&quot;expr&quot;:&quot;_oplogManagerCount &amp;gt; 0&quot;,&quot;file&quot;:&quot;src/mongo/db/storage/wiredtiger/wiredtiger_kv_engine.cpp&quot;,&quot;line&quot;:2467}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.616+02:00&quot;},&quot;s&quot;:&quot;F&quot;, &#160;&quot;c&quot;:&quot;-&quot;, &#160;&#160;&#160;&#160;&#160;&#160;&#160;&quot;id&quot;:23080, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;\n\n***aborting after invariant() failure\n\n&quot;}* &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.616+02:00&quot;},&quot;s&quot;:&quot;F&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:4757800, &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Writing fatal message&quot;,&quot;attr&quot;: {&quot;message&quot;:&quot;Got signal: 6 (Aborted).\n&quot;}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31431, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;BACKTRACE:  {bt}&quot;,&quot;attr&quot;: {&quot;bt&quot;:{&quot;backtrace&quot;:[{&quot;a&quot;:&quot;7FC54A497D91&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;2CB8D91&quot;,&quot;s&quot;:&quot;_ZN5mongo18stack_trace_detail12_GLOBAL__N_119printStackTraceImplERKNS1_7OptionsEPNS_14StackTraceSinkE.constprop.606&quot;,&quot;s+&quot;:&quot;1E1&quot;}, {&quot;a&quot;:&quot;7FC54A499439&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;2CBA439&quot;,&quot;s&quot;:&quot;_ZN5mongo15printStackTraceEv&quot;,&quot;s+&quot;:&quot;29&quot;}, {&quot;a&quot;:&quot;7FC54A496C26&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;2CB7C26&quot;,&quot;s&quot;:&quot;_ZN5mongo12_GLOBAL__N_116abruptQuitActionEiP7siginfoPv&quot;,&quot;s+&quot;:&quot;66&quot;}, {&quot;a&quot;:&quot;7FC545E277E0&quot;,&quot;b&quot;:&quot;7FC545E18000&quot;,&quot;o&quot;:&quot;F7E0&quot;,&quot;s&quot;:&quot;_L_unlock_16&quot;,&quot;s+&quot;:&quot;2D&quot;}, {&quot;a&quot;:&quot;7FC545AB64F5&quot;,&quot;b&quot;:&quot;7FC545A84000&quot;,&quot;o&quot;:&quot;324F5&quot;,&quot;s&quot;:&quot;gsignal&quot;,&quot;s+&quot;:&quot;35&quot;}, {&quot;a&quot;:&quot;7FC545AB7CD5&quot;,&quot;b&quot;:&quot;7FC545A84000&quot;,&quot;o&quot;:&quot;33CD5&quot;,&quot;s&quot;:&quot;abort&quot;,&quot;s+&quot;:&quot;175&quot;}, {&quot;a&quot;:&quot;7FC5486E1C55&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;F02C55&quot;,&quot;s&quot;:&quot;_ZN5mongo15invariantFailedEPKcS1_j&quot;,&quot;s+&quot;:&quot;12C&quot;}, {&quot;a&quot;:&quot;7FC5483C9536&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;BEA536&quot;,&quot;s&quot;:&quot;_ZN5mongo18WiredTigerKVEngine16haltOplogManagerEv.cold.1904&quot;,&quot;s+&quot;:&quot;18&quot;}, {&quot;a&quot;:&quot;7FC54880211C&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;102311C&quot;,&quot;s&quot;:&quot;_ZN5mongo21WiredTigerRecordStoreD1Ev&quot;,&quot;s+&quot;:&quot;2FC&quot;}, {&quot;a&quot;:&quot;7FC54880868B&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;102968B&quot;,&quot;s&quot;:&quot;_ZN5mongo29StandardWiredTigerRecordStoreD0Ev&quot;,&quot;s+&quot;:&quot;1B&quot;}, {&quot;a&quot;:&quot;7FC5483C9CDB&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;BEACDB&quot;,&quot;s&quot;:&quot;_ZN5mongo18WiredTigerKVEngine21getGroupedRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsENS_8KVPrefixE.cold.1921&quot;,&quot;s+&quot;:&quot;57&quot;}, {&quot;a&quot;:&quot;7FC549073A36&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;1894A36&quot;,&quot;s&quot;:&quot;_ZN5mongo17StorageEngineImpl15_initCollectionEPNS_16OperationContextENS_8RecordIdERKNS_15NamespaceStringEb&quot;,&quot;s+&quot;:&quot;316&quot;}, {&quot;a&quot;:&quot;7FC54907577D&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;189677D&quot;,&quot;s&quot;:&quot;_ZN5mongo17StorageEngineImpl11loadCatalogEPNS_16OperationContextE&quot;,&quot;s+&quot;:&quot;90D&quot;}, {&quot;a&quot;:&quot;7FC549079390&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;189A390&quot;,&quot;s&quot;:&quot;_ZN5mongo17StorageEngineImplC1EPNS_8KVEngineENS_20StorageEngineOptionsE&quot;,&quot;s+&quot;:&quot;270&quot;}, {&quot;a&quot;:&quot;7FC5487C2FE5&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;FE3FE5&quot;,&quot;s&quot;:&quot;_ZNK5mongo12_GLOBAL__N_117WiredTigerFactory6createERKNS_19StorageGlobalParamsEPKNS_21StorageEngineLockFileE&quot;,&quot;s+&quot;:&quot;1A5&quot;}, {&quot;a&quot;:&quot;7FC5490839AE&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;18A49AE&quot;,&quot;s&quot;:&quot;_ZN5mongo23initializeStorageEngineEPNS_14ServiceContextENS_22StorageEngineInitFlagsE&quot;,&quot;s+&quot;:&quot;4CE&quot;}, {&quot;a&quot;:&quot;7FC54877F577&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;FA0577&quot;,&quot;s&quot;:&quot;_ZN5mongo12_GLOBAL__N_114_initAndListenEPNS_14ServiceContextEi.isra.1409&quot;,&quot;s+&quot;:&quot;3F7&quot;}, {&quot;a&quot;:&quot;7FC548783600&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;FA4600&quot;,&quot;s&quot;:&quot;_ZN5mongo12_GLOBAL__N_111mongoDbMainEiPPcS2_&quot;,&quot;s+&quot;:&quot;650&quot;}, {&quot;a&quot;:&quot;7FC5486F2839&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;F13839&quot;,&quot;s&quot;:&quot;main&quot;,&quot;s+&quot;:&quot;9&quot;}, {&quot;a&quot;:&quot;7FC545AA2D20&quot;,&quot;b&quot;:&quot;7FC545A84000&quot;,&quot;o&quot;:&quot;1ED20&quot;,&quot;s&quot;:&quot;__libc_start_main&quot;,&quot;s+&quot;:&quot;100&quot;}, {&quot;a&quot;:&quot;7FC54877EA01&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;F9FA01&quot;,&quot;s&quot;:&quot;_start&quot;,&quot;s+&quot;:&quot;29&quot;}],&quot;processInfo&quot;: {&quot;mongodbVersion&quot;:&quot;4.4.0&quot;,&quot;gitVersion&quot;:&quot;563487e100c4215e2dce98d0af2a6a5a2d67c5cf&quot;,&quot;compiledModules&quot;:[],&quot;uname&quot;:{&quot;sysname&quot;:&quot;Linux&quot;,&quot;release&quot;:&quot;2.6.32-696.el6.x86_64&quot;,&quot;version&quot;:&quot;#1 SMP Wed Mar 22 14:27:19 PDT 2017&quot;,&quot;machine&quot;:&quot;x86_64&quot;},&quot;somap&quot;:[ {&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;elfType&quot;:3,&quot;buildId&quot;:&quot;9A85C620AD954CD5836D247C61661AFDDF2FF039&quot;}]}}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC54A497D91&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;2CB8D91&quot;,&quot;s&quot;:&quot;_ZN5mongo18stack_trace_detail12_GLOBAL__N_119printStackTraceImplERKNS1_7OptionsEPNS_14StackTraceSinkE.constprop.606&quot;,&quot;s+&quot;:&quot;1E1&quot;}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC54A499439&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;2CBA439&quot;,&quot;s&quot;:&quot;_ZN5mongo15printStackTraceEv&quot;,&quot;s+&quot;:&quot;29&quot;}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC54A496C26&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;2CB7C26&quot;,&quot;s&quot;:&quot;_ZN5mongo12_GLOBAL__N_116abruptQuitActionEiP7siginfoPv&quot;,&quot;s+&quot;:&quot;66&quot;}}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;: {&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC54A499439&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;2CBA439&quot;,&quot;s&quot;:&quot;_ZN5mongo15printStackTraceEv&quot;,&quot;s+&quot;:&quot;29&quot;}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC54A496C26&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;2CB7C26&quot;,&quot;s&quot;:&quot;_ZN5mongo12_GLOBAL__N_116abruptQuitActionEiP7siginfoPv&quot;,&quot;s+&quot;:&quot;66&quot;}}} &#160;&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;: {&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC545E277E0&quot;,&quot;b&quot;:&quot;7FC545E18000&quot;,&quot;o&quot;:&quot;F7E0&quot;,&quot;s&quot;:&quot;_L_unlock_16&quot;,&quot;s+&quot;:&quot;2D&quot;}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC545AB64F5&quot;,&quot;b&quot;:&quot;7FC545A84000&quot;,&quot;o&quot;:&quot;324F5&quot;,&quot;s&quot;:&quot;gsignal&quot;,&quot;s+&quot;:&quot;35&quot;}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC545AB7CD5&quot;,&quot;b&quot;:&quot;7FC545A84000&quot;,&quot;o&quot;:&quot;33CD5&quot;,&quot;s&quot;:&quot;abort&quot;,&quot;s+&quot;:&quot;175&quot;}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC5486E1C55&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;F02C55&quot;,&quot;s&quot;:&quot;_ZN5mongo15invariantFailedEPKcS1_j&quot;,&quot;s+&quot;:&quot;12C&quot;}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC5483C9536&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;BEA536&quot;,&quot;s&quot;:&quot;_ZN5mongo18WiredTigerKVEngine16haltOplogManagerEv.cold.1904&quot;,&quot;s+&quot;:&quot;18&quot;}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC54880211C&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;102311C&quot;,&quot;s&quot;:&quot;_ZN5mongo21WiredTigerRecordStoreD1Ev&quot;,&quot;s+&quot;:&quot;2FC&quot;}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC54880868B&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;102968B&quot;,&quot;s&quot;:&quot;_ZN5mongo29StandardWiredTigerRecordStoreD0Ev&quot;,&quot;s+&quot;:&quot;1B&quot;}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC5483C9CDB&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;BEACDB&quot;,&quot;s&quot;:&quot;_ZN5mongo18WiredTigerKVEngine21getGroupedRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsENS_8KVPrefixE.cold.1921&quot;,&quot;s+&quot;:&quot;57&quot;}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC549073A36&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;1894A36&quot;,&quot;s&quot;:&quot;_ZN5mongo17StorageEngineImpl15_initCollectionEPNS_16OperationContextENS_8RecordIdERKNS_15NamespaceStringEb&quot;,&quot;s+&quot;:&quot;316&quot;}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC54907577D&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;189677D&quot;,&quot;s&quot;:&quot;_ZN5mongo17StorageEngineImpl11loadCatalogEPNS_16OperationContextE&quot;,&quot;s+&quot;:&quot;90D&quot;}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC549079390&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;189A390&quot;,&quot;s&quot;:&quot;_ZN5mongo17StorageEngineImplC1EPNS_8KVEngineENS_20StorageEngineOptionsE&quot;,&quot;s+&quot;:&quot;270&quot;}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC5487C2FE5&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;FE3FE5&quot;,&quot;s&quot;:&quot;_ZNK5mongo12_GLOBAL__N_117WiredTigerFactory6createERKNS_19StorageGlobalParamsEPKNS_21StorageEngineLockFileE&quot;,&quot;s+&quot;:&quot;1A5&quot;}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC5490839AE&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;18A49AE&quot;,&quot;s&quot;:&quot;_ZN5mongo23initializeStorageEngineEPNS_14ServiceContextENS_22StorageEngineInitFlagsE&quot;,&quot;s+&quot;:&quot;4CE&quot;}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC54877F577&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;FA0577&quot;,&quot;s&quot;:&quot;_ZN5mongo12_GLOBAL__N_114_initAndListenEPNS_14ServiceContextEi.isra.1409&quot;,&quot;s+&quot;:&quot;3F7&quot;}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC548783600&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;FA4600&quot;,&quot;s&quot;:&quot;_ZN5mongo12_GLOBAL__N_111mongoDbMainEiPPcS2_&quot;,&quot;s+&quot;:&quot;650&quot;}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC5486F2839&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;F13839&quot;,&quot;s&quot;:&quot;main&quot;,&quot;s+&quot;:&quot;9&quot;}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC545AA2D20&quot;,&quot;b&quot;:&quot;7FC545A84000&quot;,&quot;o&quot;:&quot;1ED20&quot;,&quot;s&quot;:&quot;__libc_start_main&quot;,&quot;s+&quot;:&quot;100&quot;}}} &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T12:53:40.702+02:00&quot;},&quot;s&quot;:&quot;I&quot;, &#160;&quot;c&quot;:&quot;CONTROL&quot;, &#160;&quot;id&quot;:31427, &#160;&#160;&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot; &#160;Frame:  {frame}&quot;,&quot;attr&quot;: {&quot;frame&quot;:{&quot;a&quot;:&quot;7FC54877EA01&quot;,&quot;b&quot;:&quot;7FC5477DF000&quot;,&quot;o&quot;:&quot;F9FA01&quot;,&quot;s&quot;:&quot;_start&quot;,&quot;s+&quot;:&quot;29&quot;}}} &#160;&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;&#160;&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;
&lt;p&gt;&#160;&lt;/p&gt;</description>
                <environment>dvlp&lt;br/&gt;
oracle linux 6.9&lt;br/&gt;
running on kernel 2.6.32-696.el6.x86_64</environment>
        <key id="1431963">SERVER-50137</key>
            <summary>MongoDB crashes with Invariant failure due to oplog entries generated in 3.4</summary>
                <type id="1" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14703&amp;avatarType=issuetype">Bug</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="13201">Fixed</resolution>
                                        <assignee username="gregory.noma@mongodb.com">Gregory Noma</assignee>
                                    <reporter username="kinwai.cheung@clarivate.com">Kin Wai Cheung</reporter>
                        <labels>
                            <label>KP44</label>
                    </labels>
                <created>Thu, 6 Aug 2020 12:04:47 +0000</created>
                <updated>Sun, 29 Oct 2023 22:04:46 +0000</updated>
                            <resolved>Thu, 13 Aug 2020 14:27:25 +0000</resolved>
                                    <version>4.4.0</version>
                                    <fixVersion>4.4.1</fixVersion>
                    <fixVersion>4.7.0</fixVersion>
                                    <component>Storage</component>
                    <component>Upgrade/Downgrade</component>
                                        <votes>0</votes>
                                    <watches>12</watches>
                                                                                                                <comments>
                            <comment id="3337313" author="xgen-internal-githook" created="Thu, 13 Aug 2020 16:31:24 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Gregory Noma&apos;, &apos;email&apos;: &apos;gregory.noma@gmail.com&apos;, &apos;username&apos;: &apos;gregorynoma&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-50137&quot; title=&quot;MongoDB crashes with Invariant failure due to oplog entries generated in 3.4&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-50137&quot;&gt;&lt;del&gt;SERVER-50137&lt;/del&gt;&lt;/a&gt; Use timestamp if wall field not present when calculating oplog stones&lt;/p&gt;

&lt;p&gt;(cherry picked from commit 5be60b26dd703f8360157d074de889d0495cab6a)&lt;br/&gt;
Branch: v4.4&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/df5b9daec28555e5fb091e32a821b53d2d92bafe&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/df5b9daec28555e5fb091e32a821b53d2d92bafe&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="3336959" author="xgen-internal-githook" created="Thu, 13 Aug 2020 14:24:12 +0000"  >&lt;p&gt;Author:&lt;/p&gt;
{&apos;name&apos;: &apos;Gregory Noma&apos;, &apos;email&apos;: &apos;gregory.noma@gmail.com&apos;, &apos;username&apos;: &apos;gregorynoma&apos;}
&lt;p&gt;Message: &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-50137&quot; title=&quot;MongoDB crashes with Invariant failure due to oplog entries generated in 3.4&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-50137&quot;&gt;&lt;del&gt;SERVER-50137&lt;/del&gt;&lt;/a&gt; Use timestamp if wall field not present when calculating oplog stones&lt;br/&gt;
Branch: master&lt;br/&gt;
&lt;a href=&quot;https://github.com/mongodb/mongo/commit/5be60b26dd703f8360157d074de889d0495cab6a&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://github.com/mongodb/mongo/commit/5be60b26dd703f8360157d074de889d0495cab6a&lt;/a&gt;&lt;/p&gt;</comment>
                            <comment id="3334181" author="kinwai.cheung@clarivate.com" created="Wed, 12 Aug 2020 09:07:46 +0000"  >&lt;p&gt;Hi Eric,&lt;/p&gt;

&lt;p&gt;During our upgrade for our acceptance environment.&lt;/p&gt;

&lt;p&gt;We already resized our oplog size.&lt;/p&gt;

&lt;p&gt;we checked the wall field and it returned a date&#160; and this date is the same date when we execute&#160;rs.printReplicationInfo()&lt;/p&gt;

&lt;p&gt;CfgReplSet001:PRIMARY&amp;gt; use local&lt;br/&gt;
 switched to db local&lt;br/&gt;
 CfgReplSet001:PRIMARY&amp;gt; db.oplog.rs.findOne().wall&lt;br/&gt;
 ISODate(&quot;2020-07-04T23:32:00.048Z&quot;)&lt;br/&gt;
 CfgReplSet001:PRIMARY&amp;gt;&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;But we still faced the invariant failure so just resizing oplog didn&apos;t help us and we had to restore and add new config node for a resync with new 4.2 oplog entries.&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:20.167+00:00&quot;},&quot;s&quot;:&quot;W&quot;,  &quot;c&quot;:&quot;CONTROL&quot;,  &quot;id&quot;:20698,   &quot;ctx&quot;:&quot;main&quot;,&quot;msg&quot;:&quot;***** SERVER RESTARTED *****&quot;,&quot;tags&quot;:[&quot;startupWarnings&quot;]}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:20.172+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;CONTROL&quot;,  &quot;id&quot;:23285,   &quot;ctx&quot;:&quot;main&quot;,&quot;msg&quot;:&quot;Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols &apos;none&apos;&quot;}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:20.179+00:00&quot;},&quot;s&quot;:&quot;W&quot;,  &quot;c&quot;:&quot;ASIO&quot;,     &quot;id&quot;:22601,   &quot;ctx&quot;:&quot;main&quot;,&quot;msg&quot;:&quot;No TransportLayer configured during NetworkInterface startup&quot;}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:20.179+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;NETWORK&quot;,  &quot;id&quot;:4648602, &quot;ctx&quot;:&quot;main&quot;,&quot;msg&quot;:&quot;Implicit TCP FastOpen in use.&quot;}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:20.180+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;STORAGE&quot;,  &quot;id&quot;:4615611, &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;MongoDB starting&quot;,&quot;attr&quot;:{&quot;pid&quot;:26055,&quot;port&quot;:27017,&quot;dbPath&quot;:&quot;/automatedwordsearchio/CTR/configsvr/data&quot;,&quot;architecture&quot;:&quot;64-bit&quot;,&quot;host&quot;:&quot;amgo-pl201&quot;}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:20.180+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;CONTROL&quot;,  &quot;id&quot;:23403,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Build Info&quot;,&quot;attr&quot;:{&quot;buildInfo&quot;:{&quot;version&quot;:&quot;4.4.0&quot;,&quot;gitVersion&quot;:&quot;563487e100c4215e2dce98d0af2a6a5a2d67c5cf&quot;,&quot;openSSLVersion&quot;:&quot;OpenSSL 1.0.1e-fips 11 Feb 2013&quot;,&quot;modules&quot;:[],&quot;allocator&quot;:&quot;tcmalloc&quot;,&quot;environment&quot;:{&quot;distmod&quot;:&quot;rhel62&quot;,&quot;distarch&quot;:&quot;x86_64&quot;,&quot;target_arch&quot;:&quot;x86_64&quot;}}}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:20.180+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;CONTROL&quot;,  &quot;id&quot;:51765,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Operating System&quot;,&quot;attr&quot;:{&quot;os&quot;:{&quot;name&quot;:&quot;Oracle Linux Server release 6.9&quot;,&quot;version&quot;:&quot;Kernel 2.6.32-696.el6.x86_64&quot;}}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:20.180+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;CONTROL&quot;,  &quot;id&quot;:21951,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Options set by command line&quot;,&quot;attr&quot;:{&quot;options&quot;:{&quot;config&quot;:&quot;/automatedwordsearchio/CTR/configsvr/data/automation-mongod.conf&quot;,&quot;net&quot;:{&quot;bindIp&quot;:&quot;0.0.0.0&quot;,&quot;port&quot;:27017},&quot;processManagement&quot;:{&quot;fork&quot;:true},&quot;replication&quot;:{&quot;replSetName&quot;:&quot;CfgReplSet001&quot;},&quot;sharding&quot;:{&quot;clusterRole&quot;:&quot;configsvr&quot;},&quot;storage&quot;:{&quot;dbPath&quot;:&quot;/automatedwordsearchio/CTR/configsvr/data&quot;,&quot;engine&quot;:&quot;wiredTiger&quot;,&quot;wiredTiger&quot;:{&quot;engineConfig&quot;:{&quot;cacheSizeGB&quot;:4.0}}},&quot;systemLog&quot;:{&quot;destination&quot;:&quot;file&quot;,&quot;logAppend&quot;:true,&quot;logRotate&quot;:&quot;reopen&quot;,&quot;path&quot;:&quot;/automatedwordsearchio/CTR/configsvr/log/mongod.log&quot;}}}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:20.195+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;STORAGE&quot;,  &quot;id&quot;:22297,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Using the XFS filesystem is strongly recommended with the WiredTiger storage engine. See http://dochub.mongodb.org/core/prodnotes-filesystem&quot;,&quot;tags&quot;:[&quot;startupWarnings&quot;]}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:20.195+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;STORAGE&quot;,  &quot;id&quot;:22315,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Opening WiredTiger&quot;,&quot;attr&quot;:{&quot;config&quot;:&quot;create,cache_size=4096M,session_max=33000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000,close_scan_interval=10,close_handle_minimum=250),statistics_log=(wait=0),verbose=[recovery_progress,checkpoint_progress,compact_progress],&quot;}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:21.089+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;STORAGE&quot;,  &quot;id&quot;:22430,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger message&quot;,&quot;attr&quot;:{&quot;message&quot;:&quot;[1597218561:89280][26055:0x7f7fe2a85b40], txn-recover: [WT_VERB_RECOVERY_PROGRESS] Recovering log 385 through 386&quot;}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:21.195+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;STORAGE&quot;,  &quot;id&quot;:22430,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger message&quot;,&quot;attr&quot;:{&quot;message&quot;:&quot;[1597218561:195226][26055:0x7f7fe2a85b40], txn-recover: [WT_VERB_RECOVERY_PROGRESS] Recovering log 386 through 386&quot;}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:21.370+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;STORAGE&quot;,  &quot;id&quot;:22430,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger message&quot;,&quot;attr&quot;:{&quot;message&quot;:&quot;[1597218561:370746][26055:0x7f7fe2a85b40], txn-recover: [WT_VERB_RECOVERY | WT_VERB_RECOVERY_PROGRESS] Main recovery loop: starting at 385/1488512 to 386/256&quot;}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:21.371+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;STORAGE&quot;,  &quot;id&quot;:22430,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger message&quot;,&quot;attr&quot;:{&quot;message&quot;:&quot;[1597218561:370999][26055:0x7f7fe2a85b40], txn-recover: [WT_VERB_RECOVERY | WT_VERB_RECOVERY_PROGRESS] Creating the history store before applying log records. Likely recovering after anunclean shutdown on an earlier version&quot;}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:21.373+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;STORAGE&quot;,  &quot;id&quot;:22430,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger message&quot;,&quot;attr&quot;:{&quot;message&quot;:&quot;[1597218561:373612][26055:0x7f7fe2a85b40], txn-recover: [WT_VERB_RECOVERY_PROGRESS] Recovering log 385 through 386&quot;}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:21.461+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;STORAGE&quot;,  &quot;id&quot;:22430,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger message&quot;,&quot;attr&quot;:{&quot;message&quot;:&quot;[1597218561:461964][26055:0x7f7fe2a85b40], txn-recover: [WT_VERB_RECOVERY_PROGRESS] Recovering log 386 through 386&quot;}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:21.529+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;STORAGE&quot;,  &quot;id&quot;:22430,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger message&quot;,&quot;attr&quot;:{&quot;message&quot;:&quot;[1597218561:529819][26055:0x7f7fe2a85b40], txn-recover: [WT_VERB_RECOVERY | WT_VERB_RECOVERY_PROGRESS] Set global recovery timestamp: (1597218457, 1)&quot;}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:21.534+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;STORAGE&quot;,  &quot;id&quot;:4795906, &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger opened&quot;,&quot;attr&quot;:{&quot;durationMillis&quot;:1339}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:21.534+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;RECOVERY&quot;, &quot;id&quot;:23987,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger recoveryTimestamp&quot;,&quot;attr&quot;:{&quot;recoveryTimestamp&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1597218457,&quot;i&quot;:1}}}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:21.539+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;STORAGE&quot;,  &quot;id&quot;:22383,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;The size storer reports that the oplog contains&quot;,&quot;attr&quot;:{&quot;numRecords&quot;:42164,&quot;dataSize&quot;:5024271}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:21.539+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;STORAGE&quot;,  &quot;id&quot;:22386,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Sampling the oplog to determine where to place markers for truncation&quot;}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:21.540+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;STORAGE&quot;,  &quot;id&quot;:22389,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Sampling from the oplog to determine where to place markers for truncation&quot;,&quot;attr&quot;:{&quot;from&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1540356866,&quot;i&quot;:2}},&quot;to&quot;:{&quot;$timestamp&quot;:{&quot;t&quot;:1557734012,&quot;i&quot;:1}}}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:21.540+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;STORAGE&quot;,  &quot;id&quot;:22390,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Taking samples and assuming each oplog section contains&quot;,&quot;attr&quot;:{&quot;numSamples&quot;:95,&quot;containsNumRecords&quot;:4400,&quot;containsNumBytes&quot;:524304}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:21.540+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;STORAGE&quot;,  &quot;id&quot;:22382,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;WiredTiger record store oplog processing finished&quot;,&quot;attr&quot;:{&quot;durationMillis&quot;:1}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:21.540+00:00&quot;},&quot;s&quot;:&quot;F&quot;,  &quot;c&quot;:&quot;-&quot;,        &quot;id&quot;:23079,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Invariant failure&quot;,&quot;attr&quot;:{&quot;expr&quot;:&quot;_oplogManagerCount &amp;gt; 0&quot;,&quot;file&quot;:&quot;src/mongo/db/storage/wiredtiger/wiredtiger_kv_engine.cpp&quot;,&quot;line&quot;:2467}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:21.540+00:00&quot;},&quot;s&quot;:&quot;F&quot;,  &quot;c&quot;:&quot;-&quot;,        &quot;id&quot;:23080,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;\n\n***aborting after invariant() failure\n\n&quot;}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:21.540+00:00&quot;},&quot;s&quot;:&quot;F&quot;,  &quot;c&quot;:&quot;CONTROL&quot;,  &quot;id&quot;:4757800, &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Writing fatal message&quot;,&quot;attr&quot;:{&quot;message&quot;:&quot;Got signal: 6 (Aborted).\n&quot;}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-12T07:49:21.735+00:00&quot;},&quot;s&quot;:&quot;I&quot;,  &quot;c&quot;:&quot;CONTROL&quot;,  &quot;id&quot;:31431,   &quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;BACKTRACE: {bt}&quot;,&quot;attr&quot;:{&quot;bt&quot;:{&quot;backtrace&quot;:[{&quot;a&quot;:&quot;7F7FE575DD91&quot;,&quot;b&quot;:&quot;7F7FE2AA5000&quot;,&quot;o&quot;:&quot;2CB8D91&quot;,&quot;s&quot;:&quot;_ZN5mongo18stack_trace_detail12_GLOBAL__N_119printStackTraceImplERKNS1_7OptionsEPNS_14StackTraceSinkE.constprop.606&quot;,&quot;s+&quot;:&quot;1E1&quot;},{&quot;a&quot;:&quot;7F7FE575F439&quot;,&quot;b&quot;:&quot;7F7FE2AA5000&quot;,&quot;o&quot;:&quot;2CBA439&quot;,&quot;s&quot;:&quot;_ZN5mongo15printStackTraceEv&quot;,&quot;s+&quot;:&quot;29&quot;},{&quot;a&quot;:&quot;7F7FE575CC26&quot;,&quot;b&quot;:&quot;7F7FE2AA5000&quot;,&quot;o&quot;:&quot;2CB7C26&quot;,&quot;s&quot;:&quot;_ZN5mongo12_GLOBAL__N_116abruptQuitActionEiP7siginfoPv&quot;,&quot;s+&quot;:&quot;66&quot;},{&quot;a&quot;:&quot;7F7FE10ED7E0&quot;,&quot;b&quot;:&quot;7F7FE10DE000&quot;,&quot;o&quot;:&quot;F7E0&quot;,&quot;s&quot;:&quot;_L_unlock_16&quot;,&quot;s+&quot;:&quot;2D&quot;},{&quot;a&quot;:&quot;7F7FE0D7C4F5&quot;,&quot;b&quot;:&quot;7F7FE0D4A000&quot;,&quot;o&quot;:&quot;324F5&quot;,&quot;s&quot;:&quot;gsignal&quot;,&quot;s+&quot;:&quot;35&quot;},{&quot;a&quot;:&quot;7F7FE0D7DCD5&quot;,&quot;b&quot;:&quot;7F7FE0D4A000&quot;,&quot;o&quot;:&quot;33CD5&quot;,&quot;s&quot;:&quot;abort&quot;,&quot;s+&quot;:&quot;175&quot;},{&quot;a&quot;:&quot;7F7FE39A7C55&quot;,&quot;b&quot;:&quot;7F7FE2AA5000&quot;,&quot;o&quot;:&quot;F02C55&quot;,&quot;s&quot;:&quot;_ZN5mongo15invariantFailedEPKcS1_j&quot;,&quot;s+&quot;:&quot;12C&quot;},{&quot;a&quot;:&quot;7F7FE368F536&quot;,&quot;b&quot;:&quot;7F7FE2AA5000&quot;,&quot;o&quot;:&quot;BEA536&quot;,&quot;s&quot;:&quot;_ZN5mongo18WiredTigerKVEngine16haltOplogManagerEv.cold.1904&quot;,&quot;s+&quot;:&quot;18&quot;},{&quot;a&quot;:&quot;7F7FE3AC811C&quot;,&quot;b&quot;:&quot;7F7FE2AA5000&quot;,&quot;o&quot;:&quot;102311C&quot;,&quot;s&quot;:&quot;_ZN5mongo21WiredTigerRecordStoreD1Ev&quot;,&quot;s+&quot;:&quot;2FC&quot;},{&quot;a&quot;:&quot;7F7FE3ACE68B&quot;,&quot;b&quot;:&quot;7F7FE2AA5000&quot;,&quot;o&quot;:&quot;102968B&quot;,&quot;s&quot;:&quot;_ZN5mongo29StandardWiredTigerRecordStoreD0Ev&quot;,&quot;s+&quot;:&quot;1B&quot;},{&quot;a&quot;:&quot;7F7FE368FCDB&quot;,&quot;b&quot;:&quot;7F7FE2AA5000&quot;,&quot;o&quot;:&quot;BEACDB&quot;,&quot;s&quot;:&quot;_ZN5mongo18WiredTigerKVEngine21getGroupedRecordStoreEPNS_16OperationContextENS_10StringDataES3_RKNS_17CollectionOptionsENS_8KVPrefixE.cold.1921&quot;,&quot;s+&quot;:&quot;57&quot;},{&quot;a&quot;:&quot;7F7FE4339A36&quot;,&quot;b&quot;:&quot;7F7FE2AA5000&quot;,&quot;o&quot;:&quot;1894A36&quot;,&quot;s&quot;:&quot;_ZN5mongo17StorageEngineImpl15_initCollectionEPNS_16OperationContextENS_8RecordIdERKNS_15NamespaceStringEb&quot;,&quot;s+&quot;:&quot;316&quot;},{&quot;a&quot;:&quot;7F7FE433B77D&quot;,&quot;b&quot;:&quot;7F7FE2AA5000&quot;,&quot;o&quot;:&quot;189677D&quot;,&quot;s&quot;:&quot;_ZN5mongo17StorageEngineImpl11loadCatalogEPNS_16OperationContextE&quot;,&quot;s+&quot;:&quot;90D&quot;},{&quot;a&quot;:&quot;7F7FE433F390&quot;,&quot;b&quot;:&quot;7F7FE2AA5000&quot;,&quot;o&quot;:&quot;189A390&quot;,&quot;s&quot;:&quot;_ZN5mongo17StorageEngineImplC1EPNS_8KVEngineENS_20StorageEngineOptionsE&quot;,&quot;s+&quot;:&quot;270&quot;},{&quot;a&quot;:&quot;7F7FE3A88FE5&quot;,&quot;b&quot;:&quot;7F7FE2AA5000&quot;,&quot;o&quot;:&quot;FE3FE5&quot;,&quot;s&quot;:&quot;_ZNK5mongo12_GLOBAL__N_117WiredTigerFactory6createERKNS_19StorageGlobalParamsEPKNS_21StorageEngineLockFileE&quot;,&quot;s+&quot;:&quot;1A5&quot;},{&quot;a&quot;:&quot;7F7FE43499AE&quot;,&quot;b&quot;:&quot;7F7FE2AA5000&quot;,&quot;o&quot;:&quot;18A49AE&quot;,&quot;s&quot;:&quot;_ZN5mongo23initializeStorageEngineEPNS_14ServiceContextENS_22StorageEngineInitFlagsE&quot;,&quot;s+&quot;:&quot;4CE&quot;},{&quot;a&quot;:&quot;7F7FE3A45577&quot;,&quot;b&quot;:&quot;7F7FE2AA5000&quot;,&quot;o&quot;:&quot;FA0577&quot;,&quot;s&quot;:&quot;_ZN5mongo12_GLOBAL__N_114_initAndListenEPNS_14ServiceContextEi.isra.1409&quot;,&quot;s+&quot;:&quot;3F7&quot;},{&quot;a&quot;:&quot;7F7FE3A49600&quot;,&quot;b&quot;:&quot;7F7FE2AA5000&quot;,&quot;o&quot;:&quot;FA4600&quot;,&quot;s&quot;:&quot;_ZN5mongo12_GLOBAL__N_111mongoDbMainEiPPcS2_&quot;,&quot;s+&quot;:&quot;650&quot;},{&quot;a&quot;:&quot;7F7FE39B8839&quot;,&quot;b&quot;:&quot;7F7FE2AA5000&quot;,&quot;o&quot;:&quot;F13839&quot;,&quot;s&quot;:&quot;main&quot;,&quot;s+&quot;:&quot;9&quot;},{&quot;a&quot;:&quot;7F7FE0D68D20&quot;,&quot;b&quot;:&quot;7F7FE0D4A000&quot;,&quot;o&quot;:&quot;1ED20&quot;,&quot;s&quot;:&quot;__libc_start_main&quot;,&quot;s+&quot;:&quot;100&quot;},{&quot;a&quot;:&quot;7F7FE3A44A01&quot;,&quot;b&quot;:&quot;7F7FE2AA5000&quot;,&quot;o&quot;:&quot;F9FA01&quot;,&quot;s&quot;:&quot;_start&quot;,&quot;s+&quot;:&quot;29&quot;}],&quot;processInfo&quot;:{&quot;mongodbVersion&quot;:&quot;4.4.0&quot;,&quot;gitVersion&quot;:&quot;563487e100c4215e2dce98d0af2a6a5a2d67c5cf&quot;,&quot;compiledModules&quot;:[],&quot;uname&quot;:{&quot;sysname&quot;:&quot;Linux&quot;,&quot;release&quot;:&quot;2.6.32-696.el6.x86_64&quot;,&quot;version&quot;:&quot;#1 SMP Wed Mar 22 14:27:19 PDT 2017&quot;,&quot;machine&quot;:&quot;x86_64&quot;},&quot;somap&quot;:[{&quot;b&quot;:&quot;7F7FE2AA5000&quot;,&quot;elfType&quot;:3,&quot;buildId&quot;:&quot;9A85C620AD954CD5836D247C61661AFDDF2FF039&quot;}]}}}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;
&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;</comment>
                            <comment id="3331134" author="eric.sedor" created="Mon, 10 Aug 2020 17:30:44 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=kinwai.cheung%40clarivate.com&quot; class=&quot;user-hover&quot; rel=&quot;kinwai.cheung@clarivate.com&quot;&gt;kinwai.cheung@clarivate.com&lt;/a&gt;, we&apos;re glad to hear the deployments have made it to 4.4 and will be working on a fix for this in future versions. Thanks for writing in.&lt;/p&gt;

&lt;p&gt;Can you please file an additional ticket for your PeriodicShardedIndexConsistencyChecker question?&lt;/p&gt;</comment>
                            <comment id="3329846" author="kinwai.cheung@clarivate.com" created="Mon, 10 Aug 2020 10:38:00 +0000"  >&lt;p&gt;Additionally It seems when we upgraded to 4.2.8 or 4.40 every 10 minutes our config log is logged with messages like below when&#160;PeriodicShardedIndexConsistencyChecker is being run.&lt;/p&gt;

&lt;p&gt;These databases are were dropped&#160; from couple of years ago to more recently by dvlp afaik.&lt;/p&gt;

&lt;p&gt;I&apos;m finding&#160; entries in config.collections (config) or&#160; config.cached.collections (data bearing nodes) that reference already dropped db&apos;s&lt;/p&gt;

&lt;p&gt;Is this a known issue or should I create a new Jira for this?&#160;&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2020-08-09T04:01:01.807+0200 I  SHARDING [PeriodicShardedIndexConsistencyChecker] Checking consistency of sharded collection indexes across the cluster&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2020-08-09T04:01:01.825+0200 I  SH_REFR  [ConfigServerCatalogCacheLoader-139] Refresh for database acc took 0 ms and failed :: caused by :: NamespaceNotFound: database acc not found&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2020-08-09T04:01:01.830+0200 I  SH_REFR  [ConfigServerCatalogCacheLoader-139] Refresh for database lukes-test took 0 ms and failed :: caused by :: NamespaceNotFound: database lukes-test not found&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2020-08-09T04:01:01.832+0200 I  SH_REFR  [ConfigServerCatalogCacheLoader-139] Refresh for database ctr-integration-tests_1492084538520 took 0 ms and failed :: caused by :: NamespaceNotFound: database ctr-integration-tests_1492084538520 not found&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2020-08-09T04:01:01.833+0200 I  SH_REFR  [ConfigServerCatalogCacheLoader-139] Refresh for database ctr-integration-tests_1492085358785 took 0 ms and failed :: caused by :: NamespaceNotFound: database ctr-integration-tests_1492085358785 not found&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2020-08-09T04:01:01.833+0200 I  SH_REFR  [ConfigServerCatalogCacheLoader-139] Refresh for database ctr-integration-tests_1492093702966 took 0 ms and failed :: caused by :: NamespaceNotFound: database ctr-integration-tests_1492093702966 not found&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2020-08-09T04:01:01.833+0200 I  SH_REFR  [ConfigServerCatalogCacheLoader-139] Refresh for database ctr-integration-tests_1492094907720 took 0 ms and failed :: caused by :: NamespaceNotFound: database ctr-integration-tests_1492094907720 not found&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2020-08-09T04:01:01.833+0200 I  SH_REFR  [ConfigServerCatalogCacheLoader-139] Refresh for database ctr-integration-tests_1492151781828 took 0 ms and failed :: caused by :: NamespaceNotFound: database ctr-integration-tests_1492151781828 not found&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&amp;nbsp;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;.&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;.&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;.2020-08-09T04:01:02.851+0200 I  SH_REFR  [ConfigServerCatalogCacheLoader-139] Refresh for database ctr-integration-tests_2020-08-07-00-00-46 took 0 ms and failed :: caused by :: NamespaceNotFound: database ctr-integration-tests_2020-08-07-00-00-46 not found&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2020-08-09T04:01:02.852+0200 I  SH_REFR  [ConfigServerCatalogCacheLoader-139] Refresh for database ctr-integration-tests_2020-08-07-00-00-46 took 0 ms and failed :: caused by :: NamespaceNotFound: database ctr-integration-tests_2020-08-07-00-00-46 not found&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2020-08-09T04:01:02.852+0200 I  SH_REFR  [ConfigServerCatalogCacheLoader-139] Refresh for database ctr-integration-tests_2020-08-07-00-02-08 took 0 ms and failed :: caused by :: NamespaceNotFound: database ctr-integration-tests_2020-08-07-00-02-08 not found&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2020-08-09T04:01:02.852+0200 I  SH_REFR  [ConfigServerCatalogCacheLoader-139] Refresh for database ctr-integration-tests_2020-08-07-00-02-08 took 0 ms and failed :: caused by :: NamespaceNotFound: database ctr-integration-tests_2020-08-07-00-02-08 not found&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2020-08-09T04:01:02.852+0200 I  SH_REFR  [ConfigServerCatalogCacheLoader-139] Refresh for database ctr-integration-tests_2020-08-07-00-02-08 took 0 ms and failed :: caused by :: NamespaceNotFound: database ctr-integration-tests_2020-08-07-00-02-08 not found&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2020-08-09T04:01:02.852+0200 I  SH_REFR  [ConfigServerCatalogCacheLoader-139] Refresh for database ctr-integration-tests_2020-08-07-00-04-07 took 0 ms and failed :: caused by :: NamespaceNotFound: database ctr-integration-tests_2020-08-07-00-04-07 not found&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2020-08-09T04:01:02.852+0200 I  SH_REFR  [ConfigServerCatalogCacheLoader-139] Refresh for database ctr-integration-tests_2020-08-07-00-04-07 took 0 ms and failed :: caused by :: NamespaceNotFound: database ctr-integration-tests_2020-08-07-00-04-07 not found&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2020-08-09T04:01:02.853+0200 I  SH_REFR  [ConfigServerCatalogCacheLoader-139] Refresh for database ctr-integration-tests_2020-08-07-00-04-07 took 0 ms and failed :: caused by :: NamespaceNotFound: database ctr-integration-tests_2020-08-07-00-04-07 not found&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2020-08-09T04:01:02.853+0200 I  SHARDING [PeriodicShardedIndexConsistencyChecker] Found 0 collections with inconsistent indexes&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;</comment>
                            <comment id="3329781" author="kinwai.cheung@clarivate.com" created="Mon, 10 Aug 2020 09:21:35 +0000"  >&lt;p&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;^config_mongod_log_20200810.gz&amp;#93;&lt;/span&gt;&lt;/p&gt;

&lt;p&gt;Hi all,&lt;/p&gt;

&lt;p&gt;Even if oplog first event&#160; did showed me a recent date on our dvlp env.&lt;/p&gt;

&lt;p&gt;on DVLP running 4.2.8&lt;/p&gt;

&lt;p&gt;ConfigReplSet:PRIMARY&amp;gt; rs.printReplicationInfo()&lt;br/&gt;
configured oplog size: 5MB&lt;br/&gt;
log length start to end: 82986secs (23.05hrs)&lt;br/&gt;
oplog first event time: Thu Aug 06 2020 23:19:02 GMT+0200 (CEST)&lt;br/&gt;
oplog last event time: Fri Aug 07 2020 22:22:08 GMT+0200 (CEST)&lt;br/&gt;
now: Fri Aug 07 2020 22:22:10 GMT+0200 (CEST)&lt;/p&gt;

&lt;p&gt;I did face the invariant issue again based on above&#160; -&amp;gt;&#160; not sure if&#160; it was because it already&#160; upgraded to 4.2.8 and resetted timestamp but still had the 3.2/3.4 somewhere or I messed something up. Log with verbosity 5 attached.&lt;/p&gt;

&lt;p&gt;I restored the config back to a previous states and used&#160; your workaround.&lt;/p&gt;

&lt;p&gt;With adding&#160; a new temp node , sync it which should contain&#160; 4.2 oplog entries only.&#160; Make it primary then removed the old node and adding this back again with empty dbpath for another resync and&#160; remove the temp node&#160; (stepdown) again.&lt;/p&gt;

&lt;p&gt;This made me able to run config on 4.4 binaries&#160; and also the databearing shards and router.&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;</comment>
                            <comment id="3328731" author="eric.sedor" created="Fri, 7 Aug 2020 21:37:00 +0000"  >&lt;p&gt;Resizing the oplog is another way to remove older entries, yes.&lt;/p&gt;</comment>
                            <comment id="3328576" author="kinwai.cheung@clarivate.com" created="Fri, 7 Aug 2020 20:28:53 +0000"  >&lt;p&gt;Just checked the config servers on our higher environments.&lt;/p&gt;

&lt;p&gt;We upgraded from 3.4 to 4.0.9&#160; around may/june 2019 .&lt;/p&gt;

&lt;p&gt;And on our higher environments it still contains oplog events before that date.&lt;/p&gt;

&lt;p&gt;Also confirmed that our databearing nodes have a much more recent oplog first time event.&lt;/p&gt;

&lt;p&gt;Does resizing the oplog size for config&#160; that the first time event is after the 3.6 upgrade&#160; also solves the issue?&#160;&#160;&lt;/p&gt;

&lt;p&gt;ACC (1 member replica set)&lt;/p&gt;

&lt;p&gt;CfgReplSet001:PRIMARY&amp;gt; rs.printReplicationInfo()&lt;br/&gt;
 configured oplog size: 20361.590576171875MB&lt;br/&gt;
 log length start to end: 56426261secs (15673.96hrs)&lt;br/&gt;
 oplog first event time: Wed Oct 24 2018 20:12:52 GMT+0200 (CEST)&lt;br/&gt;
 oplog last event time: Fri Aug 07 2020 22:10:33 GMT+0200 (CEST)&lt;br/&gt;
 now: Fri Aug 07 2020 22:10:39 GMT+0200 (CEST)&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;PROD (3 member replica set)&lt;/p&gt;

&lt;p&gt;configReplSet:PRIMARY&amp;gt; rs.printReplicationInfo()&lt;br/&gt;
 configured oplog size: 51200MB&lt;br/&gt;
 log length start to end: 111213801secs (30892.72hrs)&lt;br/&gt;
 oplog first event time: Sat Jan 28 2017 16:26:26 GMT+0100 (CET)&lt;br/&gt;
 oplog last event time: Fri Aug 07 2020 22:09:47 GMT+0200 (CEST)&lt;br/&gt;
 now: Fri Aug 07 2020 22:09:48 GMT+0200 (CEST)&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;-----------------------&lt;/p&gt;

&lt;p&gt;on DVLP running 4.2.8&lt;/p&gt;

&lt;p&gt;ConfigReplSet:PRIMARY&amp;gt; rs.printReplicationInfo()&lt;br/&gt;
 configured oplog size: 5MB&lt;br/&gt;
 log length start to end: 82986secs (23.05hrs)&lt;br/&gt;
 oplog first event time: Thu Aug 06 2020 23:19:02 GMT+0200 (CEST)&lt;br/&gt;
 oplog last event time: Fri Aug 07 2020 22:22:08 GMT+0200 (CEST)&lt;br/&gt;
 now: Fri Aug 07 2020 22:22:10 GMT+0200 (CEST)&lt;/p&gt;</comment>
                            <comment id="3328513" author="eric.sedor" created="Fri, 7 Aug 2020 19:59:51 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=kinwai.cheung%40clarivate.com&quot; class=&quot;user-hover&quot; rel=&quot;kinwai.cheung@clarivate.com&quot;&gt;kinwai.cheung@clarivate.com&lt;/a&gt;, this would apply to any node. It is less likely that data-bearing nodes in the replica sets themselves will have entries that far back, but it is entirely possible. It&apos;s a question of how quickly the node is written to, and how large those updates are.&lt;/p&gt;

&lt;p&gt;A quick way if you know the upgrade date from 3.4 is to use &lt;a href=&quot;https://docs.mongodb.com/manual/reference/method/rs.printReplicationInfo/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;printReplicationInfo&lt;/a&gt;. As long as the first event time is after the upgrade date to 3.6 the node should be safe to upgrade to 4.4.&lt;/p&gt;

&lt;p&gt;It is also possible to inspect the oplog directly. Let us know if the above method won&apos;t work for you or if the results leave you in doubt!&lt;/p&gt;</comment>
                            <comment id="3328503" author="kinwai.cheung@clarivate.com" created="Fri, 7 Aug 2020 19:50:57 +0000"  >&lt;p&gt;Thanks Eric,&lt;/p&gt;

&lt;p&gt;I&apos;ll try this on Monday.&lt;/p&gt;

&lt;p&gt;Does this also applies for our 2 shards&#160; which are both primary replica sets?&lt;/p&gt;

&lt;p&gt;Also how can I check this myself if my replica sets still has oplog entries generated from 3.4?&#160;&lt;/p&gt;

&lt;p&gt;Since we want to upgrade our higher environments too.&lt;/p&gt;</comment>
                            <comment id="3328252" author="eric.sedor" created="Fri, 7 Aug 2020 18:01:41 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=kinwai.cheung%40clarivate.com&quot; class=&quot;user-hover&quot; rel=&quot;kinwai.cheung@clarivate.com&quot;&gt;kinwai.cheung@clarivate.com&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;We believe that MongoDB 4.4 is crashing due to an issue handling oplog entries generated by MongoDB 3.4. This could happen if the deployment was running on version 3.4 relatively recently, and/or wasn&apos;t receiving many writes due to low sharding-related activity.&lt;/p&gt;

&lt;p&gt;In this case, we can see from diagnostic data that the oplog has entries from as early as October 2018.&lt;/p&gt;

&lt;p&gt;We are going to look into this further.&lt;/p&gt;

&lt;p&gt;In the meantime as a workaround, we recommend adding a new node to the config server replica set, waiting for it to sync, and then promoting it to Primary. Then, you can remove the old node and try to upgrade the new node, which will only have 4.2 oplog entries.&lt;/p&gt;

&lt;p&gt;If you still see trouble after that, can you please let us know and provide the same set of information (logs at high verbosity -vvvvv, and diagnostic data)?&lt;/p&gt;

&lt;p&gt;Does this make sense? Let me know if I can answer any questions.&lt;/p&gt;

&lt;p&gt;Sincerely,&lt;br/&gt;
Eric&lt;/p&gt;</comment>
                            <comment id="3326129" author="kinwai.cheung@clarivate.com" created="Fri, 7 Aug 2020 11:57:42 +0000"  >&lt;p&gt;I could explain this.&lt;/p&gt;

&lt;p&gt;When starting the config ( 1 node only)&#160; with 4.4 binaries I&#160; lalways hit the invariant failure.&lt;/p&gt;

&lt;p&gt;Since I was not able to &apos;downgrade&apos; or start it back with previous binaries 4.2.8 due to unsupported WT version.&lt;/p&gt;

&lt;p&gt;I then tried things like repair with 4.4 binaries or 4.2.8 binaries&#160; with and without replicaset.&lt;/p&gt;

&lt;p&gt;But it still didn&apos;t let met startup config succesfully.&lt;/p&gt;

&lt;p&gt;So you should have seen messages like:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;
	&lt;ul&gt;
		&lt;li&gt;WARNING: mongod started without --replSet yet document(s) are present in local.system.replset.&lt;/li&gt;
	&lt;/ul&gt;
	&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;or&#160;&lt;/p&gt;

&lt;p&gt;2020-08-06T10:20:32.891+0200 F REPL &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; This instance has been repaired and may contain modified replicated data that would not match other replica set members. To see your repaired data, start mongod without the --replSet option. When you are finished recovering your data and would like to perform a complete re-sync, please refer to the documentation here: &lt;a href=&quot;https://docs.mongodb.com/manual/tutorial/resync-replica-set-member/&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;https://docs.mongodb.com/manual/tutorial/resync-replica-set-member/&lt;/a&gt;&lt;br/&gt;
 2020-08-06T10:20:32.891+0200 F - &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; Fatal Assertion 50923 at src/mongo/db/repl/replication_coordinator_impl.cpp 529&lt;/p&gt;

&lt;p&gt;After removing the document in local.system.replset&#160; on 4.2.8 binaries without replicaset. Then I started up the config successfully ,with replset option enabled ,&#160; &#160;on 4.2.8 binaries afterwards&lt;/p&gt;

&lt;p&gt;---------------------------------------&lt;/p&gt;

&lt;p&gt;Afterwards i tried several things without success.&lt;/p&gt;

&lt;p&gt;So I restored back the config server and started back&#160; everythin on 4.2.8 binaries around&#160;2020-08-06T14:41 as shown in the logs.&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;</comment>
                            <comment id="3326117" author="bruce.lucas@10gen.com" created="Fri, 7 Aug 2020 11:35:35 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=daniel.gottlieb&quot; class=&quot;user-hover&quot; rel=&quot;daniel.gottlieb&quot;&gt;daniel.gottlieb&lt;/a&gt; here&apos;s a possible clue.&lt;/p&gt;

&lt;p&gt;In the log file we see multiple restarts immediately after upgrading to 4.4 that hit the invariant. Then there is a restart with repair:true. After validating multiple collections without finding errors, it then hits the following fatal error end exits:&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T08:01:19.396Z&quot;},&quot;s&quot;:&quot;I&quot;,&quot;c&quot;:&quot;STORAGE&quot;,&quot;id&quot;:21029,&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;repairDatabase&quot;,&quot;attr&quot;:{&quot;db&quot;:&quot;config&quot;}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T08:01:19.405Z&quot;},&quot;s&quot;:&quot;I&quot;,&quot;c&quot;:&quot;STORAGE&quot;,&quot;id&quot;:21027,&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Repairing collection&quot;,&quot;attr&quot;:{&quot;namespace&quot;:&quot;config.version&quot;}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T08:01:19.405Z&quot;},&quot;s&quot;:&quot;I&quot;,&quot;c&quot;:&quot;STORAGE&quot;,&quot;id&quot;:22327,&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;Verify succeeded. Not salvaging.&quot;,&quot;attr&quot;:{&quot;uri&quot;:&quot;table:collection-4-361705941156805836&quot;}}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;    &quot;t&quot;: {&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;        &quot;$date&quot;: &quot;2020-08-06T08:01:19.406Z&quot;&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;    },&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;    &quot;s&quot;: &quot;E&quot;,&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;    &quot;c&quot;: &quot;STORAGE&quot;,&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;    &quot;id&quot;: 20557,&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;    &quot;ctx&quot;: &quot;initandlisten&quot;,&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;    &quot;msg&quot;: &quot;DBException in initAndListen, terminating&quot;,&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;    &quot;attr&quot;: {&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;        &quot;error&quot;: &quot;NotMasterNoSlaveOk: not master and slaveOk=false&quot;&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;    }&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;
&lt;p&gt;On the subsequent restart without repair it says&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;{&quot;t&quot;:{&quot;$date&quot;:&quot;2020-08-06T08:02:47.792Z&quot;},&quot;s&quot;:&quot;F&quot;,&quot;c&quot;:&quot;STORAGE&quot;,&quot;id&quot;:50922,&quot;ctx&quot;:&quot;initandlisten&quot;,&quot;msg&quot;:&quot;An incomplete repair has been detected! This is likely because a repair operation unexpectedly failed before completing. MongoDB will not start up again without --repair.&quot;}&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;
&lt;p&gt;from which I think we can deduce that the previous fatal NotMasterNoSlaveOk error was not a normal part of repair. Could this be the errant exception that is causing the invariant when we&apos;re running without repair, and do the logged details about the exception provide enough of a clue to understand the cause?&lt;/p&gt;
</comment>
                            <comment id="3325436" author="kinwai.cheung@clarivate.com" created="Thu, 6 Aug 2020 20:14:47 +0000"  >&lt;p&gt;&lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/attachment/272994/272994_config_mongod_log.gz&quot; title=&quot;config_mongod_log.gz attached to SERVER-50137&quot;&gt;config_mongod_log.gz&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.mongodb.org/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt;&#160; log of config attached (logrotated every 100Mb of size)&lt;/p&gt;</comment>
                            <comment id="3325404" author="daniel.gottlieb@10gen.com" created="Thu, 6 Aug 2020 20:04:23 +0000"  >&lt;blockquote&gt;
&lt;p&gt;Could having a 1 member replicaset for config and 1 member for 2 shards, instead of 3 for each in a shared cluster, be causing this issue in a sharded cluster? As I&apos;m actually upgrading binaries on a primary only.&lt;/p&gt;&lt;/blockquote&gt;

&lt;p&gt;Maybe there&apos;s a connection, but this error is early enough in startup that the replication and sharding systems haven&apos;t been initialized yet. Any interaction there would have to be with how data files were written out when shutting down the 4.2.8 binary. At the risk of speculating, I would think that a topology of 2 nodes + arbiter or 3 nodes are more likely to create problems for restarting a binary than a single node replica set/shard (where the majority point could be arbitrarily lagged).&lt;/p&gt;</comment>
                            <comment id="3325340" author="kinwai.cheung@clarivate.com" created="Thu, 6 Aug 2020 19:47:45 +0000"  >&lt;p&gt;@Bruce you mean the mongod log of the config server? Will attach it later today.&lt;/p&gt;

&lt;p&gt;I&apos;ll also have another upgrade attempt on Monday from 4.2.8 to 4.4.0&lt;br/&gt;
 But now having shutdown router first then both primary shards and then stop primary config and afterwards start config with 4.4 binary and verbosity level 5 just in case it fails again.&lt;/p&gt;

&lt;p&gt;Previous upgrades from 4.0.9 to 4.2.8 and 4.2.8 to 4.4.0 was done while Mongos and shards were up and running (with applications connecting).&lt;/p&gt;

&lt;p&gt;Could having a 1 member replicaset for config and 1 member for 2 shards, instead of 3 for each in a shared cluster, be causing this issue in a sharded cluster? As I&apos;m actually upgrading binaries on a primary only.&lt;/p&gt;</comment>
                            <comment id="3325273" author="daniel.gottlieb@10gen.com" created="Thu, 6 Aug 2020 19:18:39 +0000"  >&lt;p&gt;The &lt;a href=&quot;https://github.com/mongodb/mongo/blob/r4.4.0/src/mongo/db/storage/wiredtiger/wiredtiger_kv_engine.cpp#L2467&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;invariant being hit&lt;/a&gt;. When MDB starts up, it spins off a separate thread for updating visibility. That thread comes into existence when the oplog collection is loaded and likewise goes out of existence when it&apos;s destructed. This invariant fires when we&apos;re trying to destruct the thread, but it hasn&apos;t been started.&lt;/p&gt;

&lt;p&gt;The &lt;tt&gt;oplogManagerCount&lt;/tt&gt; (unsurprisingly) gets incremented to 1 when &lt;tt&gt;&lt;a href=&quot;https://github.com/mongodb/mongo/blob/r4.4.0/src/mongo/db/storage/wiredtiger/wiredtiger_kv_engine.cpp#L2457-L2463&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;startOplogManager&lt;/a&gt;&lt;/tt&gt; is called. That method is called &lt;a href=&quot;https://github.com/mongodb/mongo/blob/r4.4.0/src/mongo/db/storage/wiredtiger/wiredtiger_record_store.cpp#L921-L924&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;from &quot;postConstructorInit&quot;&lt;/a&gt; after &lt;a href=&quot;https://github.com/mongodb/mongo/blob/master/src/mongo/db/storage/wiredtiger/wiredtiger_kv_engine.cpp#L1659&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;the constructor succeeds&lt;/a&gt;.&lt;/p&gt;

&lt;p&gt;However, if an exception is thrown prior to &quot;starting the oplog manager&quot; (perhaps within &lt;a href=&quot;https://github.com/mongodb/mongo/blob/r4.4.0/src/mongo/db/storage/wiredtiger/wiredtiger_record_store.cpp#L918&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;initializing oplog stones&lt;/a&gt;, which does WT reads), the code would get caught in the state we see &amp;#8211; trying to destruct the WTRecordStore for the oplog collection before starting the oplog manager.&lt;/p&gt;</comment>
                            <comment id="3325239" author="daniel.gottlieb@10gen.com" created="Thu, 6 Aug 2020 19:00:23 +0000"  >&lt;p&gt;I imagine this is reproducing easily everytime a 4.4.0 binary tries coming up? I&apos;m about to follow up with a short description of what&apos;s happening, but in the meantime &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=kinwai.cheung%40clarivate.com&quot; class=&quot;user-hover&quot; rel=&quot;kinwai.cheung@clarivate.com&quot;&gt;kinwai.cheung@clarivate.com&lt;/a&gt; can you run with higher verbosity logs (e.g: &amp;#45;vvvv). &lt;/p&gt;

&lt;p&gt;I believe an exception is being thrown while constructing the WTRecordStore for the oplog, but that&apos;s hitting some code that&apos;s not exception-safe resulting in the unrelated invariant we see. I&apos;m hoping with the increased verbosity we&apos;ll be able to see what the original exception is.&lt;/p&gt;</comment>
                            <comment id="3325053" author="bruce.lucas@10gen.com" created="Thu, 6 Aug 2020 17:49:59 +0000"  >&lt;p&gt;Thanks &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=kinwai.cheung%40clarivate.com&quot; class=&quot;user-hover&quot; rel=&quot;kinwai.cheung@clarivate.com&quot;&gt;kinwai.cheung@clarivate.com&lt;/a&gt;. Can you please also attach the complete log file?&lt;/p&gt;</comment>
                            <comment id="3324702" author="kinwai.cheung@clarivate.com" created="Thu, 6 Aug 2020 15:26:54 +0000"  >&lt;p&gt;Hi Eric,&lt;/p&gt;

&lt;p&gt;I&apos;m attaching the diagnostic logs from this month.&lt;/p&gt;

&lt;p&gt;Please note that upgrade only started today (9 am CEST).&lt;/p&gt;

&lt;p&gt;I&apos;ve already done some steps like repairing from 4.2.8/4.4.0 binaries to have the config running.&lt;/p&gt;

&lt;p&gt;Since around 2:45 pm we restored the data files on config to have it running on 4.2.8&lt;/p&gt;

&lt;p&gt;As having it started on 4.4.0 binaries produces the error in ticket and subsequently starting it back on 4.2.8 binaries generated this error:&lt;/p&gt;

&lt;p&gt;unsupported WiredTiger file version: this build only supports versions up to 4, and the file is version 5: WT_ERROR: non-specific WiredTiger error&lt;/p&gt;</comment>
                            <comment id="3324646" author="eric.sedor" created="Thu, 6 Aug 2020 15:05:18 +0000"  >&lt;p&gt;Thanks for writing in &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=kinwai.cheung%40clarivate.com&quot; class=&quot;user-hover&quot; rel=&quot;kinwai.cheung@clarivate.com&quot;&gt;kinwai.cheung@clarivate.com&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Would you please archive (tar or zip) the &lt;tt&gt;$dbpath/diagnostic.data&lt;/tt&gt; directory for the config server? The contents are described &lt;a href=&quot;https://docs.mongodb.com/manual/administration/analyzing-mongodb-performance/#full-time-diagnostic-data-capture&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;here&lt;/a&gt;. Then, attach it to this ticket.&lt;/p&gt;

&lt;p&gt;Gratefully,&lt;br/&gt;
Eric&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10420">
                    <name>Backports</name>
                                            <outwardlinks description="backported by">
                                                        </outwardlinks>
                                                        </issuelinktype>
                            <issuelinktype id="10520">
                    <name>Problem/Incident</name>
                                                                <inwardlinks description="is caused by">
                                        <issuelink>
            <issuekey id="1129658">SERVER-45977</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                            <attachment id="272994" name="config_mongod_log.gz" size="6951401" author="kinwai.cheung@clarivate.com" created="Thu, 6 Aug 2020 20:12:04 +0000"/>
                            <attachment id="272943" name="metrics.2020-08.tgz" size="36884480" author="kinwai.cheung@clarivate.com" created="Thu, 6 Aug 2020 15:21:06 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>21.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18555" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname># of Sprints</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1.0</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_12450" key="com.atlassian.jira.plugin.system.customfieldtypes:multicheckboxes">
                        <customfieldname>Backport Requested</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="18953"><![CDATA[v4.4]]></customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10011" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Backwards Compatibility</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10038"><![CDATA[Fully Compatible]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Thu, 6 Aug 2020 15:05:18 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        3 years, 25 weeks, 6 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_17050" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Downstream Team Attention</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="16941"><![CDATA[Not Needed]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>luke.bonanomi@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            3 years, 25 weeks, 6 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                    <customfield id="customfield_10032" key="com.atlassian.jira.plugin.system.customfieldtypes:select">
                        <customfieldname>Operating System</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10026"><![CDATA[ALL]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>bruce.lucas@mongodb.com</customfieldvalue>
            <customfieldvalue>daniel.gottlieb@mongodb.com</customfieldvalue>
            <customfieldvalue>eric.sedor@mongodb.com</customfieldvalue>
            <customfieldvalue>xgen-internal-githook</customfieldvalue>
            <customfieldvalue>gregory.noma@mongodb.com</customfieldvalue>
            <customfieldvalue>kinwai.cheung@clarivate.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hxynov:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hr53vj:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_10557" key="com.pyxis.greenhopper.jira:gh-sprint">
                        <customfieldname>Sprint</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue id="4126">Execution Team 2020-08-24</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                    <customfieldvalue><![CDATA[eric.sedor@mongodb.com]]></customfieldvalue>
    

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hxy9y7:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>