<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 04:48:35 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-38308] WiredTiger Initialize step takes lot of time</title>
                <link>https://jira.mongodb.org/browse/SERVER-38308</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Hi,&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;We are using MongoDB 3.4 with WiredTiger Storage Engine and as you can see in the logs the startup of Mongodb to open its port for connections takes lot of time (~16 Mins).&lt;/p&gt;

&lt;p&gt;Does this usually take this time?&lt;/p&gt;

&lt;p&gt;If yes, is there a way to optimize this?&lt;/p&gt;</description>
                <environment></environment>
        <key id="640197">SERVER-38308</key>
            <summary>WiredTiger Initialize step takes lot of time</summary>
                <type id="6" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14720&amp;avatarType=issuetype">Question</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="4">Incomplete</resolution>
                                        <assignee username="eric.sedor@mongodb.com">Eric Sedor</assignee>
                                    <reporter username="ologn">Ponraj</reporter>
                        <labels>
                    </labels>
                <created>Thu, 29 Nov 2018 05:57:51 +0000</created>
                <updated>Wed, 29 May 2019 22:43:46 +0000</updated>
                            <resolved>Wed, 29 May 2019 22:43:46 +0000</resolved>
                                    <version>3.4.10</version>
                                                    <component>Storage</component>
                                        <votes>0</votes>
                                    <watches>11</watches>
                                                                                                                <comments>
                            <comment id="2264545" author="eric.sedor" created="Wed, 29 May 2019 22:43:46 +0000"  >&lt;p&gt;Hello,&lt;/p&gt;

&lt;p&gt;We haven&apos;t heard from you in some time and unfortunately have not been able to determine a cause given the information available. So, we&apos;re going to close this ticket.&lt;/p&gt;

&lt;p&gt;However, if you are able to collect more information we would like to continue to look. To do so, we&apos;d like you to increase the verbosity of MongoDB&apos;s logging. When you restart the secondary, please do so with the -vv option (two vs for &quot;log level 2&quot;). Wait until the node enters the SECONDARY state, then provide all 3 of:&lt;/p&gt;

&lt;ul&gt;
	&lt;li&gt;diagnostic data&lt;/li&gt;
	&lt;li&gt;iostat script output&lt;/li&gt;
	&lt;li&gt;mongod logs.&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;Given this information we can reopen the investigation.&lt;/p&gt;

&lt;p&gt;Thanks again,&lt;br/&gt;
Eric&lt;/p&gt;</comment>
                            <comment id="2219681" author="eric.sedor" created="Fri, 19 Apr 2019 20:45:59 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=aishwary31&quot; class=&quot;user-hover&quot; rel=&quot;aishwary31&quot;&gt;aishwary31&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;I am very sorry for the delay here. We know you have had this issue for some time and we are still trying to determine if a bug could be responsible. We continue to appreciate your patience.&lt;/p&gt;

&lt;p&gt;Unfortunately, we still need more information. We need a complete view of the whole time span of an incident, which will include all 3 of:&lt;/p&gt;
&lt;ul&gt;
	&lt;li&gt;diagnostic data&lt;/li&gt;
	&lt;li&gt;iostat script output&lt;/li&gt;
	&lt;li&gt;mongod logs.&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;All of these data sources should cover a period of time from before the restart of the node and until the node enters the SECONDARY state.&lt;/p&gt;

&lt;p&gt;Especially important this time will be to increase the verbosity of MongoDB&apos;s logging for this incident. When you restart the secondary, please do so with the &lt;a href=&quot;https://docs.mongodb.com/manual/reference/program/mongod/#cmdoption-mongod-verbose&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;-vv&lt;/a&gt; option (two vs for &quot;log level 2&quot;).&lt;/p&gt;

&lt;p&gt;Does this make sense?&lt;/p&gt;

&lt;p&gt;Thank you in advance,&lt;br/&gt;
Eric&lt;/p&gt;</comment>
                            <comment id="2199511" author="aishwary31" created="Tue, 2 Apr 2019 18:14:59 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=eric.sedor&quot; class=&quot;user-hover&quot; rel=&quot;eric.sedor&quot;&gt;eric.sedor&lt;/a&gt; From the server logs, for the time &lt;tt&gt;2019-03-26T10:39:37 UTC&lt;/tt&gt; I couldn&apos;t find the logs about the restart of mongod server, however I can see that the server was restarted at &lt;tt&gt;2019-03-26T10:50:53&lt;/tt&gt;, anyways for your reference i am attaching the server logs at time around &lt;tt&gt;2019-03-26T10:39:37&#160;}}and {{2019-03-26T10:50:53&lt;/tt&gt;&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T10:39:42.19406Z - mongod-server[rs2] 2019-03-26T10:39:39.905+0000 I -        [conn10471] end connection 10.0.73.0:40526 (199 connections now open)&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T10:39:42.194065Z - mongod-server[rs2] 2019-03-26T10:39:39.905+0000 I -        [conn10445] end connection 10.0.73.0:35946 (199 connections now open)&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T10:50:53.31079Z - mongod-server[rs2] 2019-03-26T10:50:52.837+0000 I CONTROL  [main] ***** SERVER RESTARTED *****&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T10:50:53.310794Z - mongod-server[rs2] 2019-03-26T10:50:52.857+0000 I CONTROL  [initandlisten] MongoDB starting : pid=9101 port=27017 dbpath=/var/vcap/store/mongodb/data 64-bit host=06f17252-021b-406e-93cd-4292185108f5&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T10:50:53.310803Z - mongod-server[rs2] 2019-03-26T10:50:52.857+0000 I CONTROL  [initandlisten] db version v3.4.19&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T10:50:53.310804Z - mongod-server[rs2] 2019-03-26T10:50:52.857+0000 I CONTROL  [initandlisten] git version: a2d97db8fe449d15eb8e275bbf318491781472bf&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T10:50:53.310812Z - mongod-server[rs2] 2019-03-26T10:50:52.857+0000 I CONTROL  [initandlisten] OpenSSL version: OpenSSL 1.0.2g  1 Mar 2016&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T10:50:53.310813Z - mongod-server[rs2] 2019-03-26T10:50:52.857+0000 I CONTROL  [initandlisten] allocator: tcmalloc&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T10:50:53.310821Z - mongod-server[rs2] 2019-03-26T10:50:52.857+0000 I CONTROL  [initandlisten] modules: none&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T10:50:53.310823Z - mongod-server[rs2] 2019-03-26T10:50:52.857+0000 I CONTROL  [initandlisten] build environment:&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T10:50:53.310837Z - mongod-server[rs2] 2019-03-26T10:50:52.857+0000 I CONTROL  [initandlisten]     distmod: ubuntu1604&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T10:50:53.310838Z - mongod-server[rs2] 2019-03-26T10:50:52.857+0000 I CONTROL  [initandlisten]     distarch: x86_64&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T10:50:53.310848Z - mongod-server[rs2] 2019-03-26T10:50:52.857+0000 I CONTROL  [initandlisten]     target_arch: x86_64&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T10:50:53.31085Z - mongod-server[rs2] 2019-03-26T10:50:52.857+0000 I CONTROL  [initandlisten] options: { config: &quot;/var/vcap/jobs/mongodb3.4/config/mongodb3.4.conf&quot;, net: { port: 27017, unixDomainSocket: { filePermissions: 600, pathPrefix: &quot;/var/vcap/sys/tmp/mongodb3.4/mongod&quot; } }, processManagement: { fork: true, pidFilePath: &quot;/var/vcap/sys/run/mongodb3.4/mongod/mongodb3.4.pid&quot; }, replication: { replSetName: &quot;bf4474c8bc1cd841b8c36ccde9e77c13&quot; }, security: { authorization: &quot;enabled&quot;, clusterAuthMode: &quot;keyFile&quot;, javascriptEnabled: false, keyFile: &quot;/var/vcap/jobs/mongodb3.4/config/keyfile&quot; }, storage: { dbPath: &quot;/var/vcap/store/mongodb/data&quot;, ...&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;
&lt;p&gt;And for the time&#160;&lt;tt&gt;2019-03-26T13:23:01 UTC&lt;/tt&gt;, you are right the node exited from STARTUP2, here is the log&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T13:25:20.531332Z - mongod-server[rs2] 2019-03-26T13:25:19.894+0000 I REPL     [replExecDBWorker-0] transition to STARTUP2&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T13:25:20.531334Z - mongod-server[rs2] 2019-03-26T13:25:19.894+0000 I REPL     [replExecDBWorker-0] Starting replication storage threads&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T13:25:20.531342Z - mongod-server[rs2] 2019-03-26T13:25:19.897+0000 I REPL     [replExecDBWorker-0] Starting replication fetcher thread&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T13:25:20.531343Z - mongod-server[rs2] 2019-03-26T13:25:19.897+0000 I REPL     [replExecDBWorker-0] Starting replication applier thread&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T13:25:20.531351Z - mongod-server[rs2] 2019-03-26T13:25:19.897+0000 I REPL     [replExecDBWorker-0] Starting replication reporter thread&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T13:25:20.531352Z - mongod-server[rs2] 2019-03-26T13:25:19.897+0000 I REPL     [rsSync] transition to RECOVERING&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T13:25:20.531359Z - mongod-server[rs2] 2019-03-26T13:25:19.900+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to 10.11.51.1:27017&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2019-03-26T13:25:20.531361Z - mongod-server[rs2] 2019-03-26T13:25:19.900+0000 I ASIO     [NetworkInterfaceASIO-Replication-0] Connecting to 10.11.51.2:27017&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;
&lt;p&gt;Is this information sufficient for you ?&lt;/p&gt;

&lt;p&gt;Also particulary for this replica set and the kind of workload it has I just wanted to let you know we have seen high system memory usage for wiredTiger cache(more than what is default configured wiredTiger cache)&lt;/p&gt;</comment>
                            <comment id="2198529" author="eric.sedor" created="Mon, 1 Apr 2019 22:47:41 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=aishwary31&quot; class=&quot;user-hover&quot; rel=&quot;aishwary31&quot;&gt;aishwary31&lt;/a&gt; do we understand correctly from this diagnostic data that Node1 was restarted at &lt;tt&gt;2019-03-26T10:39:37 UTC&lt;/tt&gt; and only exited the STARTUP2 state at &lt;tt&gt;2019-03-26T13:23:01 UTC&lt;/tt&gt;? Can you provide the mongod logs at that time?&lt;/p&gt;</comment>
                            <comment id="2195408" author="eric.sedor" created="Thu, 28 Mar 2019 23:26:25 +0000"  >&lt;p&gt;Thank you &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=aishwary31&quot; class=&quot;user-hover&quot; rel=&quot;aishwary31&quot;&gt;aishwary31&lt;/a&gt; for the complete set and the additional measurements; we are reviewing.&lt;/p&gt;</comment>
                            <comment id="2192872" author="aishwary31" created="Wed, 27 Mar 2019 09:32:44 +0000"  >&lt;p&gt;Regarding output  &lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; find /$dbpath/ | wc -l &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;&lt;br/&gt;
On Node1 above command returned 50 number of files&lt;br/&gt;
On Node2, it returned 56&lt;br/&gt;
On Node3, it returnee 55&lt;/p&gt;</comment>
                            <comment id="2192868" author="aishwary31" created="Wed, 27 Mar 2019 09:25:38 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=eric.sedor&quot; class=&quot;user-hover&quot; rel=&quot;eric.sedor&quot;&gt;eric.sedor&lt;/a&gt; : Please ignore the previous diagnostic.data and iostat logs that were uploaded before. As asked by you for uploading diagnostic.data  and iostat logs for all nodes, please note that the earlier diagnostic.data was for different mongodb cluster&lt;br/&gt;
Following files have been uploaded&lt;/p&gt;
&lt;ul class=&quot;alternate&quot; type=&quot;square&quot;&gt;
	&lt;li&gt;Node1.diagnostic.data.zip&lt;/li&gt;
	&lt;li&gt;Node1.iostat.log&lt;/li&gt;
	&lt;li&gt;Node2.diagnostic.data.zip&lt;/li&gt;
	&lt;li&gt;Node2.iostat.log&lt;/li&gt;
	&lt;li&gt;Node3diagnostic.data.zip&lt;/li&gt;
	&lt;li&gt;Node3.iostat.log&lt;br/&gt;
We are using 3 node replicaset mongodb cluster&lt;/li&gt;
&lt;/ul&gt;

</comment>
                            <comment id="2186770" author="eric.sedor" created="Wed, 20 Mar 2019 22:06:27 +0000"  >&lt;p&gt;Hello, I want to see if you saw my most recent request. In addition to the above, can you also let us know how many files are in your dbpath directory (such as via &lt;tt&gt;find /$dbpath/ | wc -l&lt;/tt&gt;)?&lt;/p&gt;</comment>
                            <comment id="2176359" author="eric.sedor" created="Fri, 8 Mar 2019 21:58:29 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=aishwary31&quot; class=&quot;user-hover&quot; rel=&quot;aishwary31&quot;&gt;aishwary31&lt;/a&gt;, &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=ologn&quot; class=&quot;user-hover&quot; rel=&quot;ologn&quot;&gt;ologn&lt;/a&gt; we are sorry if we have introduced any confusion.&lt;/p&gt;

&lt;p&gt;We are looking for log files, diagnostic.data, and iostat output for all nodes during a period of time during which starting one node takes 16 minutes, to investigate the possibility of a bug. But high startup times are expected on slow disks.&lt;/p&gt;

&lt;p&gt;Unfortunately, we are not able to piece anything together from the current files:&lt;/p&gt;

&lt;ul&gt;
	&lt;li&gt;WiredTiger_Initialize_issue.log seems to cover &lt;tt&gt;2018-11-28T22:28:31.120&lt;/tt&gt; to &lt;tt&gt;2018-11-28T22:44:08.335&lt;/tt&gt; UTC during which it appears the node took some time to enter the STARTUP2 phase.&lt;/li&gt;
	&lt;li&gt;mongodb.log seems to cover &lt;tt&gt;019-02-09T22:45:02.111&lt;/tt&gt; to &lt;tt&gt;2019-02-10T02:45:01.629&lt;/tt&gt; UTC but the node does not appear to have been restarted at all during that time. The node appears to be in the RECOVERING state and is unable to find a node to sync from because it has already become too stale.&lt;/li&gt;
	&lt;li&gt;diagnostic.data the time period of mongodb.log but also do not include any indication of a restart.&lt;/li&gt;
	&lt;li&gt;iostat.log overlaps the time period of mongodb.log but simply shows high disk utilization&lt;/li&gt;
&lt;/ul&gt;


&lt;p&gt;Are you able to provide a consistent view of a slow startup time across these data sources?&lt;/p&gt;
</comment>
                            <comment id="2175462" author="aishwary31" created="Fri, 8 Mar 2019 05:15:07 +0000"  >&lt;p&gt;@Eric We have also seen wiredTiger cache using more memory than the default configured cache size.&lt;/p&gt;</comment>
                            <comment id="2172194" author="aishwary31" created="Wed, 6 Mar 2019 05:55:24 +0000"  >&lt;p&gt;The logs that are provided belong to PRIMARY node which transitioned to RECOVERING node. If you want I can provide dignostic.data for other node.&lt;/p&gt;</comment>
                            <comment id="2157650" author="eric.sedor" created="Wed, 20 Feb 2019 21:14:44 +0000"  >&lt;p&gt;We appreciate your patience &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=ologn&quot; class=&quot;user-hover&quot; rel=&quot;ologn&quot;&gt;ologn&lt;/a&gt;. So far, the diagnostic data you provided indicates a heavily utilized vdb volume. Are you able to provide the same diagnostic data for the primary member of the replica set? We&apos;d like to compare the two sets.&lt;/p&gt;</comment>
                            <comment id="2143852" author="ologn" created="Mon, 11 Feb 2019 06:39:53 +0000"  >&lt;p&gt;Hi&#160;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=eric.sedor&quot; class=&quot;user-hover&quot; rel=&quot;eric.sedor&quot;&gt;eric.sedor&lt;/a&gt;&#160;,&#160;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=ramon.fernandez&quot; class=&quot;user-hover&quot; rel=&quot;ramon.fernandez&quot;&gt;ramon.fernandez&lt;/a&gt;&#160;,&lt;/p&gt;

&lt;p&gt;Can you please re-open the ticket? Because I am not able to. We have come back with the log files that you asked.&lt;/p&gt;</comment>
                            <comment id="2143851" author="aishwary31" created="Mon, 11 Feb 2019 06:31:53 +0000"  >&lt;p&gt;&lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/attachment/208638/208638_diagnostic.tar.gz&quot; title=&quot;diagnostic.tar.gz attached to SERVER-38308&quot;&gt;diagnostic.tar.gz&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.mongodb.org/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt;&lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/attachment/208640/208640_iostat.log&quot; title=&quot;iostat.log attached to SERVER-38308&quot;&gt;iostat.log&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.mongodb.org/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt;&lt;span class=&quot;nobr&quot;&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/attachment/208639/208639_mongodb.log&quot; title=&quot;mongodb.log attached to SERVER-38308&quot;&gt;mongodb.log&lt;sup&gt;&lt;img class=&quot;rendericon&quot; src=&quot;https://jira.mongodb.org/images/icons/link_attachment_7.gif&quot; height=&quot;7&quot; width=&quot;7&quot; align=&quot;absmiddle&quot; alt=&quot;&quot; border=&quot;0&quot;/&gt;&lt;/sup&gt;&lt;/a&gt;&lt;/span&gt;&lt;/p&gt;
&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; &lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; rs.printReplicationInfo()&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; configured oplog size: 1994.330810546875MB&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; log length start to end: 842secs (0.23hrs)&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; oplog first event time: Sat Feb 09 2019 01:03:13 GMT+0000 (UTC)&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; oplog last event time: Sat Feb 09 2019 01:17:15 GMT+0000 (UTC)&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; now: Mon Feb 11 2019 06:31:26 GMT+0000 (UTC)&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; XXXXXXXX:RECOVERING&amp;gt; use local&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;switched to db local&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;XXXXXXXX:RECOVERING&amp;gt; db.oplog.rs.stats().size&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;2950741224&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;XXXXXXXX:RECOVERING&amp;gt; db.oplog.rs.stats().storageSize&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;6681374720&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;XXXXXXXX:RECOVERING&amp;gt; db.oplog.rs.stats().maxSize&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;NumberLong(2091207424)&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt; &#160;&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;
&lt;p&gt;&#160;&lt;/p&gt;</comment>
                            <comment id="2116345" author="eric.sedor" created="Tue, 15 Jan 2019 21:50:07 +0000"  >&lt;p&gt;Hello,&lt;/p&gt;

&lt;p&gt;We haven&#8217;t heard back from you for some time, so I&#8217;m going to close this ticket. If this is still an issue for you, please provide the above information and we will reopen the ticket.&lt;/p&gt;

&lt;p&gt;Gratefully,&lt;br/&gt;
Eric&lt;/p&gt;</comment>
                            <comment id="2095689" author="ramon.fernandez" created="Wed, 19 Dec 2018 14:01:13 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=ologn&quot; class=&quot;user-hover&quot; rel=&quot;ologn&quot;&gt;ologn&lt;/a&gt;, we haven&apos;t heard back from you for some time. If this is still an issue for you, will you please provide the information requested above by Eric so we can continue to investigate? We&apos;re trying to determine where the startup time is going and we suspect I/O.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Ram&#243;n.&lt;/p&gt;</comment>
                            <comment id="2083984" author="eric.sedor" created="Fri, 7 Dec 2018 16:18:54 +0000"  >&lt;p&gt;Ponraj, for us to help investigate this issue, please:&lt;/p&gt;

&lt;p&gt;1) Execute the following shell script prior to starting the server:&lt;/p&gt;

&lt;p/&gt;
&lt;div id=&quot;syntaxplugin&quot; class=&quot;syntaxplugin&quot; style=&quot;border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;&quot;&gt;
&lt;table cellspacing=&quot;0&quot; cellpadding=&quot;0&quot; border=&quot;0&quot; width=&quot;100%&quot; style=&quot;font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;&quot;&gt;
		&lt;tbody &gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;  margin-top: 10px;   width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;delay=1&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
				&lt;tr id=&quot;syntaxplugin_code_and_gutter&quot;&gt;
						&lt;td  style=&quot; line-height: 1.4em !important; padding: 0em; vertical-align: top;&quot;&gt;
					&lt;pre style=&quot;font-size: 1em; margin: 0 10px;   margin-bottom: 10px;  width: auto; padding: 0;&quot;&gt;&lt;span style=&quot;color: black; font-family: &apos;Consolas&apos;, &apos;Bitstream Vera Sans Mono&apos;, &apos;Courier New&apos;, Courier, monospace !important;&quot;&gt;iostat -k -t -x ${delay:?} &amp;gt;iostat.log &amp;amp;&lt;/span&gt;&lt;/pre&gt;
			&lt;/td&gt;
		&lt;/tr&gt;
			&lt;/tbody&gt;
&lt;/table&gt;
&lt;/div&gt;
&lt;p/&gt;

&lt;p&gt;2) Start the server with additional log verbosity (add the &lt;tt&gt;-vvvvv&lt;/tt&gt; option described &lt;a href=&quot;https://docs.mongodb.com/manual/reference/program/mongod/#cmdoption-mongod-verbose&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;here&lt;/a&gt;)&lt;/p&gt;

&lt;p&gt;3) After the server starts, record the results of the following commands in the shell:&lt;/p&gt;

&lt;p&gt;&lt;tt&gt;&amp;gt; rs.printReplicationInfo()&lt;/tt&gt;&lt;/p&gt;

&lt;p&gt;and&lt;/p&gt;

&lt;p&gt;&lt;tt&gt;&amp;gt; use local&lt;/tt&gt;&lt;br/&gt;
&lt;tt&gt;&amp;gt; db.oplog.rs.stats().size&lt;/tt&gt;&lt;br/&gt;
&lt;tt&gt;&amp;gt; db.oplog.rs.stats().storageSize&lt;/tt&gt;&lt;br/&gt;
&lt;tt&gt;&amp;gt; db.oplog.rs.stats().maxSize&lt;/tt&gt;&lt;/p&gt;

&lt;p&gt;4) archive (tar or zip) the &lt;tt&gt;$dbpath/diagnostic.data&lt;/tt&gt; directory&lt;/p&gt;

&lt;p&gt;Then, attach the mongod log, iostat.log, command results, and diagnostic data archive to this ticket.&lt;/p&gt;</comment>
                            <comment id="2082368" author="ologn" created="Thu, 6 Dec 2018 05:50:19 +0000"  >&lt;p&gt;Hi Eric Sedor,&lt;/p&gt;

&lt;p&gt;As you can see in the log, it lists the size of the oplog.&lt;/p&gt;

&lt;p&gt;2018-11-28T22:28:34.098+0000 I STORAGE  &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; Starting WiredTigerRecordStoreThread local.oplog.rs&lt;br/&gt;
2018-11-28T22:28:34.098+0000 I STORAGE  &lt;span class=&quot;error&quot;&gt;&amp;#91;initandlisten&amp;#93;&lt;/span&gt; The size storer reports that the oplog contains 1205 records totaling to 5886951874 bytes&lt;/p&gt;

&lt;p&gt;Besides, I cannot run these commands as mongod has not opened its connection in the shell. Thats the actual problem we have.&lt;/p&gt;</comment>
                            <comment id="2081554" author="eric.sedor" created="Wed, 5 Dec 2018 18:35:19 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=ologn&quot; class=&quot;user-hover&quot; rel=&quot;ologn&quot;&gt;ologn&lt;/a&gt;, can you let us know about any system bottlenecks during that time? Is the disk or CPU saturated for example?&lt;/p&gt;

&lt;p&gt;We&apos;d also like to better understand the size of the oplog. From the MongoDB shell, can you provide the outputs of:&lt;/p&gt;

&lt;p&gt;&lt;tt&gt;&amp;gt; rs.printReplicationInfo()&lt;/tt&gt;&lt;/p&gt;

&lt;p&gt;and&lt;/p&gt;

&lt;p&gt;&lt;tt&gt;&amp;gt; use local&lt;/tt&gt;&lt;br/&gt;
&lt;tt&gt;&amp;gt; db.oplog.rs.stats().size&lt;/tt&gt;&lt;br/&gt;
&lt;tt&gt;&amp;gt; db.oplog.rs.stats().storageSize&lt;/tt&gt;&lt;br/&gt;
&lt;tt&gt;&amp;gt; db.oplog.rs.stats().maxSize&lt;/tt&gt;&lt;/p&gt;</comment>
                            <comment id="2080836" author="ologn" created="Wed, 5 Dec 2018 08:57:22 +0000"  >&lt;p&gt;Now this happens frequently on AZURE as well. Can you provide an update on this? Thanks.&lt;/p&gt;</comment>
                            <comment id="2077551" author="ologn" created="Sat, 1 Dec 2018 03:41:17 +0000"  >&lt;p&gt;Hi Ramon Fernandez,&lt;/p&gt;

&lt;p&gt;This happens on GCP. What more details do you need?&lt;/p&gt;</comment>
                            <comment id="2076996" author="ramon.fernandez" created="Fri, 30 Nov 2018 17:40:00 +0000"  >&lt;p&gt;&lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=ologn&quot; class=&quot;user-hover&quot; rel=&quot;ologn&quot;&gt;ologn&lt;/a&gt;, can you provide more details about your deployment? This looks very similar to the issue described in &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-27036&quot; title=&quot;WT takes longer to start than MMAPv1 on EBS volumes that have not been intialized&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-27036&quot;&gt;&lt;del&gt;SERVER-27036&lt;/del&gt;&lt;/a&gt;, which is related to AWS volumes.&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                            <attachment id="212420" name="Node1.diagnostic.data.zip" size="7231321" author="aishwary31" created="Wed, 27 Mar 2019 09:29:20 +0000"/>
                            <attachment id="212417" name="Node1.iostat.log" size="47727821" author="aishwary31" created="Wed, 27 Mar 2019 09:27:12 +0000"/>
                            <attachment id="212421" name="Node2.diagnostic.data.zip" size="3742565" author="aishwary31" created="Wed, 27 Mar 2019 09:29:20 +0000"/>
                            <attachment id="212418" name="Node2.iostat.log" size="47112878" author="aishwary31" created="Wed, 27 Mar 2019 09:27:27 +0000"/>
                            <attachment id="212422" name="Node3.diagnostic.data.zip" size="4844748" author="aishwary31" created="Wed, 27 Mar 2019 09:29:20 +0000"/>
                            <attachment id="212419" name="Node3.iostat.log" size="47164804" author="aishwary31" created="Wed, 27 Mar 2019 09:27:24 +0000"/>
                            <attachment id="202180" name="WiredTiger_Initialize_issue.log" size="5698" author="ologn" created="Thu, 29 Nov 2018 05:56:54 +0000"/>
                            <attachment id="208638" name="diagnostic.tar.gz" size="84464616" author="aishwary31" created="Mon, 11 Feb 2019 06:30:46 +0000"/>
                            <attachment id="208640" name="iostat.log" size="112518099" author="aishwary31" created="Mon, 11 Feb 2019 06:31:01 +0000"/>
                            <attachment id="208639" name="mongodb.log" size="54652312" author="aishwary31" created="Mon, 11 Feb 2019 06:30:56 +0000"/>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>22.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Thu, 29 Nov 2018 20:42:32 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        4 years, 37 weeks ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>eric.sedor@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            4 years, 37 weeks ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>aishwary31</customfieldvalue>
            <customfieldvalue>eric.sedor@mongodb.com</customfieldvalue>
            <customfieldvalue>ologn</customfieldvalue>
            <customfieldvalue>ramon.fernandez@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hudyp3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hu42bb:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                    <customfieldvalue><![CDATA[eric.sedor@mongodb.com]]></customfieldvalue>
    

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hudkyf:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>