<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 05:19:17 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-49223] Suggestions to speed up initial sync</title>
                <link>https://jira.mongodb.org/browse/SERVER-49223</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;I have a 5TB, 2 collection instance that I need to move from zlib to zstd.&#160; The initial sync is painfully slow right now on a very beefy secondary instance (m5.12xlarge,&#160;192GB of RAM, 48vCPUs).&#160; The initial sync is scheduled to be completed in 8 days.&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;Primary instance is on an even beefier machine with no load.&#160; I tried diagnosing the slowdown and determined&lt;/p&gt;

&lt;p&gt;&#160;- disk is not saturated with iostat&lt;/p&gt;

&lt;p&gt;&#160;- cpu is not saturated with htop.&#160;&#160;&lt;/p&gt;

&lt;p&gt;&#160;- changing instance type to increase/decrease RAM&#160;&lt;/p&gt;

&lt;p&gt;&#160;- played around with&#160;maxIndexBuildMemoryUsageMegabytes with setParameter&lt;/p&gt;

&lt;p&gt;&#160;- played around with&#160;replWriterThreadCount with setParameter&lt;/p&gt;

&lt;p&gt;&#160;&lt;/p&gt;

&lt;p&gt;It seems like the instance can do a lot more with disk + CPU not saturated on both the primary and the secondary.&#160; Is there anything else I can try?&lt;/p&gt;</description>
                <environment></environment>
        <key id="1397983">SERVER-49223</key>
            <summary>Suggestions to speed up initial sync</summary>
                <type id="4" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14710&amp;avatarType=issuetype">Improvement</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="4">Incomplete</resolution>
                                        <assignee username="dmitry.agranat@mongodb.com">Dmitry Agranat</assignee>
                                    <reporter username="oliver@sensortower.com">Oliver Yeh</reporter>
                        <labels>
                    </labels>
                <created>Wed, 1 Jul 2020 05:59:49 +0000</created>
                <updated>Tue, 28 Jul 2020 08:46:07 +0000</updated>
                            <resolved>Tue, 28 Jul 2020 08:46:07 +0000</resolved>
                                    <version>4.2.8</version>
                                                                        <votes>0</votes>
                                    <watches>4</watches>
                                                                                                                <comments>
                            <comment id="3281420" author="dmitry.agranat" created="Sun, 12 Jul 2020 13:54:22 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=oliver%40sensortower.com&quot; class=&quot;user-hover&quot; rel=&quot;oliver@sensortower.com&quot;&gt;oliver@sensortower.com&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Yes, if possible please upload the data covering this process from the start, both from syncing secondary and from the primary. 200MB of diagnostic data should cover these 8 days. Just as fyi, the &quot;metric&quot; file you&apos;ve uploaded just covers 5 hours so it&apos;s better to upload the whole archive of &lt;tt&gt;diagnostic.data&lt;/tt&gt;.&lt;/p&gt;

&lt;p&gt;From the period of time covering these 5 hours, we can see that setting &lt;tt&gt;replWriterThreadCount&lt;/tt&gt; to 32 is making things worse. Checkpoint is not keeping up with the demand of replicating 23k write operations. Is is possible to gather all the requested information under the default configuration?&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Dima&lt;/p&gt;</comment>
                            <comment id="3275325" author="oliver@sensortower.com" created="Wed, 8 Jul 2020 17:21:24 +0000"  >&lt;p&gt;I uploaded what I could.&#160; Some of the log files have been overwritten (apparently only 200MB on the diagnostic.data?).&#160; If that is not enough, we can close the issue and I can reopen it next time I do a full resync.&#160; Thank you!&lt;/p&gt;</comment>
                            <comment id="3271619" author="dmitry.agranat" created="Tue, 7 Jul 2020 08:38:32 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=oliver%40sensortower.com&quot; class=&quot;user-hover&quot; rel=&quot;oliver@sensortower.com&quot;&gt;oliver@sensortower.com&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;Would you please archive (tar or zip) the mongod.log files and the &lt;tt&gt;$dbpath/diagnostic.data&lt;/tt&gt; directory (the contents are described &lt;a href=&quot;https://docs.mongodb.com/manual/administration/analyzing-mongodb-performance/#full-time-diagnostic-data-capture&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;here&lt;/a&gt;) from both syncing secondary and the primary covering the time of the initial sync and upload them to this &lt;a href=&quot;https://10gen-httpsupload.s3.amazonaws.com/upload_forms/b23427f0-41e4-491f-a2dc-5a415091af59.html&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;support uploader&lt;/a&gt; location?&lt;/p&gt;

&lt;p&gt;Files uploaded to this portal are visible only to MongoDB employees and are routinely deleted after some time.&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Dima&lt;/p&gt;</comment>
                            <comment id="3268307" author="oliver@sensortower.com" created="Thu, 2 Jul 2020 13:50:45 +0000"  >&lt;p&gt;4.2.8&lt;/p&gt;</comment>
                            <comment id="3268047" author="dmitry.agranat" created="Thu, 2 Jul 2020 09:46:32 +0000"  >&lt;p&gt;Hi &lt;a href=&quot;https://jira.mongodb.org/secure/ViewProfile.jspa?name=oliver%40sensortower.com&quot; class=&quot;user-hover&quot; rel=&quot;oliver@sensortower.com&quot;&gt;oliver@sensortower.com&lt;/a&gt;,&lt;/p&gt;

&lt;p&gt;What MongoDB version do you use during the initial sync?&lt;/p&gt;

&lt;p&gt;Thanks,&lt;br/&gt;
Dima&lt;/p&gt;</comment>
                    </comments>
                    <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>5.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Thu, 2 Jul 2020 09:46:32 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        3 years, 30 weeks, 3 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>dmitry.agranat@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            3 years, 30 weeks, 3 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                    <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>dmitry.agranat@mongodb.com</customfieldvalue>
            <customfieldvalue>oliver@sensortower.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hxsw4f:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hxft67:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>9223372036854775807</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                    <customfieldvalue><![CDATA[dmitry.agranat@mongodb.com]]></customfieldvalue>
    

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hxsidr:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>