<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:14:47 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-7527] Improve speed of replication when in initial sync</title>
                <link>https://jira.mongodb.org/browse/SERVER-7527</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;Full sync using mongo is VERY slow. The transfer rates obtained via multi-session rsync with compression are many times faster and could be indicative in where improvements could be made.&lt;/p&gt;

&lt;p&gt;As it stands, nodes will be in initial sync for excessive amounts of time on anything other than a moderate amount of data.&lt;/p&gt;</description>
                <environment></environment>
        <key id="54971">SERVER-7527</key>
            <summary>Improve speed of replication when in initial sync</summary>
                <type id="4" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14710&amp;avatarType=issuetype">Improvement</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="9">Done</resolution>
                                        <assignee username="backlog-server-repl">Backlog - Replication Team</assignee>
                                    <reporter username="andre.defrere@mongodb.com">Andre de Frere</reporter>
                        <labels>
                            <label>PM248</label>
                    </labels>
                <created>Thu, 1 Nov 2012 05:22:30 +0000</created>
                <updated>Sun, 8 Jan 2023 12:09:23 +0000</updated>
                            <resolved>Thu, 14 Jun 2018 19:58:46 +0000</resolved>
                                                                    <component>Replication</component>
                                        <votes>7</votes>
                                    <watches>10</watches>
                                                                                                                <comments>
                            <comment id="5094786" author="JIRAUSER1259756" created="Fri, 6 Jan 2023 02:46:56 +0000"  >&lt;p&gt;Unfortunately, this is only for Enterprise Edition. We currently do not have plans to make this available for community.&#160;&lt;/p&gt;</comment>
                            <comment id="5092370" author="JIRAUSER1264630" created="Thu, 5 Jan 2023 10:45:11 +0000"  >&lt;p&gt;Thanks for the fast response Alan!&lt;/p&gt;

&lt;p&gt;I see that this option is &lt;b&gt;&lt;em&gt;Available in MongoDB Enterprise only.&lt;/em&gt;&lt;/b&gt;&lt;/p&gt;

&lt;p&gt;Is there an option for &lt;b&gt;&lt;em&gt;community edition&lt;/em&gt;&lt;/b&gt; users?&lt;/p&gt;</comment>
                            <comment id="5090489" author="JIRAUSER1259756" created="Wed, 4 Jan 2023 17:27:38 +0000"  >&lt;p&gt;Since MongoDB 5.2 Rapid Release, we&apos;ve introduced &lt;a href=&quot;https://www.mongodb.com/docs/manual/core/replica-set-sync/#file-copy-based-initial-sync&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;File Copy Based Initial Sync&lt;/a&gt;.&#160;&lt;/p&gt;

&lt;p&gt;With this method, MongoDB will copy files from the file system of the source node to the file system of the target node. This process can be faster than a logical initial sync, especially at larger data sizes. In our testing, initial sync via file copy was nearly four times (4X) faster than a logical initial sync on the same dataset. You can read more from our &lt;a href=&quot;https://www.mongodb.com/blog/post/introducing-mongodb-5-2-rapid-release&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;Blog Post&lt;/a&gt;.&lt;/p&gt;</comment>
                            <comment id="5089842" author="JIRAUSER1264630" created="Wed, 4 Jan 2023 14:44:14 +0000"  >&lt;p&gt;Hi, along side the slowness in initial-sync, having some other weird issues.&lt;/p&gt;

&lt;p&gt;I have a primary which has ~340GB of data that needs to be synced.&lt;/p&gt;

&lt;p&gt;The syncing node is very slow but sometimes even drops in its capacity and not being able to get back in order, just stuck in STARTUP2&#160; for a huge amount of time.&lt;/p&gt;

&lt;p&gt;How are you progressing with improving the initial-sync speed, and what are your production recommendations for making it faster currently? using mongo 6.0.3&lt;/p&gt;

&lt;p&gt;Adding zip file of the logs in the syncing node:&lt;/p&gt;

&lt;p&gt;&lt;span class=&quot;error&quot;&gt;&amp;#91;^mongologs.zip&amp;#93;&lt;/span&gt;&lt;/p&gt;</comment>
                            <comment id="1921100" author="spencer" created="Thu, 14 Jun 2018 19:58:46 +0000"  >&lt;p&gt;We have plans to run a whole project around improving initial sync performance&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10011">
                    <name>Depends</name>
                                            <outwardlinks description="depends on">
                                        <issuelink>
            <issuekey id="17611">SERVER-3160</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                            <issuelinktype id="10012">
                    <name>Related</name>
                                            <outwardlinks description="related to">
                                        <issuelink>
            <issuekey id="195942">SERVER-18041</issuekey>
        </issuelink>
                            </outwardlinks>
                                                                <inwardlinks description="is related to">
                                        <issuelink>
            <issuekey id="151145">SERVER-14805</issuekey>
        </issuelink>
                            </inwardlinks>
                                    </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>5.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                <customfield id="customfield_12751" key="com.atlassian.jira.plugin.system.customfieldtypes:multiselect">
                        <customfieldname>Assigned Teams</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="25128"><![CDATA[Replication]]></customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Tue, 16 Aug 2016 16:54:29 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        1 year, 4 weeks, 6 days ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[<s><a href='https://jira.mongodb.org/browse/SERVER-3160'>SERVER-3160</a></s>]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>true</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>oraiches@zadarastorage.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            1 year, 4 weeks, 6 days ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10000" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Old_Backport</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10000"><![CDATA[No]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>alan.zheng@mongodb.com</customfieldvalue>
            <customfieldvalue>andre.defrere@mongodb.com</customfieldvalue>
            <customfieldvalue>backlog-server-repl</customfieldvalue>
            <customfieldvalue>oraiches@zadarastorage.com</customfieldvalue>
            <customfieldvalue>spencer@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrnja7:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hrfybb:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>6365</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|ht0tov:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>