<!-- 
RSS generated by JIRA (9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66) at Thu Feb 08 03:21:21 UTC 2024

It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request.
For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request.
-->
<rss version="0.92" >
<channel>
    <title>MongoDB Jira</title>
    <link>https://jira.mongodb.org</link>
    <description>This file is an XML representation of an issue</description>
    <language>en-us</language>    <build-info>
        <version>9.7.1</version>
        <build-number>970001</build-number>
        <build-date>13-04-2023</build-date>
    </build-info>


<item>
            <title>[SERVER-9752] Resyncing a Stale Member, Stucked tor STARTUP2</title>
                <link>https://jira.mongodb.org/browse/SERVER-9752</link>
                <project id="10000" key="SERVER">Core Server</project>
                    <description>&lt;p&gt;We had a large dataset, with a stale member, and want to automatically resync it from primary (initial sync)&lt;/p&gt;

&lt;p&gt;After removing it&apos;s data directory and starting it again, it went to STARTUP2 state, and started cloning data.&lt;br/&gt;
Data cloning (and indexing) stage took 18 hours, but after initial sync, did not changed at all.&lt;/p&gt;

&lt;p&gt;This portion of log file is:&lt;br/&gt;
Tue May 21 13:39:54.466 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; oplog sync 1 of 3&lt;br/&gt;
...&lt;br/&gt;
Wed May 22 02:55:33.679 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; build index done.  scanned 52202932 total records. 5286.34 secs&lt;br/&gt;
Wed May 22 02:55:35.019 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; oplog sync 3 of 3&lt;br/&gt;
Wed May 22 02:55:35.757 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsBackgroundSync&amp;#93;&lt;/span&gt; repl: old cursor isDead, will initiate a new one&lt;br/&gt;
Wed May 22 02:59:13.691 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; replSet initialSyncOplogApplication applied 1001 operations, synced to May 21 14:22:18:22&lt;br/&gt;
Wed May 22 03:06:09.440 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; replSet initialSyncOplogApplication applied 2002 operations, synced to May 21 14:22:37:d&lt;br/&gt;
Wed May 22 03:10:59.526 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; replSet initialSyncOplogApplication applied 3003 operations, synced to May 21 14:23:25:20&lt;br/&gt;
Wed May 22 03:18:37.975 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; replSet initialSyncOplogApplication applied 4004 operations, synced to May 21 14:23:49:33&lt;br/&gt;
...&lt;br/&gt;
Wed May 22 09:56:35.674 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; replSet initialSyncOplogApplication applied 116116 operations, synced to May 21 15:27:59:10&lt;/p&gt;


&lt;p&gt;I don&apos;t know is initial sync successful or not, but we was seeing `initialSyncOplogApplication` logs every ~5min, and sync time was moving very slow (sync time move 1 hour forward after 5 hours!).&lt;/p&gt;

&lt;p&gt;We restarted mongodb service, but unfortunately, it starts to sync from scratch. With log like this:&lt;/p&gt;

&lt;p&gt;Wed May 22 10:43:28.548 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsStart&amp;#93;&lt;/span&gt; replSet I am 172.20.43.11:27118&lt;br/&gt;
Wed May 22 10:43:28.638 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsStart&amp;#93;&lt;/span&gt; replSet STARTUP2&lt;br/&gt;
Wed May 22 10:43:28.645 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; replSet initial sync pending&lt;br/&gt;
Wed May 22 10:43:58.704 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; replSet initial sync drop all databases&lt;br/&gt;
Wed May 22 10:43:58.704 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; dropAllDatabasesExceptLocal 2&lt;br/&gt;
Wed May 22 10:43:58.708 &lt;span class=&quot;error&quot;&gt;&amp;#91;rsSync&amp;#93;&lt;/span&gt; removeJournalFiles&lt;br/&gt;
....&lt;/p&gt;


&lt;p&gt;I think the state of server should be RECOVERING not STARTUP2, is this correct?&lt;br/&gt;
If yes, why server stuck to STARTUP2, and why server dropped all copied data after restart?&lt;/p&gt;</description>
                <environment>Freebsd 9.0 amd64</environment>
        <key id="76185">SERVER-9752</key>
            <summary>Resyncing a Stale Member, Stucked tor STARTUP2</summary>
                <type id="6" iconUrl="https://jira.mongodb.org/secure/viewavatar?size=xsmall&amp;avatarId=14720&amp;avatarType=issuetype">Question</type>
                                            <priority id="3" iconUrl="https://jira.mongodb.org/images/icons/priorities/major.svg">Major - P3</priority>
                        <status id="6" iconUrl="https://jira.mongodb.org/images/icons/statuses/closed.png" description="The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.">Closed</status>
                    <statusCategory id="3" key="done" colorName="success"/>
                                    <resolution id="3">Duplicate</resolution>
                                        <assignee username="thomas.rueckstiess@mongodb.com">Thomas Rueckstiess</assignee>
                                    <reporter username="taha_jahangir">Taha Jahangir</reporter>
                        <labels>
                    </labels>
                <created>Wed, 22 May 2013 10:43:37 +0000</created>
                <updated>Wed, 17 Jul 2013 16:38:23 +0000</updated>
                            <resolved>Tue, 18 Jun 2013 01:23:48 +0000</resolved>
                                    <version>2.4.3</version>
                                                    <component>Replication</component>
                                        <votes>0</votes>
                                    <watches>5</watches>
                                                                                                                <comments>
                            <comment id="347724" author="taha_jahangir" created="Wed, 29 May 2013 09:29:23 +0000"  >&lt;p&gt;But, unrelated to my problem, if initial sync have three stages (initial copy / building indexes / catching up from oplog). I think the member state should change to RECOVERING after stage-2, So it can be stopped and started again to catch-up.&lt;/p&gt;

&lt;p&gt;In our scenario, we stopped the server in catch-up stage, but the entire copied data gone!&lt;/p&gt;</comment>
                            <comment id="347722" author="taha_jahangir" created="Wed, 29 May 2013 09:24:23 +0000"  >&lt;p&gt;Thanks, Thomas&lt;/p&gt;

&lt;p&gt;You&apos;re exactly right. The secondary cannot catchup to primary, but not because of network bandwidth, limited resources or disk speed, but because of extensive write locks!&lt;/p&gt;

&lt;p&gt;Our application of write heavy app (analytical), and it seems mongodb is not good to operate in write-heavy environments. We love mongodb map/reduce framework, but write overhead is not acceptable.&lt;/p&gt;

&lt;p&gt;We are searching for a DB with high write capability (like cassandra), and with realtime map/reduce. (HADOOP is suitable mostly for offline map/reduces).&lt;/p&gt;</comment>
                            <comment id="347664" author="thomasr" created="Wed, 29 May 2013 07:10:26 +0000"  >&lt;p&gt;Hi Taha,&lt;/p&gt;

&lt;p&gt;Sorry to hear that you have trouble with your secondary catching up again with your primary node. This sounds like you&apos;re writing faster to the primary than the secondary is able to replicate. Have you looked at the network being the bottleneck for this? And are your notes set up in MMS? That would help us better understand what the problem might be.&lt;/p&gt;

&lt;p&gt;To work around the issue, you could take a snapshot of the other secondary (if available) and copy that to the node, which is described on our page &lt;a href=&quot;http://docs.mongodb.org/manual/tutorial/resync-replica-set-member/#resync-by-copying-all-datafiles-from-another-member&quot; class=&quot;external-link&quot; target=&quot;_blank&quot; rel=&quot;nofollow noopener&quot;&gt;Resync a Member of a Replica Set&lt;/a&gt;. &lt;/p&gt;

&lt;p&gt;The fact that mongod deletes all data and starts the resync from the beginning is expected behavior, and will be addressed in &lt;a href=&quot;https://jira.mongodb.org/browse/SERVER-4766&quot; title=&quot;Make initial sync restartable per collection&quot; class=&quot;issue-link&quot; data-issue-key=&quot;SERVER-4766&quot;&gt;&lt;del&gt;SERVER-4766&lt;/del&gt;&lt;/a&gt;. &lt;/p&gt;

&lt;p&gt;Regards,&lt;br/&gt;
Thomas&lt;/p&gt;</comment>
                    </comments>
                <issuelinks>
                            <issuelinktype id="10010">
                    <name>Duplicate</name>
                                            <outwardlinks description="duplicates">
                                        <issuelink>
            <issuekey id="29068">SERVER-4766</issuekey>
        </issuelink>
                            </outwardlinks>
                                                        </issuelinktype>
                    </issuelinks>
                <attachments>
                    </attachments>
                <subtasks>
                    </subtasks>
                <customfields>
                                                <customfield id="customfield_10050" key="com.atlassian.jira.toolkit:comments">
                        <customfieldname># Replies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>3.0</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10055" key="com.atlassian.jira.ext.charting:firstresponsedate">
                        <customfieldname>Date of 1st Reply</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>Wed, 29 May 2013 07:02:31 +0000</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10052" key="com.atlassian.jira.toolkit:dayslastcommented">
                        <customfieldname>Days since reply</customfieldname>
                        <customfieldvalues>
                                        10 years, 38 weeks ago
    
                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_18254" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Dependencies</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue><![CDATA[]]></customfieldvalue>


                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_15850" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary">
                        <customfieldname>Development</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <customfield id="customfield_10057" key="com.atlassian.jira.toolkit:lastusercommented">
                        <customfieldname>Last comment by Customer</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>false</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_10056" key="com.atlassian.jira.toolkit:lastupdaterorcommenter">
                        <customfieldname>Last commenter</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>ian@mongodb.com</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_11151" key="com.atlassian.jira.toolkit:LastCommentDate">
                        <customfieldname>Last public comment date</customfieldname>
                        <customfieldvalues>
                            10 years, 38 weeks ago
                        </customfieldvalues>
                    </customfield>
                                                                                                                        <customfield id="customfield_10000" key="com.atlassian.jira.plugin.system.customfieldtypes:radiobuttons">
                        <customfieldname>Old_Backport</customfieldname>
                        <customfieldvalues>
                                <customfieldvalue key="10000"><![CDATA[No]]></customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_10051" key="com.atlassian.jira.toolkit:participants">
                        <customfieldname>Participants</customfieldname>
                        <customfieldvalues>
                                        <customfieldvalue>taha_jahangir</customfieldvalue>
            <customfieldvalue>thomas.rueckstiess@mongodb.com</customfieldvalue>
    
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                        <customfield id="customfield_14254" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Product Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hrmsd3:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                <customfield id="customfield_12550" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>Rank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>2|hrqpsv:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                                                <customfield id="customfield_10558" key="com.pyxis.greenhopper.jira:gh-global-rank">
                        <customfieldname>Rank (Obsolete)</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>69687</customfieldvalue>
                        </customfieldvalues>
                    </customfield>
                                                                                            <customfield id="customfield_23361" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Requested By</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                <customfield id="customfield_10053" key="com.atlassian.jira.ext.charting:timeinstatus">
                        <customfieldname>Time In Status</customfieldname>
                        <customfieldvalues>
                            
                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <customfield id="customfield_22870" key="com.onresolve.jira.groovy.groovyrunner:scripted-field">
                        <customfieldname>Triagers</customfieldname>
                        <customfieldvalues>
                                

                        </customfieldvalues>
                    </customfield>
                                                                                                                                                                                                                                                                                                                                                                                    <customfield id="customfield_14350" key="com.pyxis.greenhopper.jira:gh-lexo-rank">
                        <customfieldname>serverRank</customfieldname>
                        <customfieldvalues>
                            <customfieldvalue>1|hs863b:</customfieldvalue>

                        </customfieldvalues>
                    </customfield>
                                    </customfields>
    </item>
</channel>
</rss>