Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-9199

Initial replication sync failed

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Works as Designed
    • Affects Version/s: 2.4.1
    • Fix Version/s: None
    • Component/s: Replication
    • Environment:
      Primary ubuntu 10.04/ mongo 2.4.1 id0
      Slave1 ubuntu 10.04/ mongo 2.4.1 id1
      Slave2 ubuntu 12.04/ mongo 2.4.1 id2
    • Operating System:
      Linux
    • Steps To Reproduce:
      Hide

      Start new replica and after 5-6 hours replica going to Assertion Failure.

      Mon Apr  1 06:10:12.909 [rsSync]   Fatal Assertion 16233
      0xdc7f71 0xd87cf3 0xbff47f 0xc1b101 0xc1bf1d 0xc1c1ec 0xe10879 0x7f569eeb1e9a 0x7f569e1c4cbd 
       /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdc7f71]
       /usr/bin/mongod(_ZN5mongo13fassertFailedEi+0xa3) [0xd87cf3]
       /usr/bin/mongod(_ZN5mongo11ReplSetImpl17syncDoInitialSyncEv+0x6f) [0xbff47f]
       /usr/bin/mongod(_ZN5mongo11ReplSetImpl11_syncThreadEv+0x71) [0xc1b101]
       /usr/bin/mongod(_ZN5mongo11ReplSetImpl10syncThreadEv+0x2d) [0xc1bf1d]
       /usr/bin/mongod(_ZN5mongo15startSyncThreadEv+0x6c) [0xc1c1ec]
       /usr/bin/mongod() [0xe10879]
       /lib/x86_64-linux-gnu/libpthread.so.0(+0x7e9a) [0x7f569eeb1e9a]
       /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f569e1c4cbd]
      Mon Apr  1 06:10:12.919 [rsSync] 
       
      ***aborting after fassert() failure
       
       
      Mon Apr  1 06:10:12.919 Got signal: 6 (Aborted).
       
      Mon Apr  1 06:10:12.923 Backtrace:
      0xdc7f71 0x6ce459 0x7f569e1074a0 0x7f569e107425 0x7f569e10ab8b 0xd87d2e 0xbff47f 0xc1b101 0xc1bf1d 0xc1c1ec 0xe10879 0x7f569eeb1e9a 0x7f569e1c4cbd 
       /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdc7f71]
       /usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0x6ce459]
       /lib/x86_64-linux-gnu/libc.so.6(+0x364a0) [0x7f569e1074a0]
       /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35) [0x7f569e107425]
       /lib/x86_64-linux-gnu/libc.so.6(abort+0x17b) [0x7f569e10ab8b]
       /usr/bin/mongod(_ZN5mongo13fassertFailedEi+0xde) [0xd87d2e]
       /usr/bin/mongod(_ZN5mongo11ReplSetImpl17syncDoInitialSyncEv+0x6f) [0xbff47f]
       /usr/bin/mongod(_ZN5mongo11ReplSetImpl11_syncThreadEv+0x71) [0xc1b101]
       /usr/bin/mongod(_ZN5mongo11ReplSetImpl10syncThreadEv+0x2d) [0xc1bf1d]
       /usr/bin/mongod(_ZN5mongo15startSyncThreadEv+0x6c) [0xc1c1ec]
       /usr/bin/mongod() [0xe10879]
       /lib/x86_64-linux-gnu/libpthread.so.0(+0x7e9a) [0x7f569eeb1e9a]
       /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f569e1c4cbd]

      Show
      Start new replica and after 5-6 hours replica going to Assertion Failure. Mon Apr 1 06:10:12.909 [rsSync] Fatal Assertion 16233 0xdc7f71 0xd87cf3 0xbff47f 0xc1b101 0xc1bf1d 0xc1c1ec 0xe10879 0x7f569eeb1e9a 0x7f569e1c4cbd /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdc7f71] /usr/bin/mongod(_ZN5mongo13fassertFailedEi+0xa3) [0xd87cf3] /usr/bin/mongod(_ZN5mongo11ReplSetImpl17syncDoInitialSyncEv+0x6f) [0xbff47f] /usr/bin/mongod(_ZN5mongo11ReplSetImpl11_syncThreadEv+0x71) [0xc1b101] /usr/bin/mongod(_ZN5mongo11ReplSetImpl10syncThreadEv+0x2d) [0xc1bf1d] /usr/bin/mongod(_ZN5mongo15startSyncThreadEv+0x6c) [0xc1c1ec] /usr/bin/mongod() [0xe10879] /lib/x86_64-linux-gnu/libpthread.so.0(+0x7e9a) [0x7f569eeb1e9a] /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f569e1c4cbd] Mon Apr 1 06:10:12.919 [rsSync]   ***aborting after fassert() failure     Mon Apr 1 06:10:12.919 Got signal: 6 (Aborted).   Mon Apr 1 06:10:12.923 Backtrace: 0xdc7f71 0x6ce459 0x7f569e1074a0 0x7f569e107425 0x7f569e10ab8b 0xd87d2e 0xbff47f 0xc1b101 0xc1bf1d 0xc1c1ec 0xe10879 0x7f569eeb1e9a 0x7f569e1c4cbd /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdc7f71] /usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0x6ce459] /lib/x86_64-linux-gnu/libc.so.6(+0x364a0) [0x7f569e1074a0] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35) [0x7f569e107425] /lib/x86_64-linux-gnu/libc.so.6(abort+0x17b) [0x7f569e10ab8b] /usr/bin/mongod(_ZN5mongo13fassertFailedEi+0xde) [0xd87d2e] /usr/bin/mongod(_ZN5mongo11ReplSetImpl17syncDoInitialSyncEv+0x6f) [0xbff47f] /usr/bin/mongod(_ZN5mongo11ReplSetImpl11_syncThreadEv+0x71) [0xc1b101] /usr/bin/mongod(_ZN5mongo11ReplSetImpl10syncThreadEv+0x2d) [0xc1bf1d] /usr/bin/mongod(_ZN5mongo15startSyncThreadEv+0x6c) [0xc1c1ec] /usr/bin/mongod() [0xe10879] /lib/x86_64-linux-gnu/libpthread.so.0(+0x7e9a) [0x7f569eeb1e9a] /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f569e1c4cbd]

      Description

      rs.conf={
      "_id" : "prod-10",
      "version" : 16,
      "members" : [

      { "_id" : 0, "host" : "prod-media-s02.10.com:27017" }

      ,

      { "_id" : 1, "host" : "prod-webapp-s03.10.com:27017" }

      ,

      { "_id" : 2, "host" : "repl-10:27017", "priority" : 0, "slaveDelay" : 1800 }

      ]
      }

      id0 and id1 in the same hosting (hetzner). network between id0 and id1 1Gb link 0.2 ms

      id2 deployed on azure. network between hetzner<>azure ~100MB link 30ms ping

        Attachments

        1. azure.pcap
          17 kB
        2. mongod.zip
          17.50 MB
        3. mongodb.log
          7.74 MB

          Activity

            People

            Assignee:
            rassi J Rassi
            Reporter:
            maratsh Marat Shakirov
            Participants:
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: