Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-22389

Replica set member with data from backup fails to sync

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Duplicate
    • Affects Version/s: 3.2.1
    • Fix Version/s: None
    • Component/s: Replication
    • Labels:
      None
    • Operating System:
      ALL

      Description

      Our replica contains a primary, secondary and arbiter. Data is backed up periodically from the secondary using the recommended method (fsync lock & snapshotting). When we create a new member based on the backup - and add it to the set - it will not sync, showing this - endlessly without doing anything:

      2016-02-01T05:33:38.739+0000 I REPL     [ReplicationExecutor] syncing from: in.db2m2.mydomain.com:27017
      2016-02-01T05:33:43.812+0000 I REPL     [ReplicationExecutor] syncing from: in.db2m2.mydomain.com:27017
      2016-02-01T05:33:48.885+0000 I REPL     [ReplicationExecutor] syncing from: in.db2m2.mydomain.com:27017
      

      This happen for very recent backups (a few minutes old). Note that the data dir contains data which is identical to our secondary node, which does sync correctly, even if stopped.
      This worked for us in 3.0.

      Happens with protocol version 0 and 1.

      A log with verbose level 5 is attached. We can easily reproduce it.

      Please advise, the only way for us to add a member is to have a full initial sync which is unrealistic (our DB size is 8TB).

        Attachments

        1. conf
          1 kB
        2. log
          28 kB
        3. log.zip
          984 kB
        4. m.zip
          32.02 MB
        5. metrics.2016-02-02T15-07-47Z-00000
          3.47 MB
        6. mongod.log
          326 kB
        7. mongod-bsync-logging.gz
          13.22 MB

          Issue Links

            Activity

              People

              Assignee:
              scotthernandez Scott Hernandez
              Reporter:
              yonido Yoni Douek
              Participants:
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: