mongomirror should periodically tail oplog between index builds

XMLWordPrintableJSON

    • Type: Improvement
    • Resolution: Community Answered
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • Server Triage
    • None
    • 3
    • None
    • None
    • None
    • None
    • None
    • None

      We recently tried to copy our DB to Atlas using mongomirror.

      mongomirror has three phases:

      1. copy the collection snapshots
      2. build indexes
      3. tail the oplog for updates since step 1 completed

      In our case, it took 48h for step 2 (index build) to complete, and our oplog only had 22h worth of data. When we reached step 3 (after waiting 2 days!) the tool could not proceed.

      It would be better if the tool could inter-mix steps 2 and 3, i.e. tail the oplog each 1 hour between index builds to stay current. This would potentially save a lot of heartbreak for users in the future.

            Assignee:
            [HELP ONLY] Backlog - Triage Team
            Reporter:
            Johnny Shields
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: