Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-15410

Batch fetch missing documents during initial sync, with retries

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major - P3
    • Resolution: Gone away
    • None
    • None
    • Replication
    • Replication

    Description

      During the first oplog apply phase in initial sync any missing local documents need to be queried for upstream. This is currently done one at a time with a max retry rate of 1; Any error will fail the initial sync process.

      By changing the process to queue up these missing document queries and retry many times we can get past connectivity issues or temporary network failures, as well as improving performance by not slowing down the apply phase to fetch these documents.

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. SERVER-24482 Initial sync during high document update/churn causes repl-worker slowness, connection churn

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-15905 Ensure Initial Sync uses the same source when fetching oplog + missing docs

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-42022 Attempt to remove initial sync missing document fetching

          • Major - P3 - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SERVER-15158 Cleanup initial sync OplogReader use

          • Minor - P4 - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          related to

          Improvement - An improvement or enhancement to an existing feature or task. SERVER-8076 Increased tolerance around network connectivity issues on initial sync

          • Major - P3 - Major loss of function.
          • Closed

          Activity

            People

              backlog-server-repl Backlog - Replication Team
              scotthernandez Scott Hernandez (Inactive)
              Votes:
              1 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: