Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-21129

Allow pipelining of applier work before updating-position/reporting

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major - P3
    • Resolution: Done
    • None
    • 3.2.0-rc2
    • Replication
    • None
    • Fully Compatible
    • Repl C (11/20/15)

    Description

      Currently the applier must (sequentially) do the following in a loop:

      1. batch oplog entries
      2. apply and record in local oplog
      3. journal, including minvalid
      4. report/update-position

      The task here is to break the last two steps (journal + reporting) into a separate process which doesn't block the next batch from starting/applying. This should allow higher throughput on the replicas without adversely affecting latency.

      Attachments

        Issue Links

          is depended on by

          Bug - A problem which impairs or prevents the functions of the product. SERVER-21237 ReplSetTest.prototype.awaitReplication reads directly from the oplog collection causing false positives

          • Critical - P2 - Crashes, loss of data, severe memory leak.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SERVER-21107 Improve protocol version 1 replication throughput

          • Critical - P2 - Crashes, loss of data, severe memory leak.
          • Closed
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. SERVER-23046 Reimplement operation pipelining applier work before updating-position/reporting

          • Major - P3 - Major loss of function.
          • Closed

          Activity

            People

              matt.dannenberg Matt Dannenberg
              scotthernandez Scott Hernandez (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: