Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-2764

Optimize checkpoints to reduce throughput disruption

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major - P3
    • Resolution: Done
    • None
    • WT2.9.0, 3.2.10, 3.3.11
    • None
    • None

    Description

      There are a large set of changes in this ticket including:

      • Release checkpoint transaction before syncing.
      • Replace write leaves phase of checkpoints with a mode that steps down the dirty content in cache using eviction.
      • Change the default eviction dirty trigger (20) and target (5)

      While measuring the workload in WT-2747, I noticed that transaction IDs stayed pinned while a checkpoint was waiting for updates to sync.

      This dates back to WT-1982 and SERVER-18316: the checkpoint's transaction snapshot is released before the sync, but that no longer clears the global "checkpoint pinned" transaction ID.

      Attachments

        Issue Links

          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. WT-2666 Enhance eviction_dirty_trigger to help bound checkpoint duration

          • Major - P3 - Major loss of function.
          • Closed
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. SERVER-22906 MongoD uses excessive memory over and above the WiredTiger cache size

          • Critical - P2 - Crashes, loss of data, severe memory leak.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. WT-2647 Improve page-out behavior for OpLog

          • Major - P3 - Major loss of function.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. WT-2841 Jenkins Valgrind runner is reporting errors in test wt2719_reconfig

          • Major - P3 - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. WT-2747 Auto-tune checkpoint write-leaves phase

          • Major - P3 - Major loss of function.
          • Closed
          related to

          Improvement - An improvement or enhancement to an existing feature or task. SERVER-16665 WiredTiger b-tree uses too much space in journal directory

          • Major - P3 - Major loss of function.
          • Closed
          links to

          Web Link pull request

          Activity

            People

              michael.cahill@mongodb.com Michael Cahill (Inactive)
              michael.cahill@mongodb.com Michael Cahill (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: