Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-4094

Enable lookaside eviction while checkpoints are running

    XMLWordPrintable

    Details

    • Sprint:
      Storage Non-NYC 2018-06-04, Storage Non-NYC 2018-06-18
    • Backport Requested:
      v4.0

      Description

      When running a YCSB 50/50 workload with 16 threads throughput can decrease significantly for around 10 seconds corresponding to a portion of a checkpoint in WiredTiger.

      Investigate the root cause of the reduction in throughput, and determine if there is something we can do to mitigate it.

      The root cause turned out to be that we disabled lookaside eviction while a checkpoint was running - which meant that updates caused the cache to get stuck.

      The fix was to allow lookaside eviction while checkpoints are running and to restructure checkpoint to minimize the amount of content read from the lookaside file.

        Attachments

        1. Screen Shot 2018-05-21 at 9.45.11 am.png
          Screen Shot 2018-05-21 at 9.45.11 am.png
          122 kB
        2. w4094_las_reads_by_ckpt.png
          w4094_las_reads_by_ckpt.png
          380 kB
        3. w4094_require_las_entries.png
          w4094_require_las_entries.png
          227 kB
        4. w4094_skew_oldest.png
          w4094_skew_oldest.png
          377 kB
        5. w4094.png
          w4094.png
          343 kB

          Issue Links

            Activity

              People

              Assignee:
              neha.khatri Neha Khatri
              Reporter:
              alexander.gorrod Alexander Gorrod
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: