Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-5042

Reduce configuration parsing overhead from checkpoints

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: WT3.2.2, 4.2.2, 4.3.2
    • Component/s: None
    • Labels:
      None
    • Story Points:
      8
    • Sprint:
      Storage Engines 2019-09-09, Storage Engines 2019-09-23, Storage Engines 2019-10-07, Storage Engines 2019-10-21, Storage Engines 2019-11-04, Storage Engines 2019-11-18
    • Backport Requested:
      v4.2, v4.0, v3.6

      Description

      In workloads where there are a lot of open data handles, it can be disruptive to other application operations while a checkpoint gathers the set of handles that need to be included in the checkpoint. This is called the prepare phase of a checkpoint (see __checkpoint_prepare).

      I crafted a wtperf workload that uses 30,000 tables with a reasonably light insert workload. I see a lot of the time in checkpoints being spent doing configuration parsing. We should review whether it's possible to reduce the amount of time doing configuration parsing.

        Attachments

        1. ckpt_apply.png
          ckpt_apply.png
          303 kB
        2. ckpt-prepare.png
          ckpt-prepare.png
          332 kB
        3. Screen Shot 2019-08-05 at 1.52.38 pm.png
          Screen Shot 2019-08-05 at 1.52.38 pm.png
          63 kB

          Issue Links

            Activity

              People

              • Assignee:
                sue.loverso Susan LoVerso
                Reporter:
                alexander.gorrod Alexander Gorrod
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: