Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-5042

Reduce configuration parsing overhead from checkpoints

    XMLWordPrintable

Details

    • Improvement
    • Status: Closed
    • Major - P3
    • Resolution: Fixed
    • None
    • WT10.0.0, 4.2.2, 4.3.2, 3.6.17, 4.0.15
    • None
    • None
    • 8
    • Storage Engines 2019-09-09, Storage Engines 2019-09-23, Storage Engines 2019-10-07, Storage Engines 2019-10-21, Storage Engines 2019-11-04, Storage Engines 2019-11-18
    • v4.2, v4.0, v3.6

    Description

      In workloads where there are a lot of open data handles, it can be disruptive to other application operations while a checkpoint gathers the set of handles that need to be included in the checkpoint. This is called the prepare phase of a checkpoint (see __checkpoint_prepare).

      I crafted a wtperf workload that uses 30,000 tables with a reasonably light insert workload. I see a lot of the time in checkpoints being spent doing configuration parsing. We should review whether it's possible to reduce the amount of time doing configuration parsing.

      Attachments

        1. ckpt_apply.png
          ckpt_apply.png
          303 kB
        2. ckpt-prepare.png
          ckpt-prepare.png
          332 kB
        3. Screen Shot 2019-08-05 at 1.52.38 pm.png
          Screen Shot 2019-08-05 at 1.52.38 pm.png
          63 kB

        Issue Links

          Activity

            People

              sue.loverso@mongodb.com Susan LoVerso
              alexander.gorrod@mongodb.com Alexander Gorrod
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: