Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-5042

Reduce configuration parsing overhead from checkpoints

XMLWordPrintableJSON

    • Type: Icon: Improvement Improvement
    • Resolution: Fixed
    • Priority: Icon: Major - P3 Major - P3
    • WT10.0.0, 4.2.2, 4.3.2, 3.6.17, 4.0.15
    • Affects Version/s: None
    • Component/s: None
    • None
    • 8
    • Storage Engines 2019-09-09, Storage Engines 2019-09-23, Storage Engines 2019-10-07, Storage Engines 2019-10-21, Storage Engines 2019-11-04, Storage Engines 2019-11-18
    • v4.2, v4.0, v3.6

      In workloads where there are a lot of open data handles, it can be disruptive to other application operations while a checkpoint gathers the set of handles that need to be included in the checkpoint. This is called the prepare phase of a checkpoint (see __checkpoint_prepare).

      I crafted a wtperf workload that uses 30,000 tables with a reasonably light insert workload. I see a lot of the time in checkpoints being spent doing configuration parsing. We should review whether it's possible to reduce the amount of time doing configuration parsing.

        1. ckpt_apply.png
          303 kB
          Susan LoVerso
        2. ckpt-prepare.png
          332 kB
          Susan LoVerso
        3. Screen Shot 2019-08-05 at 1.52.38 pm.png
          63 kB
          Alexander Gorrod

            Assignee:
            sue.loverso@mongodb.com Susan LoVerso
            Reporter:
            alexander.gorrod@mongodb.com Alexander Gorrod
            Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

              Created:
              Updated:
              Resolved: