Understand and fix change in dirty cache management during ycsb 95/5 workload

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Cache and Eviction
    • None
    • Storage Engines - Transactions
    • 637.309
    • SE Transactions - 2026-07-31
    • 5

      A recent run of the ycsb.out_of_cache.95read5update test in the perf waterfall shows the dirty cache fill climb past 85% during a long checkpoint at the end of the test run. During this time WT is rarely conscripting application threads to help with eviction. This explains the high dirty cache, as the server is able to keep dirtying data even though WT isn't keeping up.

      In contrast, a run from Jan 1 shows the cache behaving as expected – the dirty fill hovers around the 20% dirty eviction trigger, with application threads getting pulled in to help with eviction during checkpoints.

      We should understand what changed – whether it's a WT change, a server change, or a test change, and decide whether and how to address it.

        1. January 1.png
          January 1.png
          93 kB
        2. July 1.png
          July 1.png
          112 kB

            Assignee:
            [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            Keith Smith
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: