Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-14336

Investigate / Characterise History Store impact on App thread eviction

    • Type: Icon: Task Task
    • Resolution: Unresolved
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Cache and Eviction
    • None
    • Storage Engines, Storage Engines - Transactions
    • 5
    • Transactions - 2025-05-09

      History store is an internal data store of storage engines which cannot be directly controlled by application with respect to its contribution to the cache pressure. Reconciliation of a data store page either by checkpoint or eviction will not ease cache pressure much due to dirty content movement from data store to history store. As a result checkpointing could lead to tipping the cache thresholds, resulting in app thread eviction.

      We need to understand the cases of cache pressure due to history store. By understanding these cases, different eviction strategies can be considered. eg: maintaining history store cache usage to data store cache usage as 1:4, or prioritising history store dirty eviction over data store dirty eviction in app threads based on the history store cache utilisation etc.,

      Attached a FTDC snapshot from YCSB 100% update perf test. It seems checkpoint is triggering app thread eviction due to history store contribution to cache pressure.

      Definition of done: Add stats to understand the history store contribution of cache utilization in terms of updates, dirty content and total content.

            Assignee:
            backlog-server-storage-engines [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            vamsi.krishna@mongodb.com Vamsi Boyapati
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: