Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-11300

Investigation: Failure to Queue Pages with Many Updates in Eviction Process

    • Type: Icon: Bug Bug
    • Resolution: Done
    • Priority: Icon: Critical - P2 Critical - P2
    • None
    • Affects Version/s: None
    • Component/s: None
    • Labels:
    • Storage Engines
    • 13
    • Joker - StorEng - 2023-10-17, Asparagus-StorEng - 2023-10-31, c(3x10^8)-StorEng - 2023-11-14, 2024-02-20_A_near-death_puffin, 2024-03-05 - Claronald, 2024-03-19 - PacificOcean

      This ticket aims to investigate and (if exists) address the issue of pages with many updates not being queued in the eviction process. Despite reaching target trigger levels, the eviction server fails to populate the eviction queue with these pages, resulting in performance degradation and application thread stalls. See the related help tickets.

      Goals:

      • Investigate and replicate a scenario where clean and dirty pages are evicted, but the eviction server fails to queue pages with many updates.
      • Determine the underlying reason behind the eviction server's inability to queue these pages.

      Outcome:

      By investigating and addressing the eviction server's inability to queue pages with many updates, we aim to optimize the eviction process, prevent latency increase, and eliminate application thread stalls. This investigation (hopefully) will lead to stability in scenarios involving high update activity.

       

        1. Screenshot 2023-07-13 at 12.21.57 pm.png
          Screenshot 2023-07-13 at 12.21.57 pm.png
          584 kB
        2. Screenshot 2024-01-21 at 5.13.27 pm.png
          Screenshot 2024-01-21 at 5.13.27 pm.png
          829 kB
        3. Screenshot 2024-02-25 at 5.43.18 pm.png
          Screenshot 2024-02-25 at 5.43.18 pm.png
          313 kB
        4. Screenshot 2024-03-06 at 3.22.05 pm.png
          Screenshot 2024-03-06 at 3.22.05 pm.png
          615 kB
        5. Screenshot 2024-03-07 at 2.07.15 pm.png
          Screenshot 2024-03-07 at 2.07.15 pm.png
          97 kB

            Assignee:
            chenhao.qu@mongodb.com Chenhao Qu
            Reporter:
            siddhartha.mahajan@mongodb.com Sid Mahajan
            Andrew Morton, Sid Mahajan
            Votes:
            0 Vote for this issue
            Watchers:
            47 Start watching this issue

              Created:
              Updated:
              Resolved: