ExportXMLWordPrintableJSON

    • Type: Bug
    • Resolution: Fixed
    • Priority: Major - P3
    • WT12.0.0, 9.1.0-rc0
    • Affects Version/s: None
    • Component/s: Test Format
    • None
    • Storage Engines - Foundations
    • 403.232
    • SE Foundations - 2026-11-24
    • None

      Disagg switch runs with precise_checkpoint=1 and ops.hs_cursor=1 can hang during shutdown and eventually panic with:

      Cache stuck for too long, giving up: Connection timed out

      The sequence is:

      1. Format runs a history store (HS) reader thread alongside the operation workers. The reader scans the history store to exercise cursor-order checks.
      2. The phase ends. Workers finish their transactions, close their sessions and exit.
      3. Exited workers are still included in timestamp_minimum_committed(). Their old commit timestamps can therefore hold back the stable timestamp.
      4. Format sets g.workers_finished=true, stopping the timestamp thread without a final timestamp synchronization.
      5. operations() waits for the HS reader to exit before returning to the role-switch code, where timestamps are synchronized.
      6. With dirty cache above the trigger, the HS reader is blocked inside a cursor call doing eviction assistance. It cannot check its shutdown flag until that call returns.
      7. Eviction cannot drain dirty pages containing updates newer than the stable timestamp. The timestamp update it needs is scheduled after the HS join, creating a circular wait.

      Proposed fix:

      After joining the workers and timestamp thread, synchronize the workers’ recorded commit timestamps and advance the stable timestamp before joining the HS reader.

      Keep the oldest timestamp unchanged until saved historical checks finish, so those reads remain valid.

            Assignee:
            Salman Javed
            Reporter:
            Salman Javed
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: