test/format (mode=switch): verify fails with PALI/btree page count mismatch and discarded page still in use

XMLWordPrintableJSON

    • Type: Bug
    • Resolution: Duplicate
    • Priority: Critical - P2
    • None
    • Affects Version/s: None
    • Component/s: Verify

      Summary

      test/format run with mode=switch and disaggregated storage fails during WT_SESSION.verify on a follower node. Verify reports a mismatch between the PALI page count and the btree walk page count, and finds a discarded page that is still in use.

      Failure

      [2026/05/05 04:16:57.639] [1777969011:830107][346529:0x7f7ee6c2a6c0], t, file:T00002.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Mismatch in the number of page IDs found from PALI and btree walk: PALI 460 Btree walk 461
      [2026/05/05 04:16:57.639] [1777969011:830149][346529:0x7f7ee6c2a6c0], t, file:T00002.wt_stable, WT_SESSION.verify: [WT_VERB_VERIFY][ERROR]: Discarded page is still in use: BTREE[388] 521
      [2026/05/05 04:16:57.639] [1777969011:830156][346529:0x7f7ee6c2a6c0], t, file:T00002.wt_stable, WT_SESSION.verify: [WT_VERB_DEFAULT][ERROR]: __verify_page_discard, 1709: Page discard verification found mismatches: Invalid argument
      [2026/05/05 04:16:57.639] [1777969011:830432][346529:0x7f7ee6c2a6c0], t, layered:T00002, WT_SESSION.verify: [WT_VERB_DEFAULT][ERROR]: __schema_layered_stable_worker_verify, 95: Verify (layered): file:T00002.wt_stable stable table verification failed: Invalid argument
      [2026/05/05 04:16:57.639] --- [Follower] Picked up checkpoint (metadata=[metadata_lsn=660,...],timestamp=0x416d) ---
      [2026/05/05 04:16:57.639] --- [Follower] Picked up checkpoint (metadata=[metadata_lsn=731,...],timestamp=0xb296) ---
      [2026/05/05 04:16:57.639] --- [Follower] Picked up checkpoint (metadata=[metadata_lsn=816,...],timestamp=0x11df3) ---
      [2026/05/05 04:16:57.639] t: FAILED: table_verify/54: ret == 0 || ret == EBUSY || (g.disagg_storage_config && !g.disagg_leader && ret == ENOENT)
      [2026/05/05 04:16:57.639] t: run FAILED
      

            Assignee:
            [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            Sid Mahajan
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: