DC error in format with disagg (checksum mismatch in wt.wt_stable)

XMLWordPrintableJSON

    • Type: Bug
    • Resolution: Unresolved
    • Priority: Critical - P2
    • None
    • Affects Version/s: None
    • Component/s: Block Manager
    • Storage Engines, Storage Engines - Persistence
    • SE Persistence - 2025-08-01
    • 8

      While running test/format with disagg enabled and config in description, the test encountered a consistent data corruption error.

      t: process 891195 running
      t: WARNING: table selection didn't support mirroring, turning off mirroring
      0xe0358fb97ad0:[1753178579:164473][891195:0xe03590295020], t, txn-recover: [WT_VERB_RTS][WARNING]: skipped recovery RTS due to disagg
      0xe0358fb96010:[1753178580:165781][891195:0xe03590295020], t, WT_CONNECTION.close: [WT_VERB_RTS][WARNING]: skipped shutdown RTS due to disagg
      0xb2702b01f650:[1753178580:197308][891195:0xe03590295020], t, txn-recover: [WT_VERB_RTS][WARNING]: skipped recovery RTS due to disagg
      [1753178626:049759][891195:0xe034e740f120], t, file:wt.wt_stable, WT_CURSOR.prev: [WT_VERB_DEFAULT][ERROR]: __block_disagg_read_checksum_err, 48: wt.wt_stable: read checksum error for 63B block at page 2748, ckpt 5: calculated block checksum of 3139602039 (0) doesn't match expected checksum of bb228677 (0)
      [1753178626:049808][891195:0xe034e740f120], t, file:wt.wt_stable, WT_CURSOR.prev: [WT_VERB_DEFAULT][ERROR]: __wt_bm_corrupt_dump, 88: {0: 2748, 63, 0xbb228677}: (chunk 1 of 1): d3 2d 00 00 00 00 00 00 3f 00 00 00 01 00 00 00 00 07 00 00 dd 01 01 24 00 00 00 00 7d 88 8c 37 00 00 00 00 40 99 30 30 30 30 32 35 36 38 39 39 2e 30 30 2f 6f 70 71 72 73 74 75 76 77 78 79 
      [1753178626:049819][891195:0xe034e740f120], t, file:wt.wt_stable, WT_CURSOR.prev: [WT_VERB_DEFAULT][ERROR]: __block_disagg_read_multiple, 257: wt.wt_stable: fatal read error: WT_ERROR: non-specific WiredTiger error
      [1753178626:049829][891195:0xe034e740f120], t, file:wt.wt_stable, WT_CURSOR.prev: [WT_VERB_DEFAULT][ERROR]: __block_disagg_read_multiple, 257: the process must exit and restart: WT_PANIC: WiredTiger library panic
      [1753178626:049836][891195:0xe034e740f120], t, file:wt.wt_stable, WT_CURSOR.prev: [WT_VERB_DEFAULT][ERROR]: __wt_abort, 29: aborting WiredTiger library
      Aborted (core dumped)
      

              Assignee:
              Jasmine Bi
              Reporter:
              Sid Mahajan
              Sean Watt
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Created:
                Updated: