Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-10446

Block header checksum doesn't match expected (6.0)

    • Type: Icon: Build Failure Build Failure
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • Labels:

      format-stress-sanitizer-test-2 on rhel8-ppc

      Host: rhel81-ppc-11.pic.build.10gen.cc
      Project: wiredtiger-mongo-v6.0
      Commit: d31db8f8

      Task Logs:

      format-stress-sanitizer-test-2 task_log

      Logs:

      Verbose Error message
          [1672671959:800953][25930:0x7dffda2ff0e0], t, file:T00002.wt, WT_CURSOR.next: [WT_VERB_DEFAULT][ERROR]: int __wt_block_read_off(WT_SESSION_IMPL *, WT_BLOCK *, WT_ITEM *, uint32_t, wt_off_t, uint32_t, uint32_t), 226: T00002.wt: potential hardware corruption, read checksum error for 512B block at offset 150139392: block header checksum of 0xc9302eb0 doesn't match expected checksum of 0x6c6084a3
          [1672671959:808516][25930:0x7dffda2ff0e0], t, file:T00002.wt, WT_CURSOR.next: [WT_VERB_DEFAULT][ERROR]: int __wt_bm_corrupt_dump(WT_SESSION_IMPL *, WT_ITEM *, uint32_t, wt_off_t, uint32_t, uint32_t), 77: {0: 150139392, 512, 0x6c6084a3}: (chunk 1 of 1): 00 00 00 00 00 00 00 00 8c 79 04 00 00 00 00 00 da 03 00 00 0e 00 00 00 07 01 00 01 00 02 00 00 b0 2e 30 c9 00 00 00 00 60 8a e3 04 59 32 81 e4 92 b5 32 4e 80 c1 fa 30 30 30 30 34 31 35 34 30 78 9c 33 d0 f7 f1 f5 f3 0f 08 0c 0a 0e 09 0d 0b 8f 88 8c 72 74 72 76 71 75 73 f7 f0 f4 f2 1e 95 19 95 a1 ba 4c 42 d7 63 96 48 93 c6 27 eb a3 ec 42 db 0d 80 c0 c4 d0 d4 c4 c0 10 47 32 04 ab 36 6d 7c b2 fa fb ae a6 e9 70 d5 46 78 12 ad 27 5c 95 b1 9e 81 81 7e 7e 41 61 51 3f 42 08 a7 46 b0 45 66 8d 4f e4 16 29 bc 58 0c 57 6f 82 3f 77 80 35 99 37 3e 49 df 64 e7 12 0e d7 64 8a a4 29 10 2e 6a 06 73 4d 71 09 c2 23 66 78 cc 07 00 fa 14 18 0c 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
          [1672671959:808638][25930:0x7dffda2ff0e0], t, file:T00002.wt, WT_CURSOR.next: [WT_VERB_DEFAULT][ERROR]: int __wt_block_read_off(WT_SESSION_IMPL *, WT_BLOCK *, WT_ITEM *, uint32_t, wt_off_t, uint32_t, uint32_t), 235: T00002.wt: fatal read error: WT_ERROR: non-specific WiredTiger error
          [1672671959:808697][25930:0x7dffda2ff0e0], t, file:T00002.wt, WT_CURSOR.next: [WT_VERB_DEFAULT][ERROR]: int __wt_block_read_off(WT_SESSION_IMPL *, WT_BLOCK *, WT_ITEM *, uint32_t, wt_off_t, uint32_t, uint32_t), 235: the process must exit and restart: WT_PANIC: WiredTiger library panic
          [1672671959:808753][25930:0x7dffda2ff0e0], t, file:T00002.wt, WT_CURSOR.next: [WT_VERB_DEFAULT][ERROR]: void __wt_abort(WT_SESSION_IMPL *), 28: aborting WiredTiger library
          [1672678861:998520][20652:0x7ffff7ff7040], t, file:T00006.wt, WT_SESSION.verify: [WT_VERB_DEFAULT][ERROR]: int __wt_block_read_off(WT_SESSION_IMPL *, WT_BLOCK *, WT_ITEM *, uint32_t, wt_off_t, uint32_t, uint32_t), 226: T00006.wt: potential hardware corruption, read checksum error for 512B block at offset 13363200: block header checksum of 0x80317d7d doesn't match expected checksum of 0x5d9c79e5
          [1672678861:999984][20652:0x7ffff7ff7040], t, file:T00006.wt, WT_SESSION.verify: [WT_VERB_DEFAULT][ERROR]: int __wt_bm_corrupt_dump(WT_SESSION_IMPL *, WT_ITEM *, uint32_t, wt_off_t, uint32_t, uint32_t), 77: {0: 13363200, 512, 0x5d9c79e5}: (chunk 1 of 1): 00 00 00 00 00 00 00 00 5a 67 00 00 00 00 00 00 f6 05 00 00 16 00 00 00 07 09 00 01 00 02 00 00 7d 7d 31 80 01 00 00 00 71 01 00 00 43 43 43 43 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 49 60 89 e2 4c 9f 81 e4 9f c4 58 ff 80 c3 90 30 30 30 30 30 33 30 32 32 30 11 01 00 00 00 00 00 00 b6 0b 6f 2f 53 54 55 56 57 58 59 5a 41 42 43 44 45 46 47 48 49 4a 4b 4c 4d 4e 4f 50 51 52 fe 1a 00 fe 1a 00 fe 1a 00 fe 1a 00 fe 1a 00 fe 1a 00 fe 1a 00 fe 1a 00 fe 1a 00 fe 1a 00 fe 1a 00 fe 1a 00 fe 1a 00 fe 1a 00 fe 1a 00 aa 1a 00 30 60 89 e2 4c a1 81 e4 e9 70 c3 86 9f 30 01 01 10 33 30 32 31 39 79 1c 04 01 33 1c a2 81 e4 4f be c4 01 44 01 32 05 33 00 38 1d 33 01 21 18 a3 81 e4 cb 2a 67 b1 19 41 00 37 1d 21 4d 77 04 01 33 1c a4 81 e4 82 45 00 1b 76 15 41 00 36 49 33 00 01 27 1c a5 81 e4 29 b8 a3 b8 7f 15 27 00 35 49 27 00 81 ca 01 2b 1c a6 81 e4 40 73 a9 a3 8f 15 2b 00 34 59 2b 00 81 f5 01 2f 18 a7 81 e4 20 6f e2 7e 19 2f 00 33 79 2f 00 1c a8 81 e4 5a 0f 2f 4d 64 15 5e 00 32 51 2f 00 01 45 1c a9 81 e4 f2 8c 89 b1 72 15 29 00 31 3e 29 00 01 26 1c aa 81 e4 be 86 be f1 7b 15 26 00 30 3e 26 00 0c 48 49 4a 4b 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
          [1672678882:339225][20652:0x7ffff7ff7040], t, file:T00006.wt, WT_SESSION.verify: [WT_VERB_DEFAULT][ERROR]: int __verify_ckptfrag_chk(WT_SESSION_IMPL *, WT_BLOCK *), 520: checkpoint ranges never verified: 25768
          [1672678901:896629][20652:0x7ffff7ff7040], t, file:T00006.wt, WT_SESSION.verify: [WT_VERB_DEFAULT][ERROR]: int __verify_filefrag_chk(WT_SESSION_IMPL *, WT_BLOCK *), 434: file ranges never verified: 25767
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_mongo_v6.0_rhel8_ppc_format_stress_sanitizer_test_2_63b2d1ced6d80a0c1f12f7e0_23_01_02_12_45_02/0?type=T#L1077
      
      Test Failure message
          t: FAILED: void wts_verify(TABLE *, void *)/557: ret == 0 || ret == EBUSY
      
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_mongo_v6.0_rhel8_ppc_format_stress_sanitizer_test_2_63b2d1ced6d80a0c1f12f7e0_23_01_02_12_45_02/0?type=T#L1543
      
      Failure keywords
          t: process aborting
          WiredTiger Error: void __wt_abort(WT_SESSION_IMPL *), 28: aborting WiredTiger library
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_mongo_v6.0_rhel8_ppc_format_stress_sanitizer_test_2_63b2d1ced6d80a0c1f12f7e0_23_01_02_12_45_02/0?type=T#L1798
      

      logs

            Assignee:
            backlog-server-storage-engines [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            Xgen-BuildBaron-User xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: