format-stress leader-data-validation: __rec_split_write assertion with value_ovfl_rm on row-store leaf page

XMLWordPrintableJSON

    • Type: Build Failure
    • Resolution: Duplicate
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Reconciliation

      format-stress-test-disagg-leader-data-validation-1 on amazon2023-arm64-nonstandalone

      Host: i-0ef6d83ebf5972c11
      Project: wiredtiger
      Commit: 54a17329
      Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

      Task Logs:

      format-stress-test-disagg-leader-data-validation-1 task_log

      Logs:

          [1780393183:362862][15455:0xffff949fdbc0], t, file:T00001.wt, eviction-server: [WT_VERB_DEFAULT][ERROR]: __err_cell_type, 1024: illegal cell and page type combination: cell 0 on page at [reconcile-image] is a value_ovfl_rm cell on a row-store leaf page
    [1780393183:362896][15455:0xffff949fdbc0], t, file:T00001.wt, eviction-server: [WT_VERB_DEFAULT][ERROR]: __rec_split_write, 2644: WiredTiger assertion failed: 'verify_image == 0 || __wt_verify_dsk_image(session, "[reconcile-image]", chunk->image.data, 0, verify_addr, 0x2u) == 0'. Expression returned false
    [1780393183:362901][15455:0xffff949fdbc0], t, file:T00001.wt, eviction-server: [WT_VERB_DEFAULT][ERROR]: __wt_abort, 29: aborting WiredTiger library
    [1780393183:362908][15455:0xffff949fdbc0], t, file:T00001.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
    [1780393183:362917][15455:0xffff949fdbc0], t, file:T00001.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
    [1780393183:362920][15455:0xffff949fdbc0], t, file:T00001.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __verify_dsk_row_leaf, 594: Error at src/btree/bt_vrfy_dsk.c:594: "__err_cell_type(unpack->raw, vi)" failed: WT_ERROR: non-specific WiredTiger error

      logs

      format-stress-test-disagg-leader-data-validation-1 task_log

      Logs:

      test/format run configuration highlights

      logs

      format-stress-test-disagg-leader-data-validation-1 task_log

      Logs:

      #0  0x0000ffff952c4454 in __pthread_kill_implementation () from /lib64/libc.so.6
#0  0x0000ffff952c4454 in __pthread_kill_implementation () from /lib64/libc.so.6
#1  0x0000ffff9527b320 [PAC] in raise () from /lib64/libc.so.6
#2  0x0000ffff95262224 [PAC] in abort () from /lib64/libc.so.6
#3  0x0000ffff9564ed2c [PAC] in __wt_abort (session=session@entry=0x535a3fc8b800) at /data/mci/5493b9ce459049b61c87a2392e28c8d3/wiredtiger/src/os_common/os_abort.c:32
#4  0x0000ffff956a0644 in __rec_split_write (session=session@entry=0x535a3fc8b800, r=r@entry=0x535a2c9d0000, chunk=0x535a2c9d0070, last_block=last_block@entry=true) at /data/mci/5493b9ce459049b61c87a2392e28c8d3/wiredtiger/src/reconcile/rec_write.c:2644
#5  0x0000ffff956a1370 in __wti_rec_split_finish (session=session@entry=0x535a3fc8b800, r=r@entry=0x535a2c9d0000) at /data/mci/5493b9ce459049b61c87a2392e28c8d3/wiredtiger/src/reconcile/rec_write.c:1725
#6  0x0000ffff9568763c in __wti_rec_row_leaf (session=session@entry=0x535a3fc8b800, r=r@entry=0x535a2c9d0000, pageref=pageref@entry=0x535a0941ed20, salvage=salvage@entry=0x0) at /data/mci/5493b9ce459049b61c87a2392e28c8d3/wiredtiger/src/reconcile/rec_row.c:1416
#7  0x0000ffff9569e530 in __reconcile (session=session@entry=0x535a3fc8b800, ref=ref@entry=0x535a0941ed20, salvage=salvage@entry=0x0, flags=flags@entry=672, page_lockedp=page_lockedp@entry=0xffff949fc01f) at /data/mci/5493b9ce459049b61c87a2392e28c8d3/wiredtiger/src/reconcile/rec_write.c:316
#8  0x0000ffff9569d664 in __wt_reconcile (session=session@entry=0x535a3fc8b800, ref=ref@entry=0x535a0941ed20, salvage=salvage@entry=0x0, flags=flags@entry=672) at /data/mci/5493b9ce459049b61c87a2392e28c8d3/wiredtiger/src/reconcile/rec_write.c:127
#9  0x0000ffff956002b4 in __evict_reconcile (session=session@entry=0x535a3fc8b800, ref=ref@entry=0x535a0941ed20, evict_flags=evict_flags@entry=0) at /data/mci/5493b9ce459049b61c87a2392e28c8d3/wiredtiger/src/evict/evict_page.c:1277
#10 0x0000ffff956029f8 in __wt_evict (session=session@entry=0x535a3fc8b800, ref=0x535a0941ed20, previous_state=3 '\003', flags=flags@entry=0) at /data/mci/5493b9ce459049b61c87a2392e28c8d3/wiredtiger/src/evict/evict_page.c:443
#11 0x0000ffff955f77d8 in __wti_evict_page (session=session@entry=0x535a3fc8b800, is_server=is_server@entry=false) at /data/mci/5493b9ce459049b61c87a2392e28c8d3/wiredtiger/src/evict/evict_dispatch.c:254
#12 0x0000ffff956036d8 in __wti_evict_lru_pages (session=session@entry=0x535a3fc8b800, is_server=is_server@entry=false) at /data/mci/5493b9ce459049b61c87a2392e28c8d3/wiredtiger/src/evict/evict_queue.c:140
#13 0x0000ffff95607600 in __evict_thread_run (session=0x535a3fc8b800, thread=0x535a3fe45400) at /data/mci/5493b9ce459049b61c87a2392e28c8d3/wiredtiger/src/evict/evict_thread.c:117
#14 0x0000ffff95715574 in __thread_run (arg=0x535a3fe45400) at /data/mci/5493b9ce459049b61c87a2392e28c8d3/wiredtiger/src/support/thread_group.c:32
#15 0x0000ffff952c2834 in start_thread () from /lib64/libc.so.6
#16 0x0000ffff95266e5c [PAC] in thread_start () from /lib64/libc.so.6

      logs

      Repro Artifacts:

            Assignee:
            [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: