-
Type:
Build Failure
-
Resolution: Unresolved
-
Priority:
Major - P3
-
None
-
Affects Version/s: None
-
Component/s: Test Format
format-stress-test-disagg-leader-data-validation-1 on amazon2023-armv9-nonstandalone
Host: i-04e1f93bb25d85bf2
Project: wiredtiger
Commit: 46d880df
Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules
Task Logs:
format-stress-test-disagg-leader-data-validation-1 task_log
Logs:
[1765991083:709562][13125:0xffff7fbddbc0], t, file:T00003.wt_stable, WT_CURSOR.insert: [WT_VERB_DEFAULT][ERROR]: __reconcile, 341: WiredTiger assertion failed: '!((((btree)->flags) & (0x0004000u)) != 0) || ((((r->multi)->flags) & (0x1u)) != 0) || page->disagg_info->block_meta.page_id == 0 || (((page)->type == 3 || (page)->type == 6) && (((((btree)->flags) & (0x0004000u)) != 0) && ((((&conn->page_delta)->flags) & (0x2u)) != 0)) && page->disagg_info->block_meta.delta_count == conn->page_delta.max_consecutive_delta)'. Expression returned false
[1765991083:709579][13125:0xffff7fbddbc0], t, file:T00003.wt_stable, WT_CURSOR.insert: [WT_VERB_DEFAULT][ERROR]: __wt_abort, 29: aborting WiredTiger library
format-stress-test-disagg-leader-data-validation-1 task_log
Logs:
test/format run configuration highlights
format-stress-test-disagg-leader-data-validation-1 task_log
Logs:
#0 0x0000ffff9bcbf7b4 in __pthread_kill_implementation () from /lib64/libc.so.6 #0 0x0000ffff9bcbf7b4 in __pthread_kill_implementation () from /lib64/libc.so.6 #1 0x0000ffff9bc763a0 [PAC] in raise () from /lib64/libc.so.6 #2 0x0000ffff9bc62264 [PAC] in abort () from /lib64/libc.so.6 #3 0x0000ffff9c02c9f4 [PAC] in __wt_abort (session=session@entry=0x30b9ffc9dc80) at /data/mci/5128a9c39a5b5c7bc2c03992ff232100/wiredtiger/src/os_common/os_abort.c:32 #4 0x0000ffff9c0775a0 in __reconcile (session=session@entry=0x30b9ffc9dc80, ref=ref@entry=0x30b9f84bbae0, salvage=salvage@entry=0x0, flags=flags@entry=5282, page_lockedp=page_lockedp@entry=0xffff7fbdaf5f) at /data/mci/5128a9c39a5b5c7bc2c03992ff232100/wiredtiger/src/reconcile/rec_write.c:341 #5 0x0000ffff9c0763bc in __wt_reconcile (session=session@entry=0x30b9ffc9dc80, ref=ref@entry=0x30b9f84bbae0, salvage=salvage@entry=0x0, flags=flags@entry=5282) at /data/mci/5128a9c39a5b5c7bc2c03992ff232100/wiredtiger/src/reconcile/rec_write.c:128 #6 0x0000ffff9bfe84a0 in __evict_reconcile (session=session@entry=0x30b9ffc9dc80, ref=ref@entry=0x30b9f84bbae0, evict_flags=evict_flags@entry=4) at /data/mci/5128a9c39a5b5c7bc2c03992ff232100/wiredtiger/src/evict/evict_page.c:1078 #7 0x0000ffff9bfea29c in __wt_evict (session=session@entry=0x30b9ffc9dc80, ref=ref@entry=0x30b9f84bbae0, previous_state=previous_state@entry=3 '\003', flags=flags@entry=4) at /data/mci/5128a9c39a5b5c7bc2c03992ff232100/wiredtiger/src/evict/evict_page.c:241 #8 0x0000ffff9bece590 in __wt_page_release_evict (session=session@entry=0x30b9ffc9dc80, ref=ref@entry=0x30b9f84bbae0, flags=flags@entry=0) at /data/mci/5128a9c39a5b5c7bc2c03992ff232100/wiredtiger/src/btree/bt_read.c:141 #9 0x0000ffff9becebf0 in __wt_page_in_func (session=session@entry=0x30b9ffc9dc80, ref=ref@entry=0x30b9f84bbae0, flags=flags@entry=256, func=func@entry=0xffff9c1b2d80 <__PRETTY_FUNCTION__.8> "__wt_row_search", line=line@entry=576) at /data/mci/5128a9c39a5b5c7bc2c03992ff232100/wiredtiger/src/btree/bt_read.c:634 #10 0x0000ffff9bf1c320 in __wt_page_swap_func (session=session@entry=0x30b9ffc9dc80, held=held@entry=0x30b9e7a56960, want=want@entry=0x30b9f84bbae0, flags=256, func=func@entry=0xffff9c1b2d80 <__PRETTY_FUNCTION__.8> "__wt_row_search", line=line@entry=576) at /data/mci/5128a9c39a5b5c7bc2c03992ff232100/wiredtiger/src/include/btree_inline.h:2562 #11 0x0000ffff9bf1cd54 in __wt_row_search (cbt=cbt@entry=0x30b9e7536500, srch_key=srch_key@entry=0x30b9e7536620, insert=insert@entry=true, leaf=leaf@entry=0x0, leaf_safe=leaf_safe@entry=false, leaf_foundp=leaf_foundp@entry=0x0) at /data/mci/5128a9c39a5b5c7bc2c03992ff232100/wiredtiger/src/btree/row_srch.c:576 #12 0x0000ffff9be8f434 in __cursor_row_search (cbt=0x30b9e7536500, insert=true, leaf=leaf@entry=0x0, leaf_foundp=leaf_foundp@entry=0x0) at /data/mci/5128a9c39a5b5c7bc2c03992ff232100/wiredtiger/src/btree/bt_cursor.c:516 #13 0x0000ffff9be8f4ac in __cursor_search (cbt=cbt@entry=0x30b9e7536500, leaf=leaf@entry=0x0, leaf_foundp=leaf_foundp@entry=0x0, insert=insert@entry=true) at /data/mci/5128a9c39a5b5c7bc2c03992ff232100/wiredtiger/src/btree/bt_cursor.c:532 #14 0x0000ffff9be92df8 in __wt_btcur_insert (cbt=cbt@entry=0x30b9e7536500) at /data/mci/5128a9c39a5b5c7bc2c03992ff232100/wiredtiger/src/btree/bt_cursor.c:1099 #15 0x0000ffff9bf88f70 in __curfile_insert (cursor=0x30b9e7536500) at /data/mci/5128a9c39a5b5c7bc2c03992ff232100/wiredtiger/src/cursor/cur_file.c:389 #16 0x0000ffff9bf9e008 in __clayered_put (session=session@entry=0x30b9ffc9dc80, clayered=clayered@entry=0x30b9e91bed80, key=key@entry=0x30b9e91beea0, value=value@entry=0xffff7fbdd160, position=position@entry=false, reserve=reserve@entry=false) at /data/mci/5128a9c39a5b5c7bc2c03992ff232100/wiredtiger/src/cursor/cur_layered.c:1520 #17 0x0000ffff9bfaa208 in __clayered_insert (cursor=0x30b9e91bed80) at /data/mci/5128a9c39a5b5c7bc2c03992ff232100/wiredtiger/src/cursor/cur_layered.c:1667 #18 0x0000000000414214 in row_insert (tinfo=tinfo@entry=0x30b9dad35c00, positioned=positioned@entry=false) at /data/mci/5128a9c39a5b5c7bc2c03992ff232100/wiredtiger/test/format/ops.c:1986 #19 0x0000000000414dd0 in table_op (tinfo=tinfo@entry=0x30b9dad35c00, intxn=intxn@entry=true, iso_level=iso_level@entry=ISOLATION_SNAPSHOT, op=<optimized out>, op@entry=INSERT) at /data/mci/5128a9c39a5b5c7bc2c03992ff232100/wiredtiger/test/format/ops.c:824 #20 0x0000000000416580 in ops (arg=0x30b9dad35c00) at /data/mci/5128a9c39a5b5c7bc2c03992ff232100/wiredtiger/test/format/ops.c:1303 #21 0x0000ffff9bcbdb78 in start_thread () from /lib64/libc.so.6 #22 0x0000ffff9bd2acdc [PAC] in thread_start () from /lib64/libc.so.6
Repro Artifacts: