-
Type:
Build Failure
-
Resolution: Fixed
-
Priority:
Major - P3
-
Affects Version/s: None
-
Component/s: Disagg CI-blocker, Reconciliation, Test Format
-
Storage Engines, Storage Engines - Transactions
-
SE Transactions - 2025-12-19
-
None
-
1
format-stress-test-disagg-leader-1 on amazon2023-stress-nonstandalone
Host: i-0fa47443e66d18eed
Project: wiredtiger
Commit: bd267722
Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules
Task Logs:
format-stress-test-disagg-leader-1 task_log
Logs:
[1764216249:585053][11916:0xffff5d1adbc0], t, file:T00001.wt_stable, WT_CURSOR.insert: [WT_VERB_DEFAULT][ERROR]: __reconcile, 344: WiredTiger assertion failed: '!((page->type) == 7 ? (((((((WT_BTREE *)(session)->dhandle->handle))->flags) & (0x0004000u)) != 0) && ((((&((WT_CONNECTION_IMPL *)((WT_SESSION_IMPL *)(session))->iface.connection)->page_delta)->flags) & (0x4u)) != 0)) : (((((((WT_BTREE *)(session)->dhandle->handle))->flags) & (0x0004000u)) != 0) && ((((&((WT_CONNECTION_IMPL *)((WT_SESSION_IMPL *)(session))->iface.connection)->page_delta)->flags) & (0x2u)) != 0))) || ((((r)->flags) & (0x0020u)) != 0) || page->disagg_info->block_meta.page_id == 0 || page->disagg_info->block_meta.delta_count == conn->page_delta.max_consecutive_delta'. Expression returned false [1764216249:585078][11916:0xffff5d1adbc0], t, file:T00001.wt_stable, WT_CURSOR.insert: [WT_VERB_DEFAULT][ERROR]: __wt_abort, 29: aborting WiredTiger library
format-stress-test-disagg-leader-1 task_log
Logs:
#0 0x0000ffff81ebf7b4 in __pthread_kill_implementation () from /lib64/libc.so.6 #0 0x0000ffff81ebf7b4 in __pthread_kill_implementation () from /lib64/libc.so.6 #1 0x0000ffff81e763a0 [PAC] in raise () from /lib64/libc.so.6 #2 0x0000ffff81e62264 [PAC] in abort () from /lib64/libc.so.6 #3 0x0000ffff82232ac0 [PAC] in __wt_abort (session=session@entry=0x53e8ffc9ea50) at /data/mci/2e1b90af8c88b6a0e5ca5bd5921d4fa1/wiredtiger/src/os_common/os_abort.c:32 #4 0x0000ffff82280278 in __reconcile (session=session@entry=0x53e8ffc9ea50, ref=ref@entry=0x53e8ea33b860, salvage=salvage@entry=0x0, flags=flags@entry=10562, page_lockedp=page_lockedp@entry=0xffff5d1ab90f) at /data/mci/2e1b90af8c88b6a0e5ca5bd5921d4fa1/wiredtiger/src/reconcile/rec_write.c:344 #5 0x0000ffff8227f028 in __wt_reconcile (session=session@entry=0x53e8ffc9ea50, ref=ref@entry=0x53e8ea33b860, salvage=salvage@entry=0x0, flags=flags@entry=10562) at /data/mci/2e1b90af8c88b6a0e5ca5bd5921d4fa1/wiredtiger/src/reconcile/rec_write.c:128 #6 0x0000ffff821ee240 in __evict_reconcile (session=session@entry=0x53e8ffc9ea50, ref=ref@entry=0x53e8ea33b860, evict_flags=evict_flags@entry=4) at /data/mci/2e1b90af8c88b6a0e5ca5bd5921d4fa1/wiredtiger/src/evict/evict_page.c:1072 #7 0x0000ffff821f00a8 in __wt_evict (session=session@entry=0x53e8ffc9ea50, ref=ref@entry=0x53e8ea33b860, previous_state=previous_state@entry=3 '\003', flags=flags@entry=4) at /data/mci/2e1b90af8c88b6a0e5ca5bd5921d4fa1/wiredtiger/src/evict/evict_page.c:241 #8 0x0000ffff820d1fc4 in __wt_page_release_evict (session=session@entry=0x53e8ffc9ea50, ref=ref@entry=0x53e8ea33b860, flags=flags@entry=0) at /data/mci/2e1b90af8c88b6a0e5ca5bd5921d4fa1/wiredtiger/src/btree/bt_read.c:135 #9 0x0000ffff82090bd8 in __wt_page_release (session=session@entry=0x53e8ffc9ea50, ref=0x53e8ea33b860, flags=flags@entry=0) at /data/mci/2e1b90af8c88b6a0e5ca5bd5921d4fa1/wiredtiger/src/include/btree_inline.h:2441 #10 0x0000ffff82092e2c in __cursor_reset (cbt=cbt@entry=0x53e8ff65b700) at /data/mci/2e1b90af8c88b6a0e5ca5bd5921d4fa1/wiredtiger/src/include/cursor_inline.h:309 #11 0x0000ffff820952a8 in __wt_btcur_insert (cbt=cbt@entry=0x53e8ff65b700) at /data/mci/2e1b90af8c88b6a0e5ca5bd5921d4fa1/wiredtiger/src/btree/bt_cursor.c:1277 #12 0x0000ffff8218e9ec in __curfile_insert (cursor=0x53e8ff65b700) at /data/mci/2e1b90af8c88b6a0e5ca5bd5921d4fa1/wiredtiger/src/cursor/cur_file.c:389 #13 0x0000ffff821a3b50 in __clayered_put (session=session@entry=0x53e8ffc9ea50, clayered=clayered@entry=0x53e8e73be000, key=key@entry=0x53e8e73be120, value=value@entry=0xffff5d1ad160, position=position@entry=false, reserve=reserve@entry=false) at /data/mci/2e1b90af8c88b6a0e5ca5bd5921d4fa1/wiredtiger/src/cursor/cur_layered.c:1523 #14 0x0000ffff821afea0 in __clayered_insert (cursor=0x53e8e73be000) at /data/mci/2e1b90af8c88b6a0e5ca5bd5921d4fa1/wiredtiger/src/cursor/cur_layered.c:1670 #15 0x0000000000414334 in row_insert (tinfo=tinfo@entry=0x53e8e9c34000, positioned=positioned@entry=false) at /data/mci/2e1b90af8c88b6a0e5ca5bd5921d4fa1/wiredtiger/test/format/ops.c:2085 #16 0x0000000000414f10 in table_op (tinfo=tinfo@entry=0x53e8e9c34000, intxn=intxn@entry=true, iso_level=iso_level@entry=ISOLATION_SNAPSHOT, op=<optimized out>, op@entry=INSERT) at /data/mci/2e1b90af8c88b6a0e5ca5bd5921d4fa1/wiredtiger/test/format/ops.c:823 #17 0x0000000000416864 in ops (arg=0x53e8e9c34000) at /data/mci/2e1b90af8c88b6a0e5ca5bd5921d4fa1/wiredtiger/test/format/ops.c:1363 #18 0x0000ffff81ebdb78 in start_thread () from /lib64/libc.so.6 #19 0x0000ffff81f2acdc [PAC] in thread_start () from /lib64/libc.so.6
Repro Artifacts: