-
Type:
Bug
-
Resolution: Unresolved
-
Priority:
Major - P3
-
None
-
Affects Version/s: None
-
Component/s: None
-
Storage Engines, Storage Engines - Transactions
-
SE Persistence backlog
-
None
Running this test under the disagg hook gives a crash:
$ gdb --args python3 ../test/suite/run.py -v 2 --hook disagg test_prepare20.py ... Thread 1 "python3" received signal SIGABRT, Aborted. 0x0000fffff769f200 in ?? () from /lib/aarch64-linux-gnu/libc.so.6 (gdb) bt #0 0x0000fffff769f200 in ?? () from /lib/aarch64-linux-gnu/libc.so.6 #1 0x0000fffff765a67c in raise () from /lib/aarch64-linux-gnu/libc.so.6 #2 0x0000fffff7647130 in abort () from /lib/aarch64-linux-gnu/libc.so.6 #3 0x0000fffff6bdaeac in __wt_abort (session=0x8200b0) at /home/dda/wt/git/wt-15262-python-tests-stability-triage/src/os_common/os_abort.c:31 #4 0x0000fffff6c5e3b4 in __rec_hs_cursor_pos (session=0x8200b0, hs_cursor=0x20911b0, btree_id=32, key=0x7fba40, ts=23, upd_tw=0xffffffffa698, non_ts_updates=0xffffffffa10a) at /home/dda/wt/git/wt-15262-python-tests-stability-triage/src/reconcile/rec_hs.c:347 #5 0x0000fffff6c5ed00 in __rec_hs_insert_record (session=0x8200b0, cursor=0x20911b0, btree=0xa9e660, key=0x7fba40, type=3 '\003', hs_value=0x815030, tw=0xffffffffa698, error_on_ts_ordering=false) at /home/dda/wt/git/wt-15262-python-tests-stability-triage/src/reconcile/rec_hs.c:514 #6 0x0000fffff6c60d68 in __wti_rec_hs_insert_updates (session=0x8200b0, r=0x2081a10, multi=0x2090130) at /home/dda/wt/git/wt-15262-python-tests-stability-triage/src/reconcile/rec_hs.c:1111 #7 0x0000fffff6c5a684 in __rec_hs_wrapup (session=0x8200b0, r=0x2081a10) at /home/dda/wt/git/wt-15262-python-tests-stability-triage/src/reconcile/rec_write.c:3479 #8 0x0000fffff6c58cb8 in __rec_write_wrapup (session=0x8200b0, r=0x2081a10) at /home/dda/wt/git/wt-15262-python-tests-stability-triage/src/reconcile/rec_write.c:3151 #9 0x0000fffff6c4f060 in __reconcile (session=0x8200b0, ref=0x4c35c0, salvage=0x0, flags=132, page_lockedp=0xffffffffbdc0) at /home/dda/wt/git/wt-15262-python-tests-stability-triage/src/reconcile/rec_write.c:363 #10 0x0000fffff6c4ddf0 in __wt_reconcile (session=0x8200b0, ref=0x4c35c0, salvage=0x0, flags=132) at /home/dda/wt/git/wt-15262-python-tests-stability-triage/src/reconcile/rec_write.c:124 #11 0x0000fffff6a29f04 in __wt_sync_file (session=0x8200b0, syncop=WT_SYNC_CHECKPOINT) at /home/dda/wt/git/wt-15262-python-tests-stability-triage/src/btree/bt_sync.c:364 #12 0x0000fffff6a8611c in __checkpoint_tree (session=0x8200b0, is_checkpoint=true, cfg=0xffffffffd320) at /home/dda/wt/git/wt-15262-python-tests-stability-triage/src/checkpoint/checkpoint_txn.c:2547 #13 0x0000fffff6a8687c in __checkpoint_tree_helper (session=0x8200b0, cfg=0xffffffffd320) at /home/dda/wt/git/wt-15262-python-tests-stability-triage/src/checkpoint/checkpoint_txn.c:2685 #14 0x0000fffff6a7f620 in __checkpoint_apply_to_dhandles (session=0x8200b0, cfg=0xffffffffd320, op=0xfffff6a8678c <__checkpoint_tree_helper>) at /home/dda/wt/git/wt-15262-python-tests-stability-triage/src/checkpoint/checkpoint_txn.c:340 #15 0x0000fffff6a825d8 in __checkpoint_db_internal (session=0x8200b0, cfg=0xffffffffd320) at /home/dda/wt/git/wt-15262-python-tests-stability-triage/src/checkpoint/checkpoint_txn.c:1343 #16 0x0000fffff6a83b30 in __checkpoint_db_wrapper (session=0x8200b0, cfg=0xffffffffd320) at /home/dda/wt/git/wt-15262-python-tests-stability-triage/src/checkpoint/checkpoint_txn.c:1721 #17 0x0000fffff6a83e08 in __wt_checkpoint_db (session=0x8200b0, cfg=0xffffffffd320, waiting=true) at /home/dda/wt/git/wt-15262-python-tests-stability-triage/src/checkpoint/checkpoint_txn.c:1800 #18 0x0000fffff6ca1aa4 in __session_checkpoint (wt_session=0x8200b0, config=0x956f90 "") at /home/dda/wt/git/wt-15262-python-tests-stability-triage/src/session/session_api.c:2363 #19 0x0000fffff6ee998c in _wrap_Session_checkpoint (self=0xfffff70f8d60, args=0xfffff65aeb40) at /home/dda/wt/git/wt-15262-python-tests-stability-triage/build/lang/python/CMakeFiles/wiredtiger_python.dir/wiredtigerPYTHON_wrap.c:7585 #20 0x0000fffff79a06fc in cfunction_call (func=0xfffff713a7a0, args=<optimized out>, kwargs=<optimized out>) at ../src/Python-3.10.4/Objects/methodobject.c:552
This appears to crash while running scenario 9, however I don't see a crash if I specify that scenario (using -s 9). So it needs to run as indicated above, and it appears to crash reliably when getting to scenario 9.
Note: this ticket is primarily concerned with understanding and fixing the abort/crash. That alone may not fix the test, and it's okay to defer and regular logic failures to another ticket. However, if the fix allows the test to pass, please remove the test/tests from the test/hook_disagg.fail list so they will be tested regularly in Evergreen.
- related to
-
WT-15262 Disagg python testing: broad triage of apparent stability issues
-
- In Code Review
-