-
Type:
Build Failure
-
Resolution: Unresolved
-
Priority:
Major - P3
-
None
-
Affects Version/s: None
-
Component/s: Not Applicable
-
Storage Engines, Storage Engines - Persistence
-
SE Persistence - 2025-09-26
-
None
-
33
Host: rhel8-medium-11.z.devprod.mongodb.com
Project: wiredtiger
Commit: dcdc7d4c
Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules
Task Logs:
unit-test task_log
Logs:
[pid:3874487]: ERROR: test_layered04.test_layered04.test_layered04 ---------------------------------------------------------------------- [pid:3874487]: testtools.testresult.real._StringException: lost connection during test 'test_layered04.test_layered04.test_layered04' ---------------------------------------------------------------------- Ran 10641 tests in 14842.755s
unit-test task_log
Logs:
#0 0x000003ff92e471e4 in raise () from /lib64/libc.so.6 #0 0x000003ff92e471e4 in raise () from /lib64/libc.so.6 #1 0x000003ff92e23308 in abort () from /lib64/libc.so.6 #2 0x000003ff92e3c408 in __assert_fail_base () from /lib64/libc.so.6 #3 0x000003ff92e3c484 in __assert_fail () from /lib64/libc.so.6 #4 0x000003ff81f06cf2 in palm_kv_rollback_transaction (context=context@entry=0x3fff2ef9118) at /data/mci/af222920c572ef3ea7004a6e98468f04/wiredtiger/ext/page_log/palm/palm_kv.c:293 #5 0x000003ff81f05ddc in palm_handle_discard (plh=0x29b7e830, session=0x2b2278f0, page_id=106, checkpoint_id=<optimized out>, discard_args=0x3fff2ef9208) at /data/mci/af222920c572ef3ea7004a6e98468f04/wiredtiger/ext/page_log/palm/palm.c:794 #6 0x000003ff84e708ea in __wti_block_disagg_page_discard (session=session@entry=0x2b2278f0, block_disagg=0x2a1caae0, addr=<optimized out>, addr@entry=0x3fff2ef9441 "", addr_size=addr_size@entry=13) at /data/mci/af222920c572ef3ea7004a6e98468f04/wiredtiger/src/block_disagg/block_disagg_write.c:299 #7 0x000003ff84e6dc66 in __bmd_free (bm=<optimized out>, session=session@entry=0x2b2278f0, addr=addr@entry=0x3fff2ef9441 "", addr_size=13) at /data/mci/af222920c572ef3ea7004a6e98468f04/wiredtiger/src/block_disagg/block_disagg_mgr.c:79 #8 0x000003ff85027a84 in __wt_btree_block_free (session=session@entry=0x2b2278f0, addr=addr@entry=0x3fff2ef9441 "", addr_size=<optimized out>, page_replacement=page_replacement@entry=false) at /data/mci/af222920c572ef3ea7004a6e98468f04/wiredtiger/src/include/btree_inline.h:162 #9 0x000003ff8502c6de in __wt_ref_block_free (session=session@entry=0x2b2278f0, ref=ref@entry=0x2b37a4e0, page_replacement=false) at /data/mci/af222920c572ef3ea7004a6e98468f04/wiredtiger/src/include/btree_inline.h:1647 #10 0x000003ff8502df64 in __rec_write_wrapup (session=session@entry=0x2b2278f0, r=r@entry=0x2a670550) at /data/mci/af222920c572ef3ea7004a6e98468f04/wiredtiger/src/reconcile/rec_write.c:3182 #11 0x000003ff85033264 in __reconcile (session=session@entry=0x2b2278f0, ref=ref@entry=0x2b37a4e0, salvage=0x0, salvage@entry=<error reading variable: value has been optimized out>, flags=flags@entry=132, page_lockedp=page_lockedp@entry=0x3fff2efa4cf) at /data/mci/af222920c572ef3ea7004a6e98468f04/wiredtiger/src/reconcile/rec_write.c:363 #12 0x000003ff85032070 in __wt_reconcile (session=session@entry=0x2b2278f0, ref=0x2b37a4e0, salvage=<optimized out>, salvage@entry=0x0, flags=flags@entry=132) at /data/mci/af222920c572ef3ea7004a6e98468f04/wiredtiger/src/reconcile/rec_write.c:124 #13 0x000003ff84ede4d2 in __wt_sync_file (session=session@entry=0x2b2278f0, syncop=syncop@entry=WT_SYNC_CHECKPOINT) at /data/mci/af222920c572ef3ea7004a6e98468f04/wiredtiger/src/btree/bt_sync.c:364 #14 0x000003ff84f1506c in __checkpoint_tree (session=session@entry=0x2b2278f0, is_checkpoint=false, is_checkpoint@entry=true, cfg=cfg@entry=0x3fff2efb7f8) at /data/mci/af222920c572ef3ea7004a6e98468f04/wiredtiger/src/checkpoint/checkpoint_txn.c:2547 #15 0x000003ff84f15534 in __checkpoint_tree_helper (session=0x2b2278f0, cfg=0x3fff2efb7f8) at /data/mci/af222920c572ef3ea7004a6e98468f04/wiredtiger/src/checkpoint/checkpoint_txn.c:2685 #16 0x000003ff84f0f520 in __checkpoint_apply_to_dhandles (session=session@entry=0x2b2278f0, cfg=cfg@entry=0x3fff2efb7f8, op=op@entry=0x3ff84f154b0 <__checkpoint_tree_helper>) at /data/mci/af222920c572ef3ea7004a6e98468f04/wiredtiger/src/checkpoint/checkpoint_txn.c:340 #17 0x000003ff84f1606a in __checkpoint_db_internal (session=session@entry=0x2b2278f0, cfg=cfg@entry=0x3fff2efb7f8) at /data/mci/af222920c572ef3ea7004a6e98468f04/wiredtiger/src/checkpoint/checkpoint_txn.c:1343 #18 0x000003ff84f17166 in __checkpoint_db_wrapper (session=session@entry=0x2b2278f0, cfg=cfg@entry=0x3fff2efb7f8) at /data/mci/af222920c572ef3ea7004a6e98468f04/wiredtiger/src/checkpoint/checkpoint_txn.c:1721 #19 0x000003ff84f173fe in __wt_checkpoint_db (session=0x2b2278f0, cfg=cfg@entry=0x3fff2efb7f8, waiting=waiting@entry=true) at /data/mci/af222920c572ef3ea7004a6e98468f04/wiredtiger/src/checkpoint/checkpoint_txn.c:1800 #20 0x000003ff850a8382 in __wt_txn_global_shutdown (session=session@entry=0x2b225780, cfg=cfg@entry=0x3fff2efb930) at /data/mci/af222920c572ef3ea7004a6e98468f04/wiredtiger/src/txn/txn.c:2579 #21 0x000003ff84f29b70 in __conn_close (wt_conn=0x2afad660, config=<optimized out>) at /data/mci/af222920c572ef3ea7004a6e98468f04/wiredtiger/src/conn/conn_api.c:1241 #22 0x000003ff85296a3a in _wrap_Connection_close (self=<optimized out>, args=<optimized out>) at /data/mci/af222920c572ef3ea7004a6e98468f04/wiredtiger/cmake_build/lang/python/CMakeFiles/wiredtiger_python.dir/wiredtigerPYTHON_wrap.c:8619 #23 0x000003ff9345b7fe in cfunction_call (func=0x3ff8562dcb0, args=<optimized out>, kwargs=<optimized out>) at ../src/Python-3.10.4/Objects/methodobject.c:552 #24 0x000003ff9346d71c in _PyObject_Call (tstate=0x29161f30, callable=0x3ff8562dcb0, args=0x3ff19dfbd30, kwargs=0x0) at ../src/Python-3.10.4/Objects/call.c:305 #25 PyObject_Call (callable=0x3ff8562dcb0, args=0x3ff19dfbd30, kwargs=0x0) at ../src/Python-3.10.4/Objects/call.c:317 #26 0x000003ff93447992 in do_call_core (tstate=<optimized out>, trace_info=0x3fff2efc128, func=0x3ff8562dcb0, callargs=0x3ff19dfbd30, kwdict=0x0) at ../src/Python-3.10.4/Python/ceval.c:5919 #27 _PyEval_EvalFrameDefault (tstate=tstate@entry=0x29161f30, f=f@entry=0x3ff825259a0, throwflag=throwflag@entry=0) at ../src/Python-3.10.4/Python/ceval.c:4277 #28 0x000003ff9345beca in _PyEval_EvalFrame (tstate=<error reading variable: dwarf2_find_location_expression: Corrupted DWARF expression.>, f=0x3ff825259a0, throwflag=<error reading variable: dwarf2_find_location_expression: Corrupted DWARF expression.>) at ../src/Python-3.10.4/Python/ceval.c:5052 #29 _PyEval_Vector (tstate=0x29161f30, con=0x3ff8562b800, locals=0x0, args=0x29a9ab90, argcount=4396222365386, kwnames=<optimized out>) at ../src/Python-3.10.4/Python/ceval.c:5065
unit-test task_log
Logs:
[1756350674:267506][3874489:0x3ff937f5440], test_layered04.test_layered04.test_layered04, file:test_layered04.wt_stable, close_ckpt: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid argument: palm_handle_verify_page:721: Delta chain validation failed at position 1: matches.base_lsn != last_lsn. Page details: table_id=41, page_id=106, lsn=7, flags=0, matches.base_lsn=0, last_lsn=260 [1756350674:267660][3874489:0x3ff937f5440], test_layered04.test_layered04.test_layered04, file:test_layered04.wt_stable, close_ckpt: [WT_VERB_EXTENSION][ERROR]: palm LMDB: Invalid error code: /data/mci/af222920c572ef3ea7004a6e98468f04/wiredtiger/ext/page_log/palm/palm.c: 790: "palm_handle_verify_page(plh, session, page_id, lsn)": failed