-
Type:
Bug
-
Resolution: Fixed
-
Priority:
Major - P3
-
Affects Version/s: None
-
Component/s: None
When running test_tiered14.py (test added by WT-8756), with the last section enabled, we get an error during a checkpoint. This ticket will be to fix the bug, enable the last section AND the commented scenarios in test_tiered14.py. If another bug prevents the entire test from running, file additional tickets.
Here's the output:
$ more stderr.txt [1643731038:575183][14749:0x7ffff7fdc740], test_tiered14.test_tiered14.test_tiered(S.string), tiered:test_tiered14-14, W T_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_block_misplaced, 303: addr-valid failed: 49152/16384 is on the disc ard list (__wt_block_addr_invalid, 162): WT_PANIC: WiredTiger library panic [1643731038:575218][14749:0x7ffff7fdc740], test_tiered14.test_tiered14.test_tiered(S.string), tiered:test_tiered14-14, W T_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_block_misplaced, 303: the process must exit and restart: WT_PANIC: WiredTiger library panic [1643731038:575227][14749:0x7ffff7fdc740], test_tiered14.test_tiered14.test_tiered(S.string), tiered:test_tiered14-14, W T_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_abort, 28: aborting WiredTiger library
and here's the stack:
#0 0x00007ffff7a22f47 in raise () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00007ffff7a248b1 in abort () from /lib/x86_64-linux-gnu/libc.so.6 #2 0x00007ffff524a74d in __wt_abort (session=session@entry=0xe44130) at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/src/os_common/os_abort.c:30 #3 0x00007ffff52b958c in __wt_panic_func (session=session@entry=0xe44130, error=error@entry=-31804, func=func@entry=0x7ffff52f4d00 <__PRETTY_FUNCTION__.45116> "__wt_block_misplaced", line=line@entry=303, category=category@entry=WT_VERB_DEFAULT, fmt=fmt@entry=0x7ffff52f4838 "%s failed: %lu/%u is on the %s list (%s, %d)") at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/src/support/err.c:550 #4 0x00007ffff50d60ab in __wt_block_misplaced (session=session@entry=0xe44130, block=block@entry=0xe29ca0, list=list@entry=0x7ffff52f3b97 "addr-valid", offset=49152, size=16384, live=live@entry=true, func=0x7ffff52f3d30 <__PRETTY_FUNCTION__.45053> "__wt_block_addr_invalid", line=162) at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/src/block/block_ext.c:301 #5 0x00007ffff50cf454 in __wt_block_addr_invalid (session=0xe44130, block=0xe29ca0, addr=<optimized out>, addr_size=<optimized out>, live=<optimized out>) at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/src/block/block_addr.c:161 #6 0x00007ffff50e2db3 in __bm_addr_invalid (bm=<optimized out>, session=<optimized out>, addr=<optimized out>, addr_size=<optimized out>) at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/src/block_cache/block_mgr.c:31 #7 0x00007ffff5162d85 in __verify_dsk_row_int (session=session@entry=0xe44130, tag=tag@entry=0x7ffff531fec4 "[write-check]", dsk=dsk@entry=0xef4dd0, addr=addr@entry=0x0) at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/src/btree/bt_vrfy_dsk.c:383 #8 0x00007ffff5166e72 in __wt_verify_dsk_image (session=session@entry=0xe44130, tag=tag@entry=0x7ffff531fec4 "[write-check]", dsk=0xef4dd0, size=<optimized out>, addr=addr@entry=0x0, empty_page_ok=empty_page_ok@entry=false) at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/src/btree/bt_vrfy_dsk.c:180 #9 0x00007ffff5167cc3 in __wt_verify_dsk (session=session@entry=0xe44130, tag=tag@entry=0x7ffff531fec4 "[write-check]", buf=buf@entry=0xed2540) at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/src/btree/bt_vrfy_dsk.c:199 #10 0x00007ffff5284a8b in __rec_write (session=session@entry=0xe44130, buf=0xed2540, addr=addr@entry=0x0, addr_sizep=addr_sizep@entry=0x0, compressed_sizep=compressed_sizep@entry=0x0, checkpoint=checkpoint@entry=true, checkpoint_io=true, compressed=false) at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/src/reconcile/rec_write.c:845 #11 0x00007ffff5288ae5 in __rec_write_wrapup (session=session@entry=0xe44130, r=r@entry=0xed23f0, page=page@entry=0xd59ec0) at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/src/reconcile/rec_write.c:2518 #12 0x00007ffff528963c in __reconcile (page_lockedp=0x7fffffffbb9f, flags=68, salvage=<optimized out>, ref=0xe77dc0, session=0xe44130) at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/src/reconcile/rec_write.c:302 #13 __wt_reconcile (session=session@entry=0xe44130, ref=0xe77dc0, salvage=salvage@entry=0x0, flags=flags@entry=68) at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/src/reconcile/rec_write.c:97 #14 0x00007ffff515734f in __wt_sync_file (session=session@entry=0xe44130, syncop=syncop@entry=WT_SYNC_CHECKPOINT) at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/src/btree/bt_sync.c:657 #15 0x00007ffff52dd078 in __checkpoint_tree (session=session@entry=0xe44130, is_checkpoint=is_checkpoint@entry=true, cfg=cfg@entry=0x7fffffffc030) at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/src/txn/txn_ckpt.c:1878 #16 0x00007ffff52dd671 in __checkpoint_tree_helper (session=0xe44130, cfg=0x7fffffffc030) at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/src/txn/txn_ckpt.c:1994 #17 0x00007ffff52d93f1 in __checkpoint_apply_to_dhandles ( session=session@entry=0xe44130, cfg=cfg@entry=0x7fffffffc030, op=op@entry=0x7ffff52dd61d <__checkpoint_tree_helper>) at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/src/txn/txn_ckpt.c:198 #18 0x00007ffff52de460 in __txn_checkpoint (cfg=0x7fffffffc030, session=0xe44130) at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/src/txn/txn_ckpt.c:920 #19 __txn_checkpoint_wrapper (session=session@entry=0xe44130, cfg=cfg@entry=0x7fffffffc030) --Type <RET> for more, q to quit, c to continue without paging-- at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/src/txn/txn_ckpt.c:1163 #20 0x00007ffff52df749 in __wt_txn_checkpoint (session=session@entry=0xe44130, cfg=cfg@entry=0x7fffffffc030, waiting=waiting@entry=true) at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/src/txn/txn_ckpt.c:1217 #21 0x00007ffff52af79f in __session_checkpoint (wt_session=0xe44130, config=<optimized out>) at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/src/session/session_api.c:1926 #22 0x00007ffff557ca96 in _wrap_Session_checkpoint (self=<optimized out>, args=<optimized out>) at /home/ubuntu/wt/git/wt-8756-tiered-null-check-tests/build/lang/python/CMakeFiles/wiredtiger_python.dir/wiredtigerPYTHON_wrap.c:7631 #23 0x00000000005667d2 in _PyCFunction_FastCallDict () #24 0x000000000050a5c3 in ?? ()