unit-test-hook-disagg-leader-bucket01: lost connection in test_hs01 precise_checkpoint (ubuntu2004-nonstandalone)

    • Type: Build Failure
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None

      unit-test-hook-disagg-leader-bucket01 on ubuntu2004-nonstandalone

      Host: i-00f096d1997c6cf15
      Project: wiredtiger
      Commit: bdaa0078
      Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

      Task Logs:

      unit-test-hook-disagg-leader-bucket01 task_log

      Logs:

      [pid:106079]: ERROR: test_hs01.test_hs01.test_hs(row_integer.precise_checkpoint)
      ----------------------------------------------------------------------
      [pid:106079]: testtools.testresult.real._StringException: lost connection during test 'test_hs01.test_hs01.test_hs(row_integer.precise_checkpoint)'
      ----------------------------------------------------------------------
      Ran 2322 tests in 149.290s
      

      logs

      unit-test-hook-disagg-leader-bucket01 task_log

      Logs:

      #0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
      #0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
      #1  0x00007efccbe14859 in __GI_abort () at abort.c:79
      #2  0x00007efccb43b210 in __wt_abort (session=session@entry=0x5387f9d24ea0) at /data/mci/8f5600017ef104a58e4f9a18b30d0fdf/wiredtiger/src/os_common/os_abort.c:32
      #3  0x00007efccb24062a in __block_disagg_read_multiple (session=session@entry=0x5387f9d24ea0, block_disagg=block_disagg@entry=0x5387f7c64ee0, block_meta=block_meta@entry=0x7ffdb0d8c330, page_id=806, flags=0, lsn=2571, base_lsn=0, size=89, checksum=1405443535, results_array=0x7ffdb0d8c360, results_count=0x7ffdb0d8c324) at /data/mci/8f5600017ef104a58e4f9a18b30d0fdf/wiredtiger/src/block_disagg/block_disagg_read.c:166
      #4  0x00007efccb241242 in __wti_block_disagg_read_multiple (bm=<optimized out>, session=0x5387f9d24ea0, block_meta=0x7ffdb0d8c330, addr=<optimized out>, addr_size=<optimized out>, buffer_array=0x7ffdb0d8c360, buffer_count=0x7ffdb0d8c324) at /data/mci/8f5600017ef104a58e4f9a18b30d0fdf/wiredtiger/src/block_disagg/block_disagg_read.c:352
      #5  0x00007efccb235bea in __wt_blkcache_read (session=session@entry=0x5387f9d24ea0, buf=buf@entry=0x7ffdb0d8c920, block_meta=block_meta@entry=0x7ffdb0d8c8e0, addr=addr@entry=0x7ffdb0d8cdc0 "", addr_size=addr_size@entry=14) at /data/mci/8f5600017ef104a58e4f9a18b30d0fdf/wiredtiger/src/block_cache/block_io.c:186
      #6  0x00007efccb2857ef in __wti_btree_tree_open (session=session@entry=0x5387f9d24ea0, addr=addr@entry=0x7ffdb0d8cdc0 "", addr_size=14) at /data/mci/8f5600017ef104a58e4f9a18b30d0fdf/wiredtiger/src/btree/bt_handle.c:903
      #7  0x00007efccb2866ad in __wt_btree_open (session=session@entry=0x5387f9d24ea0, op_cfg=op_cfg@entry=0x7ffdb0d8f130) at /data/mci/8f5600017ef104a58e4f9a18b30d0fdf/wiredtiger/src/btree/bt_handle.c:301
      #8  0x00007efccb33fbfa in __wt_conn_dhandle_open (session=session@entry=0x5387f9d24ea0, cfg=cfg@entry=0x7ffdb0d8f130, flags=flags@entry=0) at /data/mci/8f5600017ef104a58e4f9a18b30d0fdf/wiredtiger/src/conn/conn_dhandle.c:649
      #9  0x00007efccb4d495f in __wt_session_get_dhandle (session=0x5387f9d24ea0, uri=0x5387fd680c40 "file:test_hs01.wt_stable", checkpoint=0x0, cfg=0x7ffdb0d8f130, flags=0) at /data/mci/8f5600017ef104a58e4f9a18b30d0fdf/wiredtiger/src/session/session_dhandle.c:995
      #10 0x00007efccb4d4f1d in __wt_session_get_dhandle (session=session@entry=0x5387f9d24ea0, uri=uri@entry=0x5387fd680c40 "file:test_hs01.wt_stable", checkpoint=checkpoint@entry=0x0, cfg=cfg@entry=0x7ffdb0d8f130, flags=flags@entry=0) at /data/mci/8f5600017ef104a58e4f9a18b30d0fdf/wiredtiger/src/session/session_dhandle.c:989
      #11 0x00007efccb4d5495 in __wt_session_get_btree_ckpt (session=session@entry=0x5387f9d24ea0, uri=uri@entry=0x5387fd680c40 "file:test_hs01.wt_stable", cfg=cfg@entry=0x7ffdb0d8f130, flags=flags@entry=0, hs_dhandlep=hs_dhandlep@entry=0x7ffdb0d8e758, ckpt_snapshot=ckpt_snapshot@entry=0x7ffdb0d8e780) at /data/mci/8f5600017ef104a58e4f9a18b30d0fdf/wiredtiger/src/session/session_dhandle.c:494
      #12 0x00007efccb38bea9 in __wt_curfile_open (session=session@entry=0x5387f9d24ea0, uri=uri@entry=0x5387fd680c40 "file:test_hs01.wt_stable", owner=owner@entry=0x5387fd53ab40, cfg=cfg@entry=0x7ffdb0d8f130, cursorp=cursorp@entry=0x5387fd53ad30) at /data/mci/8f5600017ef104a58e4f9a18b30d0fdf/wiredtiger/src/cursor/cur_file.c:1314
      #13 0x00007efccb4cb9a9 in __session_open_cursor_int (session=session@entry=0x5387f9d24ea0, uri=uri@entry=0x5387fd680c40 "file:test_hs01.wt_stable", owner=owner@entry=0x5387fd53ab40, other=other@entry=0x0, cfg=cfg@entry=0x7ffdb0d8f130, hash_value=1972602255275997524, cursorp=0x5387fd53ad30) at /data/mci/8f5600017ef104a58e4f9a18b30d0fdf/wiredtiger/src/session/session_api.c:697
      #14 0x00007efccb4cb371 in __wt_open_cursor (session=session@entry=0x5387f9d24ea0, uri=0x5387fd680c40 "file:test_hs01.wt_stable", owner=owner@entry=0x5387fd53ab40, cfg=cfg@entry=0x7ffdb0d8f130, cursorp=cursorp@entry=0x5387fd53ad30) at /data/mci/8f5600017ef104a58e4f9a18b30d0fdf/wiredtiger/src/session/session_api.c:806
      #15 0x00007efccb39fce7 in __clayered_open_stable_int (clayered=clayered@entry=0x5387fd53ab40, stable_uri=<optimized out>) at /data/mci/8f5600017ef104a58e4f9a18b30d0fdf/wiredtiger/src/cursor/cur_layered.c:273
      #16 0x00007efccb3a0529 in __clayered_open_stable (clayered=clayered@entry=0x5387fd53ab40, checkpoint_expected=checkpoint_expected@entry=false) at /data/mci/8f5600017ef104a58e4f9a18b30d0fdf/wiredtiger/src/cursor/cur_layered.c:344
      #17 0x00007efccb3a09f1 in __clayered_update_stable (clayered=clayered@entry=0x5387fd53ab40, flags=flags@entry=10) at /data/mci/8f5600017ef104a58e4f9a18b30d0fdf/wiredtiger/src/cursor/cur_layered.c:594
      #18 0x00007efccb3a1323 in __clayered_enter (clayered=clayered@entry=0x5387fd53ab40, flags=10, flags@entry=2) at /data/mci/8f5600017ef104a58e4f9a18b30d0fdf/wiredtiger/src/cursor/cur_layered.c:167
      #19 0x00007efccb3a38d0 in __clayered_iterate (clayered=clayered@entry=0x5387fd53ab40, iter_flag=iter_flag@entry=2) at /data/mci/8f5600017ef104a58e4f9a18b30d0fdf/wiredtiger/src/cursor/cur_layered.c:1262
      #20 0x00007efccb3a75f4 in __clayered_next (cursor=0x5387fd53ab40) at /data/mci/8f5600017ef104a58e4f9a18b30d0fdf/wiredtiger/src/cursor/cur_layered.c:1299
      #21 0x00007efccb6b8cca in _wrap_Cursor_next (self=<optimized out>, args=<optimized out>) at /data/mci/8f5600017ef104a58e4f9a18b30d0fdf/wiredtiger/cmake_build/lang/python/CMakeFiles/wiredtiger_python.dir/wiredtigerPYTHON_wrap.c:4191
      #22 0x00007efccc2efc72 in cfunction_vectorcall_O (func=0x7efccb79e340, args=0x7efcc95983d8, nargsf=<optimized out>, kwnames=<optimized out>) at ../src/Python-3.10.4/Objects/methodobject.c:516
      #23 0x00007efccc2fd582 in _PyObject_VectorcallTstate (tstate=0x5387ffe827e0, callable=0x7efccb79e340, args=0x7efcc95983d8, nargsf=<optimized out>, kwnames=<optimized out>) at ../src/Python-3.10.4/Python/ceval.c:5036
      #24 method_vectorcall (method=<optimized out>, args=0x7efcc95983e0, nargsf=<optimized out>, kwnames=<optimized out>) at ../src/Python-3.10.4/Objects/classobject.c:53
      #25 0x00007efccc2e0782 in _PyObject_VectorcallTstate (tstate=0x5387ffe827e0, callable=0x7efcc94e6300, args=0x7efcc95983e0, nargsf=<optimized out>, kwnames=0x0) at ../src/Python-3.10.4/Include/cpython/abstract.h:123
      #26 PyObject_Vectorcall (callable=0x7efcc94e6300, args=0x7efcc95983e0, nargsf=<optimized out>, kwnames=0x0) at ../src/Python-3.10.4/Include/cpython/abstract.h:123
      #27 call_function (tstate=<optimized out>, trace_info=0x7ffdb0d8fc80, pp_stack=<synthetic pointer>, oparg=<optimized out>, kwnames=0x0) at ../src/Python-3.10.4/Python/ceval.c:5867
      #28 _PyEval_EvalFrameDefault (tstate=<optimized out>, f=0x7efcc9598230, throwflag=<optimized out>) at ../src/Python-3.10.4/Python/ceval.c:4181
      #29 0x00007efccc2f06f5 in _PyEval_EvalFrame (tstate=<error reading variable: dwarf2_find_location_expression: Corrupted DWARF expression.>, f=<error reading variable: dwarf2_find_location_expression: Corrupted DWARF expression.>, throwflag=<error reading variable: dwarf2_find_location_expression: Corrupted DWARF expression.>) at ../src/Python-3.10.4/Python/ceval.c:5052
      

      logs

      unit-test-hook-disagg-leader-bucket01 task_log

      Logs:

      [1781853583:477380][106086:0x7efccbdd2cc0], test_hs01.test_hs01.test_hs(row_integer.precise_checkpoint), file:test_hs01.wt_stable, WT_CURSOR.next: [WT_VERB_DEFAULT][ERROR]: __block_disagg_read_multiple, 166: WiredTiger assertion failed: '*results_count > 0'. Expression returned false
      [1781853583:477443][106086:0x7efccbdd2cc0], test_hs01.test_hs01.test_hs(row_integer.precise_checkpoint), file:test_hs01.wt_stable, WT_CURSOR.next: [WT_VERB_DEFAULT][ERROR]: __wt_abort, 29: aborting WiredTiger library
      

      logs

            Assignee:
            [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: