failed: unit-test-extra-long on amazon2023-armv9 [wiredtiger @ b6068042]

    • Type: Build Failure
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None

      unit-test-extra-long on amazon2023-armv9

      Host: i-0156a38ac0d7a024c
      Project: wiredtiger
      Commit: b6068042
      Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

      Task Logs:

      unit-test-extra-long task_log

      Logs:

      [pid:7505]: test_layered47.test_layered47.test_checkpoint_order_mismatch -s 0 (palite): starting
      [pid:7505]: test_layered47.test_layered47.test_checkpoint_order_mismatch -s 0 (palite): 0.29 seconds
      [pid:7503/7505]: test_layered47.test_layered47.test_checkpoint_order_mismatch(palite) ... ok
      

      logs

      unit-test-extra-long task_log

      Logs:

      [pid:7503]: ERROR: test_layered27.test_layered27.test_drain_insert_update(palite.large)
      ----------------------------------------------------------------------
      [pid:7503]: testtools.testresult.real._StringException: lost connection during test 'test_layered27.test_layered27.test_drain_insert_update(palite.large)'
      ----------------------------------------------------------------------
      Ran 45773 tests in 4672.798s
      

      logs

      unit-test-extra-long task_log

      Logs:

      #0  0x0000ffff9ee0e7b4 in __pthread_kill_implementation () from /lib64/libc.so.6
      #0  0x0000ffff9ee0e7b4 in __pthread_kill_implementation () from /lib64/libc.so.6
      #1  0x0000ffff9edc53a0 [PAC] in raise () from /lib64/libc.so.6
      #2  0x0000ffff9edb1264 [PAC] in abort () from /lib64/libc.so.6
      #3  0x0000ffff9e22a970 [PAC] in __wt_abort (session=session@entry=0x1071bf263828) at /data/mci/f17840dbcaeab88121ed02af339ef16c/wiredtiger/src/os_common/os_abort.c:32
      #4  0x0000ffff9e2cf734 in __wt_panic_func (session=session@entry=0x1071bf263828, error=error@entry=22, func=func@entry=0xffff9e3c4b10 <__PRETTY_FUNCTION__.64> "__reconcile", line=line@entry=442, category=category@entry=WT_VERB_DEFAULT, fmt=fmt@entry=0xffff9e37ee38 "reconciliation failed after building the disk image") at /data/mci/f17840dbcaeab88121ed02af339ef16c/wiredtiger/src/support/err.c:611
      #5  0x0000ffff9e277e70 in __reconcile (session=session@entry=0x1071bf263828, ref=ref@entry=0x107175ffd9a0, salvage=salvage@entry=0x0, flags=flags@entry=4, page_lockedp=page_lockedp@entry=0xfffffb73317f) at /data/mci/f17840dbcaeab88121ed02af339ef16c/wiredtiger/src/reconcile/rec_write.c:442
      #6  0x0000ffff9e2768e8 in __wt_reconcile (session=session@entry=0x1071bf263828, ref=0x107175ffd9a0, salvage=salvage@entry=0x0, flags=flags@entry=4) at /data/mci/f17840dbcaeab88121ed02af339ef16c/wiredtiger/src/reconcile/rec_write.c:128
      #7  0x0000ffff9e0ecb68 in __wt_sync_file (session=session@entry=0x1071bf263828, syncop=syncop@entry=WT_SYNC_CHECKPOINT) at /data/mci/f17840dbcaeab88121ed02af339ef16c/wiredtiger/src/btree/bt_sync.c:365
      #8  0x0000ffff9e128798 in __checkpoint_tree (session=session@entry=0x1071bf263828, is_checkpoint=is_checkpoint@entry=true, cfg=cfg@entry=0xfffffb734590) at /data/mci/f17840dbcaeab88121ed02af339ef16c/wiredtiger/src/checkpoint/checkpoint_txn.c:2576
      #9  0x0000ffff9e129104 in __wt_checkpoint_file (session=session@entry=0x1071bf263828, cfg=cfg@entry=0xfffffb734590) at /data/mci/f17840dbcaeab88121ed02af339ef16c/wiredtiger/src/checkpoint/checkpoint_txn.c:2795
      #10 0x0000ffff9e129e30 in __checkpoint_db_internal (session=session@entry=0x1071bf263828, cfg=cfg@entry=0xfffffb734590) at /data/mci/f17840dbcaeab88121ed02af339ef16c/wiredtiger/src/checkpoint/checkpoint_txn.c:1406
      #11 0x0000ffff9e12aea8 in __checkpoint_db_wrapper (session=session@entry=0x1071bf263828, cfg=cfg@entry=0xfffffb734590) at /data/mci/f17840dbcaeab88121ed02af339ef16c/wiredtiger/src/checkpoint/checkpoint_txn.c:1750
      #12 0x0000ffff9e12b288 in __wt_checkpoint_db (session=0x1071bf263828, cfg=cfg@entry=0xfffffb734590, waiting=waiting@entry=true) at /data/mci/f17840dbcaeab88121ed02af339ef16c/wiredtiger/src/checkpoint/checkpoint_txn.c:1829
      #13 0x0000ffff9e2fcccc in __wt_txn_global_shutdown (session=session@entry=0x1071bf25e000, cfg=cfg@entry=0xfffffb734668) at /data/mci/f17840dbcaeab88121ed02af339ef16c/wiredtiger/src/txn/txn.c:2570
      #14 0x0000ffff9e140b08 in __conn_close (wt_conn=0x107178d5e000, config=<optimized out>) at /data/mci/f17840dbcaeab88121ed02af339ef16c/wiredtiger/src/conn/conn_api.c:1241
      #15 0x0000ffff9e5c381c in _wrap_Connection_close (self=<optimized out>, args=<optimized out>) at /data/mci/f17840dbcaeab88121ed02af339ef16c/wiredtiger/cmake_build/lang/python/CMakeFiles/wiredtiger_python.dir/wiredtigerPYTHON_wrap.c:8779
      #16 0x0000ffff9f0d05ec in cfunction_call (func=0xffff9e803600, args=<optimized out>, kwargs=<optimized out>) at ../src/Python-3.10.4/Objects/methodobject.c:552
      #17 0x0000ffff9f0e0a4c in _PyObject_Call (tstate=0x10717fe0c000, callable=0xffff9e803600, args=0xffff85696b90, kwargs=<optimized out>) at ../src/Python-3.10.4/Objects/call.c:305
      #18 PyObject_Call (callable=0xffff9e803600, args=0xffff85696b90, kwargs=<optimized out>) at ../src/Python-3.10.4/Objects/call.c:317
      #19 0x0000ffff9f0be99c in do_call_core (tstate=<optimized out>, trace_info=0xfffffb734d00, func=0xffff9e803600, callargs=0xffff85696b90, kwdict=0x0) at ../src/Python-3.10.4/Python/ceval.c:5919
      #20 _PyEval_EvalFrameDefault (tstate=0x10717fe0c000, f=<optimized out>, throwflag=<optimized out>) at ../src/Python-3.10.4/Python/ceval.c:4277
      #21 0x0000ffff9f0d0e2c in _PyEval_EvalFrame (tstate=0x10717fe0c000, f=0xffff9a889b70, throwflag=0) at ../src/Python-3.10.4/Include/internal/pycore_ceval.h:46
      #22 _PyEval_Vector (tstate=0x10717fe0c000, con=0xffff9e7abbf0, locals=0x0, args=<optimized out>, argcount=<optimized out>, kwnames=<optimized out>) at ../src/Python-3.10.4/Python/ceval.c:5065
      #23 _PyFunction_Vectorcall (func=0xffff9e7abbe0, stack=<optimized out>, nargsf=<optimized out>, kwnames=<optimized out>) at ../src/Python-3.10.4/Objects/call.c:342
      #24 0x0000ffff9f0bcb18 in _PyObject_VectorcallTstate (tstate=<optimized out>, callable=<optimized out>, args=<optimized out>, nargsf=<optimized out>, kwnames=0x0) at ../src/Python-3.10.4/Include/cpython/abstract.h:114
      #25 PyObject_Vectorcall (callable=<optimized out>, args=<optimized out>, nargsf=<optimized out>, kwnames=0x0) at ../src/Python-3.10.4/Include/cpython/abstract.h:123
      #26 call_function (tstate=<optimized out>, trace_info=0xfffffb734ed0, pp_stack=<synthetic pointer>, oparg=<optimized out>, kwnames=0x0) at ../src/Python-3.10.4/Python/ceval.c:5867
      #27 _PyEval_EvalFrameDefault (tstate=0x10717fe0c000, f=<optimized out>, throwflag=<optimized out>) at ../src/Python-3.10.4/Python/ceval.c:4198
      #28 0x0000ffff9f0d0e2c in _PyEval_EvalFrame (tstate=0x10717fe0c000, f=0x10717f4bad90, throwflag=0) at ../src/Python-3.10.4/Include/internal/pycore_ceval.h:46
      #29 _PyEval_Vector (tstate=0x10717fe0c000, con=0xffff9e505250, locals=0x0, args=<optimized out>, argcount=<optimized out>, kwnames=<optimized out>) at ../src/Python-3.10.4/Python/ceval.c:5065
      

      logs

      unit-test-extra-long task_log

      Logs:

      [1762129077:885366][7575:0xffffa04c6040], test_layered27.test_layered27.test_drain_insert_update(palite.large), file:WiredTigerSharedHS.wt_stable, close_ckpt: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
      [1762129077:885410][7575:0xffffa04c6040], test_layered27.test_layered27.test_drain_insert_update(palite.large), file:WiredTigerSharedHS.wt_stable, close_ckpt: [WT_VERB_ERROR_RETURNS][ERROR]: __wti_block_disagg_write_internal, 184: Error at src/block_disagg/block_disagg_write.c:184: "plhandle->plh_put(plhandle, &session->iface, page_id, 0, &put_args, buf)" failed: Invalid argument
      [1762129077:885422][7575:0xffffa04c6040], test_layered27.test_layered27.test_drain_insert_update(palite.large), file:WiredTigerSharedHS.wt_stable, close_ckpt: [WT_VERB_ERROR_RETURNS][ERROR]: __bmd_checkpoint_pack_raw, 54: Error at src/block_disagg/block_disagg_ckpt.c:54: "__wti_block_disagg_write_internal( session, block_disagg, root_image, block_meta, &size, &checksum, true, true)" failed: Invalid argument
      [1762129077:885429][7575:0xffffa04c6040], test_layered27.test_layered27.test_drain_insert_update(palite.large), file:WiredTigerSharedHS.wt_stable, close_ckpt: [WT_VERB_ERROR_RETURNS][ERROR]: __wti_block_disagg_checkpoint, 102: Error at src/block_disagg/block_disagg_ckpt.c:102: "__bmd_checkpoint_pack_raw(block_disagg, session, root_image, block_meta, ckpt)" failed: Invalid argument
      [1762129077:885435][7575:0xffffa04c6040], test_layered27.test_layered27.test_drain_insert_update(palite.large), file:WiredTigerSharedHS.wt_stable, close_ckpt: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_blkcache_write, 789: Error at src/block_cache/block_io.c:789: "checkpoint ? bm->checkpoint(bm, session, ip, block_meta, btree->ckpt, data_checksum) : bm->write(bm, session, ip, block_meta, addr, addr_sizep, data_checksum, checkpoint_io)" failed: Invalid argument
      [1762129077:885441][7575:0xffffa04c6040], test_layered27.test_layered27.test_drain_insert_update(palite.large), file:WiredTigerSharedHS.wt_stable, close_ckpt: [WT_VERB_ERROR_RETURNS][ERROR]: __rec_write_wrapup, 3234: Error at src/reconcile/rec_write.c:3234: "__rec_write(session, r->wrapup_checkpoint, &r->wrapup_checkpoint_block_meta, NULL, NULL, NULL, true, F_ISSET(r, WT_REC_CHECKPOINT), r->wrapup_checkpoint_compressed)" failed: Invalid argument
      [1762129077:885447][7575:0xffffa04c6040], test_layered27.test_layered27.test_drain_insert_update(palite.large), file:WiredTigerSharedHS.wt_stable, close_ckpt: [WT_VERB_ERROR_RETURNS][ERROR]: __reconcile, 387: Error at src/reconcile/rec_write.c:387: "__rec_write_wrapup(session, r)" failed: Invalid argument
      [1762129077:885453][7575:0xffffa04c6040], test_layered27.test_layered27.test_drain_insert_update(palite.large), file:WiredTigerSharedHS.wt_stable, close_ckpt: [WT_VERB_DEFAULT][ERROR]: __reconcile, 442: reconciliation failed after building the disk image: Invalid argument
      [1762129077:885459][7575:0xffffa04c6040], test_layered27.test_layered27.test_drain_insert_update(palite.large), file:WiredTigerSharedHS.wt_stable, close_ckpt: [WT_VERB_DEFAULT][ERROR]: __reconcile, 442: the process must exit and restart: WT_PANIC: WiredTiger library panic
      [1762129077:885464][7575:0xffffa04c6040], test_layered27.test_layered27.test_drain_insert_update(palite.large), file:WiredTigerSharedHS.wt_stable, close_ckpt: [WT_VERB_DEFAULT][ERROR]: __wt_abort, 29: aborting WiredTiger library
      

      logs

            Assignee:
            [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: