failed: format-stress-test-disagg-leader-2 on ubuntu2004-release-stress-tests-arm64 [wiredtiger-mongo-v8.3 @ 156d4830]

XMLWordPrintableJSON

    • Type: Build Failure
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None

      format-stress-test-disagg-leader-2 on ubuntu2004-release-stress-tests-arm64

      Host: i-0be377bdf9342e442
      Project: wiredtiger-mongo-v8.3
      Commit: 156d4830
      Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

      Task Logs:

      format-stress-test-disagg-leader-2 task_log

      Logs:

      [1778203461:046077][22357:0xffff8bfd5c80], t, file:T00003.wt_stable, eviction-server: [WT_VERB_EXTENSION][ERROR]: ext/page_log/palite/palite.cpp:1877: Pages::verify_chain(const std::vector<PageInfo>&, uint64_t)::<lambda(const PageInfo&)>: Multiple discarded pages in chain: {table_id=57, page_id=8021, lsn=2884399, backlink_lsn=2884395, base_lsn=2717881, flags=0x10002}, {table_id=57, page_id=8021, lsn=2887180, backlink_lsn=2808906, base_lsn=2717881, flags=0x10002}
[1778203461:046175][22357:0xffff8bfd5c80], t, file:T00003.wt_stable, eviction-server: [WT_VERB_EXTENSION][ERROR]: ext/page_log/palite/palite.cpp:575: int safe_call(WT_SESSION*, S*, MemberFunc, Args&& ...) [with T = PaliteHandle; S = __wt_page_log_handle; MemberFunc = int (PaliteHandle::*)(long unsigned int, long unsigned int, __wt_page_log_discard_args*); Args = {long unsigned int&, long unsigned int&, __wt_page_log_discard_args*&}; WT_SESSION = __wt_session]: Call failed
[1778203461:046186][22357:0xffff8bfd5c80], t, file:T00003.wt_stable, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curhs_search_near_helper, 751: Error at src/cursor/cur_hs.c:751: "cursor->search_near(cursor, &cmp)" failed: WT_NOTFOUND: item not found
[1778203461:046192][22357:0xffff8bfd5c80], t, file:T00003.wt_stable, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curhs_search_near_helper, 751: Error at src/cursor/cur_hs.c:751: "cursor->search_near(cursor, &cmp)" failed: WT_NOTFOUND: item not found
[1778203461:046195][22357:0xffff8bfd5c80], t, file:T00003.wt_stable, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_evict, 393: Error at src/evict/evict_page.c:393: "__evict_review(session, ref, flags, &inmem_split)" failed: Device or resource busy
[1778203461:046206][22357:0xffff8bfd5c80], t, file:T00003.wt_stable, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __evict_review, 1005: Error at src/evict/evict_page.c:1005: "ret" failed: Device or resource busy
[1778203461:046208][22357:0xffff8bfd5c80], t, file:T00003.wt_stable, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_evict, 393: Error at src/evict/evict_page.c:393: "__evict_review(session, ref, flags, &inmem_split)" failed: Device or resource busy
[1778203461:046211][22357:0xffff8bfd5c80], t, file:T00003.wt_stable, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curhs_search_near_helper, 751: Error at src/cursor/cur_hs.c:751: "cursor->search_near(cursor, &cmp)" failed: WT_NOTFOUND: item not found
[1778203461:046213][22357:0xffff8bfd5c80], t, file:T00003.wt_stable, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curhs_search_near_helper, 751: Error at src/cursor/cur_hs.c:751: "cursor->search_near(cursor, &cmp)" failed: WT_NOTFOUND: item not found
[1778203461:046216][22357:0xffff8bfd5c80], t, file:T00003.wt_stable, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_ref_block_free, 1926: Error at src/include/btree_inline.h:1926: "__wt_btree_block_free(session, addr.addr, addr.size)" failed: Invalid argument
[1778203461:046219][22357:0xffff8bfd5c80], t, file:T00003.wt_stable, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __rec_write_wrapup, 2968: Error at src/reconcile/rec_write.c:2968: "__wt_ref_block_free(session, ref, true)" failed: Invalid argument
[1778203461:046222][22357:0xffff8bfd5c80], t, file:T00003.wt_stable, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __reconcile, 388: Error at src/reconcile/rec_write.c:388: "__rec_write_wrapup(session, r)" failed: Invalid argument
[1778203461:046225][22357:0xffff8bfd5c80], t, file:T00003.wt_stable, eviction-server: [WT_VERB_DEFAULT][ERROR]: __reconcile, 442: reconciliation failed after building the disk image: Invalid argument
[1778203461:046227][22357:0xffff8bfd5c80], t, file:T00003.wt_stable, eviction-server: [WT_VERB_DEFAULT][ERROR]: __reconcile, 442: the process must exit and restart: WT_PANIC: WiredTiger library panic
t: FAILED[1778203461:046238][22357:0xffff8bfd5c80], t, file:WiredTigerSharedHS.wt_stable, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __evict_reconcile, 1281: Error at src/evict/evict_page.c:1281: "ret" failed: WT_PANIC: WiredTiger library panic
[1778203461:046242][22357:0xffff8bfd5c80], t, file:WiredTigerSharedHS.wt_stable, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_evict, 434: Error at src/evict/evict_page.c:434: "__evict_reconcile(session, ref, flags)" failed: WT_PANIC: WiredTiger library panic
t: FAILEDt: FAILED[1778203461:046244][22357:0xffff8bfd5c80], t, file:WiredTigerSharedHS.wt_stable, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __evict_thread_run, 355: Error at src/evict/evict_lru.c:355: "__evict_lru_pages(session, false)" failed: WT_PANIC: WiredTiger library panic
t: FAILEDt: FAILED[1778203461:046289][22357:0xffff8bfd5c80], t, file:WiredTigerSharedHS.wt_stable, eviction-server: [WT_VERB_DEFAULT][ERROR]: __evict_thread_run, 359: eviction thread error: WT_PANIC: WiredTiger library panic
: : : wt_wrap_begin_transaction/341: rettable_op/942: (1 && ret == WT_NOTFOUND) || ret == WT_CACHE_FULL || ret == WT_ROLLBACK: operation failed: -31804[1778203461:046306][22357:0xffff8bfd5c80], t, file:WiredTigerSharedHS.wt_stable, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __thread_run, 32: Error at src/support/thread_group.c:32: "thread->run_func(session, thread)" failed: WT_PANIC: WiredTiger library panic

      logs

      format-stress-test-disagg-leader-2 task_log

      Logs:

      : WT_PANIC: WiredTiger library panic

      logs

      format-stress-test-disagg-leader-2 task_log

      Logs:

      [1778203461:046322][22357:0xffff8bfd5c80], t, file:WiredTigerSharedHS.wt_stable, eviction-server: [WT_VERB_DEFAULT][ERROR]: __thread_run, 47: Unrecoverable utility thread error: WT_PANIC: WiredTiger library panic
[1778203461:046338][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046353][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046357][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046360][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046362][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046365][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046367][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046370][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_writelock, 364: Error at src/support/mtx_rw.c:364: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046372][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046391][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046409][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046412][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046414][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046416][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_writelock, 364: Error at src/support/mtx_rw.c:364: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046422][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046425][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046427][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046429][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046432][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046434][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046436][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046439][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_writelock, 364: Error at src/support/mtx_rw.c:364: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046441][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046444][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046446][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046448][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046451][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046453][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046457][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046459][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_writelock, 364: Error at src/support/mtx_rw.c:364: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046461][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046464][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046466][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_writelock, 364: Error at src/support/mtx_rw.c:364: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046468][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_writelock, 364: Error at src/support/mtx_rw.c:364: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046470][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed: Device or resource busy
[1778203461:046473][22357:0xffff8c7d6c80], t, file:WiredTigerHS.wt, eviction-server: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_try_readlock, 151: Error at src/support/mtx_rw.c:151: "__wt_atomic_ca

      logs

      format-stress-test-disagg-leader-2 task_log

      Logs:

      t: FAILED: timestamp_once/149: conn->set_timestamp(conn, buf): WT_PANIC: WiredTiger library panic

      logs

      format-stress-test-disagg-leader-2 task_log

      Logs:

      [1778203461:644350][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644383][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644387][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644390][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644392][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644394][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644397][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644400][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644402][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644404][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644406][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644408][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644410][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644412][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644415][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644417][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644419][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644421][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644423][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644425][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644427][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644430][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644432][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644434][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644436][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644438][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644440][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644444][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644446][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644448][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644450][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644452][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644454][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644456][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644458][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644460][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644462][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644464][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644466][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644468][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644471][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644473][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644475][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644477][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644479][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644481][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644483][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
[1778203461:644486][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 197: Error at src/cursor/cur_stat.c:197: "WT_SESSION_CHECK_PANIC(session)" failed: WT_PANIC: WiredTiger library panic
[1778203461:644488][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __statlog_dump, 379: Error at src/conn/conn_stat.c:379: "ret" failed: WT_PANIC: WiredTiger library panic
[1778203461:644499][22357:0xffff8e21ac80], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_close, 342: Error at s

      logs

      format-stress-test-disagg-leader-2 task_log

      Logs:

      t: FAILED: checkpoint/153: ret == 0 || (ret == EBUSY && ebusy_ok)

      logs

      format-stress-test-disagg-leader-2 task_log

      Logs:

      t: process aborting
WiredTiger Error: __wt_abort, 29: aborting WiredTiger library
Error at src/cursor/cur_layered.c:960: "WT_SESSION_CHECK_PANIC(session)" failed with WT_PANIC: WiredTiger library panic (-31804)

      logs

            Assignee:
            [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: