Loading...

XML

Word

Printable

JSON

Type: Build Failure
Resolution: Unresolved
Priority: Major - P3
Fix Version/s: None
Affects Version/s: None
Component/s: Disagg CI-blocker, Test Format
Labels:
- BB-Tools

Assigned Teams:

Storage Engines, Storage Engines - Foundations, Storage Engines - Persistence
Sprint:
SE Foundations - 2025-12-05
Story Points:
None
Evergreen Project:
- wiredtiger
Failure Type:
- failed
Failing Buildvariants:
- amazon2023-disagg-asan-stress
- amazon2023-disagg-stress
Failing Tasks:
First Failing Revision:
- 8c1942e328519d2ad93ec46c91cd11eae123616c(wiredtiger)
Linked BFG List:
https://buildbaron.corp.mongodb.com/ui/#/bf/WT-15990
Count of Linked BFGs (Last 30 days):
7

format-stress-data-validation-test-disagg-leader-palite-3 on amazon2023-disagg-stress

Host: i-0465775b9e0de8161
Project: wiredtiger
Commit: 8c1942e3
Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

Task Logs:

task format-stress-data-validation-test-disagg-leader-palite-3

format-stress-data-validation-test-disagg-leader-palite-3 task_log

Logs:

t: FAILED: checkpoint/153: ret == 0 || (ret == EBUSY && ebusy_ok)
t: FAILED: table_op/789: (1 && ret == WT_NOTFOUND) || ret == WT_CACHE_FULL || ret == WT_ROLLBACK: operation failed: 22

logs

format-stress-data-validation-test-disagg-leader-palite-3 task_log

Logs:

t: process aborting
WiredTiger Error: __wt_abort, 29: aborting WiredTiger library
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/support/mtx_rw.c:151: "__wt_atomic_cas_uint64_v(&l->u.v, old.u.v, new.u.v) ? 0 : EBUSY" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:1082: "ret" failed with Device or resource busy (16)
Error at src/evict/evict_page.c:241: "__evict_reconcile(session, ref, flags)" failed with Device or resource busy (16)

logs

format-stress-data-validation-test-disagg-leader-palite-3 task_log

Logs:

#0  0x0000ffff95ebf7b4 in __pthread_kill_implementation () from /lib64/libc.so.6
#0  0x0000ffff95ebf7b4 in __pthread_kill_implementation () from /lib64/libc.so.6
#1  0x0000ffff95e763a0 [PAC] in raise () from /lib64/libc.so.6
#2  0x0000ffff95e62264 [PAC] in abort () from /lib64/libc.so.6
#3  0x0000ffff9622ab64 [PAC] in __wt_abort (session=session@entry=0x0) at /data/mci/3d2725f29a7de37e1e1041ef251af70a/wiredtiger/src/os_common/os_abort.c:32
#4  0x000000000042524c in testutil_die (e=e@entry=0, fmt=fmt@entry=0x427508 "%s/%d: %s") at /data/mci/3d2725f29a7de37e1e1041ef251af70a/wiredtiger/test/utility/misc.c:75
#5  0x0000000000405f24 in checkpoint (arg=<optimized out>) at /data/mci/3d2725f29a7de37e1e1041ef251af70a/wiredtiger/test/format/checkpoint.c:153
#6  0x0000ffff95ebdb78 in start_thread () from /lib64/libc.so.6
#7  0x0000ffff95f2acdc [PAC] in thread_start () from /lib64/libc.so.6

logs

Repro Artifacts:

CONFIG

is related to

WT-16017 Force to use a new page id if we failed to write a replacement page

Closed

WT-15988 test/format (disagg.mode=leader) Delta chain validation failed

Closed

Assignee:: Albert Song
Reporter:: xgen-buildbaron-user
Votes:: 0 Vote for this issue
Watchers:: 3 Start watching this issue

Created:: Nov 08 2025 04:49:52 AM UTC
Updated:: Nov 14 2025 03:30:23 AM UTC

Details

Description

Attachments

Issue Links

Activity

People

Dates