Loading...

XML

Word

Printable

JSON

Type: Build Failure
Resolution: Gone away
Priority: Minor - P4
Fix Version/s: None
Affects Version/s: None
Component/s: Test Format
Labels:
- BB-Tools

Assigned Teams:

Storage Engines
Sprint:
None
Story Points:
None
Evergreen Project:
- wiredtiger
Failure Type:
- failed
Failing Buildvariants:
- ubuntu2004-stress-tests
Failing Tasks:
- format-stress-test-3
First Failing Revision:
- 30f7d21f2670bcc3afd730e799ef17373559b70a(wiredtiger)
Linked BFG List:
https://buildbaron.corp.mongodb.com/ui/#/bf/WT-16863
Count of Linked BFGs (Last 30 days):
1

format-stress-test-3 on ubuntu2004-stress-tests

Host: i-01112f6e01cc9cb46
Project: wiredtiger
Commit: 30f7d21f
Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

Task Logs:

task format-stress-test-3

format-stress-test-3 task_log

Logs:

    [1772715633:687319][75240:0x7fa5f464c700], t, statlog-server: [WT_VERB_DEFAULT][ERROR]: __posix_file_write, 699: /data/mci/60474b36b470880684cc2ed653877da5/wiredtiger/cmake_build/test/format/RUNDIR.62/CHECK.1772714688/./WiredTigerStat.05.13: handle-write: pwrite: failed to write 5143 bytes at offset 319488: No space left on device
    [1772715633:687402][75240:0x7fa5f464c700], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
    [1772715633:687409][75240:0x7fa5f464c700], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
    [1772715633:687414][75240:0x7fa5f464c700], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
    [1772715633:687418][75240:0x7fa5f464c700], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
    [1772715633:687423][75240:0x7fa5f464c700], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
    [1772715633:687427][75240:0x7fa5f464c700], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
    [1772715633:687432][75240:0x7fa5f464c700], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
    [1772715633:687436][75240:0x7fa5f464c700], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
    [1772715633:687440][75240:0x7fa5f464c700], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
    [1772715633:687445][75240:0x7fa5f464c700], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
    [1772715633:687449][75240:0x7fa5f464c700], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
    [1772715633:687453][75240:0x7fa5f464c700], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
    [1772715633:687458][75240:0x7fa5f464c700], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
    [1772715633:687462][75240:0x7fa5f464c700], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
    [1772715633:687466][75240:0x7fa5f464c700], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
    [1772715633:687471][75240:0x7fa5f464c700], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
    [1772715633:687475][75240:0x7fa5f464c700], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
    [1772715633:687479][75240:0x7fa5f464c700], t, statlog-server: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOU/data/mci/60474b36b470880684cc2ed653877da5/wiredtiger/cmake_build/test/format/RUNDIR.62/CONFIG:

format-stress-test-3 task_log

Logs:

test/format run configuration highlights

format-stress-test-3 task_log

Logs:

    [1772715631:623885][82112:0x7f686c138700], t, file:F00001, live_restore_workers: [WT_VERB_DEFAULT][ERROR]: __posix_file_write, 699: /data/mci/60474b36b470880684cc2ed653877da5/wiredtiger/cmake_build/test/format/RUNDIR.74/CHECK.1772715502/F00001: handle-write: pwrite: failed to write 4193280 bytes at offset 711798784: No space left on device
    [1772715631:626338][82112:0x7f686c138700], t, live_restore_workers: [WT_VERB_ERROR_RETURNS][ERROR]: __posix_file_write, 699: Error at src/os_posix/os_fs.c:699: "__wt_errno()" failed: No space left on device
    [1772715631:626358][82112:0x7f686c138700], t, live_restore_workers: [WT_VERB_ERROR_RETURNS][ERROR]: __live_restore_fh_write_int, 667: Error at src/live_restore/live_restore_fs.c:667: "__live_restore_fh_write_destination(session, lr_fh, offset, len, buf)" failed: No space left on device
    [1772715631:626371][82112:0x7f686c138700], t, live_restore_workers: [WT_VERB_ERROR_RETURNS][ERROR]: __wti_live_restore_fs_restore_file, 1009: Error at src/live_restore/live_restore_fs.c:1009: "ret" failed: No space left on device
    [1772715631:626377][82112:0x7f686c138700], t, live_restore_workers: [WT_VERB_ERROR_RETURNS][ERROR]: __thread_run, 32: Error at src/support/thread_group.c:32: "thread->run_func(session, thread)" failed: No space left on device
    [1772715631:687354][82112:0x7f6870941700], t, file:T00003.wt, live_restore_workers: [WT_VERB_DEFAULT][ERROR]: __posix_file_write, 699: /data/mci/60474b36b470880684cc2ed653877da5/wiredtiger/cmake_build/test/format/RUNDIR.74/CHECK.1772715502/T00003.wt: handle-write: pwrite: failed to write 2903040 bytes at offset 811601920: No space left on device
    [1772715631:687954][82112:0x7f6870941700], t, live_restore_workers: [WT_VERB_ERROR_RETURNS][ERROR]: __posix_file_write, 699: Error at src/os_posix/os_fs.c:699: "__wt_errno()" failed: No space left on device
    [1772715631:687974][82112:0x7f6870941700], t, live_restore_workers: [WT_VERB_ERROR_RETURNS][ERROR]: __live_restore_fh_write_int, 667: Error at src/live_restore/live_restore_fs.c:667: "__live_restore_fh_write_destination(session, lr_fh, offset, len, buf)" failed: No space left on device
    [1772715631:687979][82112:0x7f6870941700], t, live_restore_workers: [WT_VERB_ERROR_RETURNS][ERROR]: __wti_live_restore_fs_restore_file, 1009: Error at src/live_restore/live_restore_fs.c:1009: "ret" failed: No space left on device
    [1772715631:687985][82112:0x7f6870941700], t, live_restore_workers: [WT_VERB_ERROR_RETURNS][ERROR]: __thread_run, 32: Error at src/support/thread_group.c:32: "thread->run_func(session, thread)" failed: No space left on device
    [1772715631:849101][82112:0x7f687694d700], t, file:T00003.wt, WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __posix_file_write, 699: /data/mci/60474b36b470880684cc2ed653877da5/wiredtiger/cmake_build/test/format/RUNDIR.74/T00003.wt: handle-write: pwrite: failed to write 4608 bytes at offset 1052561408: No space left on device

format-stress-test-3 task_log

Logs:

    t: FAILED: checkpoint/153: ret == 0 || (ret == EBUSY && ebusy_ok)

format-stress-test-3 task_log

Logs:

test/format run configuration highlights

format-stress-test-3 task_log

Logs:

    [1772715631:858008][83039:0x7f6e41c54c80], t, file:T00003.wt, WT_CURSOR.insert: [WT_VERB_DEFAULT][ERROR]: __posix_file_write, 699: /data/mci/60474b36b470880684cc2ed653877da5/wiredtiger/cmake_build/test/format/RUNDIR.75/T00003.wt: handle-write: pwrite: failed to write 2560 bytes at offset 2367488: No space left on device

format-stress-test-3 task_log

Logs:

    t: FAILED: table_load/163: base == NULL && (ret == WT_CACHE_FULL || ret == WT_ROLLBACK): WT_CURSOR.insert failed: 28

format-stress-test-3 task_log

Logs:

test/format run configuration highlights

format-stress-test-3 task_log

Logs:

Adding file to tarball: 'tools/test/binary_files/mongodb_size_mismatch.log'.

Assignee:: [DO NOT USE] Backlog - Storage Engines Team
Reporter:: xgen-buildbaron-user
Votes:: 0 Vote for this issue
Watchers:: 2 Start watching this issue

Created:: Mar 06 2026 10:58:02 PM UTC
Updated:: Mar 12 2026 12:45:44 AM UTC
Resolved:: Mar 12 2026 12:45:44 AM UTC