-
Type:
Build Failure
-
Resolution: Fixed
-
Priority:
Major - P3
-
Affects Version/s: None
-
Component/s: Test Format
-
Storage Engines, Storage Engines - Foundations
-
SE Foundations - 2025-07-18
-
None
-
52
format-failure-configs-test on ubuntu2004
Host: i-091f3a00300c2cb16
Project: wiredtiger
Commit: a4f10c8e
Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules
Task Logs:
Logs:
[1751932192:304619][13867:0x7f1e6e291700], t, file:T00002.wt, WT_SESSION.compact: [WT_VERB_DEFAULT][ERROR]: __wt_block_compact_start, 21: Compaction already happening on data handle T00002.wt by session 8: Device or resource busy [1751932379:652257][13867:0x7f1e6e291700], t, file:T00003.wt, WT_SESSION.compact: [WT_VERB_DEFAULT][ERROR]: __wt_block_compact_start, 21: Compaction already happening on data handle T00003.wt by session 8: Device or resource busy [1751932389:653053][13867:0x7f1e6e291700], t, file:T00003.wt, WT_SESSION.compact: [WT_VERB_DEFAULT][ERROR]: __wt_block_compact_start, 21: Compaction already happening on data handle T00003.wt by session 8: Device or resource busy [1751932399:653267][13867:0x7f1e6e291700], t, file:T00003.wt, WT_SESSION.compact: [WT_VERB_DEFAULT][ERROR]: __wt_block_compact_start, 21: Compaction already happening on data handle T00003.wt by session 8: Device or resource busy [1751933343:366883][18706:0x7fa7ba60b700], t, file:F00001, WT_SESSION.compact: [WT_VERB_DEFAULT][ERROR]: __wt_block_compact_start, 21: Compaction already happening on data handle F00001 by session 25: Device or resource busy
Logs:
0x13567fce6000:transaction state dump 0x13567fce6000:current ID: 3749 0x13567fce6000:last running ID: 3749 0x13567fce6000:metadata_pinned ID: 3749 0x13567fce6000:oldest ID: 3749 0x13567fce6000:durable timestamp: (0, 10405307) 0x13567fce6000:oldest timestamp: (0, 10405154) 0x13567fce6000:pinned timestamp: (0, 10405154) 0x13567fce6000:stable timestamp: (0, 10405154) 0x13567fce6000:has_durable_timestamp: yes 0x13567fce6000:has_oldest_timestamp: yes 0x13567fce6000:has_pinned_timestamp: yes 0x13567fce6000:has_stable_timestamp: yes 0x13567fce6000:oldest_is_pinned: yes 0x13567fce6000:stable_is_pinned: yes 0x13567fce6000:checkpoint running: no 0x13567fce6000:checkpoint generation: 21 0x13567fce6000:checkpoint pinned ID: 0 0x13567fce6000:checkpoint txn ID: 0 0x13567fce6000:session count: 33 0x13567fce6000:Transaction state of active sessions: 0x13567fce6000:=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= 0x13567fce6000:cache dump 0x13567fce6000:cache full: no 0x13567fce6000:cache clean check: no (79.757%) 0x13567fce6000:cache dirty check: yes (21.983%) 0x13567fce6000:cache updates check: no (1.761%) format run more than 15 minutes past the maximum time format run dumping cache and transaction state, then aborting the process 0x13567fce6000:file:F00003(checkpoint=WiredTigerCheckpoint.19): 0x13567fce6000:internal: 20 pages, 4245.06 KB, 20/0 clean/dirty pages, 4245.06/0.00 clean / dirty KB, 332.88 KB max page, 0.00 KB max dirty page 0x13567fce6000:leaf: 7043 pages, 36413.51 KB, 7043/0 clean/dirty pages, 36413.51 /0.00 /0.00 clean/dirty/updates KB, 7.00 KB max page, 0.00 KB max dirty page 0x13567fce6000:file:T00002.wt(checkpoint=WiredTigerCheckpoint.19): 0x13567fce6000:internal: 1 pages, 4.46 KB, 1/0 clean/dirty pages, 4.46/0.00 clean / dirty KB, 4.46 KB max page, 0.00 KB max dirty page 0x13567fce6000:leaf: 0 pages 0x13567fce6000:file:T00001.wt(checkpoint=WiredTigerCheckpoint.19): 0x13567fce6000:internal: 1 pages, 776.95 KB, 1/0 clean/dirty pages, 776.95/0.00 clean / dirty KB, 776.95 KB max page, 0.00 KB max dirty page 0x13567fce6000:leaf: 28 pages, 1887.37 KB, 28/0 clean/dirty pages, 1887.37 /0.00 /0.00 clean/dirty/updates KB, 68.31 KB max page, 0.00 KB max dirty page 0x13567fce6000:file:WiredTigerHS.wt(checkpoint=WiredTigerCheckpoint.7): 0x13567fce6000:internal: 1 pages, 0.74 KB, 1/0 clean/dirty pages, 0.74/0.00 clean / dirty KB, 0.74 KB max page, 0.00 KB max dirty page 0x13567fce6000:leaf: 0 pages 0x13567fce6000:file:F00003(checkpoint=mine.1): 0x13567fce6000:internal: 1 pages, 9.39 KB, 1/0 clean/dirty pages, 9.39/0.00 clean / dirty KB, 9.39 KB max page, 0.00 KB max dirty page 0x13567fce6000:leaf: 0 pages 0x13567fce6000:file:T00002.wt(checkpoint=mine.1): 0x13567fce6000:internal: 1 pages, 4.45 KB, 1/0 clean/dirty pages, 4.45/0.00 clean / dirty KB, 4.45 KB max page, 0.00 KB max dirty page 0x13567fce6000:leaf: 0 pages 0x13567fce6000:file:WiredTigerHS.wt(checkpoint=mine.1): 0x13567fce6000:internal: 1 pages, 0.74 KB, 1/0 clean/dirty pages, 0.74/0.00 clean / dirty KB, 0.74 KB max page, 0.00 KB max dirty page 0x13567fce6000:leaf: 0 pages 0x13567fce6000:file:T00001.wt(checkpoint=mine.1): 0x13567fce6000:internal: 1 pages, 776.94 KB, 1/0 clean/dirty pages, 776.94/0.00 clean / dirty KB, 776.94 KB max page, 0.00 KB max dirty page 0x13567fce6000:leaf: 0 pages 0x13567fce6000:file:F00003(<live>): 0x13567fce6000:internal: 31 pages, 9708.14 KB, 1/30 clean/dirty pages, 6.27/9701.87 clean / dirty KB, 346.63 KB max page, 346.63 KB max dirty page 0x13567fce6000:leaf: 137 pages, 950.57 KB, 0/137 clean/dirty pages, 0.00 /950.57 /133.33 clean/dirty/updates KB, 86.25 KB max page, 86.25 KB max dirty page 0x13567fce6000:file:T00002.wt(<live>): 0x13567fce6000:internal: 12 pages, 714.91 KB, 1/11 clean/dirty pages, 2.71/712.20 clean / dirty KB, 71.15 KB max page, 71.15 KB max dirty page 0x13567fce6000:leaf: 124 pages, 9208.01 KB, 0/124 clean/dirty pages, 0.00 /9208.01 /738.91 clean/dirty/updates KB, 153.53 KB max page, 153.53 KB max dirty page 0x13567fce6000:file:T00001.wt(<live>): 0x13567fce6000:internal: 1 pages, 772.63 KB, 0/1 clean/dirty pages, 0.00/772.63 clean / dirty KB, 772.63 KB max page, 772.63 KB max dirty page 0x13567fce6000:leaf: 133 pages, 9872.94 KB, 0/133 clean/dirty pages, 0.00 /9872.94 /733.01 clean/dirty/updates KB, 152.85 KB max page, 152.85 KB max dirty page 0x13567fce6000:file:WiredTigerHS.wt(<live>): 0x13567fce6000:internal: 1 pages, 0.99 KB, 1/0 clean/dirty pages, 0.99/0.00 clean / dirty KB, 0.99 KB max page, 0.00 KB max dirty page 0x13567fce6000:leaf: 0 pages 0x13567fce6000:file:WiredTiger.wt(<live>): 0x13567fce6000:internal: 1 pages, 0.86 KB, 1/0 clean/dirty pages, 0.86/0.00 clean / dirty KB, 0.86 KB max page, 0.00 KB max dirty page 0x13567fce6000:leaf: 0 pages 0x13567fce6000:cache dump: total found: 79.47 MB vs tracked inuse 74.37 MB 0x13567fce6000:total dirty bytes: 30.49 MB vs tracked dirty 31.28 MB
Logs:
WiredTiger Error: __wt_abort, 29: aborting WiredTiger library
Logs:
#0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50 #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50 #1 0x00007fd55a8cd859 in __GI_abort () at abort.c:79 #2 0x00007fd55acabb37 in __wt_abort (session=session@entry=0x0) at /data/mci/59c6944f12803e4cd0c66e0ed8b6a6ea/wiredtiger/src/os_common/os_abort.c:31 #3 0x0000000000415ec1 in operations (ops_seconds=<optimized out>, ops_seconds@entry=215, run_current=run_current@entry=1, run_total=run_total@entry=3) at /data/mci/59c6944f12803e4cd0c66e0ed8b6a6ea/wiredtiger/test/format/ops.c:450 #4 0x000000000041998d in main (argc=<optimized out>, argv=<optimized out>) at /data/mci/59c6944f12803e4cd0c66e0ed8b6a6ea/wiredtiger/test/format/t.c:383
- is related to
-
WT-14340 Make conn->flags atomic
-
- Closed
-
-
WT-14980 Disagg table ID namespacing not correctly feature-gated
-
- Closed
-
-
SERVER-106431 Update version cursor config to new format
-
- Closed
-
-
WT-14697 Merge disagg testing code into develop
-
- Closed
-
-
WT-14978 Add diagnostic information to durable timestamp assertion
-
- Closed
-
-
WT-9931 Reader took an order of magnitude longer for when all history store records were invisible
-
- Closed
-
-
WT-14953 test_layered17 spinlock abort - pthread_mutex_lock: (null): Invalid argument
-
- Closed
-
-
WT-14954 Make test_truncate02 more reliable
-
- Closed
-
-
WT-14956 AssertionError in test_rollback01.py: no rollback occurred on cursor->next() for disagg
-
- Closed
-
- related to
-
WT-14979 Precise checkpoint incompatible with non-disagg block manager
-
- Open
-
-
WT-14653 Add logs/stats to reconciliation for tracking HS updates
-
- Closed
-
-
WT-14750 Failure in __wt_page_inmem: "encountered an illegal file format or internal value: 0x0"
-
- Closed
-
-
WT-14848 Fix missing WT_RET in live_restore_fs.c
-
- Closed
-
-
WT-14864 Remove duplicate TSAN warnings from metric script
-
- Closed
-
-
WT-14872 clang-analyzer gives misleading output
-
- Closed
-
-
WT-14919 Coverity analysis defect 175312: Unused value
-
- Closed
-
-
WT-14929 Coverity analysis defect 174890: Resource leak
-
- Closed
-
-
WT-14935 Solve: SUMMARY: ThreadSanitizer: data race /home/ec2-user/work/git/wiredtiger-arm/src/support/mtx_rw.c:168:71 in __read_blocked
-
- Closed
-
-
WT-14980 Disagg table ID namespacing not correctly feature-gated
-
- Closed
-
-
WT-14619 Merge layered tables into develop
-
- Closed
-
-
WT-14865 Create a parser script for wiredtiger config string in turtle files
-
- Closed
-
-
WT-14562 Dump all extent list blocks when we do a corrupt block dump
-
- Closed
-
-
WT-14695 Merge page deltas into develop
-
- Closed
-
-
WT-14696 Merge precise checkpoint into develop
-
- Closed
-
-
WT-14698 Merge remaining disagg code into develop
-
- Closed
-
-
WT-14826 Write the prepare timestamp and prepared id to disk with preserve prepared config
-
- Closed
-
-
WT-14828 Ensure we set the prepare id when preparing a transaction if preserve prepare config is on
-
- Closed
-
-
WT-14833 Fix TCMalloc build/propagation for some stress tests
-
- Closed
-
-
WT-14858 Forbid to prepare a transaction before the stable timestamp if preserve_prepare config is on
-
- Closed
-
-
WT-14869 Pack prepared ts and prepared id correctly to cell format and unpack them accordingly
-
- Closed
-
-
WT-14878 Assign prepared id and prepard ts on page deltas
-
- Closed
-
-
WT-14901 Enable all examples regular testing with TSAN by suppressing all the warnings
-
- Closed
-
-
WT-14951 Merge newer disagg code into develop
-
- Closed
-
-
WT-14978 Add diagnostic information to durable timestamp assertion
-
- Closed
-
-
WT-14837 Add metric to measure execution time of block_first_srch()
-
- Closed
-
-
WT-14727 update the workgen latency metrics to print the bucket count for us, ms and secs
-
- Closed
-
-
WT-14832 Add read operations to test/model
-
- Closed
-
-
WT-9931 Reader took an order of magnitude longer for when all history store records were invisible
-
- Closed
-
-
WT-12337 Review and fix WT_ASSERTs in packing_inline.h
-
- Closed
-
-
WT-13985 Did not run a sweep for 60 minutes in test_prepare_hs01 for CS
-
- Closed
-
-
WT-14648 Fix log subsystem returning EBUSY from conn->close()
-
- Closed
-
-
WT-14719 Update cache workloads to adapt to stat name change for cache_eviction_trigger_clean_reached
-
- Closed
-
-
WT-14896 Failed: s-outdated-fixmes on ~ Infrequent checks [WiredTiger (develop) @ 2b0ed0cf]
-
- Closed
-
-
WT-14946 Disable incompatible tests between disagg and tiered
-
- Closed
-
-
WT-14947 Suppress perf critical warnings
-
- Closed
-
-
WT-14953 test_layered17 spinlock abort - pthread_mutex_lock: (null): Invalid argument
-
- Closed
-
-
WT-14954 Make test_truncate02 more reliable
-
- Closed
-
-
WT-14956 AssertionError in test_rollback01.py: no rollback occurred on cursor->next() for disagg
-
- Closed
-
-
WT-13038 task-timed-out: csuite-timestamp-abort-test-s3 on ubuntu2004
-
- Closed
-