Loading...

XML

Word

Printable

JSON

Type: Build Failure
Resolution: Fixed
Priority: Major - P3
Fix Version/s: WT12.0.0, 8.2.0-rc0
Affects Version/s: None
Component/s: Layered Tables
Labels:
- BB-Tools
- CI-blocker

Assigned Teams:

Storage Engines, Storage Engines - Foundations
Sprint:
SE Foundations - 2025-07-18
Story Points:
3
Evergreen Project:
- wiredtiger
Failure Type:
- failed
Failing Buildvariants:
- macos-14-arm64
Failing Tasks:
- unit-test-macos
First Failing Revision:
- a4f10c8e09b18698ff8eaf7feb479ca18ecde8dc(wiredtiger)
Linked BFG List:
https://buildbaron.corp.mongodb.com/ui/#/bf/WT-14953
Count of Linked BFGs (Last 30 days):
14

Host: macos-14-arm64-2.mac.devprod.mongodb.com
Project: wiredtiger
Commit: a4f10c8e
Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

Task Logs:

task unit-test-macos

unit-test-macos task_log

Logs:

[pid:98868]: ERROR: test_layered17.test_layered17.test_layered17(palm.layered-prefix)
----------------------------------------------------------------------
[pid:98868]: testtools.testresult.real._StringException: lost connection during test 'test_layered17.test_layered17.test_layered17(palm.layered-prefix)'
======================================================================
[pid:98868]: ERROR: test_layered15.test_layered15.test_layered15(palm)
----------------------------------------------------------------------
[pid:98868]: testtools.testresult.real._StringException: lost connection during test 'test_layered15.test_layered15.test_layered15(palm)'
======================================================================
[pid:98868]: ERROR: test_layered14.test_layered14.test_layered_random_cursor(palm)
----------------------------------------------------------------------
[pid:98868]: testtools.testresult.real._StringException: lost connection during test 'test_layered14.test_layered14.test_layered_random_cursor(palm)'
======================================================================
[pid:98868]: ERROR: test_layered18.test_layered18.test_layered18(palm.layered)
----------------------------------------------------------------------
[pid:98868]: testtools.testresult.real._StringException: lost connection during test 'test_layered18.test_layered18.test_layered18(palm.layered)'
----------------------------------------------------------------------
Ran 7068 tests in 3668.593s

logs

unit-test-macos task_log

Logs:

[1751932890:167743][98873:0x1fce40f40], test_layered14.test_layered14.test_layered_random_cursor(palm), checkpoint-pick-up: [WT_VERB_DEFAULT][ERROR]: void __wt_spin_lock(WT_SESSION_IMPL *, WT_SPINLOCK *), 193: pthread_mutex_lock: (null): Invalid argument
[1751932890:167770][98873:0x1fce40f40], test_layered14.test_layered14.test_layered_random_cursor(palm), checkpoint-pick-up: [WT_VERB_DEFAULT][ERROR]: void __wt_spin_lock(WT_SESSION_IMPL *, WT_SPINLOCK *), 193: the process must exit and restart: WT_PANIC: WiredTiger library panic
[1751932890:167778][98873:0x1fce40f40], test_layered14.test_layered14.test_layered_random_cursor(palm), checkpoint-pick-up: [WT_VERB_DEFAULT][ERROR]: void __wt_abort(WT_SESSION_IMPL *), 29: aborting WiredTiger library
[1751932797:503959][98869:0x1fce40f40], test_layered15.test_layered15.test_layered15(palm), WT_CONNECTION.reconfigure: [WT_VERB_DEFAULT][ERROR]: void __wt_spin_lock(WT_SESSION_IMPL *, WT_SPINLOCK *), 193: pthread_mutex_lock: (null): Invalid argument
[1751932797:509527][98869:0x1fce40f40], test_layered15.test_layered15.test_layered15(palm), WT_CONNECTION.reconfigure: [WT_VERB_DEFAULT][ERROR]: void __wt_spin_lock(WT_SESSION_IMPL *, WT_SPINLOCK *), 193: the process must exit and restart: WT_PANIC: WiredTiger library panic
[1751932797:509540][98869:0x1fce40f40], test_layered15.test_layered15.test_layered15(palm), WT_CONNECTION.reconfigure: [WT_VERB_DEFAULT][ERROR]: void __wt_abort(WT_SESSION_IMPL *), 29: aborting WiredTiger library
[1751932909:291090][98870:0x1fce40f40], checkpoint-pick-up: [WT_VERB_DEFAULT][ERROR]: void __wt_spin_lock(WT_SESSION_IMPL *, WT_SPINLOCK *), 193: pthread_mutex_lock: (null): Invalid argument
[1751932909:292156][98870:0x1fce40f40], checkpoint-pick-up: [WT_VERB_DEFAULT][ERROR]: void __wt_spin_lock(WT_SESSION_IMPL *, WT_SPINLOCK *), 193: the process must exit and restart: WT_PANIC: WiredTiger library panic
[1751932909:292182][98870:0x1fce40f40], checkpoint-pick-up: [WT_VERB_DEFAULT][ERROR]: void __wt_abort(WT_SESSION_IMPL *), 29: aborting WiredTiger library
[1751932741:059921][98871:0x1fce40f40], checkpoint-pick-up: [WT_VERB_DEFAULT][ERROR]: void __wt_spin_lock(WT_SESSION_IMPL *, WT_SPINLOCK *), 193: pthread_mutex_lock: (null): Invalid argument
[1751932741:060213][98871:0x1fce40f40], checkpoint-pick-up: [WT_VERB_DEFAULT][ERROR]: void __wt_spin_lock(WT_SESSION_IMPL *, WT_SPINLOCK *), 193: the process must exit and restart: WT_PANIC: WiredTiger library panic
[1751932741:060224][98871:0x1fce40f40], checkpoint-pick-up: [WT_VERB_DEFAULT][ERROR]: void __wt_abort(WT_SESSION_IMPL *), 29: aborting WiredTiger library

logs

is related to

WT-14340 Make conn->flags atomic

Closed

WT-14980 Disagg table ID namespacing not correctly feature-gated

Closed

SERVER-106431 Update version cursor config to new format

Closed

WT-14697 Merge disagg testing code into develop

Closed

WT-14978 Add diagnostic information to durable timestamp assertion

Closed

WT-9931 Reader took an order of magnitude longer for when all history store records were invisible

Closed

WT-14954 Make test_truncate02 more reliable

Closed

WT-14955 failed: format-failure-configs-test on ubuntu2004 [wiredtiger @ a4f10c8e]

Closed

WT-14956 AssertionError in test_rollback01.py: no rollback occurred on cursor->next() for disagg

Closed

related to

WT-14653 Add logs/stats to reconciliation for tracking HS updates

Closed

WT-14750 Failure in __wt_page_inmem: "encountered an illegal file format or internal value: 0x0"

Closed

WT-14848 Fix missing WT_RET in live_restore_fs.c

Closed

WT-14864 Remove duplicate TSAN warnings from metric script

Closed

WT-14872 clang-analyzer gives misleading output

Closed

WT-14919 Coverity analysis defect 175312: Unused value

Closed

WT-14929 Coverity analysis defect 174890: Resource leak

Closed

WT-14935 Solve: SUMMARY: ThreadSanitizer: data race /home/ec2-user/work/git/wiredtiger-arm/src/support/mtx_rw.c:168:71 in __read_blocked

Closed

WT-14963 Investigate possibility to remove or weaken atomics synchronization for __wti_layered_table_manager_destroy

Closed

WT-14619 Merge layered tables into develop

Closed

WT-14865 Create a parser script for wiredtiger config string in turtle files

Closed

WT-14562 Dump all extent list blocks when we do a corrupt block dump

Closed

WT-14695 Merge page deltas into develop

Closed

WT-14696 Merge precise checkpoint into develop

Closed

WT-14698 Merge remaining disagg code into develop

Closed

WT-14826 Write the prepare timestamp and prepared id to disk with preserve prepared config

Closed

WT-14828 Ensure we set the prepare id when preparing a transaction if preserve prepare config is on

Closed

WT-14833 Fix TCMalloc build/propagation for some stress tests

Closed

WT-14858 Forbid to prepare a transaction before the stable timestamp if preserve_prepare config is on

Closed

WT-14869 Pack prepared ts and prepared id correctly to cell format and unpack them accordingly

Closed

WT-14878 Assign prepared id and prepard ts on page deltas

Closed

WT-14901 Enable all examples regular testing with TSAN by suppressing all the warnings

Closed

WT-14951 Merge newer disagg code into develop

Closed

WT-14837 Add metric to measure execution time of block_first_srch()

Closed

WT-14727 update the workgen latency metrics to print the bucket count for us, ms and secs

Closed

WT-14832 Add read operations to test/model

Closed

WT-12337 Review and fix WT_ASSERTs in packing_inline.h

Closed

WT-13985 Did not run a sweep for 60 minutes in test_prepare_hs01 for CS

Closed

WT-14648 Fix log subsystem returning EBUSY from conn->close()

Closed

WT-14719 Update cache workloads to adapt to stat name change for cache_eviction_trigger_clean_reached

Closed

WT-14896 Failed: s-outdated-fixmes on ~ Infrequent checks [WiredTiger (develop) @ 2b0ed0cf]

Closed

WT-14946 Disable incompatible tests between disagg and tiered

Closed

WT-14947 Suppress perf critical warnings

Closed

WT-14954 Make test_truncate02 more reliable

Closed

WT-14955 failed: format-failure-configs-test on ubuntu2004 [wiredtiger @ a4f10c8e]

Closed

WT-13038 task-timed-out: csuite-timestamp-abort-test-s3 on ubuntu2004

Closed

(4 is related to, 36 related to)

Assignee:: Ivan Kochin
Reporter:: xgen-buildbaron-user
Votes:: 0 Vote for this issue
Watchers:: 3 Start watching this issue

Created:: Jul 08 2025 03:40:50 AM UTC
Updated:: Jul 15 2025 05:33:32 AM UTC
Resolved:: Jul 10 2025 11:34:38 PM UTC

Details

Description

Attachments

Issue Links

Activity

People

Dates