Loading...

XML

Word

Printable

JSON

Type: Build Failure
Resolution: Fixed
Priority: Major - P3
Fix Version/s: WT12.0.0, 8.3.0-rc0
Affects Version/s: None
Component/s: Disagg CI-blocker, PALite, Test Format
Labels:

Epic Link:
Replace PALM with PALite
Assigned Teams:

Storage Engines, Storage Engines - Foundations
Sprint:
SE Foundations - 2025-11-07
Story Points:
3
Evergreen Project:
- wiredtiger
Failure Type:
- failed
Failing Buildvariants:
- amazon2023-disagg-msan-stress
Failing Tasks:
- checkpoint-test
- format-stress-test-disagg-follower-1
First Failing Revision:
- 73927b2a33767019bef29a9c9f0af0696937f99c(wiredtiger)
Linked BFG List:
https://buildbaron.corp.mongodb.com/ui/#/bf/WT-15819
Count of Linked BFGs (Last 30 days):
84

format-stress-test-disagg-follower-1 on amazon2023-disagg-msan-stress

Host: i-07ff20b7778cf7cc1
Project: wiredtiger
Commit: 93a2c434
Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

Task Logs:

task format-stress-test-disagg-follower-1

format-stress-test-disagg-follower-1 task_log

Logs:

==1595013==WARNING: MemorySanitizer: use-of-uninitialized-value
==1595013==Launching Symbolizer process: /opt/mongodbtoolchain/v5/bin/llvm-symbolizer --demangle --inlines --default-arch=arm64
    #0 0xffff992968c0 in std::__uniq_ptr_impl<std::filesystem::__cxx11::path::_List::_Impl, std::filesystem::__cxx11::path::_List::_Impl_deleter>::release() /opt/mongodbtoolchain/revisions/8695910c32ef0ee5eecaae4c9ca515b4b6436a40/stow/gcc-v5.D5C/lib/gcc/aarch64-mongodb-linux/14.2.0/../../../../include/c++/14.2.0/bits/unique_ptr.h:213:2
    #1 0xffff99296360 in std::__uniq_ptr_impl<std::filesystem::__cxx11::path::_List::_Impl, std::filesystem::__cxx11::path::_List::_Impl_deleter>::operator=(std::__uniq_ptr_impl<std::filesystem::__cxx11::path::_List::_Impl, std::filesystem::__cxx11::path::_List::_Impl_deleter>&&) /opt/mongodbtoolchain/revisions/8695910c32ef0ee5eecaae4c9ca515b4b6436a40/stow/gcc-v5.D5C/lib/gcc/aarch64-mongodb-linux/14.2.0/../../../../include/c++/14.2.0/bits/unique_ptr.h:185:12
    #2 0xffff9929622c in std::__uniq_ptr_data<std::filesystem::__cxx11::path::_List::_Impl, std::filesystem::__cxx11::path::_List::_Impl_deleter, true, true>::operator=(std::__uniq_ptr_data<std::filesystem::__cxx11::path::_List::_Impl, std::filesystem::__cxx11::path::_List::_Impl_deleter, true, true>&&) /opt/mongodbtoolchain/revisions/8695910c32ef0ee5eecaae4c9ca515b4b6436a40/stow/gcc-v5.D5C/lib/gcc/aarch64-mongodb-linux/14.2.0/../../../../include/c++/14.2.0/bits/unique_ptr.h:237:61
    #3 0xffff992960dc in std::unique_ptr<std::filesystem::__cxx11::path::_List::_Impl, std::filesystem::__cxx11::path::_List::_Impl_deleter>::operator=(std::unique_ptr<std::filesystem::__cxx11::path::_List::_Impl, std::filesystem::__cxx11::path::_List::_Impl_deleter>&&) /opt/mongodbtoolchain/revisions/8695910c32ef0ee5eecaae4c9ca515b4b6436a40/stow/gcc-v5.D5C/lib/gcc/aarch64-mongodb-linux/14.2.0/../../../../include/c++/14.2.0/bits/unique_ptr.h:408:51
    #4 0xffff99295e9c in std::filesystem::__cxx11::path::_List::operator=(std::filesystem::__cxx11::path::_List&&) /opt/mongodbtoolchain/revisions/8695910c32ef0ee5eecaae4c9ca515b4b6436a40/stow/gcc-v5.D5C/lib/gcc/aarch64-mongodb-linux/14.2.0/../../../../include/c++/14.2.0/bits/fs_path.h:688:41
    #5 0xffff992959f4 in std::filesystem::__cxx11::path::operator=(std::filesystem::__cxx11::path&&) /opt/mongodbtoolchain/revisions/8695910c32ef0ee5eecaae4c9ca515b4b6436a40/stow/gcc-v5.D5C/lib/gcc/aarch64-mongodb-linux/14.2.0/../../../../include/c++/14.2.0/bits/fs_path.h:1037:14
    #6 0xffff99290fa8 in void Config::configure_value<std::filesystem::__cxx11::path>(__wt_config_parser*, __wt_config_arg*, char const*, std::filesystem::__cxx11::path&) /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/ext/page_log/palite/palite.cpp:284:23
    #7 0xffff9928c828 in Config::Config(__wt_extension_api*, __wt_config_arg*) /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/ext/page_log/palite/palite.cpp:214:9
    #8 0xffff99289924 in Palite::Palite(std::filesystem::__cxx11::path const&, __wt_extension_api*, __wt_config_arg*) /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/ext/page_log/palite/palite.cpp:1804:40
    #9 0xffff99288820 in std::__detail::_MakeUniq<Palite>::__single_object std::make_unique<Palite, char const* const&, __wt_extension_api*&, __wt_config_arg*&>(char const* const&, __wt_extension_api*&, __wt_config_arg*&) /opt/mongodbtoolchain/revisions/8695910c32ef0ee5eecaae4c9ca515b4b6436a40/stow/gcc-v5.D5C/lib/gcc/aarch64-mongodb-linux/14.2.0/../../../../include/c++/14.2.0/bits/unique_ptr.h:1076:34
    #10 0xffff990f0228 in palite_extension_init(__wt_connection*, __wt_config_arg*) /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/ext/page_log/palite/palite.cpp:2069:42
    #11 0xffff990efc20 in wiredtiger_extension_init /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/ext/page_log/palite/palite.cpp:2114:12
    #12 0xffff9ca0b3a4 in __conn_load_extension_int /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/src/conn/conn_api.c:960:5
    #13 0xffff9c9f785c in __conn_load_extensions /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/src/conn/conn_api.c:1023:9
    #14 0xffff9c999c34 in wiredtiger_open /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/src/conn/conn_api.c:3328:5
    #15 0xaaaaafc5a194 in create_database /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/test/format/wts.c:600:5
    #16 0xaaaaafc6e970 in wts_create_database /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/test/format/wts.c:747:5
    #17 0xaaaaafc3c470 in main /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/test/format/t.c:356:9
    #18 0xffff9bc62554 in __libc_start_call_main (/lib64/libc.so.6+0x30554) (BuildId: 7f46fcd5f30f2f31235144f8192c97c839732436)
    #19 0xffff9bc62638 in __libc_start_main@GLIBC_2.17 (/lib64/libc.so.6+0x30638) (BuildId: 7f46fcd5f30f2f31235144f8192c97c839732436)
    #20 0xaaaaafad10ac in _start (/data/mci/3f8abda35e7b13ba345fb9f7e0b22961/wiredtiger/cmake_build/test/format/t+0x410ac)
  raw origin id: -1879048183
  Uninitialized value was stored to memory at
    #0 0xffff9929683c in std::__uniq_ptr_impl<std::filesystem::__cxx11::path::_List::_Impl, std::filesystem::__cxx11::path::_List::_Impl_deleter>::release() /opt/mongodbtoolchain/revisions/8695910c32ef0ee5eecaae4c9ca515b4b6436a40/stow/gcc-v5.D5C/lib/gcc/aarch64-mongodb-linux/14.2.0/../../../../include/c++/14.2.0/bits/unique_ptr.h:211:10
    #1 0xffff99296360 in std::__uniq_ptr_impl<std::filesystem::__cxx11::path::_List::_Impl, std::filesystem::__cxx11::path::_List::_Impl_deleter>::operator=(std::__uniq_ptr_impl<std::filesystem::__cxx11::path::_List::_Impl, std::filesystem::__cxx11::path::_List::_Impl_deleter>&&) /opt/mongodbtoolchain/revisions/8695910c32ef0ee5eecaae4c9ca515b4b6436a40/stow/gcc-v5.D5C/lib/gcc/aarch64-mongodb-linux/14.2.0/../../../../include/c++/14.2.0/bits/unique_ptr.h:185:12
    #2 0xffff9929622c in std::__uniq_ptr_data<std::filesystem::__cxx11::path::_List::_Impl, std::filesystem::__cxx11::path::_List::_Impl_deleter, true, true>::operator=(std::__uniq_ptr_data<std::filesystem::__cxx11::path::_List::_Impl, std::filesystem::__cxx11::path::_List::_Impl_deleter, true, true>&&) /opt/mongodbtoolchain/revisions/8695910c32ef0ee5eecaae4c9ca515b4b6436a40/stow/gcc-v5.D5C/lib/gcc/aarch64-mongodb-linux/14.2.0/../../../../include/c++/14.2.0/bits/unique_ptr.h:237:61
    #3 0xffff992960dc in std::unique_ptr<std::filesystem::__cxx11::path::_List::_Impl, std::filesystem::__cxx11::path::_List::_Impl_deleter>::operator=(std::unique_ptr<std::filesystem::__cxx11::path::_List::_Impl, std::filesystem::__cxx11::path::_List::_Impl_deleter>&&) /opt/mongodbtoolchain/revisions/8695910c32ef0ee5eecaae4c9ca515b4b6436a40/stow/gcc-v5.D5C/lib/gcc/aarch64-mongodb-linux/14.2.0/../../../../include/c++/14.2.0/bits/unique_ptr.h:408:51
    #4 0xffff99295e9c in std::filesystem::__cxx11::path::_List::operator=(std::filesystem::__cxx11::path::_List&&) /opt/mongodbtoolchain/revisions/8695910c32ef0ee5eecaae4c9ca515b4b6436a40/stow/gcc-v5.D5C/lib/gcc/aarch64-mongodb-linux/14.2.0/../../../../include/c++/14.2.0/bits/fs_path.h:688:41
    #5 0xffff992959f4 in std::filesystem::__cxx11::path::operator=(std::filesystem::__cxx11::path&&) /opt/mongodbtoolchain/revisions/8695910c32ef0ee5eecaae4c9ca515b4b6436a40/stow/gcc-v5.D5C/lib/gcc/aarch64-mongodb-linux/14.2.0/../../../../include/c++/14.2.0/bits/fs_path.h:1037:14
    #6 0xffff99290fa8 in void Config::configure_value<std::filesystem::__cxx11::path>(__wt_config_parser*, __wt_config_arg*, char const*, std::filesystem::__cxx11::path&) /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/ext/page_log/palite/palite.cpp:284:23
    #7 0xffff9928c828 in Config::Config(__wt_extension_api*, __wt_config_arg*) /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/ext/page_log/palite/palite.cpp:214:9
    #8 0xffff99289924 in Palite::Palite(std::filesystem::__cxx11::path const&, __wt_extension_api*, __wt_config_arg*) /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/ext/page_log/palite/palite.cpp:1804:40
    #9 0xffff99288820 in std::__detail::_MakeUniq<Palite>::__single_object std::make_unique<Palite, char const* const&, __wt_extension_api*&, __wt_config_arg*&>(char const* const&, __wt_extension_api*&, __wt_config_arg*&) /opt/mongodbtoolchain/revisions/8695910c32ef0ee5eecaae4c9ca515b4b6436a40/stow/gcc-v5.D5C/lib/gcc/aarch64-mongodb-linux/14.2.0/../../../../include/c++/14.2.0/bits/unique_ptr.h:1076:34
    #10 0xffff990f0228 in palite_extension_init(__wt_connection*, __wt_config_arg*) /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/ext/page_log/palite/palite.cpp:2069:42
    #11 0xffff990efc20 in wiredtiger_extension_init /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/ext/page_log/palite/palite.cpp:2114:12
    #12 0xffff9ca0b3a4 in __conn_load_extension_int /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/src/conn/conn_api.c:960:5
    #13 0xffff9c9f785c in __conn_load_extensions /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/src/conn/conn_api.c:1023:9
    #14 0xffff9c999c34 in wiredtiger_open /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/src/conn/conn_api.c:3328:5
    #15 0xaaaaafc5a194 in create_database /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/test/format/wts.c:600:5
    #16 0xaaaaafc6e970 in wts_create_database /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/test/format/wts.c:747:5
    #17 0xaaaaafc3c470 in main /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/test/format/t.c:356:9
    #18 0xffff9bc62554 in __libc_start_call_main (/lib64/libc.so.6+0x30554) (BuildId: 7f46fcd5f30f2f31235144f8192c97c839732436)
    #19 0x2fffff9bc62638  (<unknown module>)
  Uninitialized value was created by an allocation of 'ref.tmp20' in the stack frame
    #0 0xffff99290dd4 in void Config::configure_value<std::filesystem::__cxx11::path>(__wt_config_parser*, __wt_config_arg*, char const*, std::filesystem::__cxx11::path&) /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/ext/page_log/palit

logs

format-stress-test-disagg-follower-1 task_log

Logs:

SUMMARY: MemorySanitizer: use-of-uninitialized-value /data/mci/0f25ff58a605bf4b7e17499d7cdcab48/wiredtiger/ext/page_log/palite/palite.cpp:284:23 in void Config::configure_value<std::filesystem::__cxx11::path>(__wt_config_parser*, __wt_config_arg*, char const*, std::filesystem::__cxx11::path&)

logs

format-stress-test-disagg-follower-1 task_log

Logs:

#0  0x0000ffff9bcbf7b4 in __pthread_kill_implementation () from /lib64/libc.so.6
#0  0x0000ffff9bcbf7b4 in __pthread_kill_implementation () from /lib64/libc.so.6
#1  0x0000ffff9bc763a0 [PAC] in raise () from /lib64/libc.so.6
#2  0x0000ffff9bc62264 [PAC] in abort () from /lib64/libc.so.6
#3  0x0000aaaaafae7ddc [PAC] in Abort () at /data/mci/01bb46477e468e9b17d7d0a0c518db71/toolchain-builder/tmp/build-llvm-v5.sh-42U/llvm-project-llvmorg/compiler-rt/lib/sanitizer_common/sanitizer_posix_libcdep.cpp:163
#4  0x0000aaaaafae5cc4 in __sanitizer::Die() () at /data/mci/01bb46477e468e9b17d7d0a0c518db71/toolchain-builder/tmp/build-llvm-v5.sh-42U/llvm-project-llvmorg/compiler-rt/lib/sanitizer_common/sanitizer_termination.cpp:58
#5  0x0000aaaaafafaab4 in __msan_warning_with_origin_noreturn () at /data/mci/01bb46477e468e9b17d7d0a0c518db71/toolchain-builder/tmp/build-llvm-v5.sh-42U/llvm-project-llvmorg/compiler-rt/lib/msan/msan.cpp:426
#6  0x0000ffff992968c4 in ?? ()

logs

Repro Artifacts:

CONFIG

is related to

WT-15951 timing_stress_rec_before_wrapup never gets selected in test/model

Closed

WT-15963 Picking up new checkpoints or step-up and step-down can stall eviction

Closed

WT-15950 Enable MSan builds for WiredTiger tests

Open

WT-15936 (disagg.mode=leader) test/format __reconcile (rec_write.c:341) assertion failure

Closed

related to

SERVER-68656 Compile our own libstdc++ for MSan

Backlog

WT-15986 test/format (MSAN, disagg.mode=leader) cache_stuck/task-timed-out

Open

(1 related to)

Assignee:: Alex Blekhman
Reporter:: xgen-buildbaron-user
Votes:: 0 Vote for this issue
Watchers:: 3 Start watching this issue

Created:: Oct 20 2025 01:00:09 AM UTC
Updated:: Nov 11 2025 03:07:35 AM UTC
Resolved:: Nov 05 2025 09:03:41 PM UTC

Details

Description

Attachments

Issue Links

Activity

People

Dates