-
Type:
Build Failure
-
Resolution: Fixed
-
Priority:
Major - P3
-
Affects Version/s: None
-
Component/s: Schema Management
-
Storage Engines, Storage Engines - Foundations
-
265.116
-
None
-
None
-
- schema-disagg-abort-crash-test-disagg-1
- schema-disagg-abort-follower-stepup-test-disagg-1
- schema-disagg-abort-legacy-crash-test-disagg-1
- schema-disagg-abort-legacy-switch-test-disagg-1
- schema-disagg-abort-multi-crash-test-disagg-1
- schema-disagg-abort-switch-test-disagg-1
- schema-disagg-abort-unique-crash-test-disagg-1
- schema-disagg-abort-unique-follower-stepup-test-disagg-1
- schema-disagg-abort-unique-switch-test-disagg-1
-
34
schema-disagg-abort-legacy-switch-test-disagg-1 on amazon2023-disagg-asan-stress
Host: i-0366f02aa039c4534
Project: wiredtiger-disagg
Commit: 74b012e6
Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules
Task Logs:
schema-disagg-abort-legacy-switch-test-disagg-1 task_log
Logs:
Task logger initialized (agent version '2026-08-28' from Evergreen build revision '6f6d33950a789b6ea8872e276f869e979098590a').
Starting task 'wiredtiger_disagg_amazon2023_disagg_asan_stress_schema_disagg_abort_legacy_switch_test_disagg_1_74b012e60d0de08efef42edbcbcf8489c79b5661_26_08_28_16_52_57', execution 0.
Running pre-task commands.
Running command 'shell.exec' in function 'cleanup' (step 1 of 3) in block 'pre'.
Finished command 'shell.exec' in function 'cleanup' (step 1 of 3) in block 'pre' in 14.460717ms.
Running command 'expansions.update' in function 'setup environment' (step 2 of 3) in block 'pre'.
Finished command 'expansions.update' in function 'setup environment' (step 2 of 3) in block 'pre' in 40.416µs.
Running command 'shell.exec' in function 'pin mongo toolchain' (step 3 of 3) in block 'pre'.
mongodbtoolchain 93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542 not installed, downloading...
Autodetected Amazon Linux 2023 (OS_ID: amazon2023) on aarch64
Autodetected DOWNLOAD_URL: https://mongodbtoolchain.build.10gen.cc/toolchain/amazon2023-arm64/x86_64/latest
Overriding REVISION_ID, will download toolchain for 93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542
Ensuring /opt/mongodbtoolchain/revisions exists and has correct ownership...
Downloading toolchain to /data/mci/a89135961be4ed038a81fb5810239ec6/tmp/tmp.GhKZGqGKZa/mongodbtoolchain.tar.gz from https://mongodbtoolchain.build.10gen.cc/toolchain/amazon2023-arm64/x86_64/mongodbtoolchain-93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542.tar.gz
Getting toolchain revision from archive...
Checking downloaded archive integrity...
Extracting toolchain revision 93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542 from archive...
Running post install script...
Existing v2 found, uninstalling...
Existing v3 found, uninstalling...
Existing v4 found, uninstalling...
Existing v5 found, uninstalling...
Installing v2...
Installing v3...
Installing v4...
Installing v5...
Cleaning up...
Finished command 'shell.exec' in function 'pin mongo toolchain' (step 3 of 3) in block 'pre' in 3m7.718526445s.
Finished running pre-task commands in 3m7.733356054s.
Running task commands.
Running command 's3.get' in function 'fetch artifacts' (step 1 of 2).
Fetching remote file 'wiredtiger/amazon2023-disagg-asan-stress/74b012e60d0de08efef42edbcbcf8489c79b5661/artifacts/compile_wiredtiger_disagg_amazon2023_disagg_asan_stress_74b012e60d0de08efef42edbcbcf8489c79b5661_26_08_28_16_52_57.tgz' from S3 bucket 'build_external' (attempt 1 of 5).
Finished command 's3.get' in function 'fetch artifacts' (step 1 of 2) in 7.328172402s.
Running command 'shell.exec' in function 'schema disagg abort' (step 2 of 2).
export WT_TOPDIR=$(git rev-parse --show-toplevel)
export WT_BUILDDIR=$WT_TOPDIR/cmake_build
if [ "$OS" = "Windows_NT" ]; then
export PATH=/cygdrive/c/python/Python311:/cygdrive/c/python/Python311/Scripts:$PATH
else
export PATH=/opt/mongodbtoolchain/v5/bin:$PATH
export LD_LIBRARY_PATH=$WT_BUILDDIR
fi
# Create the common sanitizer options and export the specific sanitizer environment
# variables.
COMMON_SAN_OPTIONS="abort_on_error=1:disable_coredump=0"
if [[ "-DCMAKE_BUILD_TYPE=ASan" =~ ASan ]]; then
export ASAN_OPTIONS="$COMMON_SAN_OPTIONS:unmap_shadow_on_exit=1"
asan_lib=$(clang -print-file-name=libclang_rt.asan.so)
[ -f "$asan_lib" ] || { echo "ERROR: libclang_rt.asan.so not found by clang"; exit 1; }
export LD_LIBRARY_PATH="$LD_LIBRARY_PATH:$(dirname "$asan_lib")"
export TESTUTIL_BYPASS_ASAN=1
elif [[ "-DCMAKE_BUILD_TYPE=ASan" =~ MSan ]]; then
export MSAN_OPTIONS="$COMMON_SAN_OPTIONS:verbosity=3"
export TESTUTIL_MSAN=1
elif [[ "-DCMAKE_BUILD_TYPE=ASan" =~ TSan ]]; then
export TSAN_OPTIONS="$COMMON_SAN_OPTIONS:verbosity=3:history_size=7:print_suppressions=0:suppressions=$WT_TOPDIR/test/evergreen/tsan_warnings.supp"
export TESTUTIL_TSAN=1
elif [[ "-DCMAKE_BUILD_TYPE=ASan" =~ UBSan ]]; then
export UBSAN_OPTIONS="$COMMON_SAN_OPTIONS:print_stacktrace=1"
export TESTUTIL_UBSAN=1
fi
if [[ 0 -eq 1 ]]; then
# The preloaded library should be downloaded/built during "configure wiredtiger" step.
# DO NOT MOVE:This variable must be set in the same function(shell) that runs a test,
# and as close as possible to the test execution, since it affects all the binaries.
export LD_PRELOAD=$WT_TOPDIR/TCMALLOC_LIB/libtcmalloc.so
if [ ! -f "$LD_PRELOAD" ]; then
echo "Error: TCMalloc support was requested, but the library doesn't exist: $LD_PRELOAD"
exit 1
fi
fi
# Set extensions to load
EXT="extensions=["
EXT="$EXT ext/compressors/snappy/libwiredtiger_snappy.so,"
EXT="$EXT ext/collators/reverse/libwiredtiger_reverse_collator.so,"
EXT="$EXT ext/encryptors/rotn/libwiredtiger_rotn.so,"
EXT="$EXT ext/page_log/palite/libwiredtiger_palite.so,"
EXT="$EXT ]"
export EXT
export LSAN_OPTIONS="$COMMON_SAN_OPTIONS:print_suppressions=0:suppressions=$(git rev-parse --show-toplevel)/test/evergreen/asan_leaks.supp"
Dump Environment
eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot "$@"
ASAN_OPTIONS=abort_on_error=1:disable_coredump=0:unmap_shadow_on_exit=1
BASH_FUNC_which%%=() { ( alias;
CI=true
EVR_AGENT_PID=3606
EVR_TASK_ID=wiredtiger_disagg_amazon2023_disagg_asan_stress_schema_disagg_abort_legacy_switch_test_disagg_1_74b012e60d0de08efef42edbcbcf8489c79b5661_26_08_28_16_52_57
EXT=extensions=[ ext/compressors/snappy/libwiredtiger_snappy.so, ext/collators/reverse/libwiredtiger_reverse_collator.so, ext/encryptors/rotn/libwiredtiger_rotn.so, ext/page_log/palite/libwiredtiger_palite.so, ]
GOCACHE=/data/mci/a89135961be4ed038a81fb5810239ec6/wiredtiger/cmake_build/test/csuite/schema_disagg_abort/.gocache
GOTRACEBACK=none
HISTCONTROL=ignoredups
HISTSIZE=1000
HOME=/home/ec2-user
HOSTNAME=ip-10-128-180-70.ec2.internal
INVOCATION_ID=c2f0ade4412f4f339638fdc0733d2204
JASPER_ID=f811f0a2-819a-4333-b2bf-005e74d82139
JASPER_MANAGER=e9b22653-53ff-4194-ba49-b2f1c5614b39
JOURNAL_STREAM=8:26090
LANG=C.UTF-8
LC_ALL=C
LD_LIBRARY_PATH=/data/mci/a89135961be4ed038a81fb5810239ec6/wiredtiger/cmake_build:/opt/mongodbtoolchain/revisions/93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542/stow/llvm-v5.1VC/lib/clang/19/lib/aarch64-mongodb-linux
LESSOPEN=||/usr/bin/lesspipe.sh %s
LOGNAME=ec2-user
LSAN_OPTIONS=abort_on_error=1:disable_coredump=0:print_suppressions=0:suppressions=/data/mci/a89135961be4ed038a81fb5810239ec6/wiredtiger/test/evergreen/asan_leaks.supp
MAIL=/var/spool/mail/ec2-user
PATH=/opt/mongodbtoolchain/v5/bin:/usr/sbin:/usr/sbin:/usr/sbin:/home/ec2-user/.local/bin:/home/ec2-user/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/opt/node/bin:/opt/node/bin:/opt/node/bin
PWD=/data/mci/a89135961be4ed038a81fb5810239ec6/wiredtiger/cmake_build/test/csuite/schema_disagg_abort
SHELL=/bin/bash
SHLVL=1
SYSTEMD_COLORS=false
SYSTEMD_EXEC_PID=3377
S_COLORS=auto
TEMP=/data/mci/a89135961be4ed038a81fb5810239ec6/tmp
TESTUTIL_BYPASS_ASAN=1
TMP=/data/mci/a89135961be4ed038a81fb5810239ec6/tmp
TMPDIR=/data/mci/a89135961be4ed038a81fb5810239ec6/tmp
USER=ec2-user
WT_BUILDDIR=/data/mci/a89135961be4ed038a81fb5810239ec6/wiredtiger/cmake_build
WT_TOPDIR=/data/mci/a89135961be4ed038a81fb5810239ec6/wiredtiger
_=/usr/bin/printenv
which_declare=declare -f
}
echo "Dump Environment"
printenv | sort
build_dir=$(cd ../../../ && pwd)
for i in $(seq 10); do
echo "Iteration $i/10"
./test_schema_disagg_abort -b "$build_dir" -e -r l -s 30 -T 12 -u 64 -t 300
done
Iteration 1/10
Running test command: ./test_schema_disagg_abort -b /data/mci/a89135961be4ed038a81fb5810239ec6/wiredtiger/cmake_build -e -r l -s 30 -T 12 -u 64 -t 300
Parent: roles l; 12 schema threads; pool 64 slots; switch every 30s; kill leader@0 follower@0 lone@0; stop at 300s
CONFIG: test_schema_disagg_abort -e -r l -s 30 -u 64 -T 12 -t 300 -PSD11407759,E6820772
Running test command: /data/mci/a89135961be4ed038a81fb5810239ec6/wiredtiger/cmake_build/test/csuite/schema_disagg_abort/test_schema_disagg_abort -r node -i 0 -A l -h WT_TEST.test_schema_disagg_abort -b /data/mci/a89135961be4ed038a81fb5810239ec6/wiredtiger/cmake_build -T 12 -u 64 -e -s 30 -PSD11407759,E6820772
Node 0: starting as leader
Node 0: checkpoint 1 complete; stable timestamp = 47
Node 0: checkpoint 2 complete; stable timestamp = 150
Node 0: checkpoint 3 complete; stable timestamp = 264
Node 0: checkpoint 4 complete; stable timestamp = 346
Node 0: checkpoint 5 complete; stable timestamp = 567
Node 0: checkpoint 6 complete; stable timestamp = 836
Node 0: checkpoint 7 complete; stable timestamp = 1115
Node 0: checkpoint 8 complete; stable timestamp = 1386
Parent: directing switch 1
Node 0: checkpoint 9 complete; stable timestamp = 1569
Node 0: checkpoint 10 complete; stable timestamp = 1754
Node 0: checkpoint 11 complete; stable timestamp = 2049
Node 0: checkpoint 12 complete; stable timestamp = 2315
Node 0: checkpoint 13 complete; stable timestamp = 2441
Node 0: step-down checkpoint at 2462 (lsn 3284)
Node 0: step-down emitted 673 events
Node 0: no peer to hand over to; continuing alone
Node 0: now follower
Node 0: switch 1 complete
[1787941802:822688][13504:0xffff771d70e0], checkpoint-pick-up: [WT_VERB_LAYERED][WARNING]: Picking up the same checkpoint again: metadata LSN = 3282
Parent: directing switch 2
Node 0: now leader
Node 0: switch 2 complete
Node 0: checkpoint 1 complete; stable timestamp = 5096
Node 0: checkpoint 2 complete; stable timestamp = 5354
Node 0: checkpoint 3 complete; stable timestamp = 5644
Node 0: checkpoint 4 complete; stable timestamp = 5932
Node 0: checkpoint 5 complete; stable timestamp = 6016
Node 0: checkpoint 6 complete; stable timestamp = 6135
Node 0: checkpoint 7 complete; stable timestamp = 6250
Node 0: checkpoint 8 complete; stable timestamp = 6379
Node 0: checkpoint 9 complete; stable timestamp = 6669
Node 0: checkpoint 10 complete; stable timestamp = 6955
Parent: directing switch 3
Node 0: checkpoint 11 complete; stable timestamp = 7275
Node 0: checkpoint 12 complete; stable timestamp = 7546
Node 0: checkpoint 13 complete; stable timestamp = 7906
Node 0: checkpoi
schema-disagg-abort-legacy-switch-test-disagg-1 task_log
Logs:
test_schema_disagg_abort: FAILED: node0 leader DROP table:schema_0_7_15_0: EBUSY for 30 seconds: the table has dirty data and cannot be closed yet: Connection timed out
schema-disagg-abort-legacy-switch-test-disagg-1 task_log
Logs:
test_schema_disagg_abort: FAILED: node0 terminated unexpectedly: signal 6: Invalid argument
schema-disagg-abort-legacy-switch-test-disagg-1 task_log
Logs:
Running task commands failed: running command: command failed: shell script encountered problem: exit code 134 Finished running task commands in 1h17m58.074028048s. Task completed - FAILURE. Running post-task commands.
schema-disagg-abort-legacy-switch-test-disagg-1 task_log
Logs:
#0 0x0000ffffb3ec4454 in __pthread_kill_implementation () from /lib64/libc.so.6 #0 0x0000ffffb3ec4454 in __pthread_kill_implementation () from /lib64/libc.so.6 #1 0x0000ffffb3e7b320 [PAC] in raise () from /lib64/libc.so.6 #2 0x0000ffffb3e62224 [PAC] in abort () from /lib64/libc.so.6 #3 0x0000ffffb4b02fac [PAC] in __wt_abort (session=0x0) at /data/mci/7db885bdebb8cdb024aef229401e06ad/wiredtiger/src/os_common/os_abort.c:32 #4 0x0000aaaad5f63ce8 in testutil_die (e=22, fmt=0xaaaad5f7aec0 <str> "%s terminated unexpectedly: %s %d") at /data/mci/7db885bdebb8cdb024aef229401e06ad/wiredtiger/test/utility/misc.c:75 #5 0x0000aaaad5f54b98 in die_on_child_status (proc=0xaaaad6021220 <run_children[children]>, status=SUBPROC_KILLED, code=6) at /data/mci/7db885bdebb8cdb024aef229401e06ad/wiredtiger/test/csuite/schema_disagg_abort/parent.c:140 #6 0x0000aaaad5f542e0 in child_alive (proc=0xaaaad6021220 <run_children[children]>) at /data/mci/7db885bdebb8cdb024aef229401e06ad/wiredtiger/test/csuite/schema_disagg_abort/parent.c:157 #7 0x0000aaaad5f540b8 in children_poll (children=0xaaaad6021220 <run_children[children]>) at /data/mci/7db885bdebb8cdb024aef229401e06ad/wiredtiger/test/csuite/schema_disagg_abort/parent.c:171 #8 0x0000aaaad5f53fe0 in wait_for_sentinel (cfg=0xffffb2400020, children=0xaaaad6021220 <run_children[children]>, sentinel=0xffffb1d04820 "switch_done.7", max_wait=240) at /data/mci/7db885bdebb8cdb024aef229401e06ad/wiredtiger/test/csuite/schema_disagg_abort/parent.c:186 #9 0x0000aaaad5f54970 in direct_switch (cfg=0xffffb2400020, children=0xaaaad6021220 <run_children[children]>, cur_leaderp=0xffffb1f000a0, cur_followerp=0xffffb1f000b0, genp=0xffffb1f000c0) at /data/mci/7db885bdebb8cdb024aef229401e06ad/wiredtiger/test/csuite/schema_disagg_abort/parent.c:245 #10 0x0000aaaad5f520c4 in run_children (cfg=0xffffb2400020, self_path=0xffffb2402190 "/data/mci/a89135961be4ed038a81fb5810239ec6/wiredtiger/cmake_build/test/csuite/schema_disagg_abort/test_schema_disagg_abort") at /data/mci/7db885bdebb8cdb024aef229401e06ad/wiredtiger/test/csuite/schema_disagg_abort/parent.c:342 #11 0x0000aaaad5f510e0 in parent_main (cfg=0xffffb2400020, self_path=0xffffb2402190 "/data/mci/a89135961be4ed038a81fb5810239ec6/wiredtiger/cmake_build/test/csuite/schema_disagg_abort/test_schema_disagg_abort") at /data/mci/7db885bdebb8cdb024aef229401e06ad/wiredtiger/test/csuite/schema_disagg_abort/parent.c:407 #12 0x0000aaaad5f4aa6c in main (argc=14, argv=0xfffff39547b8) at /data/mci/7db885bdebb8cdb024aef229401e06ad/wiredtiger/test/csuite/schema_disagg_abort/main.c:461 #0 0x0000ffff854c4454 in __pthread_kill_implementation () from /lib64/libc.so.6 #0 0x0000ffff854c4454 in __pthread_kill_implementation () from /lib64/libc.so.6 #1 0x0000ffff8547b320 [PAC] in raise () from /lib64/libc.so.6 #2 0x0000ffff85462224 [PAC] in abort () from /lib64/libc.so.6 #3 0x0000ffff86102fac [PAC] in __wt_abort (session=0x0) at /data/mci/7db885bdebb8cdb024aef229401e06ad/wiredtiger/src/os_common/os_abort.c:32 #4 0x0000aaaab5f43ce8 in testutil_die (e=110, fmt=0xaaaab5f5eac0 <str> "node%u %s %s %s: EBUSY for %d seconds: %s") at /data/mci/7db885bdebb8cdb024aef229401e06ad/wiredtiger/test/utility/misc.c:75 #5 0x0000aaaab5f3de8c in schema_op_execute (state=0xaaaab5f8d440 <workload_state_create[state]>, session=0xffff84c1b1d0, ev=0xffff5c438020) at /data/mci/7db885bdebb8cdb024aef229401e06ad/wiredtiger/test/csuite/schema_disagg_abort/worker.c:160 #6 0x0000aaaab5f3bb70 in apply_event (state=0xaaaab5f8d440 <workload_state_create[state]>, ctx=0xffff5c238020, thread_index=7, ev=0xffff5c438020) at /data/mci/7db885bdebb8cdb024aef229401e06ad/wiredtiger/test/csuite/schema_disagg_abort/worker.c:287 #7 0x0000aaaab5f3b4ec in worker_apply_loop (state=0xaaaab5f8d440 <workload_state_create[state]>, ctx=0xffff5c238020, thread_index=7) at /data/mci/7db885bdebb8cdb024aef229401e06ad/wiredtiger/test/csuite/schema_disagg_abort/worker.c:353 #8 0x0000aaaab5f3af80 in thread_worker_run (arg=0xaaaab6001310 <node_workers_start.worker_arg+112>) at /data/mci/7db885bdebb8cdb024aef229401e06ad/wiredtiger/test/csuite/schema_disagg_abort/worker.c:375 #9 0x0000ffff86d056e0 in asan_thread_start () at /data/mci/3fc465e6a85d2b4e52ac6fc50781c0fd/toolchain-builder/tmp/build-llvm-v5.sh-aQL/llvm-project-llvmorg/compiler-rt/lib/asan/asan_interceptors.cpp:239 #10 0x0000ffff854c2834 in start_thread () from /lib64/libc.so.6 #11 0x0000ffff85466e5c [PAC] in thread_start () from /lib64/libc.so.6
schema-disagg-abort-legacy-switch-test-disagg-1 task_log
Logs:
Finished command 'shell.exec' in function 'dump stacktraces' (step 1 of 9) in block 'post' in 2.789713083s.
Running command 's3.put' in function 'upload stacktraces' (step 2 of 9) in block 'post'.
Putting files matching filter '[wiredtiger/cmake_build/*stacktrace.txt]' into path 'wiredtiger/amazon2023-disagg-asan-stress/74b012e60d0de08efef42edbcbcf8489c79b5661/artifacts/schema-disagg-abort-legacy-switch-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_asan_stress_74b012e60d0de08efef42edbcbcf8489c79b5661_26_08_28_16_52_57/' in S3 bucket 'build_external'.
Performing S3 put to file 'wiredtiger/amazon2023-disagg-asan-stress/74b012e60d0de08efef42edbcbcf8489c79b5661/artifacts/schema-disagg-abort-legacy-switch-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_asan_stress_74b012e60d0de08efef42edbcbcf8489c79b5661_26_08_28_16_52_57/' in bucket 'build_external' (attempt 1 of 5).
Finished command 's3.put' in function 'upload stacktraces' (step 2 of 9) in block 'post' in 195.161294ms.
Running command 's3.put' in function 'upload test/format config' (step 3 of 9) in block 'post'.
Putting files matching filter '[wiredtiger/cmake_build/test/format/RUNDIR*/CONFIG]' into path 'wiredtiger/amazon2023-disagg-asan-stress/74b012e60d0de08efef42edbcbcf8489c79b5661/artifacts/schema-disagg-abort-legacy-switch-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_asan_stress_74b012e60d0de08efef42edbcbcf8489c79b5661_26_08_28_16_52_57/' in S3 bucket 'build_external'.
Performing S3 put to file 'wiredtiger/amazon2023-disagg-asan-stress/74b012e60d0de08efef42edbcbcf8489c79b5661/artifacts/schema-disagg-abort-legacy-switch-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_asan_stress_74b012e60d0de08efef42edbcbcf8489c79b5661_26_08_28_16_52_57/' in bucket 'build_external' (attempt 1 of 5).
File filter 'wiredtiger/cmake_build/test/format/RUNDIR*/CONFIG' matched no files.
Finished command 's3.put' in function 'upload test/format config' (step 3 of 9) in block 'post' in 56.270653ms.
Running command 's3.put' in function 'upload test/model workloads' (step 4 of 9) in block 'post'.
Putting files matching filter '[wiredtiger/cmake_build/test/model/tools/WT_TEST*/*.workload]' into path 'wiredtiger/amazon2023-disagg-asan-stress/74b012e60d0de08efef42edbcbcf8489c79b5661/artifacts/schema-disagg-abort-legacy-switch-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_asan_stress_74b012e60d0de08efef42edbcbcf8489c79b5661_26_08_28_16_52_57/' in S3 bucket 'build_external'.
Performing S3 put to file 'wiredtiger/amazon2023-disagg-asan-stress/74b012e60d0de08efef42edbcbcf8489c79b5661/artifacts/schema-disagg-abort-legacy-switch-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_asan_stress_74b012e60d0de08efef42edbcbcf8489c79b5661_26_08_28_16_52_57/' in bucket 'build_external' (attempt 1 of 5).
File filter 'wiredtiger/cmake_build/test/model/tools/WT_TEST*/*.workload' matched no files.
Finished command 's3.put' in function 'upload test/model workloads' (step 4 of 9) in block 'post' in 45.441348ms.
Running command 'shell.exec' in function 'dump stderr/stdout' (step 5 of 9) in block 'post'.
if [ -d "WT_TEST" ]; then
# Dump stderr/stdout contents generated by the C libraries onto console for Python tests
find "WT_TEST" -name "std*.txt" ! -empty -exec bash -c "echo 'Contents from {}:'; cat '{}'" \;
fi
Finished command 'shell.exec' in function 'dump stderr/stdout' (step 5 of 9) in block 'post' in 1.401454ms.
Running command 'shell.exec' in function 'upload stat files' (step 6.1 of 9) in block 'post'.
mkdir stat_files
python3 ../test/evergreen/collect_stat_files.py -d stat_files
Finished command 'shell.exec' in function 'upload stat files' (step 6.1 of 9) in block 'post' in 59.486533ms.
Running command 'archive.targz_pack' in function 'upload stat files' (step 6.2 of 9) in block 'post'.
Beginning to build archive.
[message='successfully created archive' num_files='4' target='/data/mci/a89135961be4ed038a81fb5810239ec6/wiredtiger/cmake_build/stat_files.tar.gz']
Finished command 'archive.targz_pack' in function 'upload stat files' (step 6.2 of 9) in block 'post' in 33.261908ms.
Running command 's3.put' in function 'upload stat files' (step 6.3 of 9) in block 'post'.
Putting local file 'wiredtiger/cmake_build/stat_files.tar.gz' into path 'build_external/wiredtiger/amazon2023-disagg-asan-stress/74b012e60d0de08efef42edbcbcf8489c79b5661/artifacts/schema-disagg-abort-legacy-switch-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_asan_stress_74b012e60d0de08efef42edbcbcf8489c79b5661_26_08_28_16_52_57/stat_files.tar.gz' (https://build_external.s3.amazonaws.com/wiredtiger/amazon2023-disagg-asan-stress/74b012e60d0de08efef42edbcbcf8489c79b5661/artifacts/schema-disagg-abort-legacy-switch-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_asan_stress_74b012e60d0de08efef42edbcbcf8489c79b5661_26_08_28_16_52_57/stat_files.tar.gz).
Performing S3 put to file 'wiredtiger/amazon2023-disagg-asan-stress/74b012e60d0de08efef42edbcbcf8489c79b5661/artifacts/schema-disagg-abort-legacy-switch-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_asan_stress_74b012e60d0de08efef42edbcbcf8489c79b5661_26_08_28_16_52_57/stat_files.tar.gz' in bucket 'build_external' (attempt 1 of 5).
Finished command 's3.put' in function 'upload stat files' (step 6.3 of 9) in block 'post' in 371.757321ms.
Running command 'archive.targz_pack' in function 'upload artifact' (step 7.1 of 9) in block 'post'.
Beginning to build archive.
[message='successfully created archive' num_files='8683' target='/data/mci/a89135961be4ed038a81fb5810239ec6/wiredtiger.tgz']
Finished command 'archive.targz_pack' in function 'upload artifact' (step 7.1 of 9) in block 'post' in 1.719337066s.
Running command 's3.put' in function 'upload artifact' (step 7.2 of 9) in block 'post'.
Putting local file 'wiredtiger.tgz' into path 'build_external/wiredtiger/amazon2023-disagg-asan-stress/74b012e60d0de08efef42edbcbcf8489c79b5661/artifacts/schema-disagg-abort-legacy-switch-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_asan_stress_74b012e60d0de08efef42edbcbcf8489c79b5661_26_08_28_16_52_57-0.tgz' (https://build_external.s3.amazonaws.com/wiredtiger/amazon2023-disagg-asan-stress/74b012e60d0de08efef42edbcbcf8489c79b5661/artifacts/schema-disagg-abort-legacy-switch-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_asan_stress_74b012e60d0de08efef42edbcbcf8489c79b5661_26_08_28_16_52_57-0.tgz).
Performing S3 put to file 'wiredtiger/amazon2023-disagg-asan-stress/74b012e60d0de08efef42edbcbcf8489c79b5661/artifacts/schema-disagg-abort-legacy-switch-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_asan_stress_74b012e60d0de08efef42edbcbcf8489c79b5661_26_08_28_16_52_57-0.tgz' in bucket 'build_external' (attempt 1 of 5).
Finished command 's3.put' in function 'upload artifact' (step 7.2 of 9) in block 'post' in 1.557158248s.
Running command 'archive.targz_pack' in function 'save wt hang analyzer core/debugger files' (step 8.1 of 9) in block 'post'.
Beginning to build archive.
No files were archived.
Finished command 'archive.targz_pack' in function 'save wt hang analyzer core/debugger files' (step 8.1 of 9) in block 'post' in 385.561µs.
Running command 's3.put' in function 'save wt hang analyzer core/debugger files' (step 8.2 of 9) in block 'post'.
Putting local file 'wt-hang-analyzer.tgz' into path 'build_external/wiredtiger/amazon2023-disagg-asan-stress/74b012e60d0de08efef42edbcbcf8489c79b5661/wt_hang_analyzer/wt-hang-analyzer_schema-disagg-abort-legacy-switch-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_asan_stress_74b012e60d0de08efef42edbcbcf8489c79b5661_26_08_28_16_52_57.tgz' (https://build_external.s3.amazonaws.com/wiredtiger/amazon2023-disagg-asan-stress/74b012e60d0de08efef42edbcbcf8489c79b5661/wt_hang_analyzer/wt-hang-analyzer_schema-disagg-abort-legacy-switch-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_asan_stress_74b012e60d0de08efef42edbcbcf8489c79b5661_26_08_28_16_52_57.tgz).
Performing S3 put to file 'wiredtiger/amazon2023-disagg-asan-stress/74b012e60d0de08efef42edbcbcf8489c79b5661/wt_hang_analyzer/wt-hang-analyzer_schema-disagg-abort-legacy-switch-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_asan_stress_74b012e60d0de08efef42edbcbcf8489c79b5661_26_08_28_16_52_57.tgz' in bucket 'build_external' (attempt 1 of 5).
File '/data/mci/a89135961be4ed038a81fb5810239ec6/wt-hang-analyzer.tgz' not found and skip missing is true, exiting without error.
Finished command 's3.put' in function 'save wt hang analyzer core/debugger files' (step 8.2 of 9) in block 'post' in 15.80299ms.
Running command 'shell.exec' in function 'cleanup' (step 9 of 9) in block 'post'.
Finished command 'shell.exec' in function 'cleanup' (step 9 of 9) in block 'post' in 553.87281ms.
Finished running post-task commands in 7.400531903s.
reading test log spec; falling back to default spec: open /data/mci/a89135961be4ed038a81fb5810239ec6/build/TestLogs/log_spec.yaml: no such file or directory
- is blocked by
-
WT-18515 schema_disagg_abort: Avoid the shared metadata mismatch panic
-
- Closed
-