Schema Disagg Abort failure: EBUSY for 30 seconds

XMLWordPrintableJSON

    schema-disagg-abort-smoke-test-disagg-1 on amazon2023-disagg-stress

    Host: i-061090bffcacabade
    Project: wiredtiger-disagg
    Commit: 268cc2f4
    Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

    Task Logs:

    schema-disagg-abort-smoke-test-disagg-1 task_log

    Logs:

    Task logger initialized (agent version '2026-08-12' from Evergreen build revision '92387812403fc9e70f839339d96ace825b420548').
    Starting task 'wiredtiger_disagg_amazon2023_disagg_stress_schema_disagg_abort_smoke_test_disagg_1_268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8_26_08_17_06_45_05', execution 0.
    Running pre-task commands.
    Running command 'shell.exec' in function 'cleanup' (step 1 of 3) in block 'pre'.
    Finished command 'shell.exec' in function 'cleanup' (step 1 of 3) in block 'pre' in 2.645891ms.
    Running command 'expansions.update' in function 'setup environment' (step 2 of 3) in block 'pre'.
    Finished command 'expansions.update' in function 'setup environment' (step 2 of 3) in block 'pre' in 35.895µs.
    Running command 'shell.exec' in function 'pin mongo toolchain' (step 3 of 3) in block 'pre'.
    mongodbtoolchain 93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542 not installed, downloading...
    Autodetected Amazon Linux 2023 (OS_ID: amazon2023) on aarch64
    Autodetected DOWNLOAD_URL: https://mongodbtoolchain.build.10gen.cc/toolchain/amazon2023-arm64/x86_64/latest
    Overriding REVISION_ID, will download toolchain for 93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542
    Ensuring /opt/mongodbtoolchain/revisions exists and has correct ownership...
    Downloading toolchain to /data/mci/3a18078deb2d0e61120dd5ab8115c801/tmp/tmp.SkLTVkf3Kn/mongodbtoolchain.tar.gz from https://mongodbtoolchain.build.10gen.cc/toolchain/amazon2023-arm64/x86_64/mongodbtoolchain-93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542.tar.gz
    Getting toolchain revision from archive...
    Checking downloaded archive integrity...
    Extracting toolchain revision 93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542 from archive...
    Running post install script...
    Existing v2 found, uninstalling...
    Existing v3 found, uninstalling...
    Existing v4 found, uninstalling...
    Existing v5 found, uninstalling...
    Installing v2...
    Installing v3...
    Installing v4...
    Installing v5...
    Cleaning up...
    Finished command 'shell.exec' in function 'pin mongo toolchain' (step 3 of 3) in block 'pre' in 3m4.617807363s.
    Finished running pre-task commands in 3m4.620822235s.
    Running task commands.
    Running command 's3.get' in function 'fetch artifacts' (step 1 of 2).
    Fetching remote file 'wiredtiger/amazon2023-disagg-stress/268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8/artifacts/compile_wiredtiger_disagg_amazon2023_disagg_stress_268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8_26_08_17_06_45_05.tgz' from S3 bucket 'build_external' (attempt 1 of 5).
    Finished command 's3.get' in function 'fetch artifacts' (step 1 of 2) in 5.51163954s.
    Running command 'shell.exec' (step 2 of 2).
    export WT_TOPDIR=$(git rev-parse --show-toplevel)
    export WT_BUILDDIR=$WT_TOPDIR/cmake_build
    if [ "$OS" = "Windows_NT" ]; then
      export PATH=/cygdrive/c/python/Python311:/cygdrive/c/python/Python311/Scripts:$PATH
    else
      export PATH=/opt/mongodbtoolchain/v5/bin:$PATH
      export LD_LIBRARY_PATH=$WT_BUILDDIR
    fi
    # Create the common sanitizer options and export the specific sanitizer environment
    # variables.
    COMMON_SAN_OPTIONS="abort_on_error=1:disable_coredump=0"
    if [[ "" =~ ASan ]]; then
      export ASAN_OPTIONS="$COMMON_SAN_OPTIONS:unmap_shadow_on_exit=1"
      asan_lib=$(clang -print-file-name=libclang_rt.asan.so)
      [ -f "$asan_lib" ] || { echo "ERROR: libclang_rt.asan.so not found by clang"; exit 1; }
      export LD_LIBRARY_PATH="$LD_LIBRARY_PATH:$(dirname "$asan_lib")"
      export TESTUTIL_BYPASS_ASAN=1
    elif [[ "" =~ MSan ]]; then
      export MSAN_OPTIONS="$COMMON_SAN_OPTIONS:verbosity=3"
      export TESTUTIL_MSAN=1
    elif [[ "" =~ TSan ]]; then
      export TSAN_OPTIONS="$COMMON_SAN_OPTIONS:verbosity=3:history_size=7:print_suppressions=0:suppressions=$WT_TOPDIR/test/evergreen/tsan_warnings.supp"
      export TESTUTIL_TSAN=1
    elif [[ "" =~ UBSan ]]; then
      export UBSAN_OPTIONS="$COMMON_SAN_OPTIONS:print_stacktrace=1"
      export TESTUTIL_UBSAN=1
    fi
    if [[ 1 -eq 1 ]]; then
      # The preloaded library should be downloaded/built during "configure wiredtiger" step.
      # DO NOT MOVE:This variable must be set in the same function(shell) that runs a test,
      # and as close as possible to the test execution, since it affects all the binaries.
      export LD_PRELOAD=$WT_TOPDIR/TCMALLOC_LIB/libtcmalloc.so
      if [ ! -f "$LD_PRELOAD" ]; then
        echo "Error: TCMalloc support was requested, but the library doesn't exist: $LD_PRELOAD"
        exit 1
      fi
    fi
    # Set extensions to load
    EXT="extensions=["
    EXT="$EXT ext/compressors/snappy/libwiredtiger_snappy.so,"
    EXT="$EXT ext/collators/reverse/libwiredtiger_reverse_collator.so,"
    EXT="$EXT ext/encryptors/rotn/libwiredtiger_rotn.so,"
    EXT="$EXT ext/page_log/palite/libwiredtiger_palite.so,"
    EXT="$EXT ]"
    export EXT
    Dump Environment
     eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot "$@"
    BASH_FUNC_which%%=() {  ( alias;
    CI=true
    EVR_AGENT_PID=3487
    EVR_TASK_ID=wiredtiger_disagg_amazon2023_disagg_stress_schema_disagg_abort_smoke_test_disagg_1_268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8_26_08_17_06_45_05
    EXT=extensions=[ ext/compressors/snappy/libwiredtiger_snappy.so, ext/collators/reverse/libwiredtiger_reverse_collator.so, ext/encryptors/rotn/libwiredtiger_rotn.so, ext/page_log/palite/libwiredtiger_palite.so, ]
    GOCACHE=/data/mci/3a18078deb2d0e61120dd5ab8115c801/wiredtiger/cmake_build/test/csuite/schema_disagg_abort/.gocache
    GOTRACEBACK=none
    HISTCONTROL=ignoredups
    HISTSIZE=1000
    HOME=/home/ec2-user
    HOSTNAME=ip-10-128-98-60.ec2.internal
    INVOCATION_ID=22458ba4bd4a4aaaa5eb7c4b1bf16e3b
    JASPER_ID=c6a90f2d-09e4-4400-80d4-1bbbf9234b53
    JASPER_MANAGER=392ac4f7-52ee-44b8-896d-3c97e0467324
    JOURNAL_STREAM=8:20859
    LANG=C.UTF-8
    LC_ALL=C
    LD_LIBRARY_PATH=/data/mci/3a18078deb2d0e61120dd5ab8115c801/wiredtiger/cmake_build
    LD_PRELOAD=/data/mci/3a18078deb2d0e61120dd5ab8115c801/wiredtiger/TCMALLOC_LIB/libtcmalloc.so
    LESSOPEN=||/usr/bin/lesspipe.sh %s
    LOGNAME=ec2-user
    MAIL=/var/spool/mail/ec2-user
    PATH=/opt/mongodbtoolchain/v5/bin:/usr/sbin:/usr/sbin:/usr/sbin:/home/ec2-user/.local/bin:/home/ec2-user/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/opt/node/bin:/opt/node/bin:/opt/node/bin
    PWD=/data/mci/3a18078deb2d0e61120dd5ab8115c801/wiredtiger/cmake_build/test/csuite/schema_disagg_abort
    SHELL=/bin/bash
    SHLVL=1
    SYSTEMD_COLORS=false
    SYSTEMD_EXEC_PID=3397
    S_COLORS=auto
    TEMP=/data/mci/3a18078deb2d0e61120dd5ab8115c801/tmp
    TMP=/data/mci/3a18078deb2d0e61120dd5ab8115c801/tmp
    TMPDIR=/data/mci/3a18078deb2d0e61120dd5ab8115c801/tmp
    USER=ec2-user
    WT_BUILDDIR=/data/mci/3a18078deb2d0e61120dd5ab8115c801/wiredtiger/cmake_build
    WT_TOPDIR=/data/mci/3a18078deb2d0e61120dd5ab8115c801/wiredtiger
    _=/usr/bin/printenv
    which_declare=declare -f
    }
    echo "Dump Environment"
    printenv | sort
    # The full mode matrix in short runs: single node, lone follower, role switches,
    # kills, and both two-node topologies. The two-node switch modes at the end are
    # EXPECTED to fail until FIXME-WT-18068 and FIXME-WT-17746 land.
    Running test command: ./test_schema_disagg_abort -b /data/mci/3a18078deb2d0e61120dd5ab8115c801/wiredtiger/cmake_build -r l -t 10 -T 2 -h WT_TEST.schema_disagg_abort.l
    Parent: roles l; 2 schema threads; pool 32 slots; switch every 0s; kill leader@0 follower@0 lone@0; stop at 10s
    CONFIG: test_schema_disagg_abort -r l -u 32 -T 2 -t 10 -PSD6035278,E11530074
    Running test command: /data/mci/3a18078deb2d0e61120dd5ab8115c801/wiredtiger/cmake_build/test/csuite/schema_disagg_abort/test_schema_disagg_abort -r node -i 0 -A l -h WT_TEST.schema_disagg_abort.l -b /data/mci/3a18078deb2d0e61120dd5ab8115c801/wiredtiger/cmake_build -T 2 -u 32 -PSD6035278,E11530074
    Node 0: starting as leader
    Node 0: checkpoint 1 complete
    Node 0: checkpoint 2 complete
    Node 0: checkpoint 3 complete
    Node 0: checkpoint 4 complete
    Node 0: checkpoint 5 complete
    Node 0: checkpoint 6 complete
    Node 0: checkpoint 7 complete
    Node 0: checkpoint 8 complete
    Node 0: checkpoint 9 complete
    Parent: directing graceful stop
    Node 0: checkpoint 10 complete
    Node 0: checkpoint 11 complete
    Node 0: checkpoint 12 complete
    Node 0: checkpoint 13 complete
    Node 0: checkpoint 14 complete
    Node 0: checkpoint 15 complete
    Node 0: checkpoint 16 complete
    Node 0: checkpoint 17 complete
    Node 0: checkpoint 18 complete
    Node 0: checkpoint 19 complete
    Node 0: checkpoint 20 complete
    Node 0: checkpoint 21 complete
    Node 0: checkpoint 22 complete
    Node 0: checkpoint 23 complete
    Node 0: checkpoint 24 complete
    Node 0: checkpoint 25 complete
    Node 0: checkpoint 26 complete
    Node 0: checkpoint 27 complete
    Node 0: checkpoint 28 complete
    Node 0: checkpoint 29 complete
    Node 0: checkpoint 30 complete
    Node 0: checkpoint 31 complete
    Node 0: checkpoint 32 complete
    Node 0: checkpoint 33 complete
    Node 0: checkpoint 34 complete
    Node 0: checkpoint 35 complete
    bash ./smoke.sh
    test_schema_disagg_abort: FAILED: node0 leader DROP table:schema_0_1_30: EBUSY for 30 seconds: the table has dirty data and cannot be closed yet: Connection timed out
    test_schema_disagg_abort: process aborting
    WiredTiger Error: __wt_abort, 29: aborting WiredTiger library
    Error at src/checkpoint/checkpoint_txn.c:3679: "ret" failed with Device or resource busy (16), WT_DIRTY_DATA: Table has dirty data
    Error at src/conn/conn_dhandle.c:482: "__wt_checkpoint_close(session, final)" failed with Device or resource busy (16)
    Error at src/conn/conn_dhandle.c:484: "ret" failed with Device or resource busy (16)
    Error at src/conn/conn_dhandle.c:907: "__conn_dhandle_close_one(session, uri, NULL, removed, mark_dead, check_visibility)" failed with Device or resource busy (16)
    Error at src/schema/schema_drop.c:46: "ret" failed with Device or resource busy (16), WT_CONFLICT_DHANDLE: Another thread currently holds the data handle of the table
    Error at src/schema/schema_drop.c:241: "ret" failed with Device or resource busy (16)
    Error at src/schema/schema_drop.c:345: "__wt_schema_drop(session, colgroup->source, cfg, check_visibility)" failed with Device or resource busy (16)
    test_schema_disagg_abort: FAILED: node0 terminated unexpectedly: signal 6: Invalid argument
    test_schema_disagg_abort: process aborting
    WiredTiger Error: __wt_abort, 29: aborti
    

    logs

    schema-disagg-abort-smoke-test-disagg-1 task_log

    Logs:

    #0  0x0000ffffa00c4454 in __pthread_kill_implementation () from /lib64/libc.so.6
    #0  0x0000ffffa00c4454 in __pthread_kill_implementation () from /lib64/libc.so.6
    #1  0x0000ffffa007b320 [PAC] in raise () from /lib64/libc.so.6
    #2  0x0000ffffa0062224 [PAC] in abort () from /lib64/libc.so.6
    #3  0x0000ffffa0466690 [PAC] in __wt_abort (session=session@entry=0x0) at /data/mci/a8d556e31341129544e809239159e387/wiredtiger/src/os_common/os_abort.c:32
    #4  0x000000000040a644 in testutil_die (e=e@entry=22, fmt=fmt@entry=0x410480 "%s terminated unexpectedly: %s %d") at /data/mci/a8d556e31341129544e809239159e387/wiredtiger/test/utility/misc.c:75
    #5  0x0000000000405888 in die_on_child_status (proc=proc@entry=0x473918 <children>, status=<optimized out>, code=<optimized out>) at /data/mci/a8d556e31341129544e809239159e387/wiredtiger/test/csuite/schema_disagg_abort/parent.c:136
    #6  0x0000000000405b00 in reap_child (proc=proc@entry=0x473918 <children>, want_status=want_status@entry=SUBPROC_EXITED, want_code=want_code@entry=0) at /data/mci/a8d556e31341129544e809239159e387/wiredtiger/test/csuite/schema_disagg_abort/parent.c:213
    #7  0x000000000040666c in run_children (cfg=cfg@entry=0xffffc6319628, self_path=self_path@entry=0xffffc6318620 "/data/mci/3a18078deb2d0e61120dd5ab8115c801/wiredtiger/cmake_build/test/csuite/schema_disagg_abort/test_schema_disagg_abort") at /data/mci/a8d556e31341129544e809239159e387/wiredtiger/test/csuite/schema_disagg_abort/parent.c:346
    #8  0x0000000000406918 in parent_main (cfg=cfg@entry=0xffffc6319628, self_path=self_path@entry=0xffffc6318620 "/data/mci/3a18078deb2d0e61120dd5ab8115c801/wiredtiger/cmake_build/test/csuite/schema_disagg_abort/test_schema_disagg_abort") at /data/mci/a8d556e31341129544e809239159e387/wiredtiger/test/csuite/schema_disagg_abort/parent.c:403
    #9  0x0000000000404bc4 in main (argc=<optimized out>, argv=0xffffc631b7e8) at /data/mci/a8d556e31341129544e809239159e387/wiredtiger/test/csuite/schema_disagg_abort/main.c:428
    #0  0x0000ffff8d2c4454 in __pthread_kill_implementation () from /lib64/libc.so.6
    #0  0x0000ffff8d2c4454 in __pthread_kill_implementation () from /lib64/libc.so.6
    #1  0x0000ffff8d27b320 [PAC] in raise () from /lib64/libc.so.6
    #2  0x0000ffff8d262224 [PAC] in abort () from /lib64/libc.so.6
    #3  0x0000ffff8d666690 [PAC] in __wt_abort (session=session@entry=0x0) at /data/mci/a8d556e31341129544e809239159e387/wiredtiger/src/os_common/os_abort.c:32
    #4  0x000000000040a644 in testutil_die (e=e@entry=110, fmt=fmt@entry=0x411ac0 "node%u %s %s %s: EBUSY for %d seconds: %s") at /data/mci/a8d556e31341129544e809239159e387/wiredtiger/test/utility/misc.c:75
    #5  0x0000000000408628 in schema_op_execute (state=state@entry=0x4306a0 <state>, session=0x503affc9c0a0, ev=ev@entry=0xffff824ad258) at /data/mci/a8d556e31341129544e809239159e387/wiredtiger/test/csuite/schema_disagg_abort/worker.c:115
    #6  0x00000000004088b4 in apply_event (state=state@entry=0x4306a0 <state>, ctx=ctx@entry=0xffff824ad2d0, thread_index=thread_index@entry=1, ev=ev@entry=0xffff824ad258) at /data/mci/a8d556e31341129544e809239159e387/wiredtiger/test/csuite/schema_disagg_abort/worker.c:222
    #7  0x0000000000408a24 in worker_apply_loop (state=state@entry=0x4306a0 <state>, ctx=ctx@entry=0xffff824ad2d0, thread_index=1) at /data/mci/a8d556e31341129544e809239159e387/wiredtiger/test/csuite/schema_disagg_abort/worker.c:259
    #8  0x0000000000408a7c in thread_worker_run (arg=0x473958 <worker_arg+16>) at /data/mci/a8d556e31341129544e809239159e387/wiredtiger/test/csuite/schema_disagg_abort/worker.c:281
    #9  0x0000ffff8d2c2834 in start_thread () from /lib64/libc.so.6
    #10 0x0000ffff8d266e5c [PAC] in thread_start () from /lib64/libc.so.6
    

    logs

    schema-disagg-abort-smoke-test-disagg-1 task_log

    Logs:

    Finished command 'shell.exec' in function 'dump stacktraces' (step 1 of 9) in block 'post' in 4.148456288s.
    Running command 's3.put' in function 'upload stacktraces' (step 2 of 9) in block 'post'.
    Putting files matching filter '[wiredtiger/cmake_build/*stacktrace.txt]' into path 'wiredtiger/amazon2023-disagg-stress/268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8/artifacts/schema-disagg-abort-smoke-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_stress_268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8_26_08_17_06_45_05/' in S3 bucket 'build_external'.
    Performing S3 put to file 'wiredtiger/amazon2023-disagg-stress/268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8/artifacts/schema-disagg-abort-smoke-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_stress_268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8_26_08_17_06_45_05/' in bucket 'build_external' (attempt 1 of 5).
    Finished command 's3.put' in function 'upload stacktraces' (step 2 of 9) in block 'post' in 197.686537ms.
    Running command 's3.put' in function 'upload test/format config' (step 3 of 9) in block 'post'.
    Putting files matching filter '[wiredtiger/cmake_build/test/format/RUNDIR*/CONFIG]' into path 'wiredtiger/amazon2023-disagg-stress/268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8/artifacts/schema-disagg-abort-smoke-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_stress_268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8_26_08_17_06_45_05/' in S3 bucket 'build_external'.
    Performing S3 put to file 'wiredtiger/amazon2023-disagg-stress/268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8/artifacts/schema-disagg-abort-smoke-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_stress_268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8_26_08_17_06_45_05/' in bucket 'build_external' (attempt 1 of 5).
    File filter 'wiredtiger/cmake_build/test/format/RUNDIR*/CONFIG' matched no files.
    Finished command 's3.put' in function 'upload test/format config' (step 3 of 9) in block 'post' in 47.17476ms.
    Running command 's3.put' in function 'upload test/model workloads' (step 4 of 9) in block 'post'.
    Putting files matching filter '[wiredtiger/cmake_build/test/model/tools/WT_TEST*/*.workload]' into path 'wiredtiger/amazon2023-disagg-stress/268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8/artifacts/schema-disagg-abort-smoke-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_stress_268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8_26_08_17_06_45_05/' in S3 bucket 'build_external'.
    Performing S3 put to file 'wiredtiger/amazon2023-disagg-stress/268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8/artifacts/schema-disagg-abort-smoke-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_stress_268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8_26_08_17_06_45_05/' in bucket 'build_external' (attempt 1 of 5).
    File filter 'wiredtiger/cmake_build/test/model/tools/WT_TEST*/*.workload' matched no files.
    Finished command 's3.put' in function 'upload test/model workloads' (step 4 of 9) in block 'post' in 40.389424ms.
    Running command 'shell.exec' in function 'dump stderr/stdout' (step 5 of 9) in block 'post'.
    if [ -d "WT_TEST" ]; then
      # Dump stderr/stdout contents generated by the C libraries onto console for Python tests
      find "WT_TEST" -name "std*.txt" ! -empty -exec bash -c "echo 'Contents from {}:'; cat '{}'" \;
    fi
    Finished command 'shell.exec' in function 'dump stderr/stdout' (step 5 of 9) in block 'post' in 1.306969ms.
    Running command 'shell.exec' in function 'upload stat files' (step 6.1 of 9) in block 'post'.
    mkdir stat_files
    python3 ../test/evergreen/collect_stat_files.py -d stat_files
    Finished command 'shell.exec' in function 'upload stat files' (step 6.1 of 9) in block 'post' in 35.042211ms.
    Running command 'archive.targz_pack' in function 'upload stat files' (step 6.2 of 9) in block 'post'.
    Beginning to build archive.
    [message='successfully created archive' num_files='2' target='/data/mci/3a18078deb2d0e61120dd5ab8115c801/wiredtiger/cmake_build/stat_files.tar.gz']
    Finished command 'archive.targz_pack' in function 'upload stat files' (step 6.2 of 9) in block 'post' in 10.243713ms.
    Running command 's3.put' in function 'upload stat files' (step 6.3 of 9) in block 'post'.
    Putting local file 'wiredtiger/cmake_build/stat_files.tar.gz' into path 'build_external/wiredtiger/amazon2023-disagg-stress/268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8/artifacts/schema-disagg-abort-smoke-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_stress_268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8_26_08_17_06_45_05/stat_files.tar.gz' (https://build_external.s3.amazonaws.com/wiredtiger/amazon2023-disagg-stress/268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8/artifacts/schema-disagg-abort-smoke-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_stress_268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8_26_08_17_06_45_05/stat_files.tar.gz).
    Performing S3 put to file 'wiredtiger/amazon2023-disagg-stress/268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8/artifacts/schema-disagg-abort-smoke-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_stress_268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8_26_08_17_06_45_05/stat_files.tar.gz' in bucket 'build_external' (attempt 1 of 5).
    Finished command 's3.put' in function 'upload stat files' (step 6.3 of 9) in block 'post' in 104.910143ms.
    Running command 'archive.targz_pack' in function 'upload artifact' (step 7.1 of 9) in block 'post'.
    Beginning to build archive.
    [message='successfully created archive' num_files='7239' target='/data/mci/3a18078deb2d0e61120dd5ab8115c801/wiredtiger.tgz']
    Finished command 'archive.targz_pack' in function 'upload artifact' (step 7.1 of 9) in block 'post' in 906.707056ms.
    Running command 's3.put' in function 'upload artifact' (step 7.2 of 9) in block 'post'.
    Putting local file 'wiredtiger.tgz' into path 'build_external/wiredtiger/amazon2023-disagg-stress/268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8/artifacts/schema-disagg-abort-smoke-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_stress_268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8_26_08_17_06_45_05-0.tgz' (https://build_external.s3.amazonaws.com/wiredtiger/amazon2023-disagg-stress/268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8/artifacts/schema-disagg-abort-smoke-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_stress_268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8_26_08_17_06_45_05-0.tgz).
    Performing S3 put to file 'wiredtiger/amazon2023-disagg-stress/268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8/artifacts/schema-disagg-abort-smoke-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_stress_268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8_26_08_17_06_45_05-0.tgz' in bucket 'build_external' (attempt 1 of 5).
    Finished command 's3.put' in function 'upload artifact' (step 7.2 of 9) in block 'post' in 1.091923638s.
    Running command 'archive.targz_pack' in function 'save wt hang analyzer core/debugger files' (step 8.1 of 9) in block 'post'.
    Beginning to build archive.
    No files were archived.
    Finished command 'archive.targz_pack' in function 'save wt hang analyzer core/debugger files' (step 8.1 of 9) in block 'post' in 479.803µs.
    Running command 's3.put' in function 'save wt hang analyzer core/debugger files' (step 8.2 of 9) in block 'post'.
    Putting local file 'wt-hang-analyzer.tgz' into path 'build_external/wiredtiger/amazon2023-disagg-stress/268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8/wt_hang_analyzer/wt-hang-analyzer_schema-disagg-abort-smoke-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_stress_268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8_26_08_17_06_45_05.tgz' (https://build_external.s3.amazonaws.com/wiredtiger/amazon2023-disagg-stress/268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8/wt_hang_analyzer/wt-hang-analyzer_schema-disagg-abort-smoke-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_stress_268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8_26_08_17_06_45_05.tgz).
    Performing S3 put to file 'wiredtiger/amazon2023-disagg-stress/268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8/wt_hang_analyzer/wt-hang-analyzer_schema-disagg-abort-smoke-test-disagg-1_wiredtiger_disagg_amazon2023_disagg_stress_268cc2f44ba047b11a6a2a0d34f8fa4ffdf77bb8_26_08_17_06_45_05.tgz' in bucket 'build_external' (attempt 1 of 5).
    File '/data/mci/3a18078deb2d0e61120dd5ab8115c801/wt-hang-analyzer.tgz' not found and skip missing is true, exiting without error.
    Finished command 's3.put' in function 'save wt hang analyzer core/debugger files' (step 8.2 of 9) in block 'post' in 7.777184ms.
    Running command 'shell.exec' in function 'cleanup' (step 9 of 9) in block 'post'.
    Finished command 'shell.exec' in function 'cleanup' (step 9 of 9) in block 'post' in 252.566672ms.
    Finished running post-task commands in 6.846073045s.
    reading test log spec; falling back to default spec: open /data/mci/3a18078deb2d0e61120dd5ab8115c801/build/TestLogs/log_spec.yaml: no such file or directory
    

    logs

          Assignee:
          Alex Blekhman
          Reporter:
          xgen-buildbaron-user
          Votes:
          0 Vote for this issue
          Watchers:
          1 Start watching this issue

            Created:
            Updated:
            Resolved: