failed: format-stress-test-disagg-multi-delete-enabled-1 on amazon2023-disagg-stress [wiredtiger-disagg @ 7bf299ab]

XMLWordPrintableJSON

    • Type: Build Failure
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None

      format-stress-test-disagg-multi-delete-enabled-1 on amazon2023-disagg-stress

      Host: i-08f40e296ed4c492f
      Project: wiredtiger-disagg
      Commit: 7bf299ab
      Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

      Task Logs:

      format-stress-test-disagg-multi-delete-enabled-1 task_log

      Logs:

      Task logger initialized (agent version '2026-07-02' from Evergreen build revision 'de0b9ebbabf933f518ce2af2da0049833c3baba5').
      Starting task 'wiredtiger_disagg_amazon2023_disagg_stress_format_stress_test_disagg_multi_delete_enabled_1_7bf299ab3e0e141003b45ac0ae095019357fe8d3_26_07_15_08_51_07', execution 0.
      Running pre-task commands.
      Running command 'shell.exec' in function 'cleanup' (step 1 of 3) in block 'pre'.
      Finished command 'shell.exec' in function 'cleanup' (step 1 of 3) in block 'pre' in 2.29435ms.
      Running command 'expansions.update' in function 'setup environment' (step 2 of 3) in block 'pre'.
      Finished command 'expansions.update' in function 'setup environment' (step 2 of 3) in block 'pre' in 44.953µs.
      Running command 'shell.exec' in function 'pin mongo toolchain' (step 3 of 3) in block 'pre'.
      mongodbtoolchain 93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542 not installed, downloading...
      Autodetected Amazon Linux 2023 (OS_ID: amazon2023) on aarch64
      Autodetected DOWNLOAD_URL: https://mongodbtoolchain.build.10gen.cc/toolchain/amazon2023-arm64/x86_64/latest
      Overriding REVISION_ID, will download toolchain for 93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542
      Ensuring /opt/mongodbtoolchain/revisions exists and has correct ownership...
      Downloading toolchain to /data/mci/1c2dfa07644ab4b0ac4f381dfbb884b3/tmp/tmp.dabZLUBhBW/mongodbtoolchain.tar.gz from https://mongodbtoolchain.build.10gen.cc/toolchain/amazon2023-arm64/x86_64/mongodbtoolchain-93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542.tar.gz
      Getting toolchain revision from archive...
      Checking downloaded archive integrity...
      Extracting toolchain revision 93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542 from archive...
      bash: line 171: return: can only `return' from a function or sourced script
      /opt/mongodbtoolchain/revisions/93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542/scripts/products.sh: line 13: /opt/mongodbtoolchain/revisions/93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542/scripts/installer.sh: No such file or directory
      Running post install script...
      Existing v2 found, uninstalling...
      Existing v3 found, uninstalling...
      Existing v4 found, uninstalling...
      Existing v5 found, uninstalling...
      Installing v2...
      Installing v3...
      Installing v4...
      Installing v5...
      Cleaning up...
      Finished command 'shell.exec' in function 'pin mongo toolchain' (step 3 of 3) in block 'pre' in 3m10.484904502s.
      Finished running pre-task commands in 3m10.487537627s.
      Running task commands.
      Running command 's3.get' in function 'fetch artifacts' (step 1 of 2).
      Fetching remote file 'wiredtiger/amazon2023-disagg-stress/7bf299ab3e0e141003b45ac0ae095019357fe8d3/artifacts/compile_wiredtiger_disagg_amazon2023_disagg_stress_7bf299ab3e0e141003b45ac0ae095019357fe8d3_26_07_15_08_51_07.tgz' from S3 bucket 'build_external' (attempt 1 of 5).
      Finished command 's3.get' in function 'fetch artifacts' (step 1 of 2) in 5.561893259s.
      Running command 'shell.exec' in function 'format test disagg' (step 2 of 2).
      export WT_TOPDIR=$(git rev-parse --show-toplevel)
      export WT_BUILDDIR=$WT_TOPDIR/cmake_build
      if [ "$OS" = "Windows_NT" ]; then
        export PATH=/cygdrive/c/python/Python311:/cygdrive/c/python/Python311/Scripts:$PATH
      else
        export PATH=/opt/mongodbtoolchain/v5/bin:$PATH
        export LD_LIBRARY_PATH=$WT_BUILDDIR
      fi
      # Create the common sanitizer options and export the specific sanitizer environment
      # variables.
      COMMON_SAN_OPTIONS="abort_on_error=1:disable_coredump=0"
      if [[ "" =~ ASan ]]; then
        export ASAN_OPTIONS="$COMMON_SAN_OPTIONS:unmap_shadow_on_exit=1"
        asan_lib=$(clang -print-file-name=libclang_rt.asan.so)
        [ -f "$asan_lib" ] || { echo "ERROR: libclang_rt.asan.so not found by clang"; exit 1; }
        export LD_LIBRARY_PATH="$LD_LIBRARY_PATH:$(dirname "$asan_lib")"
        export TESTUTIL_BYPASS_ASAN=1
      elif [[ "" =~ MSan ]]; then
        export MSAN_OPTIONS="$COMMON_SAN_OPTIONS:verbosity=3"
        export TESTUTIL_MSAN=1
      elif [[ "" =~ TSan ]]; then
        export TSAN_OPTIONS="$COMMON_SAN_OPTIONS:verbosity=3"
        export TESTUTIL_TSAN=1
      elif [[ "" =~ UBSan ]]; then
        export UBSAN_OPTIONS="$COMMON_SAN_OPTIONS:print_stacktrace=1"
        export TESTUTIL_UBSAN=1
      fi
      if [[ 1 -eq 1 ]]; then
        # The preloaded library should be downloaded/built during "configure wiredtiger" step.
        # DO NOT MOVE:This variable must be set in the same function(shell) that runs a test,
        # and as close as possible to the test execution, since it affects all the binaries.
        export LD_PRELOAD=$WT_TOPDIR/TCMALLOC_LIB/libtcmalloc.so
        if [ ! -f "$LD_PRELOAD" ]; then
          echo "Error: TCMalloc support was requested, but the library doesn't exist: $LD_PRELOAD"
          exit 1
        fi
      fi
      # Set extensions to load
      EXT="extensions=["
      EXT="$EXT ext/compressors/snappy/libwiredtiger_snappy.so,"
      EXT="$EXT ext/collators/reverse/libwiredtiger_reverse_collator.so,"
      EXT="$EXT ext/encryptors/rotn/libwiredtiger_rotn.so,"
      EXT="$EXT ext/page_log/palite/libwiredtiger_palite.so,"
      EXT="$EXT ]"
      export EXT
      Dump Environment
       eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot "$@"
      BASH_FUNC_which%%=() {  ( alias;
      CI=true
      EVR_AGENT_PID=3462
      EVR_TASK_ID=wiredtiger_disagg_amazon2023_disagg_stress_format_stress_test_disagg_multi_delete_enabled_1_7bf299ab3e0e141003b45ac0ae095019357fe8d3_26_07_15_08_51_07
      EXT=extensions=[ ext/compressors/snappy/libwiredtiger_snappy.so, ext/collators/reverse/libwiredtiger_reverse_collator.so, ext/encryptors/rotn/libwiredtiger_rotn.so, ext/page_log/palite/libwiredtiger_palite.so, ]
      GOCACHE=/data/mci/1c2dfa07644ab4b0ac4f381dfbb884b3/wiredtiger/cmake_build/test/format/.gocache
      GOTRACEBACK=none
      HISTCONTROL=ignoredups
      HISTSIZE=1000
      HOME=/home/ec2-user
      HOSTNAME=ip-10-122-36-60.ec2.internal
      INVOCATION_ID=21b060302fcd47d1baa3e9df7985a4ad
      JASPER_ID=98672768-5ecf-4ab6-9cdd-01c288d5de16
      JASPER_MANAGER=de102de3-29fa-4e14-8f00-c91f0e0c8442
      JOURNAL_STREAM=8:963
      LANG=C.UTF-8
      LC_ALL=C
      LD_LIBRARY_PATH=/data/mci/1c2dfa07644ab4b0ac4f381dfbb884b3/wiredtiger/cmake_build
      LD_PRELOAD=/data/mci/1c2dfa07644ab4b0ac4f381dfbb884b3/wiredtiger/TCMALLOC_LIB/libtcmalloc.so
      LESSOPEN=||/usr/bin/lesspipe.sh %s
      LOGNAME=ec2-user
      MAIL=/var/spool/mail/ec2-user
      PATH=/opt/mongodbtoolchain/v5/bin:/usr/sbin:/usr/sbin:/usr/sbin:/home/ec2-user/.local/bin:/home/ec2-user/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/opt/node/bin:/opt/node/bin:/opt/node/bin
      PWD=/data/mci/1c2dfa07644ab4b0ac4f381dfbb884b3/wiredtiger/cmake_build/test/format
      SHELL=/bin/bash
      SHLVL=1
      SYSTEMD_COLORS=false
      SYSTEMD_EXEC_PID=3375
      S_COLORS=auto
      TEMP=/data/mci/1c2dfa07644ab4b0ac4f381dfbb884b3/tmp
      TMP=/data/mci/1c2dfa07644ab4b0ac4f381dfbb884b3/tmp
      TMPDIR=/data/mci/1c2dfa07644ab4b0ac4f381dfbb884b3/tmp
      USER=ec2-user
      WT_BUILDDIR=/data/mci/1c2dfa07644ab4b0ac4f381dfbb884b3/wiredtiger/cmake_build
      WT_TOPDIR=/data/mci/1c2dfa07644ab4b0ac4f381dfbb884b3/wiredtiger
      _=/usr/bin/printenv
      which_declare=declare -f
      }
      echo "Dump Environment"
      printenv | sort
      # Fail, show the configuration file.
      fail() {
        echo "======= FAILURE =========="
        [ -f RUNDIR/CONFIG ] && cat RUNDIR/CONFIG
        exit 1
      }
      for i in $(seq 5); do
        echo Iteration $i/5
        rm -rf RUNDIR
        ./t -c ../../../test/format/CONFIG.disagg disagg.multi=1 runs.predictable_replay=1 runs.ops=500000:2000000  || fail
      Iteration 1/5
      ===> Output will be written to RUNDIR/leader.out
           (If you want to watch live, run: tail -f RUNDIR/leader.out)
      ===> Output will be written to RUNDIR/follower/follower.out
           (If you want to watch live, run: tail -f RUNDIR/follower/follower.out)
      Iteration 2/5
      ===> Output will be written to RUNDIR/leader.out
           (If you want to watch live, run: tail -f RUNDIR/leader.out)
      ===> Output will be written to RUNDIR/follower/follower.out
           (If you want to watch live, run: tail -f RUNDIR/follower/follower.out)
      ======= FAILURE ==========
      ############################################
      #  RUN PARAMETERS: V3
      ############################################
      assert.read_timestamp=0
      background_compact=0
      background_compact.free_space_target=47
      backup=0
      backup.incremental=off
      backup.incr_granularity=1993
      backup.live_restore=0
      backup.live_restore_read_size=512
      backup.live_restore_threads=12
      block_cache=0
      block_cache.cache_on_checkpoint=1
      block_cache.cache_on_writes=1
      block_cache.size=42
      btree.reverse=0
      cache=3072
      cache.evict_max=5
      cache.eviction_dirty_target=0
      cache.eviction_dirty_trigger=0
      cache.eviction_updates_target=0
      cache.eviction_updates_trigger=0
      cache.minimum=0
      cache.maximum=0
      checkpoint=on
      checkpoint.log_size=57
      checkpoint.wait=6
      checkpoint_threads=4
      compact.free_space_target=52
      debug.background_compact=0
      debug.checkpoint_retention=3
      debug.cursor_reposition=0
      debug.disagg_slow_truncate_follower=0
      debug.eviction=0
      debug.log_retention=7
      debug.realloc_exact=0
      debug.realloc_malloc=0
      debug.slow_checkpoint=0
      debug.slow_truncate=0
      debug.table_logging=0
      debug.update_restore_evict=0
      disagg.internal_page_delta=1
      disagg.leaf_page_delta=1
      disagg.multi=1
      disagg.multi_validation=0
      disagg.enabled=1
      disagg.layered=1
      disagg.mode=leader
      disagg.page_log=palite
      disagg.key_provider=2
      disagg.page_log.verbose=0
      disagg.drain_threads=8
      disagg.preserve=0
      disagg.stepdown_async=0
      disk.data_extend=0
      disk.encryption=rotn-7
      disk.mmap=1
      disk.mmap_all=0
      eviction.evict_use_softptr=1
      file_manager.close_handle_minimum=21
      file_manager.close_idle_time=11
      file_manager.close_scan_interval=20
      format.abort=0
      format.independent_thread_rng=1
      format.major_timeout=0
      import=0
      logging=0
      logging.compression=none
      logging.file_max=443873
      logging.prealloc=0
      logging.remove=0
      obsolete_cleanup.method=off
      obsolete_cleanup.wait=2
      ops.alter=0
      ops.compaction=0
      ops.hs_cursor=1
      ops.bound_cursor=0
      ops.prepare=0
      ops.reserve=16
      ops.random_cursor=0
      ops.salvage=0
      ops.throttle=0
      ops.throttle.sleep_us=771409
      ops.verify=1
      prefetch=0
      prefetch.default=0
      precise_checkpoint=1
      preserve_prepared=0
      quiet=1
      random.data_seed=9148995
      random.extra_seed=8025069
      rollback_to_stable_threads=1
      runs.in_memory=0
      runs.ops=800000
      runs.predictable_replay=1
      runs.source=layered
      runs.tables=3
      runs.threads=2
      runs.timer=360
      runs.type=row-store
      runs.verify_failure_dump=0
      statistics.mo
      

      logs

      format-stress-test-disagg-multi-delete-enabled-1 task_log

      Logs:

      #0  0x0000ffff998c4454 in __pthread_kill_implementation () from /lib64/libc.so.6
      #0  0x0000ffff998c4454 in __pthread_kill_implementation () from /lib64/libc.so.6
      #1  0x0000ffff9987b320 [PAC] in raise () from /lib64/libc.so.6
      #2  0x0000ffff99862224 [PAC] in abort () from /lib64/libc.so.6
      #3  0x0000ffff99c5b50c [PAC] in __wt_abort (session=session@entry=0x0) at /data/mci/74d4b222a8787aec6b6ecba636b74889/wiredtiger/src/os_common/os_abort.c:32
      #4  0x0000000000427a04 in testutil_die (e=22, fmt=fmt@entry=0x429880 "%s/%d: %s") at /data/mci/74d4b222a8787aec6b6ecba636b74889/wiredtiger/test/utility/misc.c:75
      #5  0x000000000040ee9c in timestamp_once (session=session@entry=0x50d5bfc979e0, allow_lag=allow_lag@entry=false, final=final@entry=false) at /data/mci/74d4b222a8787aec6b6ecba636b74889/wiredtiger/test/format/format_timestamp.c:177
      #6  0x00000000004051f4 in bulk_commit_transaction (session=0x50d5bfc979e0) at /data/mci/74d4b222a8787aec6b6ecba636b74889/wiredtiger/test/format/bulk.c:60
      #7  0x0000000000405910 in table_load (base=0x0, table=0x50d5bfc16000) at /data/mci/74d4b222a8787aec6b6ecba636b74889/wiredtiger/test/format/bulk.c:212
      #8  0x0000000000405b50 in wts_load () at /data/mci/74d4b222a8787aec6b6ecba636b74889/wiredtiger/test/format/bulk.c:272
      #9  0x000000000041d518 in main (argc=<optimized out>, argv=<optimized out>) at /data/mci/74d4b222a8787aec6b6ecba636b74889/wiredtiger/test/format/t.c:378
      

      logs

      format-stress-test-disagg-multi-delete-enabled-1 task_log

      Logs:

      Finished command 'shell.exec' in function 'dump stacktraces' (step 1 of 9) in block 'post' in 4.211988761s.
      Running command 's3.put' in function 'upload stacktraces' (step 2 of 9) in block 'post'.
      Putting files matching filter '[wiredtiger/cmake_build/*stacktrace.txt]' into path 'wiredtiger/amazon2023-disagg-stress/7bf299ab3e0e141003b45ac0ae095019357fe8d3/artifacts/format-stress-test-disagg-multi-delete-enabled-1_wiredtiger_disagg_amazon2023_disagg_stress_7bf299ab3e0e141003b45ac0ae095019357fe8d3_26_07_15_08_51_07/' in S3 bucket 'build_external'.
      Performing S3 put to file 'wiredtiger/amazon2023-disagg-stress/7bf299ab3e0e141003b45ac0ae095019357fe8d3/artifacts/format-stress-test-disagg-multi-delete-enabled-1_wiredtiger_disagg_amazon2023_disagg_stress_7bf299ab3e0e141003b45ac0ae095019357fe8d3_26_07_15_08_51_07/' in bucket 'build_external' (attempt 1 of 5).
      Finished command 's3.put' in function 'upload stacktraces' (step 2 of 9) in block 'post' in 158.421913ms.
      Running command 's3.put' in function 'upload test/format config' (step 3 of 9) in block 'post'.
      Putting files matching filter '[wiredtiger/cmake_build/test/format/RUNDIR*/CONFIG]' into path 'wiredtiger/amazon2023-disagg-stress/7bf299ab3e0e141003b45ac0ae095019357fe8d3/artifacts/format-stress-test-disagg-multi-delete-enabled-1_wiredtiger_disagg_amazon2023_disagg_stress_7bf299ab3e0e141003b45ac0ae095019357fe8d3_26_07_15_08_51_07/' in S3 bucket 'build_external'.
      Performing S3 put to file 'wiredtiger/amazon2023-disagg-stress/7bf299ab3e0e141003b45ac0ae095019357fe8d3/artifacts/format-stress-test-disagg-multi-delete-enabled-1_wiredtiger_disagg_amazon2023_disagg_stress_7bf299ab3e0e141003b45ac0ae095019357fe8d3_26_07_15_08_51_07/' in bucket 'build_external' (attempt 1 of 5).
      Finished command 's3.put' in function 'upload test/format config' (step 3 of 9) in block 'post' in 135.080308ms.
      Running command 's3.put' in function 'upload test/model workloads' (step 4 of 9) in block 'post'.
      Putting files matching filter '[wiredtiger/cmake_build/test/model/tools/WT_TEST*/*.workload]' into path 'wiredtiger/amazon2023-disagg-stress/7bf299ab3e0e141003b45ac0ae095019357fe8d3/artifacts/format-stress-test-disagg-multi-delete-enabled-1_wiredtiger_disagg_amazon2023_disagg_stress_7bf299ab3e0e141003b45ac0ae095019357fe8d3_26_07_15_08_51_07/' in S3 bucket 'build_external'.
      Performing S3 put to file 'wiredtiger/amazon2023-disagg-stress/7bf299ab3e0e141003b45ac0ae095019357fe8d3/artifacts/format-stress-test-disagg-multi-delete-enabled-1_wiredtiger_disagg_amazon2023_disagg_stress_7bf299ab3e0e141003b45ac0ae095019357fe8d3_26_07_15_08_51_07/' in bucket 'build_external' (attempt 1 of 5).
      File filter 'wiredtiger/cmake_build/test/model/tools/WT_TEST*/*.workload' matched no files.
      Finished command 's3.put' in function 'upload test/model workloads' (step 4 of 9) in block 'post' in 39.366082ms.
      Running command 'shell.exec' in function 'dump stderr/stdout' (step 5 of 9) in block 'post'.
      if [ -d "WT_TEST" ]; then
        # Dump stderr/stdout contents generated by the C libraries onto console for Python tests
        find "WT_TEST" -name "std*.txt" ! -empty -exec bash -c "echo 'Contents from {}:'; cat '{}'" \;
      fi
      Finished command 'shell.exec' in function 'dump stderr/stdout' (step 5 of 9) in block 'post' in 1.318204ms.
      Running command 'shell.exec' in function 'upload stat files' (step 6.1 of 9) in block 'post'.
      mkdir stat_files
      python3 ../test/evergreen/collect_stat_files.py -d stat_files
      Finished command 'shell.exec' in function 'upload stat files' (step 6.1 of 9) in block 'post' in 38.378168ms.
      Running command 'archive.targz_pack' in function 'upload stat files' (step 6.2 of 9) in block 'post'.
      Beginning to build archive.
      [message='successfully created archive' num_files='5' target='/data/mci/1c2dfa07644ab4b0ac4f381dfbb884b3/wiredtiger/cmake_build/stat_files.tar.gz']
      Finished command 'archive.targz_pack' in function 'upload stat files' (step 6.2 of 9) in block 'post' in 15.903515ms.
      Running command 's3.put' in function 'upload stat files' (step 6.3 of 9) in block 'post'.
      Putting local file 'wiredtiger/cmake_build/stat_files.tar.gz' into path 'build_external/wiredtiger/amazon2023-disagg-stress/7bf299ab3e0e141003b45ac0ae095019357fe8d3/artifacts/format-stress-test-disagg-multi-delete-enabled-1_wiredtiger_disagg_amazon2023_disagg_stress_7bf299ab3e0e141003b45ac0ae095019357fe8d3_26_07_15_08_51_07/stat_files.tar.gz' (https://build_external.s3.amazonaws.com/wiredtiger/amazon2023-disagg-stress/7bf299ab3e0e141003b45ac0ae095019357fe8d3/artifacts/format-stress-test-disagg-multi-delete-enabled-1_wiredtiger_disagg_amazon2023_disagg_stress_7bf299ab3e0e141003b45ac0ae095019357fe8d3_26_07_15_08_51_07/stat_files.tar.gz).
      Performing S3 put to file 'wiredtiger/amazon2023-disagg-stress/7bf299ab3e0e141003b45ac0ae095019357fe8d3/artifacts/format-stress-test-disagg-multi-delete-enabled-1_wiredtiger_disagg_amazon2023_disagg_stress_7bf299ab3e0e141003b45ac0ae095019357fe8d3_26_07_15_08_51_07/stat_files.tar.gz' in bucket 'build_external' (attempt 1 of 5).
      Finished command 's3.put' in function 'upload stat files' (step 6.3 of 9) in block 'post' in 351.874282ms.
      Running command 'archive.targz_pack' in function 'upload artifact' (step 7.1 of 9) in block 'post'.
      Beginning to build archive.
      [message='successfully created archive' num_files='7074' target='/data/mci/1c2dfa07644ab4b0ac4f381dfbb884b3/wiredtiger.tgz']
      Finished command 'archive.targz_pack' in function 'upload artifact' (step 7.1 of 9) in block 'post' in 1.126089775s.
      Running command 's3.put' in function 'upload artifact' (step 7.2 of 9) in block 'post'.
      Putting local file 'wiredtiger.tgz' into path 'build_external/wiredtiger/amazon2023-disagg-stress/7bf299ab3e0e141003b45ac0ae095019357fe8d3/artifacts/format-stress-test-disagg-multi-delete-enabled-1_wiredtiger_disagg_amazon2023_disagg_stress_7bf299ab3e0e141003b45ac0ae095019357fe8d3_26_07_15_08_51_07-0.tgz' (https://build_external.s3.amazonaws.com/wiredtiger/amazon2023-disagg-stress/7bf299ab3e0e141003b45ac0ae095019357fe8d3/artifacts/format-stress-test-disagg-multi-delete-enabled-1_wiredtiger_disagg_amazon2023_disagg_stress_7bf299ab3e0e141003b45ac0ae095019357fe8d3_26_07_15_08_51_07-0.tgz).
      Performing S3 put to file 'wiredtiger/amazon2023-disagg-stress/7bf299ab3e0e141003b45ac0ae095019357fe8d3/artifacts/format-stress-test-disagg-multi-delete-enabled-1_wiredtiger_disagg_amazon2023_disagg_stress_7bf299ab3e0e141003b45ac0ae095019357fe8d3_26_07_15_08_51_07-0.tgz' in bucket 'build_external' (attempt 1 of 5).
      Finished command 's3.put' in function 'upload artifact' (step 7.2 of 9) in block 'post' in 1.21733418s.
      Running command 'archive.targz_pack' in function 'save wt hang analyzer core/debugger files' (step 8.1 of 9) in block 'post'.
      Beginning to build archive.
      No files were archived.
      Finished command 'archive.targz_pack' in function 'save wt hang analyzer core/debugger files' (step 8.1 of 9) in block 'post' in 333.979µs.
      Running command 's3.put' in function 'save wt hang analyzer core/debugger files' (step 8.2 of 9) in block 'post'.
      Putting local file 'wt-hang-analyzer.tgz' into path 'build_external/wiredtiger/amazon2023-disagg-stress/7bf299ab3e0e141003b45ac0ae095019357fe8d3/wt_hang_analyzer/wt-hang-analyzer_format-stress-test-disagg-multi-delete-enabled-1_wiredtiger_disagg_amazon2023_disagg_stress_7bf299ab3e0e141003b45ac0ae095019357fe8d3_26_07_15_08_51_07.tgz' (https://build_external.s3.amazonaws.com/wiredtiger/amazon2023-disagg-stress/7bf299ab3e0e141003b45ac0ae095019357fe8d3/wt_hang_analyzer/wt-hang-analyzer_format-stress-test-disagg-multi-delete-enabled-1_wiredtiger_disagg_amazon2023_disagg_stress_7bf299ab3e0e141003b45ac0ae095019357fe8d3_26_07_15_08_51_07.tgz).
      Performing S3 put to file 'wiredtiger/amazon2023-disagg-stress/7bf299ab3e0e141003b45ac0ae095019357fe8d3/wt_hang_analyzer/wt-hang-analyzer_format-stress-test-disagg-multi-delete-enabled-1_wiredtiger_disagg_amazon2023_disagg_stress_7bf299ab3e0e141003b45ac0ae095019357fe8d3_26_07_15_08_51_07.tgz' in bucket 'build_external' (attempt 1 of 5).
      File '/data/mci/1c2dfa07644ab4b0ac4f381dfbb884b3/wt-hang-analyzer.tgz' not found and skip missing is true, exiting without error.
      Finished command 's3.put' in function 'save wt hang analyzer core/debugger files' (step 8.2 of 9) in block 'post' in 20.127685ms.
      Running command 'shell.exec' in function 'cleanup' (step 9 of 9) in block 'post'.
      Finished command 'shell.exec' in function 'cleanup' (step 9 of 9) in block 'post' in 329.694806ms.
      Finished running post-task commands in 7.647256309s.
      reading test log spec; falling back to default spec: open /data/mci/1c2dfa07644ab4b0ac4f381dfbb884b3/build/TestLogs/log_spec.yaml: no such file or directory
      

      logs

            Assignee:
            Krishen Chovhan
            Reporter:
            xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: