failed: schema-disagg-abort-smoke-test-disagg-1 on amazon2023-disagg-stress [wiredtiger-disagg @ f85479d5]

XMLWordPrintableJSON

      schema-disagg-abort-smoke-test-disagg-1 on amazon2023-disagg-stress

      Host: i-064c4c8c914dab8cc
      Project: wiredtiger-disagg
      Commit: f85479d5
      Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

      Task Logs:

      schema-disagg-abort-smoke-test-disagg-1 task_log

      Logs:

      Task logger initialized (agent version '2026-07-22' from Evergreen build revision 'df31613557cd78fda1a8b957c69085c8f2b79f47').
      Starting task 'wiredtiger_disagg_amazon2023_disagg_stress_schema_disagg_abort_smoke_test_disagg_1_f85479d5032388082a3142d717f631fd7deb39bd_26_07_30_10_58_38', execution 0.
      Running pre-task commands.
      Running command 'shell.exec' in function 'cleanup' (step 1 of 3) in block 'pre'.
      Finished command 'shell.exec' in function 'cleanup' (step 1 of 3) in block 'pre' in 2.525507ms.
      Running command 'expansions.update' in function 'setup environment' (step 2 of 3) in block 'pre'.
      Finished command 'expansions.update' in function 'setup environment' (step 2 of 3) in block 'pre' in 38.074µs.
      Running command 'shell.exec' in function 'pin mongo toolchain' (step 3 of 3) in block 'pre'.
      mongodbtoolchain 93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542 not installed, downloading...
      Autodetected Amazon Linux 2023 (OS_ID: amazon2023) on aarch64
      Autodetected DOWNLOAD_URL: https://mongodbtoolchain.build.10gen.cc/toolchain/amazon2023-arm64/x86_64/latest
      Overriding REVISION_ID, will download toolchain for 93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542
      Ensuring /opt/mongodbtoolchain/revisions exists and has correct ownership...
      Downloading toolchain to /data/mci/eb22b353c403eefd4d9d4659c3c167d6/tmp/tmp.QCnjpKasGU/mongodbtoolchain.tar.gz from https://mongodbtoolchain.build.10gen.cc/toolchain/amazon2023-arm64/x86_64/mongodbtoolchain-93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542.tar.gz
      Getting toolchain revision from archive...
      Checking downloaded archive integrity...
      Extracting toolchain revision 93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542 from archive...
      Running post install script...
      Existing v2 found, uninstalling...
      Existing v3 found, uninstalling...
      Existing v4 found, uninstalling...
      Existing v5 found, uninstalling...
      Installing v2...
      Installing v3...
      Installing v4...
      Installing v5...
      Cleaning up...
      Finished command 'shell.exec' in function 'pin mongo toolchain' (step 3 of 3) in block 'pre' in 3m3.675913296s.
      Finished running pre-task commands in 3m3.678762603s.
      Running task commands.
      Running command 's3.get' in function 'fetch artifacts' (step 1 of 2).
      Fetching remote file 'wiredtiger/amazon2023-disagg-stress/f85479d5032388082a3142d717f631fd7deb39bd/artifacts/compile_wiredtiger_disagg_amazon2023_disagg_stress_f85479d5032388082a3142d717f631fd7deb39bd_26_07_30_10_58_38.tgz' from S3 bucket 'build_external' (attempt 1 of 5).
      Finished command 's3.get' in function 'fetch artifacts' (step 1 of 2) in 5.497294349s.
      Running command 'shell.exec' (step 2 of 2).
      export WT_TOPDIR=$(git rev-parse --show-toplevel)
      export WT_BUILDDIR=$WT_TOPDIR/cmake_build
      if [ "$OS" = "Windows_NT" ]; then
        export PATH=/cygdrive/c/python/Python311:/cygdrive/c/python/Python311/Scripts:$PATH
      else
        export PATH=/opt/mongodbtoolchain/v5/bin:$PATH
        export LD_LIBRARY_PATH=$WT_BUILDDIR
      fi
      # Create the common sanitizer options and export the specific sanitizer environment
      # variables.
      COMMON_SAN_OPTIONS="abort_on_error=1:disable_coredump=0"
      if [[ "" =~ ASan ]]; then
        export ASAN_OPTIONS="$COMMON_SAN_OPTIONS:unmap_shadow_on_exit=1"
        asan_lib=$(clang -print-file-name=libclang_rt.asan.so)
        [ -f "$asan_lib" ] || { echo "ERROR: libclang_rt.asan.so not found by clang"; exit 1; }
        export LD_LIBRARY_PATH="$LD_LIBRARY_PATH:$(dirname "$asan_lib")"
        export TESTUTIL_BYPASS_ASAN=1
      elif [[ "" =~ MSan ]]; then
        export MSAN_OPTIONS="$COMMON_SAN_OPTIONS:verbosity=3"
        export TESTUTIL_MSAN=1
      elif [[ "" =~ TSan ]]; then
        export TSAN_OPTIONS="$COMMON_SAN_OPTIONS:verbosity=3"
        export TESTUTIL_TSAN=1
      elif [[ "" =~ UBSan ]]; then
        export UBSAN_OPTIONS="$COMMON_SAN_OPTIONS:print_stacktrace=1"
        export TESTUTIL_UBSAN=1
      fi
      if [[ 1 -eq 1 ]]; then
        # The preloaded library should be downloaded/built during "configure wiredtiger" step.
        # DO NOT MOVE:This variable must be set in the same function(shell) that runs a test,
        # and as close as possible to the test execution, since it affects all the binaries.
        export LD_PRELOAD=$WT_TOPDIR/TCMALLOC_LIB/libtcmalloc.so
        if [ ! -f "$LD_PRELOAD" ]; then
          echo "Error: TCMalloc support was requested, but the library doesn't exist: $LD_PRELOAD"
          exit 1
        fi
      fi
      # Set extensions to load
      EXT="extensions=["
      EXT="$EXT ext/compressors/snappy/libwiredtiger_snappy.so,"
      EXT="$EXT ext/collators/reverse/libwiredtiger_reverse_collator.so,"
      EXT="$EXT ext/encryptors/rotn/libwiredtiger_rotn.so,"
      EXT="$EXT ext/page_log/palite/libwiredtiger_palite.so,"
      EXT="$EXT ]"
      export EXT
      Dump Environment
       eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot "$@"
      BASH_FUNC_which%%=() {  ( alias;
      CI=true
      EVR_AGENT_PID=3607
      EVR_TASK_ID=wiredtiger_disagg_amazon2023_disagg_stress_schema_disagg_abort_smoke_test_disagg_1_f85479d5032388082a3142d717f631fd7deb39bd_26_07_30_10_58_38
      EXT=extensions=[ ext/compressors/snappy/libwiredtiger_snappy.so, ext/collators/reverse/libwiredtiger_reverse_collator.so, ext/encryptors/rotn/libwiredtiger_rotn.so, ext/page_log/palite/libwiredtiger_palite.so, ]
      GOCACHE=/data/mci/eb22b353c403eefd4d9d4659c3c167d6/wiredtiger/cmake_build/test/csuite/schema_disagg_abort/.gocache
      GOTRACEBACK=none
      HISTCONTROL=ignoredups
      HISTSIZE=1000
      HOME=/home/ec2-user
      HOSTNAME=ip-10-128-67-52.ec2.internal
      INVOCATION_ID=8dafb2cbb51d4fc0a8d2951c83892a3f
      JASPER_ID=9757fe77-ba90-4000-920c-ac972c53a121
      JASPER_MANAGER=e1ce3fd9-80d4-4373-9979-a2f8b61729c1
      JOURNAL_STREAM=8:22950
      LANG=C.UTF-8
      LC_ALL=C
      LD_LIBRARY_PATH=/data/mci/eb22b353c403eefd4d9d4659c3c167d6/wiredtiger/cmake_build
      LD_PRELOAD=/data/mci/eb22b353c403eefd4d9d4659c3c167d6/wiredtiger/TCMALLOC_LIB/libtcmalloc.so
      LESSOPEN=||/usr/bin/lesspipe.sh %s
      LOGNAME=ec2-user
      MAIL=/var/spool/mail/ec2-user
      PATH=/opt/mongodbtoolchain/v5/bin:/usr/sbin:/usr/sbin:/usr/sbin:/home/ec2-user/.local/bin:/home/ec2-user/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/opt/node/bin:/opt/node/bin:/opt/node/bin
      PWD=/data/mci/eb22b353c403eefd4d9d4659c3c167d6/wiredtiger/cmake_build/test/csuite/schema_disagg_abort
      SHELL=/bin/bash
      SHLVL=1
      SYSTEMD_COLORS=false
      SYSTEMD_EXEC_PID=3381
      S_COLORS=auto
      TEMP=/data/mci/eb22b353c403eefd4d9d4659c3c167d6/tmp
      TMP=/data/mci/eb22b353c403eefd4d9d4659c3c167d6/tmp
      TMPDIR=/data/mci/eb22b353c403eefd4d9d4659c3c167d6/tmp
      USER=ec2-user
      WT_BUILDDIR=/data/mci/eb22b353c403eefd4d9d4659c3c167d6/wiredtiger/cmake_build
      WT_TOPDIR=/data/mci/eb22b353c403eefd4d9d4659c3c167d6/wiredtiger
      _=/usr/bin/printenv
      which_declare=declare -f
      }
      echo "Dump Environment"
      printenv | sort
      # The full mode matrix in short runs: single node, lone follower, role switches,
      # kills, and both two-node topologies. The two-node switch modes at the end are
      # EXPECTED to fail until FIXME-WT-18068 and FIXME-WT-17746 land.
      Running test command: ./test_schema_disagg_abort -b /data/mci/eb22b353c403eefd4d9d4659c3c167d6/wiredtiger/cmake_build -r l -t 10 -T 2 -h WT_TEST.schema_disagg_abort.l
      Parent: roles l; 2 schema threads; pool 32 slots; switch every 0s; kill leader@0 follower@0 lone@0; stop at 10s
      CONFIG: test_schema_disagg_abort -r l -u 32 -T 2 -t 10 -PSD712551,E15711114
      Running test command: /data/mci/eb22b353c403eefd4d9d4659c3c167d6/wiredtiger/cmake_build/test/csuite/schema_disagg_abort/test_schema_disagg_abort -r node -i 0 -A l -h WT_TEST.schema_disagg_abort.l -b /data/mci/eb22b353c403eefd4d9d4659c3c167d6/wiredtiger/cmake_build -T 2 -u 32 -PSD712551,E15711114
      Node 0: starting as leader
      Node 0: checkpoint 1 complete
      Node 0: checkpoint 2 complete
      Node 0: checkpoint 3 complete
      Node 0: checkpoint 4 complete
      Node 0: checkpoint 5 complete
      Node 0: checkpoint 6 complete
      Node 0: checkpoint 7 complete
      Node 0: checkpoint 8 complete
      Node 0: checkpoint 9 complete
      Parent: directing graceful stop
      Node 0: checkpoint 10 complete
      Node 0: stopped gracefully as leader
      Parent: Open node0 database, run recovery and verify content
      [1785415094:036627][13561:0xffff8bca3040], wiredtiger_open: [WT_VERB_METADATA][WARNING]: Removing local file due to disagg mode: WiredTiger
      [1785415094:036678][13561:0xffff8bca3040], wiredtiger_open: [WT_VERB_METADATA][WARNING]: Removing local file due to disagg mode: WiredTiger.basecfg
      [1785415094:036692][13561:0xffff8bca3040], wiredtiger_open: [WT_VERB_METADATA][WARNING]: Removing local file due to disagg mode: WiredTiger.wt
      [1785415094:036726][13561:0xffff8bca3040], wiredtiger_open: [WT_VERB_METADATA][WARNING]: Removing local file due to disagg mode: WiredTiger.turtle
      [1785415094:036739][13561:0xffff8bca3040], wiredtiger_open: [WT_VERB_METADATA][WARNING]: Removing local file due to disagg mode: WiredTigerHS.wt
      [1785415094:036749][13561:0xffff8bca3040], wiredtiger_open: [WT_VERB_METADATA][WARNING]: Removing local file due to disagg mode: schema_0_1_5.wt_ingest
      [1785415094:036760][13561:0xffff8bca3040], wiredtiger_open: [WT_VERB_METADATA][WARNING]: Removing local file due to disagg mode: schema_0_1_12.wt_ingest
      [1785415094:036769][13561:0xffff8bca3040], wiredtiger_open: [WT_VERB_METADATA][WARNING]: Removing local file due to disagg mode: schema_0_0_17.wt_ingest
      [1785415094:036778][13561:0xffff8bca3040], wiredtiger_open: [WT_VERB_METADATA][WARNING]: Removing local file due to disagg mode: schema_0_1_10.wt_ingest
      [1785415094:036787][13561:0xffff8bca3040], wiredtiger_open: [WT_VERB_METADATA][WARNING]: Removing local file due to disagg mode: schema_0_0_29.wt_ingest
      [1785415094:036797][13561:0xffff8bca3040], wiredtiger_open: [WT_VERB_METADATA][WARNING]: Removing local file due to disagg mode: schema_0_1_18.wt_ingest
      [1785415094:036806][13561:0xffff8bca3040], wiredtiger_open: [WT_VERB_METADATA][WARNING]: Removing local file due to disagg mode: schema_0_0_30.wt_ingest
      [1785415094:036815][13561:0xffff8bca3040], wiredtiger_open: [WT_VERB_METADATA][WARNING]: Removing local file due to disagg mode: schema_0_1_31.wt_ingest
      [1785415094:036824][13561:0xffff8bca3040], wiredtiger_open: [WT_VERB_METADATA][WARNING]: Removing local file due to disagg mode: schema_0_0_12.wt_ingest
      [1785415094:036834][13561:0xffff8bca3
      

      logs

      schema-disagg-abort-smoke-test-disagg-1 task_log

      Logs:

      [1785415352:691429][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_DEFAULT][ERROR]: __block_disagg_read_multiple, 176: WiredTiger assertion failed: '*results_count > 0'. Expression returned false
      [1785415352:691456][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_DEFAULT][ERROR]: __wt_abort, 29: aborting WiredTiger library
      [1785415352:691462][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curstat_next, 216: Error at src/cursor/cur_stat.c:216: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
      [1785415352:691467][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_turtle_read, 653: Error at src/meta/meta_turtle.c:653: "WT_NOTFOUND" failed: WT_NOTFOUND: item not found
      [1785415352:691470][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691472][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_metadata_search, 341: Error at src/meta/meta_table.c:341: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691474][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691476][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_metadata_search, 341: Error at src/meta/meta_table.c:341: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691478][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691480][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_metadata_search, 341: Error at src/meta/meta_table.c:341: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691481][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691483][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_metadata_search, 341: Error at src/meta/meta_table.c:341: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691485][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691487][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_metadata_search, 341: Error at src/meta/meta_table.c:341: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691488][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691490][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_metadata_search, 341: Error at src/meta/meta_table.c:341: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691492][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691493][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_metadata_search, 341: Error at src/meta/meta_table.c:341: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691495][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691497][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_metadata_search, 341: Error at src/meta/meta_table.c:341: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691499][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691500][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_metadata_search, 341: Error at src/meta/meta_table.c:341: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691503][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691505][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_metadata_search, 341: Error at src/meta/meta_table.c:341: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691507][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691508][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_metadata_search, 341: Error at src/meta/meta_table.c:341: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691510][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691512][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_metadata_search, 341: Error at src/meta/meta_table.c:341: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691514][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691515][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_metadata_search, 341: Error at src/meta/meta_table.c:341: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691517][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691519][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_metadata_search, 341: Error at src/meta/meta_table.c:341: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691520][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691522][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_metadata_search, 341: Error at src/meta/meta_table.c:341: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691524][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691526][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_metadata_search, 341: Error at src/meta/meta_table.c:341: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691527][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691529][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_metadata_search, 341: Error at src/meta/meta_table.c:341: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691531][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691533][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_metadata_search, 341: Error at src/meta/meta_table.c:341: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691535][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691537][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_metadata_search, 341: Error at src/meta/meta_table.c:341: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691538][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691540][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __wt_metadata_search, 341: Error at src/meta/meta_table.c:341: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691542][14476:0xffffb4abe040], file:schema_1_1_3.wt_stable, disagg-step-up: [WT_VERB_ERROR_RETURNS][ERROR]: __curfile_search, 326: Error at src/cursor/cur_file.c:326: "ret" failed: WT_NOTFOUND: item not found
      [1785415352:691544
      

      logs

      schema-disagg-abort-smoke-test-disagg-1 task_log

      Logs:

      test_schema_disagg_abort: FAILED: node0 terminated unexpectedly: signal 6: Invalid argument
      test_schema_disagg_abort: process aborting
      WiredTiger Error: __wt_abort, 29: aborting WiredTiger library
      ./smoke.sh: line 64: 14475 Aborted                 (core dumped) $TEST_WRAPPER "$test_bin" -b "$build_dir" -r lf -s 5 -t 20 -T 2 -h WT_TEST.schema_disagg_abort.lfs
      Node 1: now follower
      Node 1: peer died; continuing as a lone follower
      Command 'shell.exec' (step 2 of 2) failed: shell script encountered problem: exit code 134.
      Finished command 'shell.exec' (step 2 of 2) in 4m43.940639145s.
      Running task commands failed: running command: command failed: shell script encountered problem: exit code 134
      Finished running task commands in 4m49.438245062s.
      Task completed - FAILURE.
      Running post-task commands.
      

      logs

            Assignee:
            Jie Chen
            Reporter:
            xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: