failed: format-stress-test-disagg-switch-1 Checkpoint Cleanup issues a writes as a follower

    • Type: Build Failure
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None

      format-stress-test-disagg-switch-1 on ubuntu2004-asan

      Host: i-05ae2fd964329ceff
      Project: wiredtiger
      Commit: 95d04283
      Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

      Task Logs:

      format-stress-test-disagg-switch-1 task_log

      Logs:

      /opt/mongodbtoolchain/revisions/93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542/scripts/products.sh: line 13: /opt/mongodbtoolchain/revisions/93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542/scripts/installer.sh: No such file or directory
      

      logs

      format-stress-test-disagg-switch-1 task_log

      Logs:

      [450/681] Building C object test/csuite/CMakeFiles/test_wt16990_disagg_checkpoint_panic.dir/wt16990_disagg_checkpoint_panic/main.c.o
      [468/681] Linking CXX executable test/csuite/wt16990_disagg_checkpoint_panic/test_wt16990_disagg_checkpoint_panic
      

      logs

      format-stress-test-disagg-switch-1 task_log

      Logs:

          [1784539151:393787][17338:0x7f5a3f11d700], t, file:WiredTigerSharedHS.wt_stable, checkpoint-cleanup: [WT_VERB_DEFAULT][ERROR]: int __wt_page_parent_modify_set(WT_SESSION_IMPL *, WT_REF *, _Bool), 1185: WiredTiger assertion failed: '!((((btree)->flags) & (0x0004000u)) != 0) || ((WT_CONNECTION_IMPL *)((WT_SESSION_IMPL *)(session))->iface.connection)->layered_table_manager.leader'. Expression returned false
          [1784539151:393866][17338:0x7f5a3f11d700], t, file:WiredTigerSharedHS.wt_stable, checkpoint-cleanup: [WT_VERB_DEFAULT][ERROR]: void __wt_abort(WT_SESSION_IMPL *), 29: aborting WiredTiger library
      

      logs

      format-stress-test-disagg-switch-1 task_log

      Logs:

      test/format run configuration highlights
      

      logs

      format-stress-test-disagg-switch-1 task_log

      Logs:

      #0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
      #0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
      #1  0x00007f5a567fd859 in __GI_abort () at abort.c:79
      #2  0x00007f5a57496462 in __wt_abort () from /data/mci/3242f16f91c4e64ccc1e33a3bfb4a74b/wiredtiger/cmake_build/test/format/../../libwiredtiger.so.12.0.0
      #3  0x00007f5a56f2b98d in __wt_page_parent_modify_set () from /data/mci/3242f16f91c4e64ccc1e33a3bfb4a74b/wiredtiger/cmake_build/test/format/../../libwiredtiger.so.12.0.0
      #4  0x00007f5a56f2a7c1 in __sync_obsolete_disk_cleanup () from /data/mci/3242f16f91c4e64ccc1e33a3bfb4a74b/wiredtiger/cmake_build/test/format/../../libwiredtiger.so.12.0.0
      #5  0x00007f5a56f2953c in __sync_obsolete_cleanup_one () from /data/mci/3242f16f91c4e64ccc1e33a3bfb4a74b/wiredtiger/cmake_build/test/format/../../libwiredtiger.so.12.0.0
      #6  0x00007f5a56f1af68 in __checkpoint_cleanup_obsolete_cleanup () from /data/mci/3242f16f91c4e64ccc1e33a3bfb4a74b/wiredtiger/cmake_build/test/format/../../libwiredtiger.so.12.0.0
      #7  0x00007f5a56f150dd in __checkpoint_cleanup_walk_btree () from /data/mci/3242f16f91c4e64ccc1e33a3bfb4a74b/wiredtiger/cmake_build/test/format/../../libwiredtiger.so.12.0.0
      #8  0x00007f5a56f11182 in __checkpoint_cleanup_int () from /data/mci/3242f16f91c4e64ccc1e33a3bfb4a74b/wiredtiger/cmake_build/test/format/../../libwiredtiger.so.12.0.0
      #9  0x00007f5a56f1074d in __checkpoint_cleanup () from /data/mci/3242f16f91c4e64ccc1e33a3bfb4a74b/wiredtiger/cmake_build/test/format/../../libwiredtiger.so.12.0.0
      #10 0x00007f5a57fc4f97 in asan_thread_start(void*) () from /opt/mongodbtoolchain/revisions/93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542/stow/llvm-v5.7Jt/lib/clang/19/lib/x86_64-mongodb-linux/libclang_rt.asan.so
      #11 0x00007f5a569d5609 in start_thread (arg=<optimized out>) at pthread_create.c:477
      #12 0x00007f5a568fa353 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
      

      logs

      Repro Artifacts:

            Assignee:
            [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: