ExportXMLWordPrintableJSON

    • Type: Build Failure
    • Resolution: Gone away
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Logging

      race-condition-stress-asan-test-1 on ubuntu2004-asan

      Host: i-05e8475f692766722
      Project: wiredtiger
      Commit: 11c5d091
      Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

      Task Logs:

      race-condition-stress-asan-test-1 system_log

      Logs:

      CPU constraint detected (sustained >90% for 5+ minutes)
      

      logs

      race-condition-stress-asan-test-1 task_log

      Logs:

          ==17176==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x50c00043d7c0 at pc 0x7f6554e7a3fe bp 0x7f64f38104a0 sp 0x7f64f380fc60
          WRITE of size 108 at 0x50c00043d7c0 thread T145
              #0 0x7f6554e7a3fd in __asan_memcpy /data/mci/d8bac24a3d5110df1e64965da652156b/toolchain-builder/tmp/build-llvm-v5.sh-SLw/llvm-project-llvmorg/compiler-rt/lib/asan/asan_interceptors_memintrinsics.cpp:63:3
              #1 0x7f65543954b3 in __pack_write /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/include/packing_inline.h:432:13
              #2 0x7f655438d230 in __wt_struct_packv /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/include/packing_inline.h:653:9
              #3 0x7f655438b884 in __wt_struct_pack /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/packing/pack_impl.c:82:11
              #4 0x7f6554717aac in __wt_checkpoint_log /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/txn/txn_log.c:554:9
              #5 0x7f6553eed480 in __checkpoint_log_stage /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/checkpoint/checkpoint_txn.c:1541:9
              #6 0x7f6553eeb2e3 in __checkpoint_db_internal /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/checkpoint/checkpoint_txn.c:2071:5
              #7 0x7f6553edff52 in __checkpoint_db_wrapper /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/checkpoint/checkpoint_txn.c:2110:11
              #8 0x7f6553edf657 in __wt_checkpoint_db /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/checkpoint/checkpoint_txn.c:2186:9
              #9 0x7f655457a424 in __session_checkpoint /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/session/session_api.c:2511:11
              #10 0x55c8dd6627c7 in checkpoint /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/test/format/checkpoint.c:138:15
              #11 0x7f6554e79f96 in asan_thread_start(void*) /data/mci/d8bac24a3d5110df1e64965da652156b/toolchain-builder/tmp/build-llvm-v5.sh-SLw/llvm-project-llvmorg/compiler-rt/lib/asan/asan_interceptors.cpp:239:28
              #12 0x7f655387b608 in start_thread /build/glibc-FcRMwW/glibc-2.31/nptl/pthread_create.c:477:8
              #13 0x7f65537a0352 in __clone /build/glibc-FcRMwW/glibc-2.31/misc/../sysdeps/unix/sysv/linux/x86_64/clone.S:95
          0x50c00043d7c0 is located 0 bytes after 128-byte region [0x50c00043d740,0x50c00043d7c0)
          allocated by thread T145 here:
              #0 0x7f6554e7c9ac in realloc /data/mci/d8bac24a3d5110df1e64965da652156b/toolchain-builder/tmp/build-llvm-v5.sh-SLw/llvm-project-llvmorg/compiler-rt/lib/asan/asan_malloc_linux.cpp:82:3
              #1 0x7f6554355764 in __realloc_func /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/os_common/os_alloc.c:160:18
              #2 0x7f655435598e in __wt_realloc_noclear /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/os_common/os_alloc.c:198:13
              #3 0x7f6554653f80 in __wt_buf_grow_worker /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/support/scratch.c:52:9
              #4 0x7f655465aaad in __wt_buf_grow /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/include/buf_inline.h:24:9
              #5 0x7f6554659e77 in __wt_buf_init /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/include/buf_inline.h:57:13
              #6 0x7f655465930e in __wt_scr_alloc_func /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/support/scratch.c:350:5
              #7 0x7f65542d70f9 in __wt_logrec_alloc /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/log/log_auto.c:131:5
              #8 0x7f65547178e4 in __wt_checkpoint_log /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/txn/txn_log.c:552:9
              #9 0x7f6553eed480 in __checkpoint_log_stage /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/checkpoint/checkpoint_txn.c:1541:9
              #10 0x7f6553eeb2e3 in __checkpoint_db_internal /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/checkpoint/checkpoint_txn.c:2071:5
              #11 0x7f6553edff52 in __checkpoint_db_wrapper /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/checkpoint/checkpoint_txn.c:2110:11
              #12 0x7f6553edf657 in __wt_checkpoint_db /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/checkpoint/checkpoint_txn.c:2186:9
              #13 0x7f655457a424 in __session_checkpoint /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/session/session_api.c:2511:11
              #14 0x55c8dd6627c7 in checkpoint /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/test/format/checkpoint.c:138:15
              #15 0x7f6554e79f96 in asan_thread_start(void*) /data/mci/d8bac24a3d5110df1e64965da652156b/toolchain-builder/tmp/build-llvm-v5.sh-SLw/llvm-project-llvmorg/compiler-rt/lib/asan/asan_interceptors.cpp:239:28
          Thread T145 created by T0 here:
              #0 0x7f6554e61d61 in pthread_create /data/mci/d8bac24a3d5110df1e64965da652156b/toolchain-builder/tmp/build-llvm-v5.sh-SLw/llvm-project-llvmorg/compiler-rt/lib/asan/asan_interceptors.cpp:250:3
              #1 0x7f655437b34c in __wt_thread_create /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/os_posix/os_thread.c:71:5
              #2 0x55c8dd6911c6 in operations /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/test/format/ops.c:414:9
              #3 0x55c8dd6bac12 in main /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/test/format/t.c:424:13
              #4 0x7f65536a5082 in __libc_start_main /build/glibc-FcRMwW/glibc-2.31/csu/../csu/libc-start.c:308:16
      

      logs

      race-condition-stress-asan-test-1 task_log

      Logs:

          SUMMARY: AddressSanitizer: heap-buffer-overflow /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/src/include/packing_inline.h:432:13 in __pack_write
      

      logs

      race-condition-stress-asan-test-1 task_log

      Logs:

          Shadow bytes around the buggy address:
            0x50c00043d500: fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd fd
            0x50c00043d580: fa fa fa fa fa fa fa fa 00 00 00 00 00 00 00 00
            0x50c00043d600: 00 00 00 00 00 00 00 fa fa fa fa fa fa fa fa fa
            0x50c00043d680: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 05
            0x50c00043d700: fa fa fa fa fa fa fa fa 00 00 00 00 00 00 00 00
          =>0x50c00043d780: 00 00 00 00 00 00 00 00[fa]fa fa fa fa fa fa fa
            0x50c00043d800: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 06 fa
            0x50c00043d880: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
            0x50c00043d900: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
            0x50c00043d980: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
            0x50c00043da00: fa fa fa fa fa fa fa fa 00 00 00 00 00 00 00 00
          Shadow byte legend (one shadow byte represents 8 application bytes):
            Addressable:           00
            Partially addressable: 01 02 03 04 05 06 07
            Heap left redzone:       fa
            Freed heap region:       fd
            Stack left redzone:      f1
            Stack mid redzone:       f2
            Stack right redzone:     f3
            Stack after return:      f5
            Stack use after scope:   f8
            Global redzone:          f9
            Global init order:       f6
            Poisoned by user:        f7
            Container overflow:      fc
            Array cookie:            ac
            Intra object redzone:    bb
            ASan internal:           fe
            Left alloca redzone:     ca
            Right alloca redzone:    cb
      

      logs

      race-condition-stress-asan-test-1 task_log

      Logs:

      test/format run configuration highlights
      

      logs

      race-condition-stress-asan-test-1 task_log

      Logs:

      #0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
      #0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
      #1  0x00007f65536a3859 in __GI_abort () at abort.c:79
      #2  0x00007f6554dc728c in __sanitizer::Abort() () from /opt/mongodbtoolchain/revisions/93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542/stow/llvm-v5.7Jt/lib/clang/19/lib/x86_64-mongodb-linux/libclang_rt.asan.so
      #3  0x00007f6554dc51ee in __sanitizer::Die() () from /opt/mongodbtoolchain/revisions/93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542/stow/llvm-v5.7Jt/lib/clang/19/lib/x86_64-mongodb-linux/libclang_rt.asan.so
      #4  0x00007f6554e81459 in __asan::ScopedInErrorReport::~ScopedInErrorReport() () from /opt/mongodbtoolchain/revisions/93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542/stow/llvm-v5.7Jt/lib/clang/19/lib/x86_64-mongodb-linux/libclang_rt.asan.so
      #5  0x00007f6554e84757 in __asan::ReportGenericError(unsigned long, unsigned long, unsigned long, unsigned long, bool, unsigned long, unsigned int, bool) () from /opt/mongodbtoolchain/revisions/93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542/stow/llvm-v5.7Jt/lib/clang/19/lib/x86_64-mongodb-linux/libclang_rt.asan.so
      #6  0x00007f6554e7a431 in __asan_memcpy () from /opt/mongodbtoolchain/revisions/93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542/stow/llvm-v5.7Jt/lib/clang/19/lib/x86_64-mongodb-linux/libclang_rt.asan.so
      #7  0x00007f65543954b4 in __pack_write () from /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/cmake_build/test/format/../../libwiredtiger.so.12.0.0
      #8  0x00007f655438d231 in __wt_struct_packv () from /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/cmake_build/test/format/../../libwiredtiger.so.12.0.0
      #9  0x00007f655438b885 in __wt_struct_pack () from /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/cmake_build/test/format/../../libwiredtiger.so.12.0.0
      #10 0x00007f6554717aad in __wt_checkpoint_log () from /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/cmake_build/test/format/../../libwiredtiger.so.12.0.0
      #11 0x00007f6553eed481 in __checkpoint_log_stage () from /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/cmake_build/test/format/../../libwiredtiger.so.12.0.0
      #12 0x00007f6553eeb2e4 in __checkpoint_db_internal () from /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/cmake_build/test/format/../../libwiredtiger.so.12.0.0
      #13 0x00007f6553edff53 in __checkpoint_db_wrapper () from /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/cmake_build/test/format/../../libwiredtiger.so.12.0.0
      #14 0x00007f6553edf658 in __wt_checkpoint_db () from /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/cmake_build/test/format/../../libwiredtiger.so.12.0.0
      #15 0x00007f655457a425 in __session_checkpoint () from /data/mci/eeeb5a634aa2addf019336d5a14a00ce/wiredtiger/cmake_build/test/format/../../libwiredtiger.so.12.0.0
      #16 0x000055c8dd6627c8 in checkpoint ()
      #17 0x00007f6554e79f97 in asan_thread_start(void*) () from /opt/mongodbtoolchain/revisions/93d85cc1a00ca1d53fcc7d4ca790f19a4e5dd542/stow/llvm-v5.7Jt/lib/clang/19/lib/x86_64-mongodb-linux/libclang_rt.asan.so
      #18 0x00007f655387b609 in start_thread (arg=<optimized out>) at pthread_create.c:477
      #19 0x00007f65537a0353 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
      

      logs

      Repro Artifacts:

            Assignee:
            [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: