[TSAN] Multiple data races: __wti_log_fill vs pwrite, eviction-server mutex destroy/lock

XMLWordPrintableJSON

      generate-tsan-metric on amazon2023-arm64-tsan

      Host: i-0f1ab8a67286a2cd2
      Project: wiredtiger
      Commit: 8a033a75
      Please refer to BF(G) Playbook for instructions on handling BF and BFG tickets as well as Auto-Resolution Rules

      Task Logs:

      generate-tsan-metric task_log

      Logs:

      TSAN log: tsan_logs_test_verify_disagg.py.447540
      WARNING: ThreadSanitizer: data race (pid=447540)
      Atomic read of size 1 at 0xffff95809ff8 by thread T39 (mutexes: write M0):
      #0 pthread_mutex_lock <null> (libtsan.so.2+0x597a0) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_lock /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:192 (libwiredtiger.so.12.0.0+0x3fb748)
      Previous write of size 8 at 0xffff95809ff8 by main thread (mutexes: write M1, write M2, write M3, write M4):
      #0 calloc <null> (libtsan.so.2+0x553ec) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_calloc /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/os_common/os_alloc.c:68 (libwiredtiger.so.12.0.0+0x37f600)
      Location is heap block of size 328 at 0xffff95809f00 allocated by main thread:
      #0 calloc <null> (libtsan.so.2+0x553ec) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_calloc /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/os_common/os_alloc.c:68 (libwiredtiger.so.12.0.0+0x37f600)
      Mutex M0 (0xffff93cc3180) created at:
      #0 pthread_mutex_init <null> (libtsan.so.2+0x591b8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_init /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:142 (libwiredtiger.so.12.0.0+0x2f4b9c)
      Mutex M1 (0xffff967263a8) created at:
      #0 pthread_mutex_init <null> (libtsan.so.2+0x591b8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_init /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:142 (libwiredtiger.so.12.0.0+0x45f2f4)
      Mutex M2 (0xffff91485120) created at:
      #0 pthread_mutex_init <null> (libtsan.so.2+0x591b8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_init /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:142 (libwiredtiger.so.12.0.0+0x215ef4)
      Mutex M3 (0xffff93e11de0) created at:
      #0 pthread_mutex_init <null> (libtsan.so.2+0x591b8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_init /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:142 (libwiredtiger.so.12.0.0+0xed7c8)
      Mutex M4 (0xffff95806278) created at:
      #0 pthread_mutex_init <null> (libtsan.so.2+0x591b8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_init /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:142 (libwiredtiger.so.12.0.0+0x1a662c)
      Thread T39 'eviction-ser 1' (tid=447587, running) created by main thread at:
      #0 pthread_create <null> (libtsan.so.2+0x5a608) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_thread_create /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/os_posix/os_thread.c:71 (libwiredtiger.so.12.0.0+0x3914a0)
      

      logs

      generate-tsan-metric task_log

      Logs:

      SUMMARY: ThreadSanitizer: data race (/opt/mongodbtoolchain/revisions/e921fc32d5c23d7cdb5cf406b05bf16eb5ab8dbd/stow/gcc-v5.128/lib/gcc/aarch64-mongodb-linux/14.2.0/../../../../lib64/libtsan.so.2+0x597a0) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d) in pthread_mutex_lock
      

      logs

      generate-tsan-metric task_log

      Logs:

      TSAN log: tsan_logs_test_verify_disagg.py.447540
      WARNING: ThreadSanitizer: data race (pid=447540)
      Read of size 7 at 0xffff926126d1 by main thread (mutexes: write M0, write M1, write M2, write M3):
      #0 memcpy <null> (libtsan.so.2+0x84df4) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_buf_grow_worker /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/support/scratch.c:64 (libwiredtiger.so.12.0.0+0x4a72b0)
      Previous write of size 8 at 0xffff926126d0 by thread T39 (mutexes: write M4, write M5):
      #0 memcpy <null> (libtsan.so.2+0x84df4) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_memdup /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/os_common/os_alloc.c:214 (libwiredtiger.so.12.0.0+0x3804e4)
      Location is heap block of size 10564 at 0xffff92612000 allocated by thread T39:
      #0 malloc <null> (libtsan.so.2+0x55294) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_malloc /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/os_common/os_alloc.c:99 (libwiredtiger.so.12.0.0+0x37fa84)
      Mutex M0 (0xffff967263a8) created at:
      #0 pthread_mutex_init <null> (libtsan.so.2+0x591b8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_init /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:142 (libwiredtiger.so.12.0.0+0x45f2f4)
      Mutex M1 (0xffff91485120) created at:
      #0 pthread_mutex_init <null> (libtsan.so.2+0x591b8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_init /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:142 (libwiredtiger.so.12.0.0+0x215ef4)
      Mutex M2 (0xffff93e11de0) created at:
      #0 pthread_mutex_init <null> (libtsan.so.2+0x591b8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_init /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:142 (libwiredtiger.so.12.0.0+0xed7c8)
      Mutex M3 (0xffff958048f8) created at:
      #0 pthread_mutex_init <null> (libtsan.so.2+0x591b8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_init /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:142 (libwiredtiger.so.12.0.0+0x1a662c)
      Mutex M4 (0xffff93cc3180) created at:
      #0 pthread_mutex_init <null> (libtsan.so.2+0x591b8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_init /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:142 (libwiredtiger.so.12.0.0+0x2f4b9c)
      Mutex M5 (0xffff95806878) created at:
      #0 pthread_mutex_init <null> (libtsan.so.2+0x591b8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_init /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:142 (libwiredtiger.so.12.0.0+0x1a662c)
      Thread T39 'eviction-ser 1' (tid=447587, running) created by main thread at:
      #0 pthread_create <null> (libtsan.so.2+0x5a608) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_thread_create /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/os_posix/os_thread.c:71 (libwiredtiger.so.12.0.0+0x3914a0)
      

      logs

      generate-tsan-metric task_log

      Logs:

      SUMMARY: ThreadSanitizer: data race (/opt/mongodbtoolchain/revisions/e921fc32d5c23d7cdb5cf406b05bf16eb5ab8dbd/stow/gcc-v5.128/lib/gcc/aarch64-mongodb-linux/14.2.0/../../../../lib64/libtsan.so.2+0x84df4) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d) in memcpy
      

      logs

      generate-tsan-metric task_log

      Logs:

      TSAN log: tsan_logs_test_verify_disagg.py.447540
      WARNING: ThreadSanitizer: data race (pid=447540)
      Write of size 1 at 0xffff9580b4f8 by thread T39 (mutexes: write M0):
      #0 pthread_mutex_destroy <null> (libtsan.so.2+0x568a0) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_destroy /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:160 (libwiredtiger.so.12.0.0+0xe71b8)
      Previous atomic read of size 1 at 0xffff9580b4f8 by main thread (mutexes: write M1, write M2, write M3, write M4):
      #0 pthread_mutex_unlock <null> (libtsan.so.2+0x57040) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_unlock /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:208 (libwiredtiger.so.12.0.0+0x3f1ce8)
      Location is heap block of size 328 at 0xffff9580b400 allocated by main thread:
      #0 calloc <null> (libtsan.so.2+0x553ec) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_calloc /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/os_common/os_alloc.c:68 (libwiredtiger.so.12.0.0+0x37f600)
      Mutex M0 (0xffff93cc3180) created at:
      #0 pthread_mutex_init <null> (libtsan.so.2+0x591b8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_init /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:142 (libwiredtiger.so.12.0.0+0x2f4b9c)
      Mutex M1 (0xffff967263a8) created at:
      #0 pthread_mutex_init <null> (libtsan.so.2+0x591b8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_init /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:142 (libwiredtiger.so.12.0.0+0x45f2f4)
      Mutex M2 (0xffff91485120) created at:
      #0 pthread_mutex_init <null> (libtsan.so.2+0x591b8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_init /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:142 (libwiredtiger.so.12.0.0+0x215ef4)
      Mutex M3 (0xffff93e116e0) created at:
      #0 pthread_mutex_init <null> (libtsan.so.2+0x591b8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_init /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:142 (libwiredtiger.so.12.0.0+0xed7c8)
      Mutex M4 (0xffff9580b4f8) created at:
      #0 pthread_mutex_init <null> (libtsan.so.2+0x591b8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_init /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:142 (libwiredtiger.so.12.0.0+0x1a662c)
      Thread T39 'eviction-ser 1' (tid=447587, running) created by main thread at:
      #0 pthread_create <null> (libtsan.so.2+0x5a608) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_thread_create /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/os_posix/os_thread.c:71 (libwiredtiger.so.12.0.0+0x3914a0)
      

      logs

      generate-tsan-metric task_log

      Logs:

      SUMMARY: ThreadSanitizer: data race (/opt/mongodbtoolchain/revisions/e921fc32d5c23d7cdb5cf406b05bf16eb5ab8dbd/stow/gcc-v5.128/lib/gcc/aarch64-mongodb-linux/14.2.0/../../../../lib64/libtsan.so.2+0x568a0) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d) in pthread_mutex_destroy
      

      logs

      generate-tsan-metric task_log

      Logs:

      TSAN log: tsan_logs_test_util18.py.432973
      WARNING: ThreadSanitizer: data race (pid=432973)
      Read of size 8 at 0xffff71a87000 by thread T617 (mutexes: write M0):
      #0 pwrite <null> (libtsan.so.2+0x5e438) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __posix_file_write /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/os_posix/os_fs.c:698 (libwiredtiger.so.12.0.0+0x38f1a0)
      Previous write of size 8 at 0xffff71a87000 by main thread (mutexes: write M1):
      #0 memcpy <null> (libtsan.so.2+0x84df4) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wti_log_fill /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/log/log.c:753 (libwiredtiger.so.12.0.0+0x33d680)
      Location is heap block of size 10240 at 0xffff71a87000 allocated by main thread:
      #0 realloc <null> (libtsan.so.2+0x57514) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __realloc_func /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/os_common/os_alloc.c:160 (libwiredtiger.so.12.0.0+0x380224)
      Mutex M0 (0xffff77104128) created at:
      #0 pthread_mutex_init <null> (libtsan.so.2+0x591b8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_init /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:142 (libwiredtiger.so.12.0.0+0x35cd84)
      Mutex M1 (0xffff7674b920) created at:
      #0 pthread_mutex_init <null> (libtsan.so.2+0x591b8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_init /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:142 (libwiredtiger.so.12.0.0+0x215ef4)
      Thread T617 'log-server' (tid=436476, running) created by main thread at:
      #0 pthread_create <null> (libtsan.so.2+0x5a608) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_thread_create /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/os_posix/os_thread.c:71 (libwiredtiger.so.12.0.0+0x3914a0)
      

      logs

      generate-tsan-metric task_log

      Logs:

      SUMMARY: ThreadSanitizer: data race (/opt/mongodbtoolchain/revisions/e921fc32d5c23d7cdb5cf406b05bf16eb5ab8dbd/stow/gcc-v5.128/lib/gcc/aarch64-mongodb-linux/14.2.0/../../../../lib64/libtsan.so.2+0x5e438) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d) in pwrite
      

      logs

      generate-tsan-metric task_log

      Logs:

      TSAN log: tsan_logs_test_txn23.py.418520
      WARNING: ThreadSanitizer: data race (pid=418520)
      Read of size 5 at 0xffff90c2f9fb by main thread (mutexes: write M0):
      #0 strlen <null> (libtsan.so.2+0x5b7a8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_strdup /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/misc_inline.h:51 (libwiredtiger.so.12.0.0+0x371f14)
      Previous write of size 8 at 0xffff90c2f9f8 by thread T29 (mutexes: write M1):
      #0 memcpy <null> (libtsan.so.2+0x84df4) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_memdup /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/os_common/os_alloc.c:214 (libwiredtiger.so.12.0.0+0x3804e4)
      Location is heap block of size 4458 at 0xffff90c2f800 allocated by thread T29:
      #0 malloc <null> (libtsan.so.2+0x55294) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_malloc /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/os_common/os_alloc.c:99 (libwiredtiger.so.12.0.0+0x37fa84)
      Mutex M0 (0xffff8d878920) created at:
      #0 pthread_mutex_init <null> (libtsan.so.2+0x591b8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_init /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:142 (libwiredtiger.so.12.0.0+0x215ef4)
      Mutex M1 (0xffff91c43ef8) created at:
      #0 pthread_mutex_init <null> (libtsan.so.2+0x591b8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_spin_init /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/include/mutex_inline.h:142 (libwiredtiger.so.12.0.0+0x1a662c)
      Thread T29 'eviction-ser 2' (tid=419973, running) created by main thread at:
      #0 pthread_create <null> (libtsan.so.2+0x5a608) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d)
      #1 __wt_thread_create /data/mci/2764dd5d8a0bd4c6651b0ecd39fd4b90/wiredtiger/src/os_posix/os_thread.c:71 (libwiredtiger.so.12.0.0+0x3914a0)
      

      logs

      generate-tsan-metric task_log

      Logs:

      SUMMARY: ThreadSanitizer: data race (/opt/mongodbtoolchain/revisions/e921fc32d5c23d7cdb5cf406b05bf16eb5ab8dbd/stow/gcc-v5.128/lib/gcc/aarch64-mongodb-linux/14.2.0/../../../../lib64/libtsan.so.2+0x5b7a8) (BuildId: c82c4afde85b6b512548b11edd3036251bebb25d) in strlen
      

      logs

            Assignee:
            Albert Song
            Reporter:
            xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: