Loading...

Type: Build Failure
Resolution: Duplicate
Priority: Major - P3
Fix Version/s: None
Affects Version/s: None
Component/s: Not Applicable
Labels:
- BB-Tools

Assigned Teams:

Storage Engines
Evergreen Project:
- wiredtiger-mongo-v5.0
Failure Type:
- task-timed-out
Failing Buildvariants:
- ubuntu2004
Failing Tasks:
- spinlock-pthread-adaptive-test
First Failing Revision:
- 8c9b4be4d5669230a0c2b44967d81cd3e97c37fd
Linked BFG List:
https://buildbaron.corp.mongodb.com/ui/#/bf/WT-12835
Count of Linked BFGs (Last 30 days):
1

spinlock-pthread-adaptive-test on ubuntu2004

Host: i-0f4dede3f1457e62f
Project: wiredtiger-mongo-v5.0
Commit: 8c9b4be4

Task Logs:

task spinlock-pthread-adaptive-test

spinlock-pthread-adaptive-test task_log

Logs:

# XFAIL: 0
# FAIL:  0
# XPASS: 0
# ERROR: 0
============================================================================
make[3]: Leaving directory '/data/mci/f1fc3b2fb46285946aefd642890ee353/wiredtiger/build_posix/lang/python'
make[2]: Leaving directory '/data/mci/f1fc3b2fb46285946aefd642890ee353/wiredtiger/build_posix/lang/python'
make[1]: Leaving directory '/data/mci/f1fc3b2fb46285946aefd642890ee353/wiredtiger/build_posix/lang/python'
Making check in test/utility
make[1]: Entering directory '/data/mci/f1fc3b2fb46285946aefd642890ee353/wiredtiger/build_posix/test/utility'
make[1]: Nothing to be done for 'check'.
make[1]: Leaving directory '/data/mci/f1fc3b2fb46285946aefd642890ee353/wiredtiger/build_posix/test/utility'
Making check in examples/c
make[1]: Entering directory '/data/mci/f1fc3b2fb46285946aefd642890ee353/wiredtiger/build_posix/examples/c'
make  check-TESTS
make[2]: Entering directory '/data/mci/f1fc3b2fb46285946aefd642890ee353/wiredtiger/build_posix/examples/c'
make[3]: Entering directory '/data/mci/f1fc3b2fb46285946aefd642890ee353/wiredtiger/build_posix/examples/c'
PASS: ex_config_parse
PASS: ex_cursor
PASS: ex_call_center
PASS: ex_access
PASS: ex_col_store
PASS: ex_data_source
PASS: ex_event_handler
PASS: ex_file_system
PASS: ex_extractor
PASS: ex_extending
PASS: ex_encrypt
PASS: ex_hello
PASS: ex_process
PASS: ex_pack
PASS: ex_schema
PASS: ex_all
PASS: ex_smoke
PASS: ex_log
PASS: ex_stat
PASS: ex_thread
PASS: ex_backup
PASS: ex_backup_block
============================================================================
Testsuite summary for WiredTiger 10.0.2
============================================================================
# TOTAL: 22
# PASS:  22
# SKIP:  0
# XFAIL: 0
# FAIL:  0
# XPASS: 0
# ERROR: 0
============================================================================
make[3]: Leaving directory '/data/mci/f1fc3b2fb46285946aefd642890ee353/wiredtiger/build_posix/examples/c'
make[2]: Leaving directory '/data/mci/f1fc3b2fb46285946aefd642890ee353/wiredtiger/build_posix/examples/c'
make[1]: Leaving directory '/data/mci/f1fc3b2fb46285946aefd642890ee353/wiredtiger/build_posix/examples/c'
Making check in test/bloom
make[1]: Entering directory '/data/mci/f1fc3b2fb46285946aefd642890ee353/wiredtiger/build_posix/test/bloom'
make  check-TESTS
make[2]: Entering directory '/data/mci/f1fc3b2fb46285946aefd642890ee353/wiredtiger/build_posix/test/bloom'
make[3]: Entering directory '/data/mci/f1fc3b2fb46285946aefd642890ee353/wiredtiger/build_posix/test/bloom'
PASS: t
============================================================================
Testsuite summary for WiredTiger 10.0.2
============================================================================
# TOTAL: 1
# PASS:  1
# SKIP:  0
# XFAIL: 0
# FAIL:  0
# XPASS: 0
# ERROR: 0
============================================================================
make[3]: Leaving directory '/data/mci/f1fc3b2fb46285946aefd642890ee353/wiredtiger/build_posix/test/bloom'
make[2]: Leaving directory '/data/mci/f1fc3b2fb46285946aefd642890ee353/wiredtiger/build_posix/test/bloom'
make[1]: Leaving directory '/data/mci/f1fc3b2fb46285946aefd642890ee353/wiredtiger/build_posix/test/bloom'
Making check in test/checkpoint
make[1]: Entering directory '/data/mci/f1fc3b2fb46285946aefd642890ee353/wiredtiger/build_posix/test/checkpoint'
make  check-TESTS
make[2]: Entering directory '/data/mci/f1fc3b2fb46285946aefd642890ee353/wiredtiger/build_posix/test/checkpoint'
make[3]: Entering directory '/data/mci/f1fc3b2fb46285946aefd642890ee353/wiredtiger/build_posix/test/checkpoint'
Hit idle timeout (no message on stdout/stderr for more than 2h0m0s).
Command 'shell.exec' in function 'make check all' (step 3 of 5) stopped early: context canceled.
Finished command 'shell.exec' in function 'make check all' (step 3 of 5) in 2h0m26.577902757s.
Running task commands failed: running command: command stopped early: context canceled
Finished running task commands in 2h4m47.910890319s.
Running task-timeout commands.
Running command 'shell.exec' in function 'run wt hang analyzer' (step 1 of 1) in block 'timeout'.
# Dump core (-c) and debugger outputs (-o)
wt_hang_analyzer_option="-c -o file -o stdout"
echo "Calling the wt hang analyzer ..."
PATH="/opt/mongodbtoolchain/v4/bin:$PATH" /opt/mongodbtoolchain/v3/bin/python3 ../test/wt_hang_analyzer/wt_hang_analyzer.py $wt_hang_analyzer_option
Calling the wt hang analyzer ...
Python Version: 3.9.2 (default, Jun 16 2023, 15:59:06)
[GCC 9.4.0]
OS: Linux-5.4.0-1009-aws-x86_64-with-glibc2.31
Cannot determine Linux distro since Python is too old
Current User: 1000
Cannot determine Unix Current Login
Getting list of processes using /usr/bin/ps
['/usr/bin/ps', '--version']
ps from procps-ng UNKNOWN
['/usr/bin/ps', '-eo', 'pid,args']
Found 3 interesting processes [(639, 'python3'), (710, 'python3'), (26590, 't')]
Debugger /opt/mongodbtoolchain/v4/bin/gdb, analyzing python3 process with PID 639
Dumping core to dump_python3.639.core
['/opt/mongodbtoolchain/v4/bin/gdb', '--version']
GNU gdb (GDB) 12.1
Copyright (C) 2022 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
['/opt/mongodbtoolchain/v4/bin/gdb', '--quiet', '--nx', '-ex', 'set interactive-mode off', '-ex', 'set print thread-events off', '-ex', 'file python3', '-ex', 'attach 639', '-ex', 'info sharedlibrary', '-ex', 'info threads', '-ex', 'thread apply all bt', '-ex', 'set python print-stack full', '-ex', 'set scheduler-locking on', '-ex', 'gcore dump_python3.639.core', '-ex', 'set confirm off', '-ex', 'quit']
Reading symbols from python3...
Attaching to program: /opt/mongodbtoolchain/v4/bin/python3, process 639
ptrace: Operation not permitted.
No shared libraries loaded at this time.
No threads.
Target 'exec' cannot support this command.
You can't do that without a process to debug.
Done analyzing python3 process with PID 639
Debugger /opt/mongodbtoolchain/v4/bin/gdb, analyzing python3 process with PID 710
Dumping core to dump_python3.710.core
['/opt/mongodbtoolchain/v4/bin/gdb', '--version']
GNU gdb (GDB) 12.1
Copyright (C) 2022 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
['/opt/mongodbtoolchain/v4/bin/gdb', '--quiet', '--nx', '-ex', 'set interactive-mode off', '-ex', 'set print thread-events off', '-ex', 'file python3', '-ex', 'attach 710', '-ex', 'info sharedlibrary', '-ex', 'info threads', '-ex', 'thread apply all bt', '-ex', 'set python print-stack full', '-ex', 'set scheduler-locking on', '-ex', 'gcore dump_python3.710.core', '-ex', 'set confirm off', '-ex', 'quit']
Reading symbols from python3...
Attaching to program: /opt/mongodbtoolchain/v4/bin/python3, process 710
ptrace: Operation not permitted.
No shared libraries loaded at this time.
No threads.
Target 'exec' cannot support this command.
You can't do that without a process to debug.
Done analyzing python3 process with PID 710
Debugger /opt/mongodbtoolchain/v4/bin/gdb, analyzing t process with PID 26590
Dumping core to dump_t.26590.core
['/opt/mongodbtoolchain/v4/bin/gdb', '--version']
GNU gdb (GDB) 12.1
Copyright (C) 2022 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
['/opt/mongodbtoolchain/v4/bin/gdb', '--quiet', '--nx', '-ex', 'set interactive-mode off', '-ex', 'set print thread-events off', '-ex', 'file t', '-ex', 'attach 26590', '-ex', 'info sharedlibrary', '-ex', 'info threads', '-ex', 'thread apply all bt', '-ex', 'set python print-stack full', '-ex', 'set scheduler-locking on', '-ex', 'gcore dump_t.26590.core', '-ex', 'set confirm off', '-ex', 'quit']
t: No such file or directory.
Attaching to process 26590
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
0x00007fe45201fcd7 in __pthread_clockjoin_ex () from /lib/x86_64-linux-gnu/libpthread.so.0
From                To                  Syms Read   Shared Object Library
0x00007fe45205f090  0x00007fe45205f4e7  Yes (*)     /usr/lib/x86_64-linux-gnu/libeatmydata.so
0x00007fe452041720  0x00007fe452044d70  Yes (*)     /lib/x86_64-linux-gnu/librt.so.1
0x00007fe45203a220  0x00007fe45203b179  Yes (*)     /lib/x86_64-linux-gnu/libdl.so.2
0x00007fe45201cae0  0x00007fe45202c535  Yes (*)     /lib/x86_64-linux-gnu/libpthread.so.0
0x00007fe451e46630  0x00007fe451fbb4bd  Yes (*)     /lib/x86_64-linux-gnu/libc.so.6
0x00007fe452066100  0x00007fe452088684  Yes (*)     /lib64/ld-linux-x86-64.so.2
(*): Shared library is missing debugging information.
  Id   Target Id                             Frame
* 1    Thread 0x7fe451e233c0 (LWP 26590) "t" 0x00007fe45201fcd7 in __pthread_clockjoin_ex () from /lib/x86_64-linux-gnu/libpthread.so.0
  2    Thread 0x7fe451dfc700 (LWP 26595) "t" 0x00007fe4520257d1 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
  3    Thread 0x7fe4515fb700 (LWP 26596) "t" 0x00007fe4520257d1 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
  4    Thread 0x7fe44ad76700 (LWP 26597) "t" 0x00007fe4520257d1 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
  5    Thread 0x7fe44a575700 (LWP 26598) "t" 0x00007fe4520257d1 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
  6    Thread 0x7fe449d74700 (LWP 26599) "t" 0x00007fe4520257d1 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
  7    Thread 0x7fe449573700 (LWP 26600) "t" 0x00007fe4520257d1 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/l

logs

related to

WT-10691 task-timed-out: spinlock-pthread-adaptive-test on ubuntu2004 [wiredtiger-mongo-v5.0 @ ad583b15]

Closed

Details

Description

Attachments

Issue Links

Activity

People

Dates