Loading...

XML

Word

Printable

JSON

Type: Build Failure
Resolution: Gone away
Priority: Major - P3
Fix Version/s: None
Affects Version/s: None
Component/s: None
Labels:
- BB-Tools
- dev-prod

Sprint:
ASeasonTooMany-2023-08-22
Story Points:
1
Evergreen Project:
- wiredtiger
Failure Type:
- failed
Failing Buildvariants:
- code-statistics
Failing Tasks:
- coverage-report-catch2
First Failing Revision:
- 518f22ed709defa8f55fa81c87175832b8bd7953
Linked BFG List:
https://buildbaron.corp.mongodb.com/ui/#/bf/WT-11464
Count of Linked BFGs (Last 30 days):
1

This failure was a one-off caused by an issue with accessing the Artifactory server. This is the first line of the second log extract:

[2023/08/14 10:17:34.789] pip._vendor.urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='artifactory.corp.mongodb.com', port=443): Max retries exceeded with url: /artifactory/api/pypi/pypi/simple/setuptools/ (Caused by ResponseError('too many 503 error responses'))

The 503 error means "Service Unavailable".

As expected, the next run of this test worked correctly without intervention/change.

The error messages in the first log extract ("Bulk cursors can't be opened inside a transaction") are expected in this test, and are not an indication of failure here.

coverage-report-catch2 on code-statistics

Host: i-0cc4be9818493fae7
Project: wiredtiger
Commit: 518f22ed

Task Logs:

task coverage-report-catch2

coverage-report-catch2 task_log

Logs:

[1692008231:66866][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008231:77791][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008231:105285][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008231:127462][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008231:138620][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008231:165242][13052:0x7f2083c9f3c0], WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_txn_context_check, 33: not permitted in a running transaction: Invalid argument
[1692008231:165265][13052:0x7f2083c9f3c0], WT_SESSION.commit_transaction: [WT_VERB_DEFAULT][ERROR]: __session_commit_transaction, 1951: failed  transaction requires rollback: Invalid argument
[1692008231:175996][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008231:187646][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008231:215525][13052:0x7f207e490700], WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_txn_context_check, 33: not permitted in a running transaction: Invalid argument
[1692008231:215578][13052:0x7f2083c9f3c0], WT_SESSION.commit_transaction: [WT_VERB_DEFAULT][ERROR]: __session_commit_transaction, 1951: failed  transaction requires rollback: Invalid argument
[1692008231:226574][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008231:236989][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008231:264490][13052:0x7f2083c9f3c0], WT_SESSION.commit_transaction: [WT_VERB_DEFAULT][ERROR]: __session_commit_transaction, 1951: failed  transaction requires rollback: Invalid argument
[1692008231:276374][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008231:287411][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008231:314574][13052:0x7f207e490700], WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_txn_context_check, 33: not permitted in a running transaction: Invalid argument
[1692008231:325659][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008231:335831][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008232:365092][13052:0x7f2083c9f3c0], WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_txn_context_check, 33: not permitted in a running transaction: Invalid argument
[1692008233:366160][13052:0x7f2083c9f3c0], WT_SESSION.commit_transaction: [WT_VERB_DEFAULT][ERROR]: __session_commit_transaction, 1951: failed  transaction requires rollback: Invalid argument
[1692008233:378133][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008233:389109][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008233:426452][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008233:436947][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008233:447443][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008233:447847][13052:0x7f2083c9f3c0], WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_txn_context_check, 33: not permitted in a running transaction: Invalid argument
[1692008233:450542][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008233:450935][13052:0x7f2083c9f3c0], WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_txn_context_check, 33: not permitted in a running transaction: Invalid argument
[1692008233:452654][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008233:453063][13052:0x7f2083c9f3c0], WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_txn_context_check, 33: not permitted in a running transaction: Invalid argument
[1692008233:454950][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008233:455318][13052:0x7f2083c9f3c0], WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_txn_context_check, 33: not permitted in a running transaction: Invalid argument
[1692008233:457979][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008233:458356][13052:0x7f2083c9f3c0], WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_txn_context_check, 33: not permitted in a running transaction: Invalid argument
[1692008233:487173][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008233:497719][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008233:516094][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008234:517518][13052:0x7f2083c9f3c0], WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_txn_context_check, 33: not permitted in a running transaction: Invalid argument
[1692008235:521856][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008236:523322][13052:0x7f2083c9f3c0], WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_txn_context_check, 33: not permitted in a running transaction: Invalid argument
[1692008237:526668][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008238:528135][13052:0x7f2083c9f3c0], WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_txn_context_check, 33: not permitted in a running transaction: Invalid argument
[1692008239:531292][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008240:532768][13052:0x7f2083c9f3c0], WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_txn_context_check, 33: not permitted in a running transaction: Invalid argument
[1692008241:536973][13052:0x7f2083c9f3c0], WT_SESSION.open_cursor: [WT_VERB_DEFAULT][ERROR]: __wt_curfile_open, 1125: Bulk cursors can't be opened inside a transaction: Invalid argument
[1692008242:538463][13052:0x7f2083c9f3c0], WT_SESSION.checkpoint: [WT_VERB_DEFAULT][ERROR]: __wt_txn_context_check, 33: not permitted in a running transaction: Invalid argument
[1692008243:573200][13052:0x7f2083c9f3c0]: [WT_VERB_DEFAULT][ERROR]: __wt_cursor_notsup, 63: Unsupported cursor operation: Operation not supported

logs

coverage-report-catch2 task_log

Logs:

pip._vendor.urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='artifactory.corp.mongodb.com', port=443): Max retries exceeded with url: /artifactory/api/pypi/pypi/simple/setuptools/ (Caused by ResponseError('too many 503 error responses'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/virtualenv_support/pip-9.0.3-py2.py3-none-any.whl/pip/basecommand.py", line 215, in main
    status = self.run(options, args)
  File "/usr/local/lib/python2.7/dist-packages/virtualenv_support/pip-9.0.3-py2.py3-none-any.whl/pip/commands/install.py", line 324, in run
    requirement_set.prepare_files(finder)
  File "/usr/local/lib/python2.7/dist-packages/virtualenv_support/pip-9.0.3-py2.py3-none-any.whl/pip/req/req_set.py", line 376, in prepare_files
    discovered_reqs.extend(self._prepare_file(
  File "/usr/local/lib/python2.7/dist-packages/virtualenv_support/pip-9.0.3-py2.py3-none-any.whl/pip/req/req_set.py", line 551, in _prepare_file
    req_to_install.populate_link(
  File "/usr/local/lib/python2.7/dist-packages/virtualenv_support/pip-9.0.3-py2.py3-none-any.whl/pip/req/req_install.py", line 278, in populate_link
    self.link = finder.find_requirement(self, upgrade)
  File "/usr/local/lib/python2.7/dist-packages/virtualenv_support/pip-9.0.3-py2.py3-none-any.whl/pip/index.py", line 465, in find_requirement
    all_candidates = self.find_all_candidates(req.name)
  File "/usr/local/lib/python2.7/dist-packages/virtualenv_support/pip-9.0.3-py2.py3-none-any.whl/pip/index.py", line 423, in find_all_candidates
    for page in self._get_pages(url_locations, project_name):
  File "/usr/local/lib/python2.7/dist-packages/virtualenv_support/pip-9.0.3-py2.py3-none-any.whl/pip/index.py", line 568, in _get_pages
    page = self._get_page(location)
  File "/usr/local/lib/python2.7/dist-packages/virtualenv_support/pip-9.0.3-py2.py3-none-any.whl/pip/index.py", line 683, in _get_page
    return HTMLPage.get_page(link, session=self.session)
  File "/usr/local/lib/python2.7/dist-packages/virtualenv_support/pip-9.0.3-py2.py3-none-any.whl/pip/index.py", line 788, in get_page
    resp = session.get(
  File "/usr/local/lib/python2.7/dist-packages/virtualenv_support/pip-9.0.3-py2.py3-none-any.whl/pip/_vendor/requests/sessions.py", line 521, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/virtualenv_support/pip-9.0.3-py2.py3-none-any.whl/pip/download.py", line 386, in request
    return super(PipSession, self).request(method, url, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/virtualenv_support/pip-9.0.3-py2.py3-none-any.whl/pip/_vendor/requests/sessions.py", line 508, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python2.7/dist-packages/virtualenv_support/pip-9.0.3-py2.py3-none-any.whl/pip/_vendor/requests/sessions.py", line 618, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/virtualenv_support/pip-9.0.3-py2.py3-none-any.whl/pip/_vendor/requests/adapters.py", line 499, in send
    raise RetryError(e, request=request)
pip._vendor.requests.exceptions.RetryError: HTTPSConnectionPool(host='artifactory.corp.mongodb.com', port=443): Max retries exceeded with url: /artifactory/api/pypi/pypi/simple/setuptools/ (Caused by ResponseError('too many 503 error responses'))
----------------------------------------
...Installing setuptools, pip, wheel...done.
virtualenv -p python3 venv
/usr/local/lib/python2.7/dist-packages/virtualenv.py:1047: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
  import imp
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/virtualenv.py", line 2349, in <module>
    main()
  File "/usr/local/lib/python2.7/dist-packages/virtualenv.py", line 703, in main
    create_environment(home_dir,
  File "/usr/local/lib/python2.7/dist-packages/virtualenv.py", line 949, in create_environment
    install_wheel(
  File "/usr/local/lib/python2.7/dist-packages/virtualenv.py", line 904, in install_wheel
    call_subprocess(cmd, show_stdout=False, extra_env=env, stdin=SCRIPT)
  File "/usr/local/lib/python2.7/dist-packages/virtualenv.py", line 794, in call_subprocess
    raise OSError(
OSError: Command /data/mci/e079ff2ef0...ild/venv/bin/python3 - setuptools pip wheel failed with error code 2
Running virtualenv with interpreter /usr/bin/python3
Command 'shell.exec' in function 'code coverage analysis' (step 4 of 6) failed: shell script encountered problem: exit code 1.
Task completed - FAILURE.
Running post-task commands.
Running command 'shell.exec' in function 'dump stacktraces' (step 1 of 6) in block 'post'.
/opt/mongodbtoolchain/v4/bin/python3 ../test/evergreen/print_stack_trace.py
Finished command 'shell.exec' in function 'dump stacktraces' (step 1 of 6) in block 'post' in 40.381563ms.
Running command 's3.put' in function 'upload stacktraces' (step 2 of 6) in block 'post'.
Putting files matching filter '[wiredtiger/cmake_build/*stacktrace.txt]' into path 'wiredtiger/code-statistics/518f22ed709defa8f55fa81c87175832b8bd7953/artifacts/coverage-report-catch2_wiredtiger_code_statistics_518f22ed709defa8f55fa81c87175832b8bd7953_23_08_14_09_54_27/' in S3 bucket 'build_external'.
Performing S3 put to file 'wiredtiger/code-statistics/518f22ed709defa8f55fa81c87175832b8bd7953/artifacts/coverage-report-catch2_wiredtiger_code_statistics_518f22ed709defa8f55fa81c87175832b8bd7953_23_08_14_09_54_27/' in bucket 'build_external' (attempt 1 of 5).
File filter 'wiredtiger/cmake_build/*stacktrace.txt' matched no files.
Finished command 's3.put' in function 'upload stacktraces' (step 2 of 6) in block 'post' in 48.880574ms.
Running command 'shell.exec' in function 'dump stderr/stdout' (step 3 of 6) in block 'post'.
if [ -d "WT_TEST" ]; then
  # Dump stderr/stdout contents generated by the C libraries onto console for Python tests
  find "WT_TEST" -name "std*.txt" ! -empty -exec sh -c "echo 'Contents from {}:'; cat '{}'" \;
fi
Finished command 'shell.exec' in function 'dump stderr/stdout' (step 3 of 6) in block 'post' in 1.555365ms.
Running command 'archive.targz_pack' in function 'upload artifact' (step 4.1 of 6) in block 'post'.
Finished command 'archive.targz_pack' in function 'upload artifact' (step 4.1 of 6) in block 'post' in 26.195927501s.
Running command 's3.put' in function 'upload artifact' (step 4.2 of 6) in block 'post'.
Putting local file 'wiredtiger.tgz' into path 'build_external/wiredtiger/code-statistics/518f22ed709defa8f55fa81c87175832b8bd7953/artifacts/coverage-report-catch2_wiredtiger_code_statistics_518f22ed709defa8f55fa81c87175832b8bd7953_23_08_14_09_54_27-0.tgz' (https://build_external.s3.amazonaws.com/wiredtiger/code-statistics/518f22ed709defa8f55fa81c87175832b8bd7953/artifacts/coverage-report-catch2_wiredtiger_code_statistics_518f22ed709defa8f55fa81c87175832b8bd7953_23_08_14_09_54_27-0.tgz).
Performing S3 put to file 'wiredtiger/code-statistics/518f22ed709defa8f55fa81c87175832b8bd7953/artifacts/coverage-report-catch2_wiredtiger_code_statistics_518f22ed709defa8f55fa81c87175832b8bd7953_23_08_14_09_54_27-0.tgz' in bucket 'build_external' (attempt 1 of 5).
Finished command 's3.put' in function 'upload artifact' (step 4.2 of 6) in block 'post' in 15.075508025s.
Running command 'archive.targz_pack' in function 'save wt hang analyzer core/debugger files' (step 5.1 of 6) in block 'post'.
Finished command 'archive.targz_pack' in function 'save wt hang analyzer core/debugger files' (step 5.1 of 6) in block 'post' in 24.267844ms.
Running command 's3.put' in function 'save wt hang analyzer core/debugger files' (step 5.2 of 6) in block 'post'.
Putting local file 'wt-hang-analyzer.tgz' into path 'build_external/wiredtiger/code-statistics/518f22ed709defa8f55fa81c87175832b8bd7953/wt_hang_analyzer/wt-hang-analyzer_coverage-report-catch2_wiredtiger_code_statistics_518f22ed709defa8f55fa81c87175832b8bd7953_23_08_14_09_54_27-0.tgz' (https://build_external.s3.amazonaws.com/wiredtiger/code-statistics/518f22ed709defa8f55fa81c87175832b8bd7953/wt_hang_analyzer/wt-hang-analyzer_coverage-report-catch2_wiredtiger_code_statistics_518f22ed709defa8f55fa81c87175832b8bd7953_23_08_14_09_54_27-0.tgz).
Performing S3 put to file 'wiredtiger/code-statistics/518f22ed709defa8f55fa81c87175832b8bd7953/wt_hang_analyzer/wt-hang-analyzer_coverage-report-catch2_wiredtiger_code_statistics_518f22ed709defa8f55fa81c87175832b8bd7953_23_08_14_09_54_27-0.tgz' in bucket 'build_external' (attempt 1 of 5).
File '/data/mci/e079ff2ef0d8b75a0fa76a896034e8c8/wt-hang-analyzer.tgz' not found and skip missing is true, exiting without error.
Finished command 's3.put' in function 'save wt hang analyzer core/debugger files' (step 5.2 of 6) in block 'post' in 19.004893ms.
Running command 'shell.exec' in function 'cleanup' (step 6 of 6) in block 'post'.
Finished command 'shell.exec' in function 'cleanup' (step 6 of 6) in block 'post' in 164.727418ms.
Finished running post-task commands in 41.591749075s.

logs

Assignee:: Jeremy Thorp

Reporter:: xgen-buildbaron-user

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Created:: Aug 14 2023 11:00:55 PM UTC

Updated:: Oct 27 2023 08:19:59 PM UTC

Resolved:: Aug 14 2023 11:18:53 PM UTC

Details

Description

Attachments

Activity

People

Dates