Loading...

Type: Build Failure
Resolution: Fixed
Priority: Major - P3
Fix Version/s: WT11.2.0, 7.0.0-rc0
Affects Version/s: None
Component/s: None
Labels:

Evergreen Project:
- wiredtiger
Failure Type:
- failed
Failing Buildvariants:
- amazon2-arm64
- ubuntu2004
Failing Tasks:
First Failing Revision:
- e9fad99f3e9eebbed7917d55d32a70c6f33f8dd8
Linked BFG List:
https://buildbaron.corp.mongodb.com/ui/#/bf/WT-10657
Count of Linked BFGs (Last 30 days):
19

Story Points:
3
Sprint:
2023-04-04 Bibbidi-Bobbidi-Boo

tiered-storage-extensions-test on amazon2-arm64

Host: i-06ee9aa3c65d2df93
Project: wiredtiger
Commit: e9fad99f

Task Logs:

task tiered-storage-extensions-test

tiered-storage-extensions-test task_log

Logs:

HEAD is now at e9fad99f3 WT-10563 Print calculated checksum and expected checksum when we have a checksum mismatch (#8809)
e9fad99f3 WT-10563 Print calculated checksum and expected checksum when we have a checksum mismatch (#8809)

logs

tiered-storage-extensions-test task_log

Logs:

"[1677131475:559457][12329:0xffff996d6a90], test_tiered07.test_tiered07.test_tiered(no_ckpt.dirstore), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
"[1677131475:633532][12329:0xffff996d6a90], test_tiered15.test_tiered15.test_create_type_config(dirstore.tiered), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
"[1677131475:634385][12329:0xffff996d6a90], test_tiered15.test_tiered15.test_create_type_config(dirstore.backup), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
"[1677131475:660087][12329:0xffff996d6a90], test_tiered15.test_tiered15.test_create_type_config(non_tiered.tiered), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
"[1677131475:660816][12329:0xffff996d6a90], test_tiered15.test_tiered15.test_create_type_config(non_tiered.backup), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
"[1677131475:661642][12329:0xffff996d6a90], test_tiered17.test_tiered17.test_open_readonly_conn(dirstore.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
"[1677131475:662378][12329:0xffff996d6a90], test_tiered17.test_tiered17.test_open_readonly_conn(non_tiered.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
"[1677131475:677333][12329:0xffff996d6a90], test_tiered18.test_tiered18.test_tiered_shared(dirstore), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

logs

tiered-storage-extensions-test task_log

Logs:

ERROR: test_tiered04.test_tiered04.test_tiered(s3) (subunit.RemotedTestCase)
test_tiered04.test_tiered04.test_tiered(s3)
----------------------------------------------------------------------
testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/test/suite/test_tiered04.py", line 107, in test_tiered
    self.session.create(self.uri1, base_create + conf)
_wiredtiger.WiredTigerError: Invalid argument
======================================================================
ERROR: test_tiered06.test_tiered06.test_ss_file_systems(s3) (subunit.RemotedTestCase)
test_tiered06.test_tiered06.test_ss_file_systems(s3)
----------------------------------------------------------------------
testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/test/suite/wttest.py", line 645, in setUp
    self.tearDown()
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/test/suite/wttest.py", line 700, in tearDown
    self.download_objects(self.bucket, self.bucket_prefix)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/test/suite/helper_tiered.py", line 248, in download_objects
    objects = list(bucket.objects.filter(Prefix=prefix))
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/boto3/resources/collection.py", line 81, in __iter__
    for page in self.pages():
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/boto3/resources/collection.py", line 171, in pages
    for page in pages:
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/paginate.py", line 269, in __iter__
    response = self._make_request(current_kwargs)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/paginate.py", line 357, in _make_request
    return self._method(**current_kwargs)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/client.py", line 944, in _make_api_call
    operation_model, request_dict, request_context
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/client.py", line 966, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/endpoint.py", line 119, in make_request
    return self._send_request(request_dict, operation_model)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/endpoint.py", line 198, in _send_request
    request = self.create_request(request_dict, operation_model)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/endpoint.py", line 137, in create_request
    operation_name=operation_model.name,
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/hooks.py", line 412, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/hooks.py", line 256, in emit
    return self._emit(event_name, kwargs)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/hooks.py", line 239, in _emit
    response = handler(**kwargs)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/signers.py", line 105, in handler
    return self.sign(operation_name, request)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/signers.py", line 189, in sign
    auth.add_auth(request)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/auth.py", line 418, in add_auth
    raise NoCredentialsError()
botocore.exceptions.NoCredentialsError: Unable to locate credentials
======================================================================
ERROR: test_tiered09.test_tiered09.test_tiered(s3) (subunit.RemotedTestCase)
test_tiered09.test_tiered09.test_tiered(s3)
----------------------------------------------------------------------
testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/test/suite/wttest.py", line 645, in setUp
    self.tearDown()
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/test/suite/wttest.py", line 700, in tearDown
    self.download_objects(self.bucket, self.bucket_prefix)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/test/suite/helper_tiered.py", line 248, in download_objects
    objects = list(bucket.objects.filter(Prefix=prefix))
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/boto3/resources/collection.py", line 81, in __iter__
    for page in self.pages():
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/boto3/resources/collection.py", line 171, in pages
    for page in pages:
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/paginate.py", line 269, in __iter__
    response = self._make_request(current_kwargs)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/paginate.py", line 357, in _make_request
    return self._method(**current_kwargs)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/client.py", line 944, in _make_api_call
    operation_model, request_dict, request_context
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/client.py", line 966, in _make_request
    return self._endpoint.make_request(operation_model, request_dict)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/endpoint.py", line 119, in make_request
    return self._send_request(request_dict, operation_model)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/endpoint.py", line 198, in _send_request
    request = self.create_request(request_dict, operation_model)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/endpoint.py", line 137, in create_request
    operation_name=operation_model.name,
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/hooks.py", line 412, in emit
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/hooks.py", line 256, in emit
    return self._emit(event_name, kwargs)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/hooks.py", line 239, in _emit
    response = handler(**kwargs)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/signers.py", line 105, in handler
    return self.sign(operation_name, request)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/signers.py", line 189, in sign
    auth.add_auth(request)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/auth.py", line 418, in add_auth
    raise NoCredentialsError()
botocore.exceptions.NoCredentialsError: Unable to locate credentials
======================================================================
ERROR: test_tiered11.test_tiered11.test_tiered11(s3) (subunit.RemotedTestCase)
test_tiered11.test_tiered11.test_tiered11(s3)
----------------------------------------------------------------------
testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/test/suite/wttest.py", line 645, in setUp
    self.tearDown()
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/test/suite/wttest.py", line 700, in tearDown
    self.download_objects(self.bucket, self.bucket_prefix)
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/test/suite/helper_tiered.py", line 248, in download_objects
    objects = list(bucket.objects.filter(Prefix=prefix))
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/boto3/resources/collection.py", line 81, in __iter__
    for page in self.pages():
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/boto3/resources/collection.py", line 171, in pages
    for page in pages:
  File "/data/mci/d8cde0b139dd6522473906fd2f983aa0/wiredtiger/cmake_build/venv/lib/python3.7/site-packages/botocore/paginate.py", line 269, in __iter__
    response = self._make_request(current_kwargs)
  File "/

logs

tiered-storage-extensions-test task_log

Logs:

[1677131475:320301][12329:0xffff996d6a90], test_tiered04.test_tiered04.test_tiered(s3), connection: [WT_VERB_EXTENSION][ERROR]: S3CustomizeFileSystem: s3testext : No such bucket.
[1677131475:545688][12329:0xffff996d6a90], test_tiered06.test_tiered06.test_ss_file_systems(s3), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1677131475:559457][12329:0xffff996d6a90], test_tiered07.test_tiered07.test_tiered(no_ckpt.dirstore), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1677131475:560577][12329:0xffff996d6a90], test_tiered09.test_tiered09.test_tiered(s3), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1677131475:572631][12329:0xffff996d6a90], test_tiered11.test_tiered11.test_tiered11(s3), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1677131475:585338][12329:0xffff996d6a90], test_tiered13.test_tiered13.test_tiered13(s3), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1677131475:597103][12329:0xffff996d6a90], test_tiered14.test_tiered14.test_tiered(0.string.simple.s3), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1677131475:609921][12329:0xffff996d6a90], test_tiered14.test_tiered14.test_tiered(S.string.simple.s3), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1677131475:621666][12329:0xffff996d6a90], test_tiered14.test_tiered14.test_tiered(M.string.simple.s3), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1677131475:633532][12329:0xffff996d6a90], test_tiered15.test_tiered15.test_create_type_config(dirstore.tiered), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1677131475:634385][12329:0xffff996d6a90], test_tiered15.test_tiered15.test_create_type_config(dirstore.backup), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1677131475:635179][12329:0xffff996d6a90], test_tiered15.test_tiered15.test_create_type_config(s3.tiered), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1677131475:648197][12329:0xffff996d6a90], test_tiered15.test_tiered15.test_create_type_config(s3.backup), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1677131475:660087][12329:0xffff996d6a90], test_tiered15.test_tiered15.test_create_type_config(non_tiered.tiered), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1677131475:660816][12329:0xffff996d6a90], test_tiered15.test_tiered15.test_create_type_config(non_tiered.backup), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1677131475:661642][12329:0xffff996d6a90], test_tiered17.test_tiered17.test_open_readonly_conn(dirstore.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1677131475:662378][12329:0xffff996d6a90], test_tiered17.test_tiered17.test_open_readonly_conn(non_tiered.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1677131475:663185][12329:0xffff996d6a90], test_tiered17.test_tiered17.test_open_readonly_cursor(s3.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1677131475:677333][12329:0xffff996d6a90], test_tiered18.test_tiered18.test_tiered_shared(dirstore), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

logs

is duplicated by

WT-10821 failed: azure-gcp-tiered-storage-extensions-test cannot establish a connection in Azure

Closed

is related to

WT-10821 failed: azure-gcp-tiered-storage-extensions-test cannot establish a connection in Azure

Closed

Details

Description

Attachments

Issue Links

Activity

People

Dates