Loading...

XML

Word

Printable

JSON

Type: Build Failure
Resolution: Fixed
Priority: Major - P3
Fix Version/s: WT11.2.0, 7.1.0-rc0
Affects Version/s: None
Component/s: None
Labels:
- BB-Tools
- stability

Evergreen Project:
- wiredtiger
Failure Type:
- failed
Failing Buildvariants:
Failing Tasks:
- s3-tiered-storage-extensions-test
First Failing Revision:
- 1ed75dd0937da05deeafa874b30f2dfe505f22be
Linked BFG List:
https://buildbaron.corp.mongodb.com/ui/#/bf/WT-11001
Count of Linked BFGs (Last 30 days):
9

Backport Requested:

v7.0

s3-tiered-storage-extensions-test on ubuntu2004

Host: i-03cd2788b819dab95
Project: wiredtiger
Commit: 1ed75dd0

Task Logs:

task s3-tiered-storage-extensions-test

s3-tiered-storage-extensions-test task_log

Logs:

"[1682643506:106597][12022:0x7f262ebc0dc0], test_tiered15.test_tiered15.test_create_type_config(dir_store.table), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
"[1682643506:107454][12022:0x7f262ebc0dc0], test_tiered15.test_tiered15.test_create_type_config(dir_store.index), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
"[1682643506:385213][12022:0x7f262ebc0dc0], test_tiered15.test_tiered15.test_create_type_config(non_tiered.table), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
"[1682643506:385886][12022:0x7f262ebc0dc0], test_tiered15.test_tiered15.test_create_type_config(non_tiered.index), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
"[1682643506:523608][12022:0x7f262ebc0dc0], test_tiered17.test_tiered17.test_open_readonly_conn(dir_store.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
"[1682643506:524922][12022:0x7f262ebc0dc0], test_tiered17.test_tiered17.test_open_readonly_conn(non_tiered.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
"[1682643506:667128][12022:0x7f262ebc0dc0], test_tiered18.test_tiered18.test_tiered_shared(dir_store), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy

logs

s3-tiered-storage-extensions-test task_log

Logs:

ERROR: test_tiered13.test_tiered13.test_tiered13(s3_store) (subunit.RemotedTestCase)
test_tiered13.test_tiered13.test_tiered13(s3_store)
----------------------------------------------------------------------
testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/test/suite/wttest.py", line 688, in setUp
    self.tearDown()
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/test/suite/wttest.py", line 765, in tearDown
    self.download_objects(self.bucket, self.bucket_prefix)
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/test/suite/helper_tiered.py", line 282, in download_objects
    objects = list(bucket.objects.filter(Prefix=prefix))
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/boto3/resources/collection.py", line 81, in __iter__
    for page in self.pages():
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/boto3/resources/collection.py", line 171, in pages
    for page in pages:
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/botocore/paginate.py", line 269, in __iter__
    response = self._make_request(current_kwargs)
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/botocore/paginate.py", line 357, in _make_request
    return self._method(**current_kwargs)
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/botocore/client.py", line 960, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the ListObjects operation: Access Denied
======================================================================
ERROR: test_tiered14.test_tiered14.test_tiered(0.integer.simple.s3_store) (subunit.RemotedTestCase)
test_tiered14.test_tiered14.test_tiered(0.integer.simple.s3_store)
----------------------------------------------------------------------
testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/test/suite/wttest.py", line 688, in setUp
    self.tearDown()
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/test/suite/wttest.py", line 765, in tearDown
    self.download_objects(self.bucket, self.bucket_prefix)
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/test/suite/helper_tiered.py", line 282, in download_objects
    objects = list(bucket.objects.filter(Prefix=prefix))
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/boto3/resources/collection.py", line 81, in __iter__
    for page in self.pages():
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/boto3/resources/collection.py", line 171, in pages
    for page in pages:
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/botocore/paginate.py", line 269, in __iter__
    response = self._make_request(current_kwargs)
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/botocore/paginate.py", line 357, in _make_request
    return self._method(**current_kwargs)
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/botocore/client.py", line 960, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the ListObjects operation: Access Denied
======================================================================
ERROR: test_tiered14.test_tiered14.test_tiered(0.string.simple.s3_store) (subunit.RemotedTestCase)
test_tiered14.test_tiered14.test_tiered(0.string.simple.s3_store)
----------------------------------------------------------------------
testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/test/suite/wttest.py", line 688, in setUp
    self.tearDown()
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/test/suite/wttest.py", line 765, in tearDown
    self.download_objects(self.bucket, self.bucket_prefix)
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/test/suite/helper_tiered.py", line 282, in download_objects
    objects = list(bucket.objects.filter(Prefix=prefix))
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/boto3/resources/collection.py", line 81, in __iter__
    for page in self.pages():
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/boto3/resources/collection.py", line 171, in pages
    for page in pages:
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/botocore/paginate.py", line 269, in __iter__
    response = self._make_request(current_kwargs)
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/botocore/paginate.py", line 357, in _make_request
    return self._method(**current_kwargs)
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/botocore/client.py", line 960, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the ListObjects operation: Access Denied
======================================================================
ERROR: test_tiered14.test_tiered14.test_tiered(S.integer.simple.s3_store) (subunit.RemotedTestCase)
test_tiered14.test_tiered14.test_tiered(S.integer.simple.s3_store)
----------------------------------------------------------------------
testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/test/suite/wttest.py", line 688, in setUp
    self.tearDown()
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/test/suite/wttest.py", line 765, in tearDown
    self.download_objects(self.bucket, self.bucket_prefix)
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/test/suite/helper_tiered.py", line 282, in download_objects
    objects = list(bucket.objects.filter(Prefix=prefix))
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/boto3/resources/collection.py", line 81, in __iter__
    for page in self.pages():
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/boto3/resources/collection.py", line 171, in pages
    for page in pages:
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/botocore/paginate.py", line 269, in __iter__
    response = self._make_request(current_kwargs)
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/botocore/paginate.py", line 357, in _make_request
    return self._method(**current_kwargs)
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/botocore/client.py", line 960, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the ListObjects operation: Access Denied
======================================================================
ERROR: test_tiered14.test_tiered14.test_tiered(S.string.simple.s3_store) (subunit.RemotedTestCase)
test_tiered14.test_tiered14.test_tiered(S.string.simple.s3_store)
----------------------------------------------------------------------
testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/test/suite/wttest.py", line 688, in setUp
    self.tearDown()
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/test/suite/wttest.py", line 765, in tearDown
    self.download_objects(self.bucket, self.bucket_prefix)
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/test/suite/helper_tiered.py", line 282, in download_objects
    objects = list(bucket.objects.filter(Prefix=prefix))
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/boto3/resources/collection.py", line 81, in __iter__
    for page in self.pages():
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/boto3/resources/collection.py", line 171, in pages
    for page in pages:
  File "/data/mci/31dd3fd7206ed8f67baaa7c92bb1004b/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/botocore/paginate.py", line 269, in __iter__
    response = self._make_request(current_kwargs)
  File "/da

logs

s3-tiered-storage-extensions-test task_log

Logs:

[1682643505:126477][12022:0x7f262ebc0dc0], test_tiered13.test_tiered13.test_tiered13(s3_store), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1682643505:264996][12022:0x7f262ebc0dc0], test_tiered14.test_tiered14.test_tiered(0.integer.simple.s3_store), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1682643505:398447][12022:0x7f262ebc0dc0], test_tiered14.test_tiered14.test_tiered(0.string.simple.s3_store), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1682643505:538646][12022:0x7f262ebc0dc0], test_tiered14.test_tiered14.test_tiered(S.integer.simple.s3_store), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1682643505:680819][12022:0x7f262ebc0dc0], test_tiered14.test_tiered14.test_tiered(S.string.simple.s3_store), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1682643505:818045][12022:0x7f262ebc0dc0], test_tiered14.test_tiered14.test_tiered(M.integer.simple.s3_store), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1682643505:958856][12022:0x7f262ebc0dc0], test_tiered14.test_tiered14.test_tiered(M.string.simple.s3_store), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1682643506:106597][12022:0x7f262ebc0dc0], test_tiered15.test_tiered15.test_create_type_config(dir_store.table), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1682643506:107454][12022:0x7f262ebc0dc0], test_tiered15.test_tiered15.test_create_type_config(dir_store.index), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1682643506:108310][12022:0x7f262ebc0dc0], test_tiered15.test_tiered15.test_create_type_config(s3_store.table), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1682643506:259330][12022:0x7f262ebc0dc0], test_tiered15.test_tiered15.test_create_type_config(s3_store.index), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1682643506:385213][12022:0x7f262ebc0dc0], test_tiered15.test_tiered15.test_create_type_config(non_tiered.table), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1682643506:385886][12022:0x7f262ebc0dc0], test_tiered15.test_tiered15.test_create_type_config(non_tiered.index), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1682643506:386655][12022:0x7f262ebc0dc0], test_tiered16.test_tiered16.test_remove_shared(s3_store), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1682643506:523608][12022:0x7f262ebc0dc0], test_tiered17.test_tiered17.test_open_readonly_conn(dir_store.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1682643506:524922][12022:0x7f262ebc0dc0], test_tiered17.test_tiered17.test_open_readonly_conn(non_tiered.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1682643506:525737][12022:0x7f262ebc0dc0], test_tiered17.test_tiered17.test_open_readonly_cursor(s3_store.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy
[1682643506:667128][12022:0x7f262ebc0dc0], test_tiered18.test_tiered18.test_tiered_shared(dir_store), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1771: WiredTiger database is already being managed by another thread in this process: Device or resource busy

logs

Assignee:: Peter Macko

Reporter:: xgen-buildbaron-user

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Created:: Apr 28 2023 12:40:21 PM UTC

Updated:: Oct 29 2023 04:37:46 PM UTC

Resolved:: May 01 2023 02:30:34 PM UTC

Details

Description

Attachments

Activity

People

Dates