[WT-10821] failed: azure-gcp-tiered-storage-extensions-test cannot establish a connection in Azure - MongoDB Jira

XML

Word

Printable

JSON

Details

Type: Build Failure
Status: Closed
Priority: Major - P3
Resolution: Duplicate
Affects Version/s: None
Fix Version/s: None
Component/s: None
Labels:

Evergreen Project:
- wiredtiger
Failure Type:
- failed
Failing Buildvariants:
- ubuntu2004
Failing Tasks:
- azure-gcp-tiered-storage-extensions-test
- azure-gcp-tiered-test-small
First Failing Revision:
- 0e8b8669bb909c4ea180ca59916e9d21ad49e137
Linked BFG List:
https://buildbaron.corp.mongodb.com/ui/#/bf/WT-10821
Count of Linked BFGs (Last 30 days):
17

Story Points:
3
Sprint:
2023-04-04 Bibbidi-Bobbidi-Boo

Description

azure-gcp-tiered-storage-extensions-test on ubuntu2004

Host: i-073128919e4649410
Project: wiredtiger
Commit: 0e8b8669

Task Logs:

task azure-gcp-tiered-storage-extensions-test

azure-gcp-tiered-storage-extensions-test task_log

Logs:

-- Installing: /data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/gcp-sdk-cpp/install/include/google/cloud/storage/hash_mismatch_error.h

logs

azure-gcp-tiered-storage-extensions-test task_log

Logs:

"[1679626876:482475][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(dir_store.table), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

"[1679626876:483495][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(dir_store.index), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

"[1679626876:485797][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(gcp_store.table), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

"[1679626876:781774][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(gcp_store.index), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

"[1679627047:792551][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(non_tiered.table), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

"[1679627047:793364][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(non_tiered.index), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

"[1679627047:794790][14146:0x7fe973a3fdc0], test_tiered17.test_tiered17.test_open_readonly_conn(dir_store.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

"[1679627047:795558][14146:0x7fe973a3fdc0], test_tiered17.test_tiered17.test_open_readonly_conn(gcp_store.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

"[1679627047:977150][14146:0x7fe973a3fdc0], test_tiered17.test_tiered17.test_open_readonly_conn(non_tiered.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

"[1679627130:744286][14146:0x7fe973a3fdc0], test_tiered18.test_tiered18.test_tiered_shared(dir_store), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

logs

azure-gcp-tiered-storage-extensions-test task_log

Logs:

ERROR: test_tiered06.test_tiered06.test_ss_file_systems(azure_store) (subunit.RemotedTestCase)

test_tiered06.test_tiered06.test_ss_file_systems(azure_store)

----------------------------------------------------------------------

testtools.testresult.real._StringException: Traceback (most recent call last):

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/test/suite/wttest.py", line 688, in setUp

    self.tearDown()

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/test/suite/wttest.py", line 763, in tearDown

    self.download_objects(self.bucket, self.bucket_prefix)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/test/suite/helper_tiered.py", line 303, in download_objects

    for blob in blob_list:

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/paging.py", line 132, in __next__

    return next(self._page_iterator)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/paging.py", line 76, in __next__

    self._response = self._get_next(self.continuation_token)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_list_blobs_helper.py", line 93, in _get_next_cb

    return self._command(

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/tracing/decorator.py", line 78, in wrapper_use_tracer

    return func(*args, **kwargs)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_generated/operations/_container_operations.py", line 2488, in list_blob_flat_segment

    pipeline_response = self._client._pipeline.run(  # type: ignore # pylint: disable=protected-access

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 205, in run

    return first_node.send(pipeline_request)  # type: ignore

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send

    response = self.next.send(request)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send

    response = self.next.send(request)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send

    response = self.next.send(request)

  [Previous line repeated 2 more times]

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/policies/_redirect.py", line 160, in send

    response = self.next.send(request)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send

    response = self.next.send(request)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_shared/policies.py", line 546, in send

    raise err

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_shared/policies.py", line 520, in send

    response = self.next.send(request)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send

    response = self.next.send(request)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send

    response = self.next.send(request)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send

    response = self.next.send(request)

  [Previous line repeated 1 more time]

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_shared/policies.py", line 313, in send

    response = self.next.send(request)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send

    response = self.next.send(request)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send

    response = self.next.send(request)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 100, in send

    self._sender.send(request.http_request, **request.context.options),

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_shared/base_client.py", line 329, in send

    return self._transport.send(request, **kwargs)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/transport/_requests_basic.py", line 376, in send

    raise error

azure.core.exceptions.ServiceRequestError: <urllib3.connection.HTTPSConnection object at 0x7fe967cf18b0>: Failed to establish a new connection: [Errno -2] Name or service not known

======================================================================

ERROR: test_tiered06.test_tiered06.test_ss_write_read(azure_store) (subunit.RemotedTestCase)

test_tiered06.test_tiered06.test_ss_write_read(azure_store)

----------------------------------------------------------------------

testtools.testresult.real._StringException: Traceback (most recent call last):

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/test/suite/wttest.py", line 688, in setUp

    self.tearDown()

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/test/suite/wttest.py", line 763, in tearDown

    self.download_objects(self.bucket, self.bucket_prefix)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/test/suite/helper_tiered.py", line 303, in download_objects

    for blob in blob_list:

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/paging.py", line 132, in __next__

    return next(self._page_iterator)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/paging.py", line 76, in __next__

    self._response = self._get_next(self.continuation_token)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_list_blobs_helper.py", line 93, in _get_next_cb

    return self._command(

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/tracing/decorator.py", line 78, in wrapper_use_tracer

    return func(*args, **kwargs)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_generated/operations/_container_operations.py", line 2488, in list_blob_flat_segment

    pipeline_response = self._client._pipeline.run(  # type: ignore # pylint: disable=protected-access

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 205, in run

    return first_node.send(pipeline_request)  # type: ignore

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send

    response = self.next.send(request)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send

    response = self.next.send(request)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send

    response = self.next.send(request)

  [Previous line repeated 2 more times]

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/policies/_redirect.py", line 160, in send

    response = self.next.send(request)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send

    response = self.next.send(request)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_shared/policies.py", line 546, in send

    raise err

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_shared/policies.py", line 520, in send

    response = self.next.send(request)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send

    response = self.next.send(request)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send

    response = self.next.send(request)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send

    response = self.next.send(request)

  [Previous line repeated 1 more time]

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_shared/policies.py", line 313, in send

    response = self.next.send(request)

  File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/pyt

logs

azure-gcp-tiered-storage-extensions-test task_log

Logs:

azure.core.exceptions.ServiceRequestError: <urllib3.connection.HTTPSConnection object at 0x7fe967dd63d0>: Failed to establish a new connection: [Errno -2] Name or service not known

logs

azure-gcp-tiered-storage-extensions-test task_log

Logs:

[1679626701:447096][14146:0x7fe973a3fdc0], test_tiered06.test_tiered06.test_ss_file_systems(azure_store), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

[1679626787:267840][14146:0x7fe973a3fdc0], test_tiered06.test_tiered06.test_ss_write_read(azure_store), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

[1679626876:482475][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(dir_store.table), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

[1679626876:483495][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(dir_store.index), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

[1679626876:485797][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(gcp_store.table), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

[1679626876:781774][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(gcp_store.index), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

[1679626876:961210][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(azure_store.table), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

[1679626964:283174][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(azure_store.index), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

[1679627047:792551][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(non_tiered.table), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

[1679627047:793364][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(non_tiered.index), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

[1679627047:794790][14146:0x7fe973a3fdc0], test_tiered17.test_tiered17.test_open_readonly_conn(dir_store.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

[1679627047:795558][14146:0x7fe973a3fdc0], test_tiered17.test_tiered17.test_open_readonly_conn(gcp_store.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

[1679627047:977150][14146:0x7fe973a3fdc0], test_tiered17.test_tiered17.test_open_readonly_conn(non_tiered.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

[1679627047:978624][14146:0x7fe973a3fdc0], test_tiered17.test_tiered17.test_open_readonly_cursor(azure_store.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

[1679627130:744286][14146:0x7fe973a3fdc0], test_tiered18.test_tiered18.test_tiered_shared(dir_store), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy

logs

Attachments

Issue Links

duplicates

WT-10657 Fix Azure Python string and listing blobs limitation

Closed

related to

WT-10657 Fix Azure Python string and listing blobs limitation

Closed

Activity

People

Assignee:: Backlog - Storage Engines Team

Reporter:: xgen-buildbaron-user

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: Mar 27 2023 01:59:11 PM UTC

Updated:: Mar 28 2023 06:56:36 PM UTC

Resolved:: Mar 27 2023 11:15:42 PM UTC