Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-10821

failed: azure-gcp-tiered-storage-extensions-test cannot establish a connection in Azure

    • Type: Icon: Build Failure Build Failure
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • 3
    • 2023-04-04 Bibbidi-Bobbidi-Boo

      azure-gcp-tiered-storage-extensions-test on ubuntu2004

      Host: i-073128919e4649410
      Project: wiredtiger
      Commit: 0e8b8669

      Task Logs:

      azure-gcp-tiered-storage-extensions-test task_log

      Logs:

      -- Installing: /data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/gcp-sdk-cpp/install/include/google/cloud/storage/hash_mismatch_error.h
      
      

      logs

      azure-gcp-tiered-storage-extensions-test task_log

      Logs:

      "[1679626876:482475][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(dir_store.table), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      "[1679626876:483495][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(dir_store.index), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      "[1679626876:485797][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(gcp_store.table), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      "[1679626876:781774][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(gcp_store.index), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      "[1679627047:792551][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(non_tiered.table), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      "[1679627047:793364][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(non_tiered.index), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      "[1679627047:794790][14146:0x7fe973a3fdc0], test_tiered17.test_tiered17.test_open_readonly_conn(dir_store.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      "[1679627047:795558][14146:0x7fe973a3fdc0], test_tiered17.test_tiered17.test_open_readonly_conn(gcp_store.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      "[1679627047:977150][14146:0x7fe973a3fdc0], test_tiered17.test_tiered17.test_open_readonly_conn(non_tiered.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      "[1679627130:744286][14146:0x7fe973a3fdc0], test_tiered18.test_tiered18.test_tiered_shared(dir_store), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      

      logs

      azure-gcp-tiered-storage-extensions-test task_log

      Logs:

      ERROR: test_tiered06.test_tiered06.test_ss_file_systems(azure_store) (subunit.RemotedTestCase)
      test_tiered06.test_tiered06.test_ss_file_systems(azure_store)
      ----------------------------------------------------------------------
      testtools.testresult.real._StringException: Traceback (most recent call last):
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/test/suite/wttest.py", line 688, in setUp
          self.tearDown()
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/test/suite/wttest.py", line 763, in tearDown
          self.download_objects(self.bucket, self.bucket_prefix)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/test/suite/helper_tiered.py", line 303, in download_objects
          for blob in blob_list:
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/paging.py", line 132, in __next__
          return next(self._page_iterator)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/paging.py", line 76, in __next__
          self._response = self._get_next(self.continuation_token)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_list_blobs_helper.py", line 93, in _get_next_cb
          return self._command(
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/tracing/decorator.py", line 78, in wrapper_use_tracer
          return func(*args, **kwargs)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_generated/operations/_container_operations.py", line 2488, in list_blob_flat_segment
          pipeline_response = self._client._pipeline.run(  # type: ignore # pylint: disable=protected-access
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 205, in run
          return first_node.send(pipeline_request)  # type: ignore
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send
          response = self.next.send(request)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send
          response = self.next.send(request)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send
          response = self.next.send(request)
        [Previous line repeated 2 more times]
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/policies/_redirect.py", line 160, in send
          response = self.next.send(request)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send
          response = self.next.send(request)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_shared/policies.py", line 546, in send
          raise err
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_shared/policies.py", line 520, in send
          response = self.next.send(request)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send
          response = self.next.send(request)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send
          response = self.next.send(request)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send
          response = self.next.send(request)
        [Previous line repeated 1 more time]
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_shared/policies.py", line 313, in send
          response = self.next.send(request)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send
          response = self.next.send(request)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send
          response = self.next.send(request)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 100, in send
          self._sender.send(request.http_request, **request.context.options),
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_shared/base_client.py", line 329, in send
          return self._transport.send(request, **kwargs)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/transport/_requests_basic.py", line 376, in send
          raise error
      azure.core.exceptions.ServiceRequestError: <urllib3.connection.HTTPSConnection object at 0x7fe967cf18b0>: Failed to establish a new connection: [Errno -2] Name or service not known
      ======================================================================
      ERROR: test_tiered06.test_tiered06.test_ss_write_read(azure_store) (subunit.RemotedTestCase)
      test_tiered06.test_tiered06.test_ss_write_read(azure_store)
      ----------------------------------------------------------------------
      testtools.testresult.real._StringException: Traceback (most recent call last):
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/test/suite/wttest.py", line 688, in setUp
          self.tearDown()
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/test/suite/wttest.py", line 763, in tearDown
          self.download_objects(self.bucket, self.bucket_prefix)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/test/suite/helper_tiered.py", line 303, in download_objects
          for blob in blob_list:
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/paging.py", line 132, in __next__
          return next(self._page_iterator)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/paging.py", line 76, in __next__
          self._response = self._get_next(self.continuation_token)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_list_blobs_helper.py", line 93, in _get_next_cb
          return self._command(
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/tracing/decorator.py", line 78, in wrapper_use_tracer
          return func(*args, **kwargs)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_generated/operations/_container_operations.py", line 2488, in list_blob_flat_segment
          pipeline_response = self._client._pipeline.run(  # type: ignore # pylint: disable=protected-access
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 205, in run
          return first_node.send(pipeline_request)  # type: ignore
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send
          response = self.next.send(request)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send
          response = self.next.send(request)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send
          response = self.next.send(request)
        [Previous line repeated 2 more times]
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/policies/_redirect.py", line 160, in send
          response = self.next.send(request)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send
          response = self.next.send(request)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_shared/policies.py", line 546, in send
          raise err
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_shared/policies.py", line 520, in send
          response = self.next.send(request)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send
          response = self.next.send(request)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send
          response = self.next.send(request)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/core/pipeline/_base.py", line 69, in send
          response = self.next.send(request)
        [Previous line repeated 1 more time]
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/python3.8/site-packages/azure/storage/blob/_shared/policies.py", line 313, in send
          response = self.next.send(request)
        File "/data/mci/e45f69dc932ff68d4ff64890990a14d0/wiredtiger/cmake_build/venv/lib/pyt
      

      logs

      azure-gcp-tiered-storage-extensions-test task_log

      Logs:

      azure.core.exceptions.ServiceRequestError: <urllib3.connection.HTTPSConnection object at 0x7fe967dd63d0>: Failed to establish a new connection: [Errno -2] Name or service not known
      
      

      logs

      azure-gcp-tiered-storage-extensions-test task_log

      Logs:

      [1679626701:447096][14146:0x7fe973a3fdc0], test_tiered06.test_tiered06.test_ss_file_systems(azure_store), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      [1679626787:267840][14146:0x7fe973a3fdc0], test_tiered06.test_tiered06.test_ss_write_read(azure_store), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      [1679626876:482475][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(dir_store.table), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      [1679626876:483495][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(dir_store.index), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      [1679626876:485797][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(gcp_store.table), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      [1679626876:781774][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(gcp_store.index), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      [1679626876:961210][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(azure_store.table), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      [1679626964:283174][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(azure_store.index), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      [1679627047:792551][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(non_tiered.table), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      [1679627047:793364][14146:0x7fe973a3fdc0], test_tiered15.test_tiered15.test_create_type_config(non_tiered.index), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      [1679627047:794790][14146:0x7fe973a3fdc0], test_tiered17.test_tiered17.test_open_readonly_conn(dir_store.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      [1679627047:795558][14146:0x7fe973a3fdc0], test_tiered17.test_tiered17.test_open_readonly_conn(gcp_store.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      [1679627047:977150][14146:0x7fe973a3fdc0], test_tiered17.test_tiered17.test_open_readonly_conn(non_tiered.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      [1679627047:978624][14146:0x7fe973a3fdc0], test_tiered17.test_tiered17.test_open_readonly_cursor(azure_store.clean), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      [1679627130:744286][14146:0x7fe973a3fdc0], test_tiered18.test_tiered18.test_tiered_shared(dir_store), wiredtiger_open: [WT_VERB_DEFAULT][ERROR]: __conn_single, 1765: WiredTiger database is already being managed by another thread in this process: Device or resource busy
      

      logs

            Assignee:
            backlog-server-storage-engines [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            Xgen-BuildBaron-User xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: