Loading...

Type: Build Failure
Resolution: Unresolved
Priority: Unknown
Fix Version/s: None
Affects Version/s: None
Component/s: None
Labels:
- greenerbuild

Confidence Status:
None

Assigned Teams:

Python Drivers

Documentation Changes Summary:

Hide

1. What would you like to communicate to the user about this feature?
2. Would you like the user to see examples of the syntax and/or executable code and its output?
3. Which versions of the driver/connector does this apply to?

Show
1. What would you like to communicate to the user about this feature? 2. Would you like the user to see examples of the syntax and/or executable code and its output? 3. Which versions of the driver/connector does this apply to?

Aha! Reference:
None
Tracking Level:
None
Risk Status:
None
Exec Notes:
None
Goal Name:
None
Goal Link:
None

Name of Failure:

test.asynchronous.test_encryption.TestDecryptProse.test_03_decrypt_error

Link to task:

https://spruce.mongodb.com/task/mongo_python_driver_encryption_crypt_shared_rhel8_pypy3.10_auth_ssl_test_latest_standalone_patch_6f4258c1cdb95f6fe624a66760a66423048b6884_67106d57897b7d000719b0e1_24_10_17_01_50_16?execution=0&sortBy=STATUS&sortDir=ASC

Context of when and why the failure occurred:

~~PYTHON-4700~~, only happens with PyPy.

Stack trace:

 [2024/10/16 21:10:57.389] FAILURE: pymongo.errors.AutoReconnect: localhost:27017: connection closed (configured timeouts: connectTimeoutMS: 20000.0ms) ()
 [2024/10/16 21:10:57.389] self = AsyncConnection(<ssl.SSLSocket [closed] fd=-1, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6>) CLOSED at 139823334397720
 [2024/10/16 21:10:57.389] dbname = 'keyvault'
 [2024/10/16 21:10:57.389] spec = {'$db': 'keyvault', 'drop': 'datakeys', 'lsid': {'id': Binary(b'...', 4)}, 'writeConcern': {'w': 'majority'}}
 [2024/10/16 21:10:57.389] read_preference = Primary()
 [2024/10/16 21:10:57.389] codec_options = CodecOptions(document_class=dict, tz_aware=False, uuid_representation=UuidRepresentation.UNSPECIFIED, unicode_decode_e...ne, type_registry=TypeRegistry(type_codecs=[], fallback_encoder=None), datetime_conversion=DatetimeConversion.DATETIME)
 [2024/10/16 21:10:57.389] check = True, allowable_errors = ['ns not found', 26], read_concern = None
 [2024/10/16 21:10:57.389] write_concern = WriteConcern(w=majority), parse_write_concern_error = True
 [2024/10/16 21:10:57.389] collation = None
 [2024/10/16 21:10:57.389] session = <pymongo.asynchronous.client_session.AsyncClientSession object at 0x000000000bb122c0>
 [2024/10/16 21:10:57.389] client = AsyncMongoClient(host=['localhost:27017'], document_class=dict, tz_aware=False, connect=True, replicaset=None, tls=Tru...en/x509gen/client.pem', tlscafile='/data/mci/aa90b1c2eee05d3ee15e16fbf6d4ece0/drivers-tools/.evergreen/x509gen/ca.pem')
 [2024/10/16 21:10:57.389] retryable_write = False, publish_events = True, user_fields = None
 [2024/10/16 21:10:57.389] exhaust_allowed = False
 [2024/10/16 21:10:57.389]     @_handle_reauth
 [2024/10/16 21:10:57.389]     async def command(
 [2024/10/16 21:10:57.389]         self,
 [2024/10/16 21:10:57.389]         dbname: str,
 [2024/10/16 21:10:57.389]         spec: MutableMapping[str, Any],
 [2024/10/16 21:10:57.389]         read_preference: _ServerMode = ReadPreference.PRIMARY,
 [2024/10/16 21:10:57.389]         codec_options: CodecOptions = DEFAULT_CODEC_OPTIONS,
 [2024/10/16 21:10:57.389]         check: bool = True,
 [2024/10/16 21:10:57.389]         allowable_errors: Optional[Sequence[Union[str, int]]] = None,
 [2024/10/16 21:10:57.389]         read_concern: Optional[ReadConcern] = None,
 [2024/10/16 21:10:57.389]         write_concern: Optional[WriteConcern] = None,
 [2024/10/16 21:10:57.389]         parse_write_concern_error: bool = False,
 [2024/10/16 21:10:57.389]         collation: Optional[_CollationIn] = None,
 [2024/10/16 21:10:57.389]         session: Optional[AsyncClientSession] = None,
 [2024/10/16 21:10:57.389]         client: Optional[AsyncMongoClient] = None,
 [2024/10/16 21:10:57.389]         retryable_write: bool = False,
 [2024/10/16 21:10:57.389]         publish_events: bool = True,
 [2024/10/16 21:10:57.389]         user_fields: Optional[Mapping[str, Any]] = None,
 [2024/10/16 21:10:57.389]         exhaust_allowed: bool = False,
 [2024/10/16 21:10:57.389]     ) -> dict[str, Any]:
 [2024/10/16 21:10:57.389]         """Execute a command or raise an error.
 [2024/10/16 21:10:57.389]     
 [2024/10/16 21:10:57.389]         :param dbname: name of the database on which to run the command
 [2024/10/16 21:10:57.389]         :param spec: a command document as a dict, SON, or mapping object
 [2024/10/16 21:10:57.389]         :param read_preference: a read preference
 [2024/10/16 21:10:57.389]         :param codec_options: a CodecOptions instance
 [2024/10/16 21:10:57.389]         :param check: raise OperationFailure if there are errors
 [2024/10/16 21:10:57.389]         :param allowable_errors: errors to ignore if `check` is True
 [2024/10/16 21:10:57.389]         :param read_concern: The read concern for this command.
 [2024/10/16 21:10:57.389]         :param write_concern: The write concern for this command.
 [2024/10/16 21:10:57.389]         :param parse_write_concern_error: Whether to parse the
 [2024/10/16 21:10:57.389]             ``writeConcernError`` field in the command response.
 [2024/10/16 21:10:57.389]         :param collation: The collation for this command.
 [2024/10/16 21:10:57.389]         :param session: optional AsyncClientSession instance.
 [2024/10/16 21:10:57.389]         :param client: optional AsyncMongoClient for gossipping $clusterTime.
 [2024/10/16 21:10:57.389]         :param retryable_write: True if this command is a retryable write.
 [2024/10/16 21:10:57.389]         :param publish_events: Should we publish events for this command?
 [2024/10/16 21:10:57.389]         :param user_fields: Response fields that should be decoded
 [2024/10/16 21:10:57.389]             using the TypeDecoders from codec_options, passed to
 [2024/10/16 21:10:57.389]             bson._decode_all_selective.
 [2024/10/16 21:10:57.389]         """
 [2024/10/16 21:10:57.389]         self.validate_session(client, session)
 [2024/10/16 21:10:57.389]         session = _validate_session_write_concern(session, write_concern)
 [2024/10/16 21:10:57.389]     
 [2024/10/16 21:10:57.389]         # Ensure command name remains in first place.
 [2024/10/16 21:10:57.389]         if not isinstance(spec, ORDERED_TYPES):  # type:ignore[arg-type]
 [2024/10/16 21:10:57.389]             spec = dict(spec)
 [2024/10/16 21:10:57.389]     
 [2024/10/16 21:10:57.389]         if not (write_concern is None or write_concern.acknowledged or collation is None):
 [2024/10/16 21:10:57.389]             raise ConfigurationError("Collation is unsupported for unacknowledged writes.")
 [2024/10/16 21:10:57.389]     
 [2024/10/16 21:10:57.389]         self.add_server_api(spec)
 [2024/10/16 21:10:57.389]         if session:
 [2024/10/16 21:10:57.389]             session._apply_to(spec, retryable_write, read_preference, self)
 [2024/10/16 21:10:57.389]         self.send_cluster_time(spec, session, client)
 [2024/10/16 21:10:57.389]         listeners = self.listeners if publish_events else None
 [2024/10/16 21:10:57.389]         unacknowledged = bool(write_concern and not write_concern.acknowledged)
 [2024/10/16 21:10:57.389]         if self.op_msg_enabled:
 [2024/10/16 21:10:57.389]             self._raise_if_not_writable(unacknowledged)
 [2024/10/16 21:10:57.389]         try:
 [2024/10/16 21:10:57.389] >           return await command(
 [2024/10/16 21:10:57.389]                 self,
 [2024/10/16 21:10:57.389]                 dbname,
 [2024/10/16 21:10:57.389]                 spec,
 [2024/10/16 21:10:57.389]                 self.is_mongos,
 [2024/10/16 21:10:57.389]                 read_preference,
 [2024/10/16 21:10:57.389]                 codec_options,
 [2024/10/16 21:10:57.389]                 session,
 [2024/10/16 21:10:57.389]                 client,
 [2024/10/16 21:10:57.389]                 check,
 [2024/10/16 21:10:57.389]                 allowable_errors,
 [2024/10/16 21:10:57.389]                 self.address,
 [2024/10/16 21:10:57.389]                 listeners,
 [2024/10/16 21:10:57.389]                 self.max_bson_size,
 [2024/10/16 21:10:57.389]                 read_concern,
 [2024/10/16 21:10:57.389]                 parse_write_concern_error=parse_write_concern_error,
 [2024/10/16 21:10:57.389]                 collation=collation,
 [2024/10/16 21:10:57.389]                 compression_ctx=self.compression_context,
 [2024/10/16 21:10:57.389]                 use_op_msg=self.op_msg_enabled,
 [2024/10/16 21:10:57.389]                 unacknowledged=unacknowledged,
 [2024/10/16 21:10:57.389]                 user_fields=user_fields,
 [2024/10/16 21:10:57.389]                 exhaust_allowed=exhaust_allowed,
 [2024/10/16 21:10:57.389]                 write_concern=write_concern,
 [2024/10/16 21:10:57.389]             )
 [2024/10/16 21:10:57.389] pymongo/asynchronous/pool.py:538: 
 [2024/10/16 21:10:57.389] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
 [2024/10/16 21:10:57.389] pymongo/asynchronous/network.py:203: in command
 [2024/10/16 21:10:57.389]     reply = await receive_message(conn, request_id)
 [2024/10/16 21:10:57.389] pymongo/asynchronous/network.py:315: in receive_message
 [2024/10/16 21:10:57.389]     length, _, response_to, op_code = _UNPACK_HEADER(await async_receive_data(conn, 16, deadline))
 [2024/10/16 21:10:57.389] pymongo/network_layer.py:275: in async_receive_data
 [2024/10/16 21:10:57.389]     return read_task.result()
 [2024/10/16 21:10:57.389] /opt/python/pypy3.10/lib/pypy3.10/asyncio/futures.py:201: in result
 [2024/10/16 21:10:57.389]     raise self._exception.with_traceback(self._exception_tb)
 [2024/10/16 21:10:57.389] /opt/python/pypy3.10/lib/pypy3.10/asyncio/tasks.py:232: in __step
 [2024/10/16 21:10:57.389]     result = coro.send(None)
 [2024/10/16 21:10:57.389] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
 [2024/10/16 21:10:57.389] conn = <ssl.SSLSocket [closed] fd=-1, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6>
 [2024/10/16 21:10:57.389] length = 16
 [2024/10/16 21:10:57.389] loop = <_UnixSelectorEventLoop running=False closed=True debug=True>
 [2024/10/16 21:10:57.389] once = False
 [2024/10/16 21:10:57.389]     async def _async_receive_ssl(
 [2024/10/16 21:10:57.389]         conn: _sslConn, length: int, loop: AbstractEventLoop, once: Optional[bool] = False
 [2024/10/16 21:10:57.389]     ) -> memoryview:
 [2024/10/16 21:10:57.389]         mv = memoryview(bytearray(length))
 [2024/10/16 21:10:57.389]         total_read = 0
 [2024/10/16 21:10:57.389]     
 [2024/10/16 21:10:57.389]         def _is_ready(fut: Future) -> None:
 [2024/10/16 21:10:57.389]             if fut.done():
 [2024/10/16 21:10:57.389]                 return
 [2024/10/16 21:10:57.389]             fut.set_result(None)
 [2024/10/16 21:10:57.389]     
 [2024/10/16 21:10:57.389]         while total_read < length:
 [2024/10/16 21:10:57.389]             try:
 [2024/10/16 21:10:57.389]                 read = conn.recv_into(mv[total_read:])
 [2024/10/16 21:10:57.389]                 if read == 0:
 [2024/10/16 21:10:57.389] >                   raise OSError("connection closed")
 [2024/10/16 21:10:57.389] E                   OSError: connection closed
 [2024/10/16 21:10:57.389] pymongo/network_layer.py:147: OSError
 [2024/10/16 21:10:57.389] The above exception was the direct cause of the following exception:
 [2024/10/16 21:10:57.389] self = <test.asynchronous.test_encryption.TestDecryptProse testMethod=test_03_decrypt_error>
 [2024/10/16 21:10:57.389]     async def asyncSetUp(self):
 [2024/10/16 21:10:57.389]         self.client = async_client_context.client
 [2024/10/16 21:10:57.389]         await self.client.db.drop_collection("decryption_events")
 [2024/10/16 21:10:57.389] >       await create_key_vault(self.client.keyvault.datakeys)
 [2024/10/16 21:10:57.389] test/asynchronous/test_encryption.py:1845: 
 [2024/10/16 21:10:57.389] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
 [2024/10/16 21:10:57.389] test/asynchronous/test_encryption.py:783: in create_key_vault
 [2024/10/16 21:10:57.389]     await vault.drop()
 [2024/10/16 21:10:57.389] pymongo/asynchronous/collection.py:1495: in drop
 [2024/10/16 21:10:57.389]     await dbo.drop_collection(
 [2024/10/16 21:10:57.389] pymongo/_csot.py:109: in csot_wrapper
 [2024/10/16 21:10:57.389]     return await func(self, *args, **kwargs)
 [2024/10/16 21:10:57.389] pymongo/asynchronous/database.py:1328: in drop_collection
 [2024/10/16 21:10:57.389]     return await self._drop_helper(name, session, comment)
 [2024/10/16 21:10:57.389] pymongo/asynchronous/database.py:1243: in _drop_helper
 [2024/10/16 21:10:57.389]     return await self._command(
 [2024/10/16 21:10:57.389] pymongo/asynchronous/database.py:770: in _command
 [2024/10/16 21:10:57.389]     return await conn.command(
 [2024/10/16 21:10:57.389] pymongo/asynchronous/helpers.py:45: in inner
 [2024/10/16 21:10:57.389]     return await func(*args, **kwargs)
 [2024/10/16 21:10:57.389] pymongo/asynchronous/pool.py:566: in command
 [2024/10/16 21:10:57.389]     self._raise_connection_failure(error)
 [2024/10/16 21:10:57.389] pymongo/asynchronous/pool.py:765: in _raise_connection_failure
 [2024/10/16 21:10:57.389]     _raise_connection_failure(self.address, error, timeout_details=details)
 [2024/10/16 21:10:57.389] _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
 [2024/10/16 21:10:57.389] address = ('localhost', 27017), error = OSError('connection closed')
 [2024/10/16 21:10:57.389] msg_prefix = None, timeout_details = {'connectTimeoutMS': 20000.0}
 [2024/10/16 21:10:57.389]     def _raise_connection_failure(
 [2024/10/16 21:10:57.389]         address: Any,
 [2024/10/16 21:10:57.389]         error: Exception,
 [2024/10/16 21:10:57.389]         msg_prefix: Optional[str] = None,
 [2024/10/16 21:10:57.389]         timeout_details: Optional[dict[str, float]] = None,
 [2024/10/16 21:10:57.389]     ) -> NoReturn:
 [2024/10/16 21:10:57.389]         """Convert a socket.error to ConnectionFailure and raise it."""
 [2024/10/16 21:10:57.389]         host, port = address
 [2024/10/16 21:10:57.389]         # If connecting to a Unix socket, port will be None.
 [2024/10/16 21:10:57.389]         if port is not None:
 [2024/10/16 21:10:57.389]             msg = "%s:%d: %s" % (host, port, error)
 [2024/10/16 21:10:57.389]         else:
 [2024/10/16 21:10:57.389]             msg = f"{host}: {error}"
 [2024/10/16 21:10:57.389]         if msg_prefix:
 [2024/10/16 21:10:57.389]             msg = msg_prefix + msg
 [2024/10/16 21:10:57.389]         if "configured timeouts" not in msg:
 [2024/10/16 21:10:57.389]             msg += format_timeout_details(timeout_details)
 [2024/10/16 21:10:57.389]         if isinstance(error, socket.timeout):
 [2024/10/16 21:10:57.389]             raise NetworkTimeout(msg) from error
 [2024/10/16 21:10:57.389]         elif isinstance(error, SSLError) and "timed out" in str(error):
 [2024/10/16 21:10:57.389]             # Eventlet does not distinguish TLS network timeouts from other
 [2024/10/16 21:10:57.389]             # SSLErrors (https://github.com/eventlet/eventlet/issues/692).
 [2024/10/16 21:10:57.389]             # Luckily, we can work around this limitation because the phrase
 [2024/10/16 21:10:57.389]             # 'timed out' appears in all the timeout related SSLErrors raised.
 [2024/10/16 21:10:57.389]             raise NetworkTimeout(msg) from error
 [2024/10/16 21:10:57.389]         else:
 [2024/10/16 21:10:57.389] >           raise AutoReconnect(msg) from error
 [2024/10/16 21:10:57.389] E           pymongo.errors.AutoReconnect: localhost:27017: connection closed (configured timeouts: connectTimeoutMS: 20000.0ms)
 [2024/10/16 21:10:57.389] pymongo/asynchronous/pool.py:208: AutoReconnect

depends on

PYTHON-4493 Use asyncio protocols instead of sockets for network IO

Closed

related to

PYTHON-4982 Test Failure - network errors running configureFailPoint

Blocked

Details

Description

Name of Failure:

Link to task:

Context of when and why the failure occurred:

Stack trace:

Attachments

Issue Links

Activity

People

Dates