[DRIVERS-2432] Run unified tests from all specs against Atlas Serverless Created: 09/Sep/22  Updated: 21/Aug/23

Status: Implementing
Project: Drivers
Component/s: Serverless
Fix Version/s: None

Type: Task Priority: Unknown
Reporter: Jeremy Mikola Assignee: Jeremy Mikola
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Issue split
split to CDRIVER-4472 Run unified tests from all specs agai... Backlog
split to CSHARP-4318 Run unified tests from all specs agai... Backlog
split to CXX-2573 Run unified tests from all specs agai... Backlog
split to NODE-4627 Run unified tests from all specs agai... Backlog
split to GODRIVER-2545 Run unified tests from all specs agai... Closed
split to JAVA-4723 Run unified tests from all specs agai... Closed
split to MOTOR-1028 Run unified tests from all specs agai... Closed
split to PHPLIB-948 Run unified tests from all specs agai... Closed
split to PYTHON-3436 Run unified tests from all specs agai... Closed
split to RUBY-3112 Run unified tests from all specs agai... Closed
split to RUST-1469 Run unified tests from all specs agai... Closed
Related
is related to DRIVERS-1967 Update serverless testing for load ba... Implementing
is related to DRIVERS-2431 Forbid Serverless in Change Stream Di... Implementing
is related to DRIVERS-2288 Unified change stream spec tests shou... Implementing
Driver Changes: Needed
Downstream Changes Summary:

Ensure all unified spec tests from all specs are run when testing against Atlas Serverless. Individual tests may still be skipped according to the the "serverless" runOnRequirement; however, all tests should be considered for execution.

Drivers that previously made this change as part of DRIVERS-1967 may immediately resolve their language ticket for DRIVERS-2432.

Start date:
Driver Compliance:
Key Status/Resolution FixVersion
CDRIVER-4472 Backlog
CXX-2573 Backlog
CSHARP-4318 Backlog
GODRIVER-2545 Works as Designed
JAVA-4723 Done
NODE-4627 Backlog
MOTOR-1028 Duplicate
PYTHON-3436 Works as Designed
PHPLIB-948 Fixed 1.15.0
RUBY-3112 Fixed 2.18.2
RUST-1469 Done
SWIFT-1634 Done

 Description   

Summary

In mongodb/specifications@1b471f1 for DRIVERS-1967, Serverless Testing: Existing Spec Tests was changed to instruct drivers to run all unified spec tests against Atlas Serverless and only exclude them based on the "serverless" runOnRequirement:

Unified spec tests from all specifications MUST be run against Atlas Serverless.
Since schema version 1.4, unified tests can specify Atlas Serverless
compatibility in their ``runOnRequirements``.

This change was never formally communicated in the downstream changes for DRIVERS-1967, so it's possible that some drivers never made the change. This ticket can server as a reminder to do so, and may be ignored if not relevant.

Motivation

Who is the affected end user?

Drivers.

How does this affect the end user?

Some tests may be skipped on Atlas Serverless.

How likely is it that this problem or use case will occur?

Depends on each driver.

If the problem does occur, what are the consequences and how severe are they?

Lack of test coverage.

Is this issue urgent?

No.

Is this ticket required by a downstream team?

No.

Is this ticket only for tests?

Yes.



 Comments   
Comment by Jeremy Mikola [ 09/Sep/22 ]

Context: this came up in a recent Slack discussion in #driver-devs about DRIVERS-2288 and DRIVERS-2431

Generated at Thu Feb 08 08:25:34 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.