[DRIVERS-2700] Remove Astrolabe "failure" tests Created: 22/Aug/23  Updated: 23/Aug/23  Resolved: 22/Aug/23

Status: Closed
Project: Drivers
Component/s: Astrolabe, Atlas Testing
Fix Version/s: None

Type: Task Priority: Unknown
Reporter: Matt Dale Assignee: Durran Jordan
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Driver Changes: Not Needed

 Description   

Summary

The "failure read" and "failure write" tests (see failure.yml) are flaky for a number of drivers and add little benefit. They basically assert that reads or writes during a failover will fail if retryable reads and retryable writes are not enabled. That test does show that a failover can cause read/write failures, but otherwise does not assert a behavior that anyone actually wants. Asking a driver team to "make the driver fail more often" doesn't make sense, either. Considering the noise it creates, it would be better to remove it.

Motivation

Who is the affected end user?

Drivers devs.

How does this affect the end user?

They are annoyed by intermittent failure notifications.

How likely is it that this problem or use case will occur?

The failure is intermittent. Fails maybe 5% of the time for the Ruby driver and less often for others.

If the problem does occur, what are the consequences and how severe are they?

People get notifications about a failure that they can't do anything about.

Is this issue urgent?

No.

Is this ticket required by a downstream team?

No.

Is this ticket only for tests?

Yes.

Acceptance Criteria

The "failure read" and "failure write" Astrolabe tests are less flaky or gone.



 Comments   
Comment by Githook User [ 23/Aug/23 ]

Author:

{'name': 'Durran Jordan', 'email': 'durran@gmail.com', 'username': 'durran'}

Message: Merge pull request #172 from durran/fix-failure

test(DRIVERS-2700): remove failure also from evg run
Branch: master
https://github.com/mongodb-labs/drivers-atlas-testing/commit/c3e675dd5265018d042478b6e65bfc15b78f8370

Comment by Githook User [ 23/Aug/23 ]

Author:

{'name': 'Durran Jordan', 'email': 'durran@gmail.com', 'username': 'durran'}

Message: test(DRIVERS-2700): remove failure also from evg run
Branch: master
https://github.com/mongodb-labs/drivers-atlas-testing/commit/b8334905788550133d5a1df9ce1a2dded32cd91b

Comment by Githook User [ 22/Aug/23 ]

Author:

{'name': 'Matt Dale', 'email': '9760375+matthewdale@users.noreply.github.com', 'username': 'matthewdale'}

Message: DRIVERS-2700 Remove failure tests. (#171)
Branch: master
https://github.com/mongodb-labs/drivers-atlas-testing/commit/6f00ed13602a87beeeafa0ff8b386192ac63cd0f

Generated at Thu Feb 08 08:26:13 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.