-
Type:
Task
-
Resolution: Fixed
-
Priority:
Major - P3
-
Affects Version/s: None
-
Component/s: Infrastructure, Tests
-
None
-
Python Drivers
-
Not Needed
-
-
None
-
None
-
None
-
None
-
None
-
None
Context
The pypy test job has been extremely flaky, due to the limited resources on the GitHub hosted runners, e.g. this job
FAILED test/asynchronous/test_client_bulk_write.py::TestClientBulkWriteCSOT::test_timeout_in_multi_batch_bulk_write - AssertionError: 1 != 2 = 1 failed, 4795 passed, 3376 skipped, 861 deselected, 128 xfailed, 47 warnings, 108 subtests passed in 1002.62s (0:16:42) =
We are already testing pypy with 12 tasks in Evergreen on PRs, and we have deprecated pypy support (PYTHON-6062), so removing this test would be a win for the team.
Definition of done
Remove the pypy GitHub build, perhaps selecting another test setup to run that is less flaky.
Pitfalls
We can't use GitHub secrets on pull requests, so we can't run the encryption tests or any other that require drivers test secrets.