[CDRIVER-4101] Add a workflow to skip known flaky-tests / failing-on-waterfall tests Created: 22/Jul/21  Updated: 28/Oct/23  Resolved: 08/Apr/22

Status: Closed
Project: C Driver
Component/s: None
Affects Version/s: None
Fix Version/s: 1.22.0, 1.22.0-beta0

Type: Task Priority: Unknown
Reporter: Kevin Albertson Assignee: Roberto Sanchez
Resolution: Fixed Votes: 0
Labels: failing-on-waterfall
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Epic Link: Stabilize Evergreen

 Description   

Motivation & Background

There are multiple tests failing on the Evergreen waterfall, labeled under:

  • failing-on-waterfall
  • flaky-tests

When these are determined not to require an immediate fix, this causes two problems:

  1. The failures reduce the number of tests run on Evergreen. Non-Windows tasks in Evergreen run test-libmongoc with the --no-fork options. They abort on the first test failure.
  2. It slow downs the development process. Authors and reviewers need to inspect logs on Evergreen patches to determine whether their changes have introduced new failures.

Scope

  • Investigate and decide how to skip individual tests in test-libmongoc.
  • Add a workflow for opting in to skip individual tests run on Evergreen.


 Comments   
Comment by Githook User [ 08/Apr/22 ]

Author:

{'name': 'Roberto C. Sánchez', 'email': 'roberto@connexer.com', 'username': 'rcsanchez97'}

Message: CDRIVER-4101 failing/flaky test skip feature (#961)

  • implement --skip-tests option for test runner
  • populate initial lists of failing and flaky tests
  • additional failing and flaky tests to skip

Co-authored-by: Ezra Chung <88335979+eramongodb@users.noreply.github.com>
Co-authored-by: Kevin Albertson <kevin.albertson@10gen.com>
Branch: master
https://github.com/mongodb/mongo-c-driver/commit/c6a69cd8c4f2ff84f94e769e44937ec06159e31f

Generated at Wed Feb 07 21:19:56 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.