[SERVER-30828] Tests that don't appear in the reliable period report should be considered reliable Created: 25/Aug/17  Updated: 30/Oct/23  Resolved: 06/Oct/17

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 3.6.0-rc0

Type: Bug Priority: Major - P3
Reporter: Yves Duhem Assignee: Yves Duhem
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Backwards Compatibility: Fully Compatible
Operating System: ALL
Sprint: TIG 2017-10-23
Participants:

 Description   

When updating the test lifecycle tags, we only go through the tests present in the report for the reliable period to find tests combination to mark as reliable.
This means that a test that has a failure rate above the threshold for the unreliable period can be marked as unreliable even though it has not run at all during the reliable period.



 Comments   
Comment by Githook User [ 06/Oct/17 ]

Author:

{'email': 'yves.duhem@mongodb.com', 'name': 'Yves Duhem', 'username': 'syev'}

Message: SERVER-30828 Untag unreliable tests that are not running
Branch: master
https://github.com/mongodb/mongo/commit/0875727af8e43230497e9e88222d53020ee9cdf6

Generated at Thu Feb 08 04:25:09 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.