[SERVER-29060] Add etc/test_retrial.yml resmoke.py tag file Created: 04/May/17  Updated: 30/Oct/23  Resolved: 30/May/17

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 3.5.9

Type: Task Priority: Major - P3
Reporter: Max Hirschhorn Assignee: Eddie Louie
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
is depended on by SERVER-29062 Add support for silencing test failur... Closed
Backwards Compatibility: Fully Compatible
Sprint: TIG 2017-05-29, TIG 2017-06-19
Participants:

 Description   

Similar to the etc/test_lifecycle.yml tag file from SERVER-28440, an etc/test_retrial.yml tag file should be added for marking tests with a "retry_on_failure*" tag. Since a human is intended to edit the etc/test_retrial.yml, there should be a header comment that explains how to be specific in indicating that

  • the test sometimes fails in any task on any build variant with any distro,
  • the test sometimes fails in a specific task on any build variant with any distro,
  • the test sometimes fails in a specific task on a specific build variant with any distro, or
  • the test sometimes fails in a specific task on a specific build variant with a specific distro.

by giving examples of the

  • retry_on_failure,
  • retry_on_failure|${task_name},
  • retry_on_failure|${task_name}|${build_variant}, and
  • retry_on_failure|${task_name}|${build_variant}|${distro_id} tags, respectively.

Additionally, there should be a warning that making it possible to ignore the test failures increases the risk we won't (or will take longer to) discover a bug and that therefore tests should be tagged judiciously.



 Comments   
Comment by Githook User [ 30/May/17 ]

Author:

{u'username': u'elouie99', u'name': u'Eddie Louie', u'email': u'eddie.louie@mongodb.com'}

Message: SERVER-29060 Add etc/test_retrial.yml resmoke.py tag file
Branch: master
https://github.com/mongodb/mongo/commit/7a5e180130dd464a9d74bef1442e3a767f9dfbdc

Comment by Eddie Louie [ 26/May/17 ]

Code review: https://mongodbcr.appspot.com/129720002

Generated at Thu Feb 08 04:19:48 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.