[SERVER-33853] Define a new test tag to temporarily disable a test Created: 13/Mar/18  Updated: 29/Oct/23  Resolved: 03/Oct/18

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 4.1.4

Type: Improvement Priority: Major - P3
Reporter: Yves Duhem Assignee: Jonathan Abrahams
Resolution: Fixed Votes: 0
Labels: tig-qwin-eligible
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Duplicate
is duplicated by SERVER-55206 Consider adding a tag to disable an i... Closed
Backwards Compatibility: Fully Compatible
Sprint: DAG 2018-10-08
Participants:
Story Points: 1

 Description   

When engineers need to temporarily disable a JavaScript test, they have to update the YAML file for each suite the test runs under and explicitly blacklist it.

We should define a new tag (e.g. "temporarily_disabled") that can be added to a test to quickly prevent it from running in all suites.

The new tag exclusion could be specified in all the suites configuration files (and the tag would be no different than any other tag) or could be implemented in resmoke.



 Comments   
Comment by Githook User [ 03/Oct/18 ]

Author:

{'name': 'Jonathan Abrahams', 'email': 'jonathan@mongodb.com', 'username': 'hptabster'}

Message: SERVER-33853 Define a new test tag, test_disabled, to temporarily disable a test
Branch: master
https://github.com/mongodb/mongo/commit/b665d7a575ca08c6d6157f35f2d4bb6bf38a8388

Comment by Jonathan Abrahams [ 28/Sep/18 ]

I think we should name the tag something more obvious that it's meant for internal usage, i.e., __TEMPORARILY_DISABLED__.

Comment by Max Hirschhorn [ 05/Jul/18 ]

We'll do this in etc/evergreen.yml using --excludeWithAnyTags=temporarily_disabled_in_evergreen (or similar tag name). Server engineer can update a local bash alias for resmoke.py if they want to run resmoke.py with the same effect.

Comment by Max Hirschhorn [ 13/Mar/18 ]

ian.whalen, is there a process we could define on the PM side to audit whatever tests are tagged with the "temporarily_disabled" tag as we near the release deadline?

Generated at Thu Feb 08 04:34:46 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.