[SERVER-33853] Define a new test tag to temporarily disable a test Created: 13/Mar/18 Updated: 29/Oct/23 Resolved: 03/Oct/18 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Testing Infrastructure |
| Affects Version/s: | None |
| Fix Version/s: | 4.1.4 |
| Type: | Improvement | Priority: | Major - P3 |
| Reporter: | Yves Duhem | Assignee: | Jonathan Abrahams |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | tig-qwin-eligible | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||
| Backwards Compatibility: | Fully Compatible | ||||||||
| Sprint: | DAG 2018-10-08 | ||||||||
| Participants: | |||||||||
| Story Points: | 1 | ||||||||
| Description |
|
When engineers need to temporarily disable a JavaScript test, they have to update the YAML file for each suite the test runs under and explicitly blacklist it. We should define a new tag (e.g. "temporarily_disabled") that can be added to a test to quickly prevent it from running in all suites. The new tag exclusion could be specified in all the suites configuration files (and the tag would be no different than any other tag) or could be implemented in resmoke. |
| Comments |
| Comment by Githook User [ 03/Oct/18 ] |
|
Author: {'name': 'Jonathan Abrahams', 'email': 'jonathan@mongodb.com', 'username': 'hptabster'}Message: |
| Comment by Jonathan Abrahams [ 28/Sep/18 ] |
|
I think we should name the tag something more obvious that it's meant for internal usage, i.e., __TEMPORARILY_DISABLED__. |
| Comment by Max Hirschhorn [ 05/Jul/18 ] |
|
We'll do this in etc/evergreen.yml using --excludeWithAnyTags=temporarily_disabled_in_evergreen (or similar tag name). Server engineer can update a local bash alias for resmoke.py if they want to run resmoke.py with the same effect. |
| Comment by Max Hirschhorn [ 13/Mar/18 ] |
|
ian.whalen, is there a process we could define on the PM side to audit whatever tests are tagged with the "temporarily_disabled" tag as we near the release deadline? |