[SERVER-79258] resmoke --force-excluded-tests param does not work with fully_disabled_feature_flags.yml Created: 24/Jul/23  Updated: 16/Jan/24

Status: Backlog
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: Trevor Guidry Assignee: [DO NOT ASSIGN] Backlog - DevProd Correctness
Resolution: Unresolved Votes: 0
Labels: FY25Q1
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Related
is related to SERVER-77376 fully_disabled_feature_flags.yml does... Closed
Assigned Teams:
Correctness
Operating System: ALL
Participants:

 Description   

It looks like the changes from https://github.com/mongodb/mongo/commit/3b4b7fd820a59b794c739daa062ffac9b87d3496 made it so the tests which are tagged with fully disabled feature flags cannot be run by resmoke at all, even when they are explicitly named, and even when they are explicitly named and --force-excluded-tests is specified.

Original slack thread: https://mongodb.slack.com/archives/C0V79S1PY/p1689865913280029

 

relevant comments from Max:

It might be better to fix --force-excluded-tests because I think https://github.com/mongodb/mongo/commit/2dbc2a40b841eef00e2ad1b79e3f938bad889c58#diff-f2cf305d49623a1306c7130f462[…]5620a04ed9a241adbeacd1e944d15418 isn't written in a way where it can identify tests which were excluded via tags. And so anywhere the python code appends to config.EXCLUDE_WITH_ANY_TAGS means those tests can't be run without any direct indicationMy thought right now would be for suitesconfig.py to instead generate a Suite which removes all inclusions/exclusions and only lists roots from the test_files

 

Specifying the test_files in the include_files section in addition to the roots section would allow the include_files to take precedence over the tag exclusions. Maybe that's a way to achieve the idea I'm proposing?


Generated at Thu Feb 08 06:40:29 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.