The feature flag-guarding policy states that feature flags should be enabled in the ~ Shared Library Enterprise RHEL 6.2 (disabled feature flags) variant and that tests for flag-guarded features should be tagged with the feature flag name. However, we don't have a mechanism for only running tests for flag-guarded features in the disabled feature flags variant. Current options include excluding those tags from all other variants (which requires too much copy-paste) or creating separate suites that only run in the disabled feature flags variant (which doesn't play well with passthroughs). Additionally, both of these solutions require significant changes to evergreen.yml when the feature flag is enabled.
We should provide an easy and standard way for making sure that tests for flag-guarded features only run in variants in which they are enabled.