-
Type:
Task
-
Resolution: Fixed
-
Priority:
Minor - P4
-
Affects Version/s: None
-
Component/s: Testing Infrastructure
-
None
-
Fully Compatible
-
v9.0, v8.3, v8.0, v7.0
-
DevProd Test Infra 2026-11-03, DevProd Test Infra 2026-11-17
-
None
-
None
-
None
-
None
-
None
-
None
-
None
Summary
Add static, deterministic checks to the existing check_feature_flag_tags Evergreen task (SERVER-132548) that validate etc/backports_required_for_multiversion_tests.yml and the resmoke suite yamls. These checks are false-positive-free and run blocking pre-merge.
Background
~21% of Repl's recent test-only hot BFs failed on issues catchable via static analysis of jstests and yaml files. This covers the deterministic half (BF-44237, BF-44795).
Checks
- Verify every entry in etc/backports_required_for_multiversion_tests.yml is well formed. The expected shape is already codified in sort_backport_multiversion.py.
- Verify that no entry exists on the branch but not on master (a branch-only entry allows the test to run in the branch's multiversion matrix). Example failures: BF-44237, BF-44795.
- Verify that all yaml suites in buildscripts/resmokeconfig/suites/ are well formed.
Implementation notes
- The task script already computes the base-commit view of the tree to diff against, which the branch-vs-master comparison needs. The comparison is only meaningful for master-targeting patches; assume a master patch build.
- Run all checks together and aggregate failures rather than failing fast, so devs fix everything in one iteration.
Impact
Catches the BF-44237/BF-44795 failure class pre-merge with no false positives.
- is related to
-
SERVER-139455 Remove existence check in backports required for multiversion linter
-
- Closed
-
-
SERVER-139124 Optimize bazel_rules_mongo's get_diff_revision
-
- Backlog
-