ExportXMLWordPrintableJSON

    • Fully Compatible
    • v9.0, v8.3, v8.0, v7.0
    • DevProd Test Infra 2026-11-03, DevProd Test Infra 2026-11-17
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Summary

      Add static, deterministic checks to the existing check_feature_flag_tags Evergreen task (SERVER-132548) that validate etc/backports_required_for_multiversion_tests.yml and the resmoke suite yamls. These checks are false-positive-free and run blocking pre-merge.

      Background

      ~21% of Repl's recent test-only hot BFs failed on issues catchable via static analysis of jstests and yaml files. This covers the deterministic half (BF-44237, BF-44795).

      Checks

      • Verify every entry in etc/backports_required_for_multiversion_tests.yml is well formed. The expected shape is already codified in sort_backport_multiversion.py.
      • Verify that no entry exists on the branch but not on master (a branch-only entry allows the test to run in the branch's multiversion matrix). Example failures: BF-44237, BF-44795.
      • Verify that all yaml suites in buildscripts/resmokeconfig/suites/ are well formed.

      Implementation notes

      • The task script already computes the base-commit view of the tree to diff against, which the branch-vs-master comparison needs. The comparison is only meaningful for master-targeting patches; assume a master patch build.
      • Run all checks together and aggregate failures rather than failing fast, so devs fix everything in one iteration.

      Impact

      Catches the BF-44237/BF-44795 failure class pre-merge with no false positives.

            Assignee:
            Sean Lyons
            Reporter:
            Steve McClure
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: