Recently I noticed that the config for mongosync's 2 fle2 suites had exclude_files entries referring to files that simply no longer existed in the commit of the mongo repo we use. While resmoke does some validation of the contents of these YAML files, there is more it could do.

Acceptance Criteria

• Resmoke should validate all YAML files that it processes resmokeconfig/suites. For the elements under the selector key, it should do the following checks:
  • For roots, ensure that these paths (with globs expanded) match at least one file.
  • For exclude_files, ensure that these paths (with globs expanded) match at least one file.
  • For exclude_with_any_tags, ensure that this tag exists in at least one test file.
  • Are there any other keys that can be under selector? If so, those should be tested too.