-
Type: Bug
-
Resolution: Unresolved
-
Priority: Major - P3
-
None
-
Affects Version/s: None
-
Component/s: None
-
None
-
Correctness
-
ALL
Tests that need to be ignored on multiversion suites until a ticket is backported have to be added to backports_required_for_multiversion_tests.yml, the generate_multiversion_exclude_tags.py script will then process this file and compare it with the `old-lts` version of the same file, to check if the test has been backported or not.
If a test gets renamed only on the newer branch these files will get out of sync, and generate_multiversion_exclude_tags.py will always think the ticket was not backported, so the test will not be run in the multiversion suites, losing test coverage.
This is what happened when we renamed many tests in SERVER-64473, for instance this line from master and this line from v6.0 don't match, so the test will not be run.
New backports could also face the same problem, one workaround is to add both filenames to the old branch like this, but this is easy to miss. Another option is to backport SERVER-64473, so that the directory structure is the same on all branches.
- is related to
-
SERVER-64473 Take a stab at splitting up the jscore suite
- Closed