-
Type: Bug
-
Resolution: Fixed
-
Priority: Major - P3
-
Affects Version/s: None
-
Component/s: None
-
None
-
Fully Compatible
-
ALL
-
DAG 2023-04-17
-
0
We are using test_flags build variant expansion to exclude tests from running on specific variants, e.g. https://github.com/mongodb/mongo/blob/713c60157fea0cab9da39ff90a8d0a8eb6583a1b/etc/evergreen.yml#L931-L934
Those tests are perfectly excluded from running in resmoke suite. However when we are calculating the evergreen timeout, the list of tests that we get there contains those tests
https://github.com/mongodb/mongo/blob/713c60157fea0cab9da39ff90a8d0a8eb6583a1b/buildscripts/timeouts/timeout_service.py#L56
Since the test is excluded from running there will be no historic runtime data for such test. It makes evergreen timeout calculation think that we are missing historic data and avoid task timeout calculation.
AC:
- Accomodate test exclusion during evergreen timeout calculation.
We are instantiating resmoke proxy here. Maybe we can pass in resmoke test exclusion flags there, so the test discovery will be working the same way as it works during the resmoke suite run. - Verify and if possible remove default timeouts for replica_sets_jscore_passthrough task from evergreen_timeouts.yml
- File a new ticket where we list the tests to exclude
Timebox: 2 days