Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-73708

Filter out excluded tests when calculating evergreen timeouts

    XMLWordPrintableJSON

Details

    • Icon: Bug Bug
    • Resolution: Fixed
    • Icon: Major - P3 Major - P3
    • 7.1.0-rc0
    • None
    • None
    • None
    • Fully Compatible
    • ALL
    • DAG 2023-04-17
    • 0

    Description

      We are using test_flags build variant expansion to exclude tests from running on specific variants, e.g. https://github.com/mongodb/mongo/blob/713c60157fea0cab9da39ff90a8d0a8eb6583a1b/etc/evergreen.yml#L931-L934

      Those tests are perfectly excluded from running in resmoke suite. However when we are calculating the evergreen timeout, the list of tests that we get there contains those tests
      https://github.com/mongodb/mongo/blob/713c60157fea0cab9da39ff90a8d0a8eb6583a1b/buildscripts/timeouts/timeout_service.py#L56

      Since the test is excluded from running there will be no historic runtime data for such test. It makes evergreen timeout calculation think that we are missing historic data and avoid task timeout calculation.

      AC:

      • Accomodate test exclusion during evergreen timeout calculation.
        We are instantiating resmoke proxy here. Maybe we can pass in resmoke test exclusion flags there, so the test discovery will be working the same way as it works during the resmoke suite run.
      • Verify and if possible remove default timeouts for replica_sets_jscore_passthrough task from evergreen_timeouts.yml
      • File a new ticket where we list the tests to exclude

       

      Timebox: 2 days

      Attachments

        Activity

          People

            mikhail.shchatko@mongodb.com Mikhail Shchatko
            mikhail.shchatko@mongodb.com Mikhail Shchatko
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: