Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-53058

Better account of CleanEveryN runtime when setting dynamic timeouts

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.9.0, 4.4.3
    • Component/s: Testing Infrastructure
    • Labels:
      None
    • Backwards Compatibility:
      Fully Compatible
    • Operating System:
      ALL
    • Backport Requested:
      v4.4
    • Sprint:
      DAG 2020-12-14
    • Linked BF Score:
      50
    • Story Points:
      3

      Description

      When setting dynamic timeouts, we look at the historic runtime of a test/task. The runtime of any hooks that are run will be included with the test they are associated with. This works pretty well, except for the "CleanEveryN' hook which is run every Nth test (usually 20). The problem with this hook is that it has a relatively large runtime and it can be associated with different tests on different runs. This sometimes results in sub-suites containing tests with no "CleanEveryN" runtimes associated with them that will suddenly start having "CleanEveryN" run. And it quickly eats up the padding we put in place for timeouts.

      We need to be smarter about how we include the "CleanEveryN" runtimes when determining timeouts to avoid this problem.

        Attachments

          Activity

            People

            Assignee:
            david.bradford David Bradford
            Reporter:
            david.bradford David Bradford
            Participants:
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: