Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-50290

Enforce stronger limits on task splitting

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.4.1, 4.7.0
    • Component/s: Testing Infrastructure
    • Labels:
      None
    • Backwards Compatibility:
      Fully Compatible
    • Backport Requested:
      v4.4
    • Sprint:
      DAG 2020-08-24

      Description

      We have found that splitting tasks too aggressively we can create a lot of extra work in setup and teardown of the tests, which causes us to split tasks even more, which leads to more setup and teardown. By limiting the number of sub-tasks we create, we can contain the growth of the setup/teardown overhead.

      In some exploration, it appears that a max split of 3 gives us similar makespans as we currently have, which minimizing the overhead of additional tasks.


      As a server engineer,
      I want tasks in my patch builds split optimally,
      So that I can minimize the amount of time I spend waiting for a patch build.


      AC:

      • All required builders set the max_sub_suites value to 3.
      • Non-required builders set the max_sub_suites value to 1.

        Attachments

          Activity

            People

            Assignee:
            david.bradford David Bradford
            Reporter:
            david.bradford David Bradford
            Participants:
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: