Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-50290

Enforce stronger limits on task splitting

    XMLWordPrintable

Details

    • Improvement
    • Status: Closed
    • Major - P3
    • Resolution: Fixed
    • None
    • 4.4.1, 4.7.0
    • Testing Infrastructure
    • None
    • Fully Compatible
    • v4.4
    • DAG 2020-08-24

    Description

      We have found that splitting tasks too aggressively we can create a lot of extra work in setup and teardown of the tests, which causes us to split tasks even more, which leads to more setup and teardown. By limiting the number of sub-tasks we create, we can contain the growth of the setup/teardown overhead.

      In some exploration, it appears that a max split of 3 gives us similar makespans as we currently have, which minimizing the overhead of additional tasks.


      As a server engineer,
      I want tasks in my patch builds split optimally,
      So that I can minimize the amount of time I spend waiting for a patch build.


      AC:

      • All required builders set the max_sub_suites value to 3.
      • Non-required builders set the max_sub_suites value to 1.

      Attachments

        Activity

          People

            david.bradford@mongodb.com David Bradford (Inactive)
            david.bradford@mongodb.com David Bradford (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: