Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-4441

Create a script to group tests into given number of buckets based on runtime

    • Type: Icon: Task Task
    • Resolution: Won't Fix
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Python tests
    • Labels:
      None

      This ticket was triggered by the need of splitting 'unit-test' task to reduce Evergreen test runtime (WT-4410). In order to effectively group tests into multiple buckets (or Evergreen task) with similar amount of runtime, we need a script to run and evaluate the runtime of each test, calculate the expected runtime of each bucket based on given number of buckets, and fit tests into those buckets to achieve an evenly distributed result in terms of bucket/task runtime. 

      We can periodically run the script (e.g. once a new Python test is added) to rebalance the tests across buckets/tasks. 

      We should also consider making the script as generic as possible so that it could be reused to split tests for other Evergreen tasks. 

            Assignee:
            backlog-server-storage-engines [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            luke.chen@mongodb.com Luke Chen
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: