Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-11858

Reduce runtime of Python tests on Windows for PR testing

    • Type: Icon: Improvement Improvement
    • Resolution: Unresolved
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Test Python
    • 5
    • StorEng - Refinement Pipeline

      We try to keep the maximum runtime of PR tests to approximately 25 minutes, and recently with unit-test-bucket* tests on Windows have crept up to 35 minutes. This is due to two reasons:

      1. When we add new tests the bucketing process moves tests from one bucket to another. Through bad luck this can lead to one bucket having a lot of long running tests and another having only short tests. There's no good way to predict the impact of adding a new python test on PR test runtimes
      2. Our python tests can't be run in parallel on Windows. We implement concurrency using the third part tool concurrencytest, however this uses os.fork() which only works on Unix platforms

      This ticket is twofold - Firstly to get PR test times down under 25 minutes again, and secondly to identify long term fixes for this issue.

            Assignee:
            backlog-server-storage-engines [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            andrew.morton@mongodb.com Andrew Morton
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated: