-
Type:
Improvement
-
Resolution: Unresolved
-
Priority:
Minor - P4
-
None
-
Affects Version/s: None
-
Component/s: Testing Infrastructure
-
None
-
DevProd Correctness
-
None
-
3
-
None
-
None
-
None
-
None
-
None
-
None
-
None
At least for jstests, there is huge variance in test runtimes which often results in the longest running test of a suite extending the entire task by minutes, even for "reasonable" long running tests.
In mongo-task-generator create suites, the tests are already in sorted order by runtime.
One caution is we don't want to lose the benefit of shuffling tests as a mechanism for flushing out flaky tests.