-
Type:
Improvement
-
Resolution: Unresolved
-
Priority:
Major - P3
-
None
-
Affects Version/s: None
-
Component/s: None
-
None
-
DevProd Correctness
-
None
-
None
-
None
-
None
-
None
-
None
-
None
When a task is made significantly quicker, any patch based on an older commit can frequently timeout. The timeout calculation always uses the latest runtimes.
It is a simple workaround to rebase/merge the latest changes.
For example, unittest_shell_hang_analyzer was significantly sped up by https://github.com/10gen/mongo/commit/640931caeab20de94945e8ce9fabb1bbaedfacd5#diff-0a36fcfdb73c149a6bfd9ca02c3d7d35493172639e211637fb1081accd1f192aL194-L199. Circa a week after this change, the calculated idle timeout dropped from 960 seconds to 300 seconds, lower than the typical runtime of the jstest in the task prior to the change. Patches with base commits prior to this change were almost guaranteed to fail:
Metrics on this task's times: https://ui.honeycomb.io/mongodb-4b/environments/production/datasets/evergreen-agent/result/b15a5fcDA91?vs=hideCompare&cs_0=omitMissingValues&cs_1=omitMissingValues
