-
Type: Improvement
-
Resolution: Unresolved
-
Priority: Major - P3
-
None
-
Affects Version/s: None
-
Component/s: None
-
Labels:None
In the Jenkins performance tests a "stability check" is performed for each test to ensure that performance has not degraded compared to the last 3/20/100 runs. When there is a regression Jenkins will set the job to unstable and send an email.
This check was not ported as part of PM-1707, and needs to be done separately. Most likely as a separate job to the performance tests which only compares the current results to historical data on the develop branch.
Definition of Done:
New evergreen jobs are added that fail when the most recent WT performance statistics deviate from the prior values on the develop branch.