-
Type: Improvement
-
Resolution: Done
-
Priority: Major - P3
-
None
-
Affects Version/s: None
-
Component/s: None
-
Labels:None
-
5
-
Storage Engines - 2022-11-14
Summary
WiredTiger performance tests can see a run-to-run variance up to 15% which makes performance regression difficult to measure. However in WT-8918 we identified a process to help manage this by:
- Running the test multiple (10) times,
- Dropping any outlier results (typically min and max from the 10 runs)
- Taking the average of the remaining results.
This drops variance to within roughly 0.8%.
This ticket will create a script we can run to perform the above steps for a single .wtperf test. On completion we should see reliable runs within 1% of each other.
- is related to
-
WT-8918 Investigate feasibility of reconfiguring assertion checking
- Closed