-
Type: Improvement
-
Resolution: Fixed
-
Priority: Major - P3
-
Affects Version/s: None
-
Component/s: None
-
None
-
Query Execution
-
Fully Compatible
This is zixuan.zhuang@mongodb.com's skunkworks in 2024.
Improves benchrun.py to includes median and stdev for each test result, allows users to provide a variant name and list of variant values and comparing the perf with different variants.