Currently, there can be confusion when identifying performance degradations, since in the changepoint tool it can be unclear which change points represent regressions and which represent improvements. We should think about how to improve this system to avoid misinterpretation.

A very basic idea would be to add labels such as “less is better” or “more is better” for all measurements, but I’m sure there are other possible solutions to this problem as well.