Currently only the analysis phase of our tests will turn an evergreen box red. Failures during the test themselves turn the evergreen box purple. Those purple boxes should be red. Failures during provisioning and mongo setup should remain purple.

https://github.com/mongodb/mongo/blob/master/etc/perf.yml