Add new resmoke hook to check result of a benchmark

XMLWordPrintableJSON

    • Type: New Feature
    • Resolution: Done
    • Priority: Major - P3
    • 8.0.0-rc0
    • Affects Version/s: None
    • Component/s: None
    • None
    • DevProd Last Mile
    • Fully Compatible
    • None
    • 3
    • None
    • None
    • None
    • None
    • None
    • None

      Currently, there doesn't exist a great way for us to "fail" a test due to the results of a Google benchmark. Today, we just run the benchmarks and then send the data up into Cedar to be tracked as a regular performance result.

      We want a way to be able to set a threshold limit on the result of a Google benchmark test. If the benchmark reports a result for a metric that is above one of the thresholds we set, the test should fail and that result should be reported to the engineer that ran the test. 

            Assignee:
            Jeffrey Zambory
            Reporter:
            Jeffrey Zambory
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: