[SERVER-62180] Enable signal processing (or red/green) checks for Google Microbenchmark Created: 19/Dec/21  Updated: 29/Oct/23  Resolved: 20/Jan/22

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 5.3.0

Type: Task Priority: Blocker - P1
Reporter: Cristopher Stauffer Assignee: Mikhail Shchatko
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Related
related to SERVER-65385 Disable threshold checks for Google M... Closed
related to SERVER-65986 Disable threshold checks for highly v... Closed
Backwards Compatibility: Fully Compatible
Sprint: STM 2022-01-24
Participants:
Story Points: 2

 Description   

Tasks: https://evergreen.mongodb.com/waterfall/mongodb-mongo-master?task_filter=benchmark

Context

As a database contributor

when I run a patch build containing Google Microbenchmarks

Then I expect to see red/green results(or async signal processed BFs), as a way to alert me to performance regressions

AC

  • Ensure signal processing is running in google benchmarks
  • Check historical values for google benchmarks through the evergreen API of the base commit 
  • Make the threshold configurable in a yaml file in google benchmarks
    • we'll use 20% for this use case, meaning if the task is 20% worse for Latency (since google benchmarks only reports latency) than the baseline commit then the task will be marked failed (red)
    • The key in the yaml file should be the key for the metric in the json perf output


 Comments   
Comment by Githook User [ 20/Jan/22 ]

Author:

{'name': 'Mikhail Shchatko', 'email': 'mikhail.shchatko@mongodb.com', 'username': 'MikhailShchatko'}

Message: SERVER-62180 Enable signal processing (or red/green) checks for Google Microbenchmark
Branch: master
https://github.com/mongodb/mongo/commit/971f88711eb859c308be510ddf48d10066c3ea62

Generated at Thu Feb 08 05:54:24 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.