As a DAG engineer, I'd like to add the following command to evergreen, such that, we have a simple method for transmitting performance data to expanded metrics w/o using cedar.
User facing syntax (very similar to json.send, but with an expected schema):
This command stores performance data for this task and notifies our performance monitoring systems of the update.
file: the JSON-formatted performance data file to save to Evergreen's DB and notify performance monitoring systems of.
The schema for this file is the following:
Evergreen should perform the following in order to execute this command:
1. Validate the schema of the reported data. Fail the command if the data is not formatted correctly.
2. Create a new document with metadata from evergreen:
3. Store this in the same place as json.send, under the "performance-data" key/name. This should make this data available through the json history routes for our performance monitoring service to consume. Fail the command if unable to store the data.
4. Notify signal processing service of the update:
The credentials for making requests to SPS are already provided in Cedar. DO NOT FAIL THE COMMAND IF THIS CALL FAILS. This should generate a warning perhaps, but our service will consider the data for this run on the subsequent run. As long as evergreen has stored the data, we are good.
This is more or less the same thing json.send currently does, but with less flexibility, and an extra call to performance monitoring service. We can probably reuse code from json.send and cedar to accomplish the above without much work needed.