[SERVER-82266] create script to extract engflow build metrics Created: 17/Oct/23  Updated: 18/Jan/24

Status: Open
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: New Feature Priority: Major - P3
Reporter: Daniel Moody Assignee: Daniel Moody
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Related
related to SERVER-80309 Design a mechanism to collect perform... Backlog
Participants:

 Description   

Engflow has metrics for remote execution, we need a script which can extract this data.

Talking with engflow, they have[ a grpc API|https://github.com/EngFlow/engflowapis] (example java client) they expose for collecting build events. This is not ideal as we would need to write and maintain a build event collection service ourselves, store the data somewhere, and then finally write something to extract the data into the build metrics and developer workflow metrics tools. If this is the case we may need to break this ticket down into smaller chunks for creation of such system.

 
Engflow has an analytics page which appears it would require collecting and storing the build events, so hopefully there is a way to access that data instead of writing our own thing.



 Comments   
Comment by Daniel Moody [ 18/Oct/23 ]

Their metrics page does look good, but we don't have the raw data for machine processing. I was under the assumption we wanted all the data in one common location.

Comment by Alex Neben [ 18/Oct/23 ]

Do you think their metrics page will be good enough for us or do you think we will have to make our "own thing"?

Generated at Thu Feb 08 06:48:44 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.