-
Type:
Improvement
-
Resolution: Unresolved
-
Priority:
Unknown
-
None
-
Affects Version/s: None
-
Component/s: Performance Benchmarking
Use Case
As a... driver engineer
I want... to add a metadata field to the BenchmarkModule type in the driver's new benchmark runner
So that... we can set the improvement direction for each benchmark on a case-by-case basis
User Experience
- None
Dependencies
- None
Risks/Unknowns
- N/A
Acceptance Criteria
Implementation Requirements
- Add a required metadata field to the BenchmarkModule type with an improvement_direction: 'up' | 'down' property
- Update all benchmarks to export their metadata
- Update runner.mts to correctly handle the metadata
Testing Requirements
- Manually verify that the perf.send document contains the appropriate metadata
Documentation Requirements
- N/A
Follow Up Requirements
- None