-
Type:
Build Failure
-
Resolution: Unresolved
-
Priority:
Unknown
-
None
-
Affects Version/s: None
-
Component/s: Performance Benchmarking
-
None
-
Dotnet Drivers
-
None
-
None
-
None
-
None
-
None
-
None
When benchmarks fail during execution, the BenchmarkDotNet runner continues and exits with code 0 (success), even when:
1. Individual benchmarks throw exceptions during execution
2. Exporter plugins (LocalExporter, EvergreenExporter) crash with exceptions
3. The evergreen-results.json file is not generated
We need to find a way to improve this so that benchmarks don't fail silently.