Individual Benchmark Failures Don't Fail Benchmark Runner

XMLWordPrintableJSON

    • None
    • Dotnet Drivers
    • None
    • None
    • None
    • None
    • None
    • None

      When benchmarks fail during execution, the BenchmarkDotNet runner continues and exits with code 0 (success), even when:

      1. Individual benchmarks throw exceptions during execution
      2. Exporter plugins (LocalExporter, EvergreenExporter) crash with exceptions
      3. The evergreen-results.json file is not generated

      We need to find a way to improve this so that benchmarks don't fail silently.

            Assignee:
            Unassigned
            Reporter:
            Adelin Mbida Owona
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: