Summary

• Implement Driver Performance Benchmarking specification
• Port tests to Evergreen

Motivation

As of Q2 2023, MongoDB Product and Engineering leadership is placing increasing priority upon improving end-to-end performance within drivers. The Driver Benchmarking spec provides an internal set of benchmarking standards already implemented by many drivers. By implementing these tests and including them in our Evergreen suite, we will be able to meaningfully track C# driver performance over time, catching performance regressions and improvements in new builds. Further, because other drivers have adopted these tests, we will have some comparison benchmarks available (most comparable will be Java).

Who is the affected end user?

DBX Engineers, PMs, business stakeholders

How does this affect the end user?

no direct impacts, however monitoring performance will allow us to ship fewer performance regressions and better identify performance improvements.

How likely is it that this problem or use case will occur?

We will need to adopt some solution for benchmarking in order to measure and report progress.

Is this issue urgent?

Ideally, in Q3FY2024

Is this ticket required by a downstream team?

Not at the moment.

Is this ticket only for tests?

Yes.

Acceptance Criteria

• Drivers Benchmarking Spec implemented
• Tests deployed on Evergreen and monitored with alerting in all builds.