As a performance testing framework has already been established for the MongoDB Drivers, a subset of these tests can potentially be reused for evaluating ODMs such as Mongoose or Mongoid.

Each library would need to be evaluated independently though and additional criteria added that can be used to measure library-specific functionality. For example with Mongoid we would want to take basic CRUD benchmarks and layer on measurements for validations, callbacks, and relations.

The testing criteria would be documented in a human readable form (such as either a docs page or a markdown file), and once benchmarks have been developed we would run these against each new notable release of the client library. Providing well documented benchmarks will hopefully also encourage the developer community to contribute additional tests to further improve coverage.