Standardized Performance Testing of ODMs and Integrations

XMLWordPrintableJSON

    • Not Needed
    • Hide

      Summary of necessary driver changes
      Implement a benchmarking test suite in accordance with the specification for each ODM we support.

      •  

      Commits for syncing spec/prose tests
      (and/or refer to an existing language POC if needed)
      https://github.com/mongodb/specifications/commit/a23e8363c06c766477daf85869d0c0909cf21290

      •  

      Context for other referenced/linked tickets

      •  
      Show
      Summary of necessary driver changes Implement a benchmarking test suite in accordance with the specification for each ODM we support.   Commits for syncing spec/prose tests (and/or refer to an existing language POC if needed) https://github.com/mongodb/specifications/commit/a23e8363c06c766477daf85869d0c0909cf21290   Context for other referenced/linked tickets  

      As a performance testing framework has already been established for the MongoDB Drivers, a subset of these tests can potentially be reused for evaluating ODMs such as Mongoose or Mongoid.

      Each library would need to be evaluated independently though and additional criteria added that can be used to measure library-specific functionality. For example with Mongoid we would want to take basic CRUD benchmarks and layer on measurements for validations, callbacks, and relations.

      The testing criteria would be documented in a human readable form (such as either a docs page or a markdown file), and once benchmarks have been developed we would run these against each new notable release of the client library. Providing well documented benchmarks will hopefully also encourage the developer community to contribute additional tests to further improve coverage.

            Assignee:
            Noah Stapp
            Reporter:
            Alex Bevilacqua
            Jib Adegunloye Jib Adegunloye
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated: