Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-11135

Create and implement a new code coverage per minute metric

    • Type: Icon: Improvement Improvement
    • Resolution: Fixed
    • Priority: Icon: Major - P3 Major - P3
    • WT11.2.0, 7.1.0-rc0
    • Affects Version/s: None
    • Component/s: None
    • Labels:
      None
    • 2
    • StorEng - 2023-06-13

      This ticket is step 2 of the Mini-plan: Moving the needle for code coverage & complexity metrics.

      This ticket will create and implement a new metric: “code coverage per minute”:

      • This would be a measure of efficiency for a code coverage task. More coverage per unit time is better. The main purpose is to guide a search for high efficiency code coverage testing, especially as a metric to ‘game’ in a competition
      • This would be calculated using the time to run the actual code coverage tests only within the coverage task (ie excluding any setup, compile, results publish step etc).
      • Implement the calculation and reporting of the value of this metric in every code coverage task in Evergreen

      The goal is to get better ‘bang for the buck’ in coverage tests, as well as improved tests.

            Assignee:
            jeremy.thorp@mongodb.com Jeremy Thorp
            Reporter:
            jeremy.thorp@mongodb.com Jeremy Thorp
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: