Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-28783

Add buildscripts/combine_reports.py script for combining report.json files

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major - P3
    • Resolution: Fixed
    • None
    • 3.5.7
    • Testing Infrastructure
    • None
    • Fully Compatible
    • TIG 2017-05-08

    Description

      The buildscripts/combine_reports.py script takes the paths to at least one report.json file as command line arguments and writes a combined report.json file to its stdout. The order of test executions within each report.json file should be preserved and the merged order should follow the order in which the report.json files were specified on the command line.

      Since a JS test isn't consider unreliable if one of the dynamic tests (i.e. a resmoke.py hook) fails after the test runs, the combine_reports.py script should exit with a non-zero return code even if a dynamic test has the "silentfail" status.

      • (0) All tests have status "pass", or only non-dynamic tests have status "silentfail".
      • (32) At least one dynamic test has status "silentfail", but no tests have status "fail" or "timeout".
      • (31) At least one test has status "fail" or "timeout".

      Note: A test can be considered dynamic if its name contains a ":" character.

      Attachments

        Issue Links

          Activity

            People

              jonathan.abrahams Jonathan Abrahams
              max.hirschhorn@mongodb.com Max Hirschhorn
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: