-
Type: New Feature
-
Resolution: Fixed
-
Priority: Major - P3
-
Affects Version/s: None
-
Component/s: Testing Infrastructure
-
None
-
Fully Compatible
-
TIG 2017-05-29, TIG 2017-06-19
The buildscripts/promote_silent_failures.py script takes
- the path to a single report.json file as a command line argument, as well as
- optionally a path to an output filename via a --output-file command line argument (defaults to stdout)
and writes a report.json file to the specified location.
Note: This is effectively how the command line parsing for the buildscripts/combine_reports.py script works with the exception that the buildscripts/promote_silent_failures.py script should only accept a single report.json file and error if multiple are specified.
For any test files that for at least 2 executions in the report.json file have a "silentfail" status, the buildscripts/promote_silent_failures.py script should change the outputted report to have a "fail" status instead.
Note: The TestReport.from_dict() class method should be used to construct the TestReport instance corresponding to the specified report.json file to avoid manipulating the Python dict structure directly after parsing the JSON file.
- is depended on by
-
SERVER-29062 Add support for silencing test failures in the mainline from specific tests
- Closed