[SERVER-29061] Add buildscripts/promote_silent_failures.py script to convert silent test failures into non-silent test failures Created: 04/May/17 Updated: 30/Oct/23 Resolved: 30/May/17 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Testing Infrastructure |
| Affects Version/s: | None |
| Fix Version/s: | 3.5.9 |
| Type: | New Feature | Priority: | Major - P3 |
| Reporter: | Max Hirschhorn | Assignee: | Eddie Louie |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||
| Backwards Compatibility: | Fully Compatible | ||||||||
| Sprint: | TIG 2017-05-29, TIG 2017-06-19 | ||||||||
| Participants: | |||||||||
| Description |
|
The buildscripts/promote_silent_failures.py script takes
and writes a report.json file to the specified location. Note: This is effectively how the command line parsing for the buildscripts/combine_reports.py script works with the exception that the buildscripts/promote_silent_failures.py script should only accept a single report.json file and error if multiple are specified. For any test files that for at least 2 executions in the report.json file have a "silentfail" status, the buildscripts/promote_silent_failures.py script should change the outputted report to have a "fail" status instead. Note: The TestReport.from_dict() class method should be used to construct the TestReport instance corresponding to the specified report.json file to avoid manipulating the Python dict structure directly after parsing the JSON file. |
| Comments |
| Comment by Githook User [ 30/May/17 ] |
|
Author: {u'username': u'elouie99', u'name': u'Eddie Louie', u'email': u'eddie.louie@mongodb.com'}Message: |
| Comment by Eddie Louie [ 25/May/17 ] |
|
Code review: https://mongodbcr.appspot.com/125900001 |