[SERVER-29061] Add buildscripts/promote_silent_failures.py script to convert silent test failures into non-silent test failures Created: 04/May/17  Updated: 30/Oct/23  Resolved: 30/May/17

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 3.5.9

Type: New Feature Priority: Major - P3
Reporter: Max Hirschhorn Assignee: Eddie Louie
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
is depended on by SERVER-29062 Add support for silencing test failur... Closed
Backwards Compatibility: Fully Compatible
Sprint: TIG 2017-05-29, TIG 2017-06-19
Participants:

 Description   

The buildscripts/promote_silent_failures.py script takes

  1. the path to a single report.json file as a command line argument, as well as
  2. optionally a path to an output filename via a --output-file command line argument (defaults to stdout)

and writes a report.json file to the specified location.

Note: This is effectively how the command line parsing for the buildscripts/combine_reports.py script works with the exception that the buildscripts/promote_silent_failures.py script should only accept a single report.json file and error if multiple are specified.

For any test files that for at least 2 executions in the report.json file have a "silentfail" status, the buildscripts/promote_silent_failures.py script should change the outputted report to have a "fail" status instead.

Note: The TestReport.from_dict() class method should be used to construct the TestReport instance corresponding to the specified report.json file to avoid manipulating the Python dict structure directly after parsing the JSON file.



 Comments   
Comment by Githook User [ 30/May/17 ]

Author:

{u'username': u'elouie99', u'name': u'Eddie Louie', u'email': u'eddie.louie@mongodb.com'}

Message: SERVER-29061 Add buildscripts/promote_silent_failures.py script to convert silent
test failures into non-silent test failures
Branch: master
https://github.com/mongodb/mongo/commit/50ea467d27c8ec98ee25d8298d61e0d5edfc560e

Comment by Eddie Louie [ 25/May/17 ]

Code review: https://mongodbcr.appspot.com/125900001

Generated at Thu Feb 08 04:19:49 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.