[SERVER-28783] Add buildscripts/combine_reports.py script for combining report.json files Created: 12/Apr/17  Updated: 12/Oct/17  Resolved: 25/Apr/17

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 3.5.7

Type: New Feature Priority: Major - P3
Reporter: Max Hirschhorn Assignee: Jonathan Abrahams
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Gantt Dependency
has to be done before SERVER-28784 Update "run tests" function to run un... Closed
Backwards Compatibility: Fully Compatible
Sprint: TIG 2017-05-08
Participants:

 Description   

The buildscripts/combine_reports.py script takes the paths to at least one report.json file as command line arguments and writes a combined report.json file to its stdout. The order of test executions within each report.json file should be preserved and the merged order should follow the order in which the report.json files were specified on the command line.

Since a JS test isn't consider unreliable if one of the dynamic tests (i.e. a resmoke.py hook) fails after the test runs, the combine_reports.py script should exit with a non-zero return code even if a dynamic test has the "silentfail" status.

  • (0) All tests have status "pass", or only non-dynamic tests have status "silentfail".
  • (32) At least one dynamic test has status "silentfail", but no tests have status "fail" or "timeout".
  • (31) At least one test has status "fail" or "timeout".

Note: A test can be considered dynamic if its name contains a ":" character.



 Comments   
Comment by Githook User [ 25/Apr/17 ]

Author:

{u'username': u'hptabster', u'name': u'Jonathan Abrahams', u'email': u'jonathan@mongodb.com'}

Message: SERVER-28783 Add buildscripts/combine_reports.py script for combining report.json files
Branch: master
https://github.com/mongodb/mongo/commit/f34a173b12323565ad3b0647dd0e8dbcdcd6fff7

Generated at Thu Feb 08 04:19:02 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.