[SERVER-11382] smoke.py includes results of skipped tests Created: 25/Oct/13  Updated: 11/Jul/16  Resolved: 18/Nov/13

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 2.5.5

Type: Bug Priority: Major - P3
Reporter: Adinoyi Omuya Assignee: Adinoyi Omuya
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Backwards Compatibility: Fully Compatible
Operating System: ALL
Participants:

 Description   

When a test is skipped, smoke.py still creates and reports results about the test. When a particular test should be skipped, we should indicate this in its status field (as "skipped") and not leave it as "pass".



 Comments   
Comment by Githook User [ 18/Nov/13 ]

Author:

{u'username': u'deafgoat', u'name': u'Wisdom Omuya', u'email': u'deafgoat@gmail.com'}

Message: SERVER-11382: record of skipped tests as 'skip'

Signed-off-by: Matt Kangas <matt.kangas@mongodb.com>
Branch: master
https://github.com/mongodb/mongo/commit/75d67cdf5ab747385d85f06ad0995e7db099007f

Comment by Matt Kangas [ 18/Nov/13 ]

Confirmed:

$ ./buildscripts/smoke.py --with-cleanbb --report-file=report.json --auth --mode=files jstests/drop2.js
$ json_pp <report.json
{
   "failures" : 0,
   "elapsed" : 1.15199184417725,
   "results" : [
      {
         "test_file" : "jstests/drop2.js",
         "status" : "skip",
         "elapsed" : 0.000154018402099609,
         "end" : 1384810038.60371,
         "start" : 1384810038.60356
      }
   ],
   "end" : 1384810038.64415,
   "start" : 1384810037.49216
}

Generated at Thu Feb 08 03:25:39 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.