[CDRIVER-1112] Upload test results to Evergreen Created: 12/Feb/16  Updated: 10/Aug/16  Resolved: 16/Feb/16

Status: Closed
Project: C Driver
Component/s: None
Affects Version/s: None
Fix Version/s: 1.4.0

Type: Improvement Priority: Major - P3
Reporter: Hannes Magnusson Assignee: Hannes Magnusson
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
depends on CDRIVER-1114 libmongoc tests fail with parallel en... Closed
Epic Link: C Driver in Evergreen

 Description   

https://github.com/evergreen-ci/evergreen/wiki/Project-Files#attachresults

Evergreen supports attaching test results and shows pretty statistics and fluffy boxes from that info.

Would be nice to see which tests are generally failing like this. Should also be able to give indication if we are getting slower or faster etc



 Comments   
Comment by Hannes Magnusson [ 16/Feb/16 ]

Closing this.

One improvement would be to change the testname in the logfile as Evergreen currently treats it as a directory/filename combination and only shows the trailing path.
We have a lot of same trailing paths, and there have for example many test results called "pool"

Comment by Githook User [ 16/Feb/16 ]

Author:

{u'username': u'bjori', u'name': u'Hannes Magnusson', u'email': u'bjori@php.net'}

Message: CDRIVER-1112: Provide the start time and end too

This isn't unix timestamp, but its only used for calculating how
long the tests took, not to map it out on a clock
Branch: master
https://github.com/mongodb/mongo-c-driver/commit/14e03d83e858507299baa7dddbb7bce36e342f8f

Comment by Githook User [ 13/Feb/16 ]

Author:

{u'username': u'bjori', u'name': u'Hannes Magnusson', u'email': u'bjori@php.net'}

Message: CDRIVER-1114: fork() before running the tests

This allows us to always submit test results as per CDRIVER-1112
Branch: master
https://github.com/mongodb/mongo-c-driver/commit/01495b9692a4eab414da83b4c8d852871343512e

Comment by Githook User [ 12/Feb/16 ]

Author:

{u'username': u'bjori', u'name': u'Hannes Magnusson', u'email': u'bjori@php.net'}

Message: CDRIVER-1112: Upload test results to Evergreen

Only the basics included so far
Branch: master
https://github.com/mongodb/mongo-c-driver/commit/c0260660b841527925d42afb4a4c1f1675c88ffd

Comment by Githook User [ 12/Feb/16 ]

Author:

{u'username': u'bjori', u'name': u'Hannes Magnusson', u'email': u'bjori@php.net'}

Message: CDRIVER-1112: Fix JSON syntax and field names

Now they match the Evergreen test results format
Branch: master
https://github.com/mongodb/mongo-c-driver/commit/6c95965a0f52700f1c650052f862ddd033a4413e

Comment by A. Jesse Jiryu Davis [ 12/Feb/16 ]

This would be great. I think we need to fix whatever's wrong with the "fork" test option first, so the suite can recover from a failed test instead of aborting.

Generated at Wed Feb 07 21:11:36 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.