[SERVER-33963] Use an Evergreen task group for compile-related tasks Created: 18/Mar/18 Updated: 29/Oct/23 Resolved: 27/Apr/18 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Build, Testing Infrastructure |
| Affects Version/s: | None |
| Fix Version/s: | 4.0.0-rc0 |
| Type: | Improvement | Priority: | Major - P3 |
| Reporter: | Max Hirschhorn | Assignee: | Jonathan Abrahams |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||||||||||||||||||||||||||||||||||||||
| Backwards Compatibility: | Fully Compatible | ||||||||||||||||||||||||||||||||||||||||||||
| Sprint: | TIG 2018-04-09, TIG 2018-04-23, TIG 2018-05-07 | ||||||||||||||||||||||||||||||||||||||||||||
| Participants: | |||||||||||||||||||||||||||||||||||||||||||||
| Linked BF Score: | 61 | ||||||||||||||||||||||||||||||||||||||||||||
| Description |
|
We made changes in Per an in-person discussion with cristopher.stauffer and acm, we'll likely want to have the following Evergreen tasks execute as part of a task group with max_hosts=1:
Note: There were some ideas to also have compile_dist and compile_dagger tasks, but adding those should be done as follow-up work either on this ticket or another one. |
| Comments |
| Comment by Githook User [ 27/Apr/18 ] | |||||||||||
|
Author: {'email': 'jonathan@mongodb.com', 'username': 'hptabster', 'name': 'Jonathan Abrahams'}Message: | |||||||||||
| Comment by Githook User [ 27/Apr/18 ] | |||||||||||
|
Author: {'email': 'jonathan@mongodb.com', 'username': 'hptabster', 'name': 'Jonathan Abrahams'}Message: | |||||||||||
| Comment by Githook User [ 27/Apr/18 ] | |||||||||||
|
Author: {'email': 'jonathan@mongodb.com', 'username': 'hptabster', 'name': 'Jonathan Abrahams'}Message: | |||||||||||
| Comment by Githook User [ 26/Apr/18 ] | |||||||||||
|
Author: {'email': 'jonathan@mongodb.com', 'username': 'hptabster', 'name': 'Jonathan Abrahams'}Message: | |||||||||||
| Comment by Jonathan Abrahams [ 04/Apr/18 ] | |||||||||||
|
Some limitations have been discovered from the original design. If there are tasks in a task_group with dependencies, i.e., depends_on, then those tasks will not be scheduled with the other tasks in that group. The workaround is as follows:
| |||||||||||
| Comment by Githook User [ 03/Apr/18 ] | |||||||||||
|
Author: {'email': 'jonathan@mongodb.com', 'name': 'Jonathan Abrahams', 'username': 'hptabster'}Message: | |||||||||||
| Comment by Jonathan Abrahams [ 03/Apr/18 ] | |||||||||||
|
Adding first part of work, refactoring evergreen.yml | |||||||||||
| Comment by Max Hirschhorn [ 03/Apr/18 ] | |||||||||||
robert.guo, jonathan.abrahams, the idea behind having benchmarks_orphaned being run as part of the same task group is that we wouldn't need to upload a tarball containing the C++ benchmark executables to S3 as part of the compile_benchmarks task only to download them in subsequent ones. Until we'd be able to run compile_benchmarks on the centos6-perf / CBI machines, I don't think it would be meaningful to run the benchmarks* tasks in the same task group. | |||||||||||
| Comment by Jonathan Abrahams [ 03/Apr/18 ] | |||||||||||
|
Per comment from robert.guo: |