[SERVER-48893] Use dynamic linking for the commit queue build Created: 16/Jun/20  Updated: 29/Oct/23  Resolved: 21/Aug/20

Status: Closed
Project: Core Server
Component/s: Build
Affects Version/s: None
Fix Version/s: 4.7.0

Type: Improvement Priority: Major - P3
Reporter: Andrew Morrow (Inactive) Assignee: Andrew Morrow (Inactive)
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: PNG File Screenshot_20200803_113201.png     PNG File Screenshot_20200803_150934.png    
Issue Links:
Duplicate
duplicates SERVER-40032 Move post-scons compile tasks that do... Closed
Backwards Compatibility: Fully Compatible
Sprint: Dev Platform 2020-07-13, Dev Platform 2020-07-27, Dev Platform 2020-08-10, Dev Platform 2020-08-24
Participants:

 Description   

We can't currently do this because the cost of making archives is too high, but we know from SERVER-46296 that the benefits would be great, potentially giving us enough budget to incorporate the unit tests.



 Comments   
Comment by Githook User [ 21/Aug/20 ]

Author:

{'name': 'Andrew Morrow', 'email': 'acm@mongodb.com', 'username': 'acmorrow'}

Message: SERVER-48893 Remove outdated tasks from the commit queue variant
Branch: master
https://github.com/mongodb/mongo/commit/8cd9ddcadf24703cb87abc4f3e35d42a69d31191

Comment by Andrew Morrow (Inactive) [ 14/Aug/20 ]

david.bradford - This has merged and early signal is that it appears to be working as designed. I suggest that as a next step we add the following tasks to the commit queue tasks:

  • { ! Shared Library Enterprise RHEL 6.2 / dbtest_no_archive }
  • { ! Shared Library Enterprise RHEL 6.2 / unittests }
  • { ! Shared Library Enterprise RHEL 6.2 / compile_all }

If all works correctly, that should also drag in

{ ! Shared Library Enterprise RHEL 6.2 / compile_no_archive }

via dependency. Then we can see how the throughput on the whole suite of tasks in

{ ! Shared Library Enterprise RHEL 6.2 }

in the commit queue compares with what is there currently. If it is overall an improvement (maybe at some time cost but in favor of much better coverage) we can remove the

{ Enterprise RHEL 6.2 / dbtest }

and

{ ~ Commit Queue / compile_core_tools }

tasks from the commit queue task list. Then we can have one last commit under this ticket remove those tasks from

{evergreen.yml}

, and close out this ticket.

Comment by Githook User [ 14/Aug/20 ]

Author:

{'name': 'Andrew Morrow', 'email': 'acm@mongodb.com', 'username': 'acmorrow'}

Message: SERVER-48893 Refactor task groups for dynamic builds
Branch: master
https://github.com/mongodb/mongo/commit/34cf3f46be8dbf6433ed69b9eb925c6f2856c2e1

Comment by Andrew Morrow (Inactive) [ 04/Aug/20 ]

david.bradford - Thanks for taking a look. My personal conclusion was similar but I wanted to get an independent analysis. This was the simplest possible change I could make before EVG-12417. Now that EVG-12417 is resolved, I can revisit some of my earlier ideas that required intra-TG dependencies.

Comment by Githook User [ 17/Jul/20 ]

Author:

{'name': 'Andrew Morrow', 'email': 'acm@mongodb.com', 'username': 'acmorrow'}

Message: SERVER-48893 Allow concurrent execution of the core TG on dynamic builders
Branch: master
https://github.com/mongodb/mongo/commit/64ca473943adf524718b528acafaf90874ce59e4

Generated at Thu Feb 08 05:18:22 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.