[SERVER-57048] create Scons resource aware job mechanism Created: 18/May/21 Updated: 27/Oct/23 Resolved: 27/Oct/23 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | None |
| Type: | New Feature | Priority: | Major - P3 |
| Reporter: | Daniel Moody | Assignee: | [DO NOT ASSIGN] Backlog - Server Development Platform Team (SDP) (Inactive) |
| Resolution: | Won't Do | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||
| Assigned Teams: |
Server Development Platform
|
||||
| Participants: | |||||
| Linked BF Score: | 35 | ||||
| Description |
|
There are occasionally instances of tasks in the evergreen CI that run out of memory, either via the static link or compile jobs. The jlink option and limiting the -j are options to deal with this, but it does mean that we are not fully utilizing the system resources. A system which can determine how much RAM is available and then estimate to a certain degree from files involved or historical data, how much memory it thinks it will need to compile or link, and also employ a 'try, scale back, retry, scale up' feedback loop may provide a general solution. |