[SERVER-57048] create Scons resource aware job mechanism Created: 18/May/21  Updated: 27/Oct/23  Resolved: 27/Oct/23

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: New Feature Priority: Major - P3
Reporter: Daniel Moody Assignee: [DO NOT ASSIGN] Backlog - Server Development Platform Team (SDP) (Inactive)
Resolution: Won't Do Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Related
Assigned Teams:
Server Development Platform
Participants:
Linked BF Score: 35

 Description   

There are occasionally instances of tasks in the evergreen CI that run out of memory, either via the static link or compile jobs.

The jlink option and limiting the -j are options to deal with this, but it does mean that we are not fully utilizing the system resources.

A system which can determine how much RAM is available and then estimate to a certain degree from files involved or historical data, how much memory it thinks it will need to compile or link, and also employ a 'try, scale back, retry, scale up' feedback loop may provide a general solution.


Generated at Thu Feb 08 05:40:50 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.