[SERVER-46732] Cap number of tasks generated on non-required build variants Created: 09/Mar/20  Updated: 29/Oct/23  Resolved: 10/Mar/20

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 4.4.0-rc0, 4.7.0

Type: Improvement Priority: Major - P3
Reporter: David Bradford (Inactive) Assignee: David Bradford (Inactive)
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Backwards Compatibility: Fully Compatible
Backport Requested:
v4.4
Sprint: DAG 2020-03-23
Participants:
Story Points: 1

 Description   

We recently hit an issue where the amount of evergreen project config generated by generate.tasks exceeded the maximum document size and started causing issues. It looks like this was caused by the number of tasks being generated as each task adds to the project config. It also looks like this would only happen if all the build variants in the version were run.

We could reduce the chance of this happening by capping the number of sub-tasks we will generate for a task in non-required build variants.


As a server engineer,
I want to limit the number of tasks dynamically generated in non-required builders,
So that versions do not hit the maximum document size.


AC:

  • non-required builders set a cap on number of tasks to generate.


 Comments   
Comment by Githook User [ 10/Mar/20 ]

Author:

{'username': 'dbradf', 'name': 'David Bradford', 'email': 'david.bradford@mongodb.com'}

Message: SERVER-46732: Cap number of generated sub-tasks on non-required builders

(cherry picked from commit 62c56c44fb107c2ff34a0752e8f254b263e4f630)
Branch: v4.4
https://github.com/mongodb/mongo/commit/e0d34a841aab61ff6fa2a6045c90a0a828bcb3bc

Comment by Githook User [ 09/Mar/20 ]

Author:

{'username': 'dbradf', 'name': 'David Bradford', 'email': 'david.bradford@mongodb.com'}

Message: SERVER-46732: Cap number of generated sub-tasks on non-required builders
Branch: master
https://github.com/mongodb/mongo/commit/62c56c44fb107c2ff34a0752e8f254b263e4f630

Generated at Thu Feb 08 05:12:17 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.