[SERVER-57003] Generate all tasks for a build variant in a single task Created: 17/May/21  Updated: 29/Oct/23  Resolved: 08/Jul/21

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 5.0.2, 5.1.0-rc0

Type: Improvement Priority: Major - P3
Reporter: David Bradford (Inactive) Assignee: David Bradford (Inactive)
Resolution: Fixed Votes: 1
Labels: tig-diag-patch-build
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Depends
depends on SERVER-57002 Refactor Evergreen task creation to s... Closed
is depended on by SERVER-53886 jstestfuzz (mutational) fuzzer is for... Closed
is depended on by SERVER-55857 Support loading generated suites in r... Closed
Duplicate
duplicates SERVER-56921 Task generation should depend on the ... Closed
Related
related to SERVER-58853 Remove add_git_tag from generated tas... Closed
related to SERVER-59431 [v5.0] disable parallel task in EFT b... Closed
is related to SERVER-56921 Task generation should depend on the ... Closed
Backwards Compatibility: Fully Compatible
Backport Requested:
v5.0
Sprint: DAG 2021-06-28, DAG 2021-07-12
Participants:
Linked BF Score: 151
Story Points: 3

 Description   

Currently, when generating task, we have each task generate its own sub-tasks. This model ends up with a lot of generating tasks and those end up getting serialized when being run in evergreen, which can lead to significant slow downs. If we instead generated all the needed tasks in a single task, we could avoid those slow downs. We should still support generating single tasks, in case an engineer does not want to run an entire build variant in their patch, but we could use an evergreen parameter to make that opt-in.


As a database contributor,
I want all tasks in a build variant to be generated at once,
So that my patch does not have to wait for serialized generators to run.


AC:

  • Only a single generator is used to created all the generated tasks in a build variant.


 Comments   
Comment by Vivian Ge (Inactive) [ 06/Oct/21 ]

Updating the fixversion since branching activities occurred yesterday. This ticket will be in rc0 when it’s been triggered. For more active release information, please keep an eye on #server-release. Thank you!

Comment by Githook User [ 27/Jul/21 ]

Author:

{'name': 'David Bradford', 'email': 'david.bradford@mongodb.com', 'username': 'dbradf'}

Message: SERVER-57003: Generate resmoke tasks at build variant granularity

(cherry picked from commit f7af7fe8600b5245bdfefd03081948a7525d39f4)
Branch: v5.0
https://github.com/mongodb/mongo/commit/41e14c8b4d08b29ca8390ec169b36d6a127c29e3

Comment by Githook User [ 07/Jul/21 ]

Author:

{'name': 'David Bradford', 'email': 'david.bradford@mongodb.com', 'username': 'dbradf'}

Message: SERVER-57003: Generate resmoke tasks at build variant granularity
Branch: master
https://github.com/mongodb/mongo/commit/f7af7fe8600b5245bdfefd03081948a7525d39f4

Generated at Thu Feb 08 05:40:44 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.