[SERVER-65835] Certain tasks have timeouts set higher than default Created: 06/Apr/22  Updated: 29/Oct/23  Resolved: 27/Apr/22

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 6.0.0-rc6, 6.1.0-rc0

Type: Bug Priority: Major - P3
Reporter: Daniel Morilha (Inactive) Assignee: David Bradford (Inactive)
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Problem/Incident
Related
related to SERVER-63872 Tighter task and idle timeout Closed
Backwards Compatibility: Fully Compatible
Backport Requested:
v6.0
Sprint: DAG 2022-05-02
Participants:
Linked BF Score: 180
Story Points: 2

 Description   

Motivation for Request

Reduce log size and overall build resources by timing out tasks faster.

Context

Certain builds might take a long time to be considered hanging in case an unexpected failure happens increasing the use of resources and the generated logs.

Description

While revisiting how MongoDB networking layer connects to other processes, multiple builds stalled due unexpected errors and crashes. SERVER-63872 tighter idle timeouts to under 30 minutes but certain tasks have their timeout overwritten to a higher duration[1]. Longer tasks are expected to generate larger logs which are cumbersome to work with and generally can't be loaded by the internal tool Lobster.

[1]:

[2022/03/16 20:37:40.507] [2022-03-16 20:37:40,507 - __main__ - INFO] 2022-03-16 20:37.40 Overriding required-builder timeout exec_timeout_secs=4800.0
[2022/03/16 20:37:40.756] [2022-03-16 20:37:40,756 - __main__ - INFO] 2022-03-16 20:37.40 Using historic based timeout   exec_timeout_secs=10860



 Comments   
Comment by Githook User [ 10/May/22 ]

Author:

{'name': 'David Bradford', 'email': 'david.bradford@mongodb.com', 'username': 'dbradf'}

Message: SERVER-65835: Refactor how task timeouts are determined

(cherry picked from commit 1f60e18fd71fc6012b455dc79cbfaf8708d8d580)
Branch: v6.0
https://github.com/mongodb/mongo/commit/a88f6f47d29603ebf7cbd3ddf65b212528c89b63

Comment by Githook User [ 27/Apr/22 ]

Author:

{'name': 'David Bradford', 'email': 'david.bradford@mongodb.com', 'username': 'dbradf'}

Message: SERVER-65835: Refactor how task timeouts are determined
Branch: master
https://github.com/mongodb/mongo/commit/1f60e18fd71fc6012b455dc79cbfaf8708d8d580

Generated at Thu Feb 08 06:03:46 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.