[SERVER-40034] Set setup_group_can_fail_task to true for compile-related task groups Created: 07/Mar/19  Updated: 29/Oct/23  Resolved: 13/Mar/19

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 4.0.7, 4.1.9

Type: Task Priority: Major - P3
Reporter: Max Hirschhorn Assignee: Max Hirschhorn
Resolution: Fixed Votes: 0
Labels: tig-evgconfig
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Depends
Related
is related to SERVER-33963 Use an Evergreen task group for compi... Closed
Backwards Compatibility: Fully Compatible
Backport Requested:
v4.0
Sprint: STM 2019-03-25
Participants:
Linked BF Score: 0
Story Points: 1

 Description   

The Evergreen team introduced the setup_group_can_fail_task option in EVG-5759 to make it possible for commands which fail in the setup_group list to cause the task to fail. This is desirable because it is otherwise possible for a transient network error to occur when cloning the enterprise module and for the compile task to successfully build the server without the enterprise module.

[2019/01/14 00:08:14.587] + cd src
[2019/01/14 00:08:14.587] + git reset --hard 58d80a26224da882cbe30d301ed295c302515c9b
[2019/01/14 00:08:14.587] + set -o errexit
[2019/01/14 00:08:14.587] + git clone git@github.com:10gen/mongo-enterprise-modules.git src/mongo/db/modules/enterprise
[2019/01/14 00:08:44.713] Cloning into 'src/mongo/db/modules/enterprise'...
[2019/01/14 00:08:44.713] ssh: Could not resolve hostname github.com: nodename nor servname provided, or not known
[2019/01/14 00:08:44.714] fatal: Could not read from remote repository.
[2019/01/14 00:08:44.714] Please make sure you have the correct access rights
[2019/01/14 00:08:44.719] and the repository exists.
[2019/01/14 00:08:44.719] HEAD is now at 58d80a2 SERVER-37775 Add Community RHEL7 s390x
[2019/01/14 00:08:44.719] Command failed: problem with git command: exit status 128
[2019/01/14 00:08:44.719] Running command 'shell.exec' in "get modified patch files" (step 8 of 14)
...



 Comments   
Comment by Githook User [ 13/Mar/19 ]

Author:

{'name': 'Max Hirschhorn', 'email': 'max.hirschhorn@mongodb.com', 'username': 'visemet'}

Message: SERVER-40034 Set setup_group_can_fail_task=true for all task groups.

(cherry picked from commit 471ef6b4335dd180a9fd446629a4b068abd6c02e)
Branch: v4.0
https://github.com/mongodb/mongo/commit/ff56e747256f1197bb8b5672c9bddb78f5781cca

Comment by Githook User [ 13/Mar/19 ]

Author:

{'name': 'Max Hirschhorn', 'username': 'visemet', 'email': 'max.hirschhorn@mongodb.com'}

Message: SERVER-40034 Set setup_group_can_fail_task=true for all task groups.
Branch: master
https://github.com/mongodb/mongo/commit/471ef6b4335dd180a9fd446629a4b068abd6c02e

Comment by Annie Black [ 08/Mar/19 ]

Sorry about that max.hirschhorn, should be fixed next time we deploy.

Comment by Max Hirschhorn [ 08/Mar/19 ]

brian.samek, annie.black, I'm running into trouble trying to use the setup_group_can_fail_task option where it appears a command in the setup_group is failing but the task keeps going without running the remainder of the setup_group. Note that the """Running command 'shell.exec' in "generate compile expansions" (step 7 of 7)""" message never appears in the log output (which is what causes this failure in a later task in the task group).

The following error is actually an issue with how the embedded_sdk_build_and_test task group attempts to run the "install pip requirements" function before running the "set up virtualenv" function.

[2019/03/08 00:15:29.649] Running command 'shell.exec' in "install pip requirements" (step 6 of 7)
...
[2019/03/08 00:15:33.971] set -o errexit
[2019/03/08 00:15:33.971] python2 -m pip install -r etc/pip/evgtest-requirements.txt
[2019/03/08 00:15:33.971] Could not install packages due to an EnvironmentError: [Errno 13] Permission denied: '/usr/local/lib/python2.7/site-packages/_posixsubprocess32.so'
[2019/03/08 00:15:33.971] Consider using the `--user` option or check the permissions.
[2019/03/08 00:15:34.329] Command failed: command [pid=75492] encountered problem: exit status 1
[2019/03/08 00:15:39.224] Task logger initialized (agent revision: 660bb906e0814d573934d444d1744f4c95d20085).
[2019/03/08 00:15:39.498] Starting task mongodb_mongo_master_embedded_sdk_iphoneos_embedded_sdk_build_cdriver_patch_5a7ccd5f073341f5f98e0ced39a80416869c181b_5c81b2591e2d171c9b21f724_19_03_08_00_08_28, execution 0.
[2019/03/08 00:15:39.918] Running pre-task commands.

https://evergreen.mongodb.com/task_log_raw/mongodb_mongo_master_embedded_sdk_iphoneos_embedded_sdk_build_cdriver_patch_5a7ccd5f073341f5f98e0ced39a80416869c181b_5c81b2591e2d171c9b21f724_19_03_08_00_08_28/0?type=T

Generated at Thu Feb 08 04:53:50 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.