[SERVER-56478] Run powercycle with extended host lifetime for easier debugging Created: 29/Apr/21  Updated: 29/Oct/23  Resolved: 14/May/21

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 5.0.0-rc0

Type: Task Priority: Major - P3
Reporter: Mikhail Shchatko Assignee: Mikhail Shchatko
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
Backwards Compatibility: Fully Compatible
Sprint: STM 2021-05-17, STM 2021-05-31
Participants:
Linked BF Score: 0
Story Points: 3

 Description   

The idea is to have hosts still running in powercycle tasks so members of a Build team will be able to have live machines to diagnose the root cause of ssh failures in powercycle.

Run 20 powercycle tasks with extended host lifetime on ~ STM Daily Cron for easier debugging:

  • run 20 powercycle_smoke_no_compile tasks - use generate.tasks
  • extended host lifetime by increasing exec_timeout_secs and timeout_secs to 7 days in task config (do not modify the current powerycle tasks that will still continue running on other buildvariants as is)
  • set timeout_teardown_secs to 7 days in host.create command
  • add a sentinel task that will system fail when any of the tasks above will be running for more than 2 hours (current exec_timeout_secs of powercycle tasks) - use Evergreen API to get other tasks start time


 Comments   
Comment by Githook User [ 14/May/21 ]

Author:

{'name': 'Mikhail Shchatko', 'email': 'mikhail.shchatko@mongodb.com', 'username': 'MikhailShchatko'}

Message: SERVER-56478 Run powercycle with extended host lifetime for easier debugging
Branch: master
https://github.com/mongodb/mongo/commit/985e4fbf29d8b80101fa17cc00e28c6fa2eeba93

Generated at Thu Feb 08 05:39:21 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.