[SERVER-59473] mongocryptd on windows sometimes does not exit after idleShutdownTimeoutSecs period Created: 20/Aug/21  Updated: 16/Sep/21

Status: Investigating
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: Boris Dogadov Assignee: Boris Dogadov
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
is depended on by CSHARP-3809 Tests timeouts: Investigate timeouts ... Closed
Operating System: ALL
Participants:

 Description   

On Win hosts on EverGreen, mongocryptd is not always shut down after idleShutdownTimeoutSecs.

Verified with the following steps:

  • Ensured that the client process was shut down.
  • Observed mongocryptd.exe is alive with --idleShutdownTimeoutSecs 60 config option
  • Waited for 80 seconds
  • Observed that mongocryptd.exe is still alive

Example EG run



 Comments   
Comment by Boris Dogadov [ 15/Sep/21 ]

Thanks mark.benvenuto, we will look into providing logs or mini dump.

Comment by Mark Benvenuto [ 15/Sep/21 ]

We have a test that verifies the idle shutdown works that runs on every commit. I believe the idle timeout watchdog works as expected.

In order for me to investigate this issue, I need some evidence to investigate. I need either a log file from mongocryptd or a miniudmp of a "hung" mongocryptd. Something like the hang_analyzer can be used to take a mini dump.

Comment by Boris Dogadov [ 14/Sep/21 ]

Hi mark.benvenuto,
Unfortunately our EG pipeline is set to run without log files for mongodcryptd.

The behavior that we observe is that mongocryptd is shut down most of the times on EG hosts, and always shut down locally.
Approximately 5% for all runs result in hanging mongocryptd (and therefore timeouts the whole EG task).

Comment by Mark Benvenuto [ 14/Sep/21 ]

boris.dogadov, do you have the log file from mongocryptd? I verified it shutdowns down if I start and never connect to it after 60 seconds.

.\mongocryptd.exe --idleShutdownTimeoutSecs 60

Generated at Thu Feb 08 05:47:20 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.