[SERVER-48458] Mongos open too many eventfd file handles Created: 28/May/20  Updated: 12/Dec/23

Status: Backlog
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: Cen Zheng Assignee: Backlog - Cluster Scalability
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: File 58188.fd.list     File metrics.2020-05-28T06-30-14Z-00000     File mongos.log.tar.gz    
Assigned Teams:
Cluster Scalability
Operating System: ALL
Participants:

 Description   

Hi,

We have encountered an issue that mongos holding too many eventfd file handles while there are only few connections.  This mongos had crashed because the system was using out of file handles. Following are the logs at that time:

020-05-28T14:29:58.053+0800 F NETWORK [conn59705274] error in eventfd: Too many open files in system 
2020-05-28T14:29:58.053+0800 I NETWORK [listener] Error accepting new connection on 0.0.0.0:3027: Too many open files in system 
2020-05-28T14:29:58.053+0800 F - [conn59705274] Fatal Assertion 50833 at src/mongo/transport/baton_asio_linux.h 68

And after it restarted, we noticed that it still holding 200k file handles, most of which are of type eventfd. While there were only 6 opening connections. I have uploaded the FTDC data, mongos.log and the file handle list. Please help!

 


Generated at Thu Feb 08 05:17:10 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.