2018-02-13T18:15:44.343-0500 I INDEX [repl writer worker 4] building index using bulk method; build may temporarily use up to 500 megabytes of RAM 2018-02-13T18:15:44.358-0500 I INDEX [repl writer worker 4] build index done. scanned 7767 total records. 0 secs 2018-02-13T19:10:38.433-0500 I ASIO [NetworkInterfaceASIO-BGSync-0] Connecting to mongodb-server-16:39511 2018-02-13T19:10:38.488-0500 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to mongodb-server-16:39511, took 55ms (2 connections now open to mongodb-server-16:39511) 2018-02-13T19:11:38.488-0500 I ASIO [NetworkInterfaceASIO-BGSync-0] Ending idle connection to host mongodb-server-16:39511 because the pool meets constraints; 1 connections to that host remain open 2018-02-13T19:14:31.419-0500 I ASIO [NetworkInterfaceASIO-BGSync-0] Connecting to mongodb-server-16:39511 2018-02-13T19:14:31.428-0500 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to mongodb-server-16:39511, took 9ms (2 connections now open to mongodb-server-16:39511) 2018-02-13T19:15:31.428-0500 I ASIO [NetworkInterfaceASIO-BGSync-0] Ending idle connection to host mongodb-server-16:39511 because the pool meets constraints; 1 connections to that host remain open 2018-02-13T19:20:50.516-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Ending connection to host mongodb-server-16:39511 due to bad connection status; 0 connections to that host remain open 2018-02-13T19:20:50.516-0500 I REPL [ReplicationExecutor] Error in heartbeat request to mongodb-server-16:39511; ExceededTimeLimit: Operation timed out 2018-02-13T19:20:51.179-0500 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2018-02-13T19:20:51.179-0500 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2018-02-13T19:20:51.179-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to mongodb-server-16:39511 2018-02-13T19:20:51.179-0500 I REPL [ReplicationExecutor] dry election run succeeded, running for election 2018-02-13T19:20:51.180-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to mongodb-server-16:39511 2018-02-13T19:20:51.181-0500 I REPL [ReplicationExecutor] election succeeded, assuming primary role in term 24 2018-02-13T19:20:51.181-0500 I REPL [ReplicationExecutor] transition to PRIMARY 2018-02-13T19:20:51.181-0500 I ASIO [NetworkInterfaceASIO-BGSync-0] Ending connection to host mongodb-server-16:39511 due to bad connection status; 0 connections to that host remain open 2018-02-13T19:20:51.181-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to mongodb-server-16:39511 2018-02-13T19:20:51.183-0500 I REPL [rsSync] transition to primary complete; database writes are now permitted 2018-02-13T19:21:01.181-0500 I REPL [ReplicationExecutor] Error in heartbeat request to mongodb-server-16:39511; ExceededTimeLimit: Couldn't get a connection within the time limit 2018-02-13T19:21:11.179-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Failed to connect to mongodb-server-16:39511 - ExceededTimeLimit: Operation timed out 2018-02-13T19:21:11.180-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Failed to connect to mongodb-server-16:39511 - ExceededTimeLimit: Operation timed out 2018-02-13T19:21:11.181-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Failed to connect to mongodb-server-16:39511 - ExceededTimeLimit: Operation timed out 2018-02-13T19:21:11.181-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to mongodb-server-16:39511 2018-02-13T19:21:13.182-0500 I REPL [ReplicationExecutor] Error in heartbeat request to mongodb-server-16:39511; ExceededTimeLimit: Couldn't get a connection within the time limit 2018-02-13T19:21:16.108-0500 I NETWORK [SyncSourceFeedback] Socket recv() timeout 50.15.16.49:39511 2018-02-13T19:21:16.108-0500 I NETWORK [SyncSourceFeedback] SocketException: remote: (NONE):0 error: 9001 socket exception [RECV_TIMEOUT] server [50.15.16.49:39511] 2018-02-13T19:21:16.108-0500 I REPL [SyncSourceFeedback] SyncSourceFeedback error sending update: network error while attempting to run command 'replSetUpdatePosition' on host 'mongodb-server-16:39511' 2018-02-13T19:21:16.108-0500 I REPL [SyncSourceFeedback] updateUpstream failed: HostUnreachable: network error while attempting to run command 'replSetUpdatePosition' on host 'mongodb-server-16:39511' , will retry 2018-02-13T19:21:25.183-0500 I REPL [ReplicationExecutor] Error in heartbeat request to mongodb-server-16:39511; ExceededTimeLimit: Couldn't get a connection within the time limit 2018-02-13T19:21:31.181-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Failed to connect to mongodb-server-16:39511 - ExceededTimeLimit: Operation timed out 2018-02-13T19:21:31.181-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to mongodb-server-16:39511 2018-02-13T19:21:37.183-0500 I REPL [ReplicationExecutor] Error in heartbeat request to mongodb-server-16:39511; ExceededTimeLimit: Couldn't get a connection within the time limit 2018-02-13T19:21:44.463-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to mongodb-server-16:39511, took 13282ms (1 connections now open to mongodb-server-16:39511) 2018-02-13T19:21:44.463-0500 I REPL [ReplicationExecutor] Member mongodb-server-16:39511 is now in state PRIMARY 2018-02-13T19:21:46.463-0500 I ASIO [ReplicationExecutor] dropping unhealthy pooled connection to mongodb-server-16:39511 2018-02-13T19:21:46.463-0500 I ASIO [ReplicationExecutor] after drop, pool was empty, going to spawn some connections 2018-02-13T19:21:46.463-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Connecting to mongodb-server-16:39511 2018-02-13T19:21:46.473-0500 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to mongodb-server-16:39511, took 10ms (1 connections now open to mongodb-server-16:39511) 2018-02-13T19:21:46.473-0500 I REPL [ReplicationExecutor] Member mongodb-server-16:39511 is now in state SECONDARY