2016-04-12T18:19:32.206+0000 I CONTROL [initandlisten] MongoDB starting : pid=16576 port=27016 dbpath=/var/lib/mongodb-replica/mongodbreplica2 64-bit host=ip-172-31-6-169 2016-04-12T18:19:32.207+0000 I CONTROL [initandlisten] db version v3.2.1 2016-04-12T18:19:32.207+0000 I CONTROL [initandlisten] git version: a14d55980c2cdc565d4704a7e3ad37e4e535c1b2 2016-04-12T18:19:32.207+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014 2016-04-12T18:19:32.207+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-04-12T18:19:32.207+0000 I CONTROL [initandlisten] modules: none 2016-04-12T18:19:32.207+0000 I CONTROL [initandlisten] build environment: 2016-04-12T18:19:32.207+0000 I CONTROL [initandlisten] distmod: ubuntu1404 2016-04-12T18:19:32.207+0000 I CONTROL [initandlisten] distarch: x86_64 2016-04-12T18:19:32.207+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-04-12T18:19:32.207+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb.d/mongodbreplica2.conf", net: { http: { RESTInterfaceEnabled: true, enabled: true }, port: 27016 }, processManagement: { pidFilePath: "/var/run/mongodb-replica/mongodbreplica2.pid" }, replication: { oplogSizeMB: 128, replSet: "mongodbreplica" }, storage: { dbPath: "/var/lib/mongodb-replica/mongodbreplica2", mmapv1: { smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb-replica/mongodbreplica2.log" } } 2016-04-12T18:19:32.534+0000 I - [initandlisten] Detected data files in /var/lib/mongodb-replica/mongodbreplica2 created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2016-04-12T18:19:32.534+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-04-12T18:19:35.467+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-04-12T18:19:35.467+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 127570 records totaling to 2938105140 bytes 2016-04-12T18:19:35.478+0000 I STORAGE [initandlisten] Sampling from the oplog between Apr 8 12:06:39:1 and Apr 12 12:22:26:1 to determine where to place markers for truncation 2016-04-12T18:19:35.478+0000 I STORAGE [initandlisten] Taking 1009 samples and assuming that each section of oplog contains approximately 1264 records totaling to 29111584 bytes 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 12:54:46:2 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 13:49:12:1 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 14:41:57:1 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 15:33:45:3 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 16:25:40:1 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 17:23:08:1 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 18:25:00:1 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 19:19:45:5 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 20:20:47:1 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 21:14:45:4 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 22:09:00:1 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 23:12:39:1 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 00:07:24:1 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 01:02:07:1 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 02:01:45:2 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 02:56:08:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 03:50:36:2 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 04:50:07:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 05:44:39:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 06:44:00:6 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 07:38:36:2 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 08:32:39:3 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 09:32:07:2 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 10:26:34:2 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 11:20:43:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 12:20:36:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 13:15:18:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 14:12:08:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 15:14:45:2 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 16:09:07:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 17:08:12:2 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 18:03:10:2 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 18:57:46:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 19:57:36:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:51:54:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 21:43:45:3 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 22:35:39:2 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 23:30:17:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 00:21:56:1 2016-04-12T18:19:43.968+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 01:09:07:1 2016-04-12T18:19:43.968+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 02:01:08:2 2016-04-12T18:19:43.968+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 02:52:46:1 2016-04-12T18:19:43.968+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 03:45:02:2 2016-04-12T18:19:43.969+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 04:39:36:2 2016-04-12T18:19:43.969+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 05:31:42:1 2016-04-12T18:19:43.969+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 06:18:45:1 2016-04-12T18:19:43.969+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 07:10:46:1 2016-04-12T18:19:43.970+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 08:02:47:2 2016-04-12T18:19:43.970+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 08:55:08:2 2016-04-12T18:19:43.970+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 09:49:48:2 2016-04-12T18:19:43.970+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 10:43:00:6 2016-04-12T18:19:43.970+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 11:30:15:1 2016-04-12T18:19:43.970+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 12:22:45:2 2016-04-12T18:19:43.970+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 13:15:09:2 2016-04-12T18:19:43.970+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 14:07:47:1 2016-04-12T18:19:43.971+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 15:02:45:3 2016-04-12T18:19:44.077+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 15:55:10:1 2016-04-12T18:19:44.078+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 16:42:46:1 2016-04-12T18:19:44.079+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 17:44:08:2 2016-04-12T18:19:44.079+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 18:40:45:1 2016-04-12T18:19:44.079+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 19:32:20:2 2016-04-12T18:19:44.079+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 20:26:29:2 2016-04-12T18:19:44.079+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 21:17:46:1 2016-04-12T18:19:44.079+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 22:05:07:2 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 22:56:19:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 23:47:51:2 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 00:39:45:5 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 01:33:46:2 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:25:44:2 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 03:12:22:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 04:03:46:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 04:55:51:3 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 05:47:47:2 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 06:41:53:2 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 07:33:45:6 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 08:20:26:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 09:12:21:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:03:52:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:55:48:2 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 11:49:50:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 12:41:45:2 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 13:29:00:4 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 14:24:50:3 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 15:16:32:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 16:08:46:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 17:04:46:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 17:57:39:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 18:54:45:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 19:46:54:2 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 20:56:45:3 2016-04-12T18:19:44.082+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 21:51:50:2 2016-04-12T18:19:44.082+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 22:51:00:3 2016-04-12T18:19:44.082+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 23:42:43:2 2016-04-12T18:19:44.082+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 00:39:56:1 2016-04-12T18:19:44.082+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 01:32:32:1 2016-04-12T18:19:44.082+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 02:25:00:2 2016-04-12T18:19:44.082+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 03:17:07:2 2016-04-12T18:19:44.082+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 04:12:46:1 2016-04-12T18:19:44.082+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:04:48:1 2016-04-12T18:19:44.082+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:52:47:1 2016-04-12T18:19:45.289+0000 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2016-04-12T18:19:45.619+0000 I NETWORK [websvr] admin web console waiting for connections on port 28016 2016-04-12T18:19:45.636+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb-replica/mongodbreplica2/diagnostic.data' 2016-04-12T18:19:45.639+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-04-12T18:19:45.645+0000 I NETWORK [initandlisten] waiting for connections on port 27016 2016-04-12T18:19:45.767+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51000 #1 (1 connection now open) 2016-04-12T18:19:45.791+0000 I NETWORK [conn1] end connection 127.0.0.1:51000 (0 connections now open) 2016-04-12T18:19:45.864+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51003 #2 (1 connection now open) 2016-04-12T18:19:45.865+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "mongodbreplica", version: 2, protocolVersion: 1, members: [ { _id: 0, host: "localhost:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "localhost:27016", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "localhost:27015", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-04-12T18:19:45.865+0000 I REPL [ReplicationExecutor] This node is localhost:27016 in the config 2016-04-12T18:19:45.865+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-04-12T18:19:45.865+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-04-12T18:19:45.963+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-12T18:19:45.963+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-12T18:19:45.963+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-04-12T18:19:45.964+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-12T18:19:45.964+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-04-12T18:19:45.966+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-12T18:19:48.258+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51017 #3 (2 connections now open) 2016-04-12T18:19:48.259+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51018 #4 (3 connections now open) 2016-04-12T18:19:48.260+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51019 #5 (4 connections now open) 2016-04-12T18:19:48.263+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51020 #6 (5 connections now open) 2016-04-12T18:19:48.278+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51021 #7 (6 connections now open) 2016-04-12T18:19:48.290+0000 I NETWORK [conn3] end connection 127.0.0.1:51017 (5 connections now open) 2016-04-12T18:19:48.292+0000 I NETWORK [conn4] end connection 127.0.0.1:51018 (4 connections now open) 2016-04-12T18:19:48.292+0000 I NETWORK [conn5] end connection 127.0.0.1:51019 (3 connections now open) 2016-04-12T18:19:48.292+0000 I NETWORK [conn6] end connection 127.0.0.1:51020 (2 connections now open) 2016-04-12T18:19:48.293+0000 I NETWORK [conn7] end connection 127.0.0.1:51021 (1 connection now open) 2016-04-12T18:19:48.822+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51033 #8 (2 connections now open) 2016-04-12T18:19:48.822+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51034 #9 (3 connections now open) 2016-04-12T18:19:48.840+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51035 #10 (4 connections now open) 2016-04-12T18:19:48.841+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51036 #11 (5 connections now open) 2016-04-12T18:19:48.842+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51037 #12 (6 connections now open) 2016-04-12T18:19:48.868+0000 I NETWORK [conn8] end connection 127.0.0.1:51033 (5 connections now open) 2016-04-12T18:19:48.868+0000 I NETWORK [conn9] end connection 127.0.0.1:51034 (4 connections now open) 2016-04-12T18:19:48.868+0000 I NETWORK [conn10] end connection 127.0.0.1:51035 (3 connections now open) 2016-04-12T18:19:48.869+0000 I NETWORK [conn11] end connection 127.0.0.1:51036 (2 connections now open) 2016-04-12T18:19:48.869+0000 I NETWORK [conn12] end connection 127.0.0.1:51037 (1 connection now open) 2016-04-12T18:19:48.918+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51038 #13 (2 connections now open) 2016-04-12T18:19:50.390+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51051 #14 (3 connections now open) 2016-04-12T18:19:50.391+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51052 #15 (4 connections now open) 2016-04-12T18:19:50.393+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51053 #16 (5 connections now open) 2016-04-12T18:19:50.394+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51054 #17 (6 connections now open) 2016-04-12T18:19:50.456+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51055 #18 (7 connections now open) 2016-04-12T18:19:50.478+0000 I NETWORK [conn14] end connection 127.0.0.1:51051 (6 connections now open) 2016-04-12T18:19:50.478+0000 I NETWORK [conn15] end connection 127.0.0.1:51052 (5 connections now open) 2016-04-12T18:19:50.478+0000 I NETWORK [conn16] end connection 127.0.0.1:51053 (4 connections now open) 2016-04-12T18:19:50.478+0000 I NETWORK [conn17] end connection 127.0.0.1:51054 (3 connections now open) 2016-04-12T18:19:50.479+0000 I NETWORK [conn18] end connection 127.0.0.1:51055 (2 connections now open) 2016-04-12T18:19:51.940+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51056 #19 (3 connections now open) 2016-04-12T18:19:51.941+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51057 #20 (4 connections now open) 2016-04-12T18:19:51.941+0000 I NETWORK [conn19] end connection 127.0.0.1:51056 (3 connections now open) 2016-04-12T18:19:51.943+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51058 #21 (4 connections now open) 2016-04-12T18:19:53.682+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51070 #22 (5 connections now open) 2016-04-12T18:19:53.687+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51071 #23 (6 connections now open) 2016-04-12T18:19:53.688+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51072 #24 (7 connections now open) 2016-04-12T18:19:53.712+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51073 #25 (8 connections now open) 2016-04-12T18:19:53.716+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51074 #26 (9 connections now open) 2016-04-12T18:19:53.750+0000 I NETWORK [conn22] end connection 127.0.0.1:51070 (8 connections now open) 2016-04-12T18:19:53.752+0000 I NETWORK [conn23] end connection 127.0.0.1:51071 (7 connections now open) 2016-04-12T18:19:53.752+0000 I NETWORK [conn24] end connection 127.0.0.1:51072 (6 connections now open) 2016-04-12T18:19:53.752+0000 I NETWORK [conn25] end connection 127.0.0.1:51073 (5 connections now open) 2016-04-12T18:19:53.752+0000 I NETWORK [conn26] end connection 127.0.0.1:51074 (4 connections now open) 2016-04-12T18:19:56.768+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-12T18:19:56.768+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-12T18:19:56.795+0000 I REPL [ReplicationExecutor] dry election run succeeded, running for election 2016-04-12T18:19:56.880+0000 I REPL [ReplicationExecutor] election succeeded, assuming primary role in term 27 2016-04-12T18:19:56.952+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-12T18:19:56.952+0000 I REPL [ReplicationExecutor] transition to PRIMARY 2016-04-12T18:19:56.952+0000 W REPL [ReplicationExecutor] The liveness timeout does not match callback handle, so not resetting it. 2016-04-12T18:19:57.067+0000 I REPL [rsSync] transition to primary complete; database writes are now permitted 2016-04-12T18:19:58.987+0000 I NETWORK [conn20] end connection 127.0.0.1:51057 (3 connections now open) 2016-04-12T18:19:58.990+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51079 #27 (4 connections now open) 2016-04-12T18:19:58.991+0000 I NETWORK [conn27] end connection 127.0.0.1:51079 (3 connections now open) 2016-04-12T18:19:59.032+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51080 #28 (4 connections now open) 2016-04-12T18:19:59.038+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51081 #29 (5 connections now open) 2016-04-12T18:20:00.948+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51093 #30 (6 connections now open) 2016-04-12T18:20:00.950+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51094 #31 (7 connections now open) 2016-04-12T18:20:00.953+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51095 #32 (8 connections now open) 2016-04-12T18:20:00.953+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51096 #33 (9 connections now open) 2016-04-12T18:20:00.954+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51097 #34 (10 connections now open) 2016-04-12T18:20:01.096+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51099 #35 (11 connections now open) 2016-04-12T18:20:01.100+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51103 #36 (12 connections now open) 2016-04-12T18:20:01.148+0000 I NETWORK [conn36] end connection 127.0.0.1:51103 (11 connections now open) 2016-04-12T18:20:01.275+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51106 #37 (12 connections now open) 2016-04-12T18:20:01.402+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51109 #38 (13 connections now open) 2016-04-12T18:20:02.099+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51112 #39 (14 connections now open) 2016-04-12T18:20:02.099+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51113 #40 (15 connections now open) 2016-04-12T18:20:02.100+0000 I NETWORK [conn39] end connection 127.0.0.1:51112 (14 connections now open) 2016-04-12T18:20:02.647+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51125 #41 (15 connections now open) 2016-04-12T18:20:02.647+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51126 #42 (16 connections now open) 2016-04-12T18:20:02.647+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51127 #43 (17 connections now open) 2016-04-12T18:20:02.647+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51128 #44 (18 connections now open) 2016-04-12T18:20:02.647+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51129 #45 (19 connections now open) 2016-04-12T18:20:02.749+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51131 #46 (20 connections now open) 2016-04-12T18:20:02.750+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51135 #47 (21 connections now open) 2016-04-12T18:20:02.776+0000 I NETWORK [conn47] end connection 127.0.0.1:51135 (20 connections now open) 2016-04-12T18:20:02.858+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51138 #48 (21 connections now open) 2016-04-12T18:20:03.532+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51151 #49 (22 connections now open) 2016-04-12T18:20:03.532+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51152 #50 (23 connections now open) 2016-04-12T18:20:03.533+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51153 #51 (24 connections now open) 2016-04-12T18:20:03.534+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51154 #52 (25 connections now open) 2016-04-12T18:20:03.534+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51155 #53 (26 connections now open) 2016-04-12T18:20:03.716+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51157 #54 (27 connections now open) 2016-04-12T18:20:03.716+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51161 #55 (28 connections now open) 2016-04-12T18:20:03.731+0000 I NETWORK [conn55] end connection 127.0.0.1:51161 (27 connections now open) 2016-04-12T18:20:03.782+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51164 #56 (28 connections now open) 2016-04-12T18:20:03.833+0000 I ACCESS [conn37] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:03.885+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51167 #57 (29 connections now open) 2016-04-12T18:20:05.284+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51171 #58 (30 connections now open) 2016-04-12T18:20:06.094+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51185 #59 (31 connections now open) 2016-04-12T18:20:06.101+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51186 #60 (32 connections now open) 2016-04-12T18:20:06.113+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51187 #61 (33 connections now open) 2016-04-12T18:20:06.114+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51188 #62 (34 connections now open) 2016-04-12T18:20:06.115+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51189 #63 (35 connections now open) 2016-04-12T18:20:06.302+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51191 #64 (36 connections now open) 2016-04-12T18:20:06.303+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51195 #65 (37 connections now open) 2016-04-12T18:20:06.401+0000 I NETWORK [conn65] end connection 127.0.0.1:51195 (36 connections now open) 2016-04-12T18:20:06.478+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51198 #66 (37 connections now open) 2016-04-12T18:20:08.605+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51202 #67 (38 connections now open) 2016-04-12T18:20:08.624+0000 I NETWORK [conn67] end connection 127.0.0.1:51202 (37 connections now open) 2016-04-12T18:20:08.701+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51208 #68 (38 connections now open) 2016-04-12T18:20:08.702+0000 I ACCESS [conn56] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:08.779+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51217 #69 (39 connections now open) 2016-04-12T18:20:08.779+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51218 #70 (40 connections now open) 2016-04-12T18:20:08.795+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51219 #71 (41 connections now open) 2016-04-12T18:20:08.795+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51220 #72 (42 connections now open) 2016-04-12T18:20:08.796+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51221 #73 (43 connections now open) 2016-04-12T18:20:08.798+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51223 #74 (44 connections now open) 2016-04-12T18:20:08.919+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51227 #75 (45 connections now open) 2016-04-12T18:20:08.919+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51231 #76 (46 connections now open) 2016-04-12T18:20:08.980+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51234 #77 (47 connections now open) 2016-04-12T18:20:08.981+0000 I REPL [ReplicationExecutor] stepping down from primary, because a new term has begun: 28 2016-04-12T18:20:08.981+0000 I REPL [ReplicationExecutor] stepping down from primary, because a new term has begun: 28 2016-04-12T18:20:08.982+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state PRIMARY 2016-04-12T18:20:08.981+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51235 #78 (48 connections now open) 2016-04-12T18:20:08.982+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51236 #79 (49 connections now open) 2016-04-12T18:20:08.981+0000 I NETWORK [conn76] end connection 127.0.0.1:51231 (46 connections now open) 2016-04-12T18:20:08.982+0000 I REPL [replExecDBWorker-1] transition to SECONDARY 2016-04-12T18:20:08.996+0000 I NETWORK [conn2] end connection 127.0.0.1:51003 (47 connections now open) 2016-04-12T18:20:08.997+0000 I NETWORK [conn29] end connection 127.0.0.1:51081 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn30] end connection 127.0.0.1:51093 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn31] end connection 127.0.0.1:51094 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn32] end connection 127.0.0.1:51095 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn33] end connection 127.0.0.1:51096 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn34] end connection 127.0.0.1:51097 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn35] end connection 127.0.0.1:51099 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn37] end connection 127.0.0.1:51106 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn38] end connection 127.0.0.1:51109 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn40] end connection 127.0.0.1:51113 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn41] end connection 127.0.0.1:51125 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn42] end connection 127.0.0.1:51126 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn43] end connection 127.0.0.1:51127 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn44] end connection 127.0.0.1:51128 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn45] end connection 127.0.0.1:51129 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn46] end connection 127.0.0.1:51131 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn48] end connection 127.0.0.1:51138 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn49] end connection 127.0.0.1:51151 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn50] end connection 127.0.0.1:51152 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn51] end connection 127.0.0.1:51153 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn52] end connection 127.0.0.1:51154 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn53] end connection 127.0.0.1:51155 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn54] end connection 127.0.0.1:51157 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn56] end connection 127.0.0.1:51164 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn57] end connection 127.0.0.1:51167 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn58] end connection 127.0.0.1:51171 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn59] end connection 127.0.0.1:51185 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn60] end connection 127.0.0.1:51186 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn61] end connection 127.0.0.1:51187 (47 connections now open) 2016-04-12T18:20:09.026+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51237 #80 (49 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn63] end connection 127.0.0.1:51189 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn64] end connection 127.0.0.1:51191 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn68] end connection 127.0.0.1:51208 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn69] end connection 127.0.0.1:51217 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn62] end connection 127.0.0.1:51188 (47 connections now open) 2016-04-12T18:20:09.026+0000 I NETWORK [conn66] end connection 127.0.0.1:51198 (47 connections now open) 2016-04-12T18:20:09.026+0000 I NETWORK [conn72] end connection 127.0.0.1:51220 (47 connections now open) 2016-04-12T18:20:09.026+0000 I NETWORK [conn74] end connection 127.0.0.1:51223 (47 connections now open) 2016-04-12T18:20:09.027+0000 I NETWORK [conn73] end connection 127.0.0.1:51221 (47 connections now open) 2016-04-12T18:20:09.027+0000 I NETWORK [conn71] end connection 127.0.0.1:51219 (47 connections now open) 2016-04-12T18:20:09.027+0000 I NETWORK [conn70] end connection 127.0.0.1:51218 (47 connections now open) 2016-04-12T18:20:09.027+0000 I NETWORK [conn13] end connection 127.0.0.1:51038 (47 connections now open) 2016-04-12T18:20:09.027+0000 I NETWORK [conn75] end connection 127.0.0.1:51227 (47 connections now open) 2016-04-12T18:20:09.044+0000 I NETWORK [conn78] end connection 127.0.0.1:51235 (5 connections now open) 2016-04-12T18:20:09.060+0000 I NETWORK [conn79] end connection 127.0.0.1:51236 (5 connections now open) 2016-04-12T18:20:09.066+0000 I NETWORK [conn77] end connection 127.0.0.1:51234 (3 connections now open) 2016-04-12T18:20:09.226+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51239 #81 (4 connections now open) 2016-04-12T18:20:09.232+0000 I NETWORK [conn28] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:51080] 2016-04-12T18:20:09.242+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-12T18:20:09.247+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-12T18:20:09.249+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-12T18:20:09.250+0000 I NETWORK [conn21] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:51058] 2016-04-12T18:20:09.329+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51247 #82 (3 connections now open) 2016-04-12T18:20:09.786+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51248 #83 (4 connections now open) 2016-04-12T18:20:09.787+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51250 #84 (5 connections now open) 2016-04-12T18:20:09.802+0000 I NETWORK [conn84] end connection 127.0.0.1:51250 (4 connections now open) 2016-04-12T18:20:09.803+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51252 #85 (5 connections now open) 2016-04-12T18:20:09.807+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51253 #86 (6 connections now open) 2016-04-12T18:20:09.834+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51255 #87 (7 connections now open) 2016-04-12T18:20:09.836+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51256 #88 (8 connections now open) 2016-04-12T18:20:09.856+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51257 #89 (9 connections now open) 2016-04-12T18:20:11.043+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51262 #90 (10 connections now open) 2016-04-12T18:20:11.142+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51264 #91 (11 connections now open) 2016-04-12T18:20:11.143+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51268 #92 (12 connections now open) 2016-04-12T18:20:11.145+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51269 #93 (13 connections now open) 2016-04-12T18:20:11.147+0000 I NETWORK [conn93] end connection 127.0.0.1:51269 (12 connections now open) 2016-04-12T18:20:12.179+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51274 #94 (13 connections now open) 2016-04-12T18:20:13.477+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51276 #95 (14 connections now open) 2016-04-12T18:20:13.490+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51277 #96 (15 connections now open) 2016-04-12T18:20:13.490+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51278 #97 (16 connections now open) 2016-04-12T18:20:13.490+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51279 #98 (17 connections now open) 2016-04-12T18:20:13.490+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51280 #99 (18 connections now open) 2016-04-12T18:20:13.493+0000 I ACCESS [conn90] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:13.542+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51281 #100 (19 connections now open) 2016-04-12T18:20:13.676+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51286 #101 (20 connections now open) 2016-04-12T18:20:14.038+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51288 #102 (21 connections now open) 2016-04-12T18:20:14.038+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51290 #103 (22 connections now open) 2016-04-12T18:20:14.039+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51291 #104 (23 connections now open) 2016-04-12T18:20:14.063+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51292 #105 (24 connections now open) 2016-04-12T18:20:14.077+0000 I NETWORK [conn102] end connection 127.0.0.1:51288 (23 connections now open) 2016-04-12T18:20:14.118+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51294 #106 (24 connections now open) 2016-04-12T18:20:14.118+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51295 #107 (25 connections now open) 2016-04-12T18:20:14.121+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51296 #108 (26 connections now open) 2016-04-12T18:20:16.065+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51298 #109 (27 connections now open) 2016-04-12T18:20:16.068+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51299 #110 (28 connections now open) 2016-04-12T18:20:16.110+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51300 #111 (29 connections now open) 2016-04-12T18:20:16.110+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51301 #112 (30 connections now open) 2016-04-12T18:20:16.110+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51302 #113 (31 connections now open) 2016-04-12T18:20:16.110+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51303 #114 (32 connections now open) 2016-04-12T18:20:16.383+0000 I ACCESS [conn81] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:16.399+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51307 #115 (33 connections now open) 2016-04-12T18:20:16.402+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51308 #116 (34 connections now open) 2016-04-12T18:20:16.486+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51310 #117 (35 connections now open) 2016-04-12T18:20:16.486+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51312 #118 (36 connections now open) 2016-04-12T18:20:16.487+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51313 #119 (37 connections now open) 2016-04-12T18:20:16.487+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51314 #120 (38 connections now open) 2016-04-12T18:20:16.487+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51315 #121 (39 connections now open) 2016-04-12T18:20:16.490+0000 I NETWORK [conn117] end connection 127.0.0.1:51310 (38 connections now open) 2016-04-12T18:20:16.541+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51317 #122 (39 connections now open) 2016-04-12T18:20:16.582+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51322 #123 (40 connections now open) 2016-04-12T18:20:16.727+0000 I ACCESS [conn89] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:16.852+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51323 #124 (41 connections now open) 2016-04-12T18:20:16.853+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51324 #125 (42 connections now open) 2016-04-12T18:20:18.433+0000 I ACCESS [conn110] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:18.433+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51325 #126 (43 connections now open) 2016-04-12T18:20:19.238+0000 I ACCESS [conn125] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:20.902+0000 I ACCESS [conn126] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:21.034+0000 I ACCESS [conn100] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:21.052+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51326 #127 (44 connections now open) 2016-04-12T18:20:21.081+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51327 #128 (45 connections now open) 2016-04-12T18:20:21.084+0000 I ACCESS [conn108] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:21.093+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51328 #129 (46 connections now open) 2016-04-12T18:20:21.117+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51329 #130 (47 connections now open) 2016-04-12T18:20:21.123+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51330 #131 (48 connections now open) 2016-04-12T18:20:21.123+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51331 #132 (49 connections now open) 2016-04-12T18:20:23.398+0000 I ACCESS [conn122] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:23.399+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51332 #133 (50 connections now open) 2016-04-12T18:20:23.538+0000 I ACCESS [conn132] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:24.631+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51333 #134 (51 connections now open) 2016-04-12T18:20:27.336+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51334 #135 (52 connections now open) 2016-04-12T18:20:31.138+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-12T18:24:03.396+0000 I NETWORK [conn128] end connection 127.0.0.1:51327 (51 connections now open) 2016-04-12T18:24:03.396+0000 I NETWORK [conn127] end connection 127.0.0.1:51326 (50 connections now open) 2016-04-12T18:24:03.396+0000 I NETWORK [conn101] end connection 127.0.0.1:51286 (49 connections now open) 2016-04-12T18:24:03.397+0000 I NETWORK [conn100] end connection 127.0.0.1:51281 (48 connections now open) 2016-04-12T18:24:03.397+0000 I NETWORK [conn99] end connection 127.0.0.1:51280 (47 connections now open) 2016-04-12T18:24:03.397+0000 I NETWORK [conn98] end connection 127.0.0.1:51279 (46 connections now open) 2016-04-12T18:24:03.397+0000 I NETWORK [conn97] end connection 127.0.0.1:51278 (45 connections now open) 2016-04-12T18:24:03.398+0000 I NETWORK [conn96] end connection 127.0.0.1:51277 (44 connections now open) 2016-04-12T18:24:03.398+0000 I NETWORK [conn95] end connection 127.0.0.1:51276 (43 connections now open) 2016-04-12T18:24:03.398+0000 I NETWORK [conn90] end connection 127.0.0.1:51262 (42 connections now open) 2016-04-12T18:24:04.953+0000 I NETWORK [conn91] end connection 127.0.0.1:51264 (41 connections now open) 2016-04-12T18:24:04.953+0000 I NETWORK [conn130] end connection 127.0.0.1:51329 (40 connections now open) 2016-04-12T18:24:04.954+0000 I NETWORK [conn129] end connection 127.0.0.1:51328 (39 connections now open) 2016-04-12T18:24:04.954+0000 I NETWORK [conn126] end connection 127.0.0.1:51325 (38 connections now open) 2016-04-12T18:24:04.961+0000 I NETWORK [conn114] end connection 127.0.0.1:51303 (37 connections now open) 2016-04-12T18:24:04.961+0000 I NETWORK [conn113] end connection 127.0.0.1:51302 (36 connections now open) 2016-04-12T18:24:04.961+0000 I NETWORK [conn112] end connection 127.0.0.1:51301 (35 connections now open) 2016-04-12T18:24:04.961+0000 I NETWORK [conn111] end connection 127.0.0.1:51300 (34 connections now open) 2016-04-12T18:24:04.961+0000 I NETWORK [conn110] end connection 127.0.0.1:51299 (33 connections now open) 2016-04-12T18:24:04.961+0000 I NETWORK [conn109] end connection 127.0.0.1:51298 (32 connections now open) 2016-04-12T18:24:07.202+0000 I NETWORK [conn135] end connection 127.0.0.1:51334 (31 connections now open) 2016-04-12T18:24:07.203+0000 I NETWORK [conn132] end connection 127.0.0.1:51331 (30 connections now open) 2016-04-12T18:24:07.203+0000 I NETWORK [conn131] end connection 127.0.0.1:51330 (29 connections now open) 2016-04-12T18:24:07.203+0000 I NETWORK [conn115] end connection 127.0.0.1:51307 (28 connections now open) 2016-04-12T18:24:07.203+0000 I NETWORK [conn108] end connection 127.0.0.1:51296 (27 connections now open) 2016-04-12T18:24:07.203+0000 I NETWORK [conn107] end connection 127.0.0.1:51295 (26 connections now open) 2016-04-12T18:24:07.203+0000 I NETWORK [conn104] end connection 127.0.0.1:51291 (25 connections now open) 2016-04-12T18:24:07.203+0000 I NETWORK [conn103] end connection 127.0.0.1:51290 (24 connections now open) 2016-04-12T18:24:07.203+0000 I NETWORK [conn106] end connection 127.0.0.1:51294 (23 connections now open) 2016-04-12T18:24:07.203+0000 I NETWORK [conn105] end connection 127.0.0.1:51292 (22 connections now open) 2016-04-12T18:24:10.319+0000 I NETWORK [conn134] end connection 127.0.0.1:51333 (21 connections now open) 2016-04-12T18:24:10.319+0000 I NETWORK [conn125] end connection 127.0.0.1:51324 (20 connections now open) 2016-04-12T18:24:10.319+0000 I NETWORK [conn124] end connection 127.0.0.1:51323 (19 connections now open) 2016-04-12T18:24:10.319+0000 I NETWORK [conn94] end connection 127.0.0.1:51274 (18 connections now open) 2016-04-12T18:24:10.320+0000 I NETWORK [conn89] end connection 127.0.0.1:51257 (17 connections now open) 2016-04-12T18:24:10.320+0000 I NETWORK [conn88] end connection 127.0.0.1:51256 (16 connections now open) 2016-04-12T18:24:10.350+0000 I NETWORK [conn87] end connection 127.0.0.1:51255 (16 connections now open) 2016-04-12T18:24:10.350+0000 I NETWORK [conn85] end connection 127.0.0.1:51252 (15 connections now open) 2016-04-12T18:24:10.350+0000 I NETWORK [conn86] end connection 127.0.0.1:51253 (14 connections now open) 2016-04-12T18:24:10.350+0000 I NETWORK [conn83] end connection 127.0.0.1:51248 (13 connections now open) 2016-04-12T18:24:11.576+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51399 #136 (13 connections now open) 2016-04-12T18:24:11.576+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51400 #137 (14 connections now open) 2016-04-12T18:24:11.576+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51401 #138 (15 connections now open) 2016-04-12T18:24:11.576+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51402 #139 (16 connections now open) 2016-04-12T18:24:11.576+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51403 #140 (17 connections now open) 2016-04-12T18:24:11.705+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51407 #141 (18 connections now open) 2016-04-12T18:24:11.705+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51409 #142 (19 connections now open) 2016-04-12T18:24:11.739+0000 I NETWORK [conn142] end connection 127.0.0.1:51409 (18 connections now open) 2016-04-12T18:24:11.786+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51412 #143 (19 connections now open) 2016-04-12T18:24:11.899+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51417 #144 (20 connections now open) 2016-04-12T18:24:14.321+0000 I NETWORK [conn133] end connection 127.0.0.1:51332 (19 connections now open) 2016-04-12T18:24:14.333+0000 I NETWORK [conn123] end connection 127.0.0.1:51322 (18 connections now open) 2016-04-12T18:24:14.334+0000 I NETWORK [conn121] end connection 127.0.0.1:51315 (17 connections now open) 2016-04-12T18:24:14.334+0000 I NETWORK [conn120] end connection 127.0.0.1:51314 (16 connections now open) 2016-04-12T18:24:14.334+0000 I NETWORK [conn118] end connection 127.0.0.1:51312 (15 connections now open) 2016-04-12T18:24:14.334+0000 I NETWORK [conn119] end connection 127.0.0.1:51313 (14 connections now open) 2016-04-12T18:24:14.334+0000 I NETWORK [conn122] end connection 127.0.0.1:51317 (13 connections now open) 2016-04-12T18:24:14.334+0000 I NETWORK [conn116] end connection 127.0.0.1:51308 (12 connections now open) 2016-04-12T18:24:14.335+0000 I NETWORK [conn82] end connection 127.0.0.1:51247 (11 connections now open) 2016-04-12T18:24:14.335+0000 I NETWORK [conn81] end connection 127.0.0.1:51239 (10 connections now open) 2016-04-12T18:24:16.460+0000 I ACCESS [conn143] Successfully authenticated as principal oplogger on admin 2016-04-12T18:24:16.653+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51430 #145 (11 connections now open) 2016-04-12T18:24:16.658+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51431 #146 (12 connections now open) 2016-04-12T18:24:16.659+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51432 #147 (13 connections now open) 2016-04-12T18:24:16.688+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51433 #148 (14 connections now open) 2016-04-12T18:24:16.688+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51434 #149 (15 connections now open) 2016-04-12T18:24:16.797+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51438 #150 (16 connections now open) 2016-04-12T18:24:16.797+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51440 #151 (17 connections now open) 2016-04-12T18:24:16.851+0000 I NETWORK [conn151] end connection 127.0.0.1:51440 (16 connections now open) 2016-04-12T18:24:16.884+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51443 #152 (17 connections now open) 2016-04-12T18:24:18.729+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51446 #153 (18 connections now open) 2016-04-12T18:24:18.732+0000 I NETWORK [conn153] end connection 127.0.0.1:51446 (17 connections now open) 2016-04-12T18:24:18.740+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51449 #154 (18 connections now open) 2016-04-12T18:24:19.013+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51454 #155 (19 connections now open) 2016-04-12T18:24:19.467+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51466 #156 (20 connections now open) 2016-04-12T18:24:19.469+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51467 #157 (21 connections now open) 2016-04-12T18:24:19.469+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51468 #158 (22 connections now open) 2016-04-12T18:24:19.470+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51469 #159 (23 connections now open) 2016-04-12T18:24:19.471+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51470 #160 (24 connections now open) 2016-04-12T18:24:19.728+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51474 #161 (25 connections now open) 2016-04-12T18:24:19.729+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51476 #162 (26 connections now open) 2016-04-12T18:24:19.874+0000 I NETWORK [conn162] end connection 127.0.0.1:51476 (25 connections now open) 2016-04-12T18:24:19.904+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51479 #163 (26 connections now open) 2016-04-12T18:24:20.114+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51484 #164 (27 connections now open) 2016-04-12T18:24:20.848+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51488 #165 (28 connections now open) 2016-04-12T18:24:23.614+0000 I ACCESS [conn152] Successfully authenticated as principal oplogger on admin 2016-04-12T18:24:23.684+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51490 #166 (29 connections now open) 2016-04-12T18:24:23.686+0000 I NETWORK [conn166] end connection 127.0.0.1:51490 (28 connections now open) 2016-04-12T18:24:23.695+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51493 #167 (29 connections now open) 2016-04-12T18:24:23.750+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51498 #168 (30 connections now open) 2016-04-12T18:24:24.249+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51510 #169 (31 connections now open) 2016-04-12T18:24:24.249+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51511 #170 (32 connections now open) 2016-04-12T18:24:24.250+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51512 #171 (33 connections now open) 2016-04-12T18:24:24.250+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51513 #172 (34 connections now open) 2016-04-12T18:24:24.250+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51514 #173 (35 connections now open) 2016-04-12T18:24:24.419+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51518 #174 (36 connections now open) 2016-04-12T18:24:24.419+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51520 #175 (37 connections now open) 2016-04-12T18:24:24.450+0000 I NETWORK [conn175] end connection 127.0.0.1:51520 (36 connections now open) 2016-04-12T18:24:24.506+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51523 #176 (37 connections now open) 2016-04-12T18:24:24.690+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51528 #177 (38 connections now open) 2016-04-12T18:24:25.337+0000 I ACCESS [conn154] Successfully authenticated as principal oplogger on admin 2016-04-12T18:24:26.213+0000 I ACCESS [conn167] Successfully authenticated as principal oplogger on admin 2016-04-12T18:24:26.818+0000 I ACCESS [conn163] Successfully authenticated as principal oplogger on admin 2016-04-12T18:24:26.847+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51530 #178 (39 connections now open) 2016-04-12T18:24:26.864+0000 I NETWORK [conn178] end connection 127.0.0.1:51530 (38 connections now open) 2016-04-12T18:24:26.896+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51533 #179 (39 connections now open) 2016-04-12T18:24:26.952+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51538 #180 (40 connections now open) 2016-04-12T18:24:27.442+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51550 #181 (41 connections now open) 2016-04-12T18:24:27.442+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51551 #182 (42 connections now open) 2016-04-12T18:24:27.442+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51552 #183 (43 connections now open) 2016-04-12T18:24:27.442+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51553 #184 (44 connections now open) 2016-04-12T18:24:27.442+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51554 #185 (45 connections now open) 2016-04-12T18:24:27.503+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51558 #186 (46 connections now open) 2016-04-12T18:24:27.536+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51560 #187 (47 connections now open) 2016-04-12T18:24:27.623+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51563 #188 (48 connections now open) 2016-04-12T18:24:27.624+0000 I NETWORK [conn187] end connection 127.0.0.1:51560 (47 connections now open) 2016-04-12T18:24:27.707+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51568 #189 (48 connections now open) 2016-04-12T18:24:31.275+0000 I ACCESS [conn179] Successfully authenticated as principal oplogger on admin 2016-04-12T18:24:31.865+0000 I ACCESS [conn176] Successfully authenticated as principal oplogger on admin 2016-04-12T18:24:31.914+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51570 #190 (49 connections now open) 2016-04-12T18:24:31.932+0000 I NETWORK [conn190] end connection 127.0.0.1:51570 (48 connections now open) 2016-04-12T18:24:32.055+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51573 #191 (49 connections now open) 2016-04-12T18:24:34.058+0000 I ACCESS [conn188] Successfully authenticated as principal oplogger on admin 2016-04-12T18:24:34.171+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51576 #192 (50 connections now open) 2016-04-12T18:24:34.175+0000 I NETWORK [conn192] end connection 127.0.0.1:51576 (49 connections now open) 2016-04-12T18:24:34.246+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51579 #193 (50 connections now open) 2016-04-12T18:24:34.345+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51584 #194 (51 connections now open) 2016-04-12T18:24:34.609+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51588 #195 (52 connections now open) 2016-04-12T18:24:38.418+0000 I ACCESS [conn191] Successfully authenticated as principal oplogger on admin 2016-04-12T18:24:39.204+0000 I ACCESS [conn193] Successfully authenticated as principal oplogger on admin 2016-04-12T18:29:45.092+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 28, timestamp: Apr 12 18:29:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 28, timestamp: Apr 12 18:29:45:5) 2016-04-12T18:29:45.092+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-12T18:29:45.093+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-12T18:29:45.093+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T18:29:48.696+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T18:31:42.853+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 28, timestamp: Apr 12 18:31:09:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 28, timestamp: Apr 12 18:31:42:1) 2016-04-12T18:31:42.853+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-12T18:31:42.853+0000 W REPL [ReplicationExecutor] The liveness timeout does not match callback handle, so not resetting it. 2016-04-12T18:31:47.864+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-12T18:31:47.865+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-12T18:35:31.687+0000 I NETWORK [conn165] end connection 127.0.0.1:51488 (51 connections now open) 2016-04-12T18:35:31.688+0000 I NETWORK [conn154] end connection 127.0.0.1:51449 (50 connections now open) 2016-04-12T18:35:31.688+0000 I NETWORK [conn144] end connection 127.0.0.1:51417 (49 connections now open) 2016-04-12T18:35:31.688+0000 I NETWORK [conn143] end connection 127.0.0.1:51412 (48 connections now open) 2016-04-12T18:35:31.689+0000 I NETWORK [conn141] end connection 127.0.0.1:51407 (47 connections now open) 2016-04-12T18:35:31.689+0000 I NETWORK [conn140] end connection 127.0.0.1:51403 (46 connections now open) 2016-04-12T18:35:31.689+0000 I NETWORK [conn139] end connection 127.0.0.1:51402 (45 connections now open) 2016-04-12T18:35:31.689+0000 I NETWORK [conn138] end connection 127.0.0.1:51401 (44 connections now open) 2016-04-12T18:35:31.689+0000 I NETWORK [conn137] end connection 127.0.0.1:51400 (43 connections now open) 2016-04-12T18:35:31.689+0000 I NETWORK [conn136] end connection 127.0.0.1:51399 (42 connections now open) 2016-04-12T18:35:32.480+0000 I NETWORK [conn168] end connection 127.0.0.1:51498 (41 connections now open) 2016-04-12T18:35:32.480+0000 I NETWORK [conn167] end connection 127.0.0.1:51493 (40 connections now open) 2016-04-12T18:35:32.480+0000 I NETWORK [conn155] end connection 127.0.0.1:51454 (39 connections now open) 2016-04-12T18:35:32.480+0000 I NETWORK [conn152] end connection 127.0.0.1:51443 (38 connections now open) 2016-04-12T18:35:32.481+0000 I NETWORK [conn150] end connection 127.0.0.1:51438 (37 connections now open) 2016-04-12T18:35:32.481+0000 I NETWORK [conn149] end connection 127.0.0.1:51434 (36 connections now open) 2016-04-12T18:35:32.481+0000 I NETWORK [conn148] end connection 127.0.0.1:51433 (35 connections now open) 2016-04-12T18:35:32.481+0000 I NETWORK [conn147] end connection 127.0.0.1:51432 (34 connections now open) 2016-04-12T18:35:32.482+0000 I NETWORK [conn146] end connection 127.0.0.1:51431 (33 connections now open) 2016-04-12T18:35:32.482+0000 I NETWORK [conn145] end connection 127.0.0.1:51430 (32 connections now open) 2016-04-12T18:35:33.257+0000 I NETWORK [conn180] end connection 127.0.0.1:51538 (31 connections now open) 2016-04-12T18:35:33.266+0000 I NETWORK [conn179] end connection 127.0.0.1:51533 (30 connections now open) 2016-04-12T18:35:33.266+0000 I NETWORK [conn164] end connection 127.0.0.1:51484 (29 connections now open) 2016-04-12T18:35:33.267+0000 I NETWORK [conn163] end connection 127.0.0.1:51479 (28 connections now open) 2016-04-12T18:35:33.267+0000 I NETWORK [conn161] end connection 127.0.0.1:51474 (27 connections now open) 2016-04-12T18:35:33.267+0000 I NETWORK [conn160] end connection 127.0.0.1:51470 (26 connections now open) 2016-04-12T18:35:33.267+0000 I NETWORK [conn159] end connection 127.0.0.1:51469 (25 connections now open) 2016-04-12T18:35:33.267+0000 I NETWORK [conn158] end connection 127.0.0.1:51468 (24 connections now open) 2016-04-12T18:35:33.267+0000 I NETWORK [conn157] end connection 127.0.0.1:51467 (23 connections now open) 2016-04-12T18:35:33.268+0000 I NETWORK [conn156] end connection 127.0.0.1:51466 (22 connections now open) 2016-04-12T18:35:34.033+0000 I NETWORK [conn195] end connection 127.0.0.1:51588 (21 connections now open) 2016-04-12T18:35:34.034+0000 I NETWORK [conn191] end connection 127.0.0.1:51573 (21 connections now open) 2016-04-12T18:35:34.034+0000 I NETWORK [conn177] end connection 127.0.0.1:51528 (21 connections now open) 2016-04-12T18:35:34.035+0000 I NETWORK [conn176] end connection 127.0.0.1:51523 (21 connections now open) 2016-04-12T18:35:34.035+0000 I NETWORK [conn174] end connection 127.0.0.1:51518 (21 connections now open) 2016-04-12T18:35:34.035+0000 I NETWORK [conn173] end connection 127.0.0.1:51514 (21 connections now open) 2016-04-12T18:35:34.035+0000 I NETWORK [conn172] end connection 127.0.0.1:51513 (21 connections now open) 2016-04-12T18:35:34.035+0000 I NETWORK [conn171] end connection 127.0.0.1:51512 (21 connections now open) 2016-04-12T18:35:34.035+0000 I NETWORK [conn170] end connection 127.0.0.1:51511 (21 connections now open) 2016-04-12T18:35:34.035+0000 I NETWORK [conn169] end connection 127.0.0.1:51510 (21 connections now open) 2016-04-12T18:35:34.836+0000 I NETWORK [conn194] end connection 127.0.0.1:51584 (11 connections now open) 2016-04-12T18:35:34.836+0000 I NETWORK [conn193] end connection 127.0.0.1:51579 (10 connections now open) 2016-04-12T18:35:34.836+0000 I NETWORK [conn189] end connection 127.0.0.1:51568 (9 connections now open) 2016-04-12T18:35:34.836+0000 I NETWORK [conn188] end connection 127.0.0.1:51563 (8 connections now open) 2016-04-12T18:35:34.836+0000 I NETWORK [conn186] end connection 127.0.0.1:51558 (7 connections now open) 2016-04-12T18:35:34.837+0000 I NETWORK [conn185] end connection 127.0.0.1:51554 (6 connections now open) 2016-04-12T18:35:34.837+0000 I NETWORK [conn184] end connection 127.0.0.1:51553 (5 connections now open) 2016-04-12T18:35:34.837+0000 I NETWORK [conn183] end connection 127.0.0.1:51552 (4 connections now open) 2016-04-12T18:35:34.837+0000 I NETWORK [conn182] end connection 127.0.0.1:51551 (3 connections now open) 2016-04-12T18:35:34.837+0000 I NETWORK [conn181] end connection 127.0.0.1:51550 (2 connections now open) 2016-04-12T18:35:44.197+0000 I CONTROL [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends 2016-04-12T18:35:44.197+0000 I FTDC [signalProcessingThread] Shutting down full-time diagnostic data capture 2016-04-12T18:35:44.203+0000 I REPL [signalProcessingThread] Stopping replication applier threads 2016-04-12T18:35:44.281+0000 W EXECUTOR [rsBackgroundSync] killCursors command task failed: CallbackCanceled Callback canceled 2016-04-12T18:35:45.240+0000 I CONTROL [signalProcessingThread] now exiting 2016-04-12T18:35:45.240+0000 I NETWORK [signalProcessingThread] shutdown: going to close listening sockets... 2016-04-12T18:35:45.240+0000 I NETWORK [signalProcessingThread] closing listening socket: 6 2016-04-12T18:35:45.240+0000 I NETWORK [signalProcessingThread] closing listening socket: 7 2016-04-12T18:35:45.240+0000 I NETWORK [signalProcessingThread] closing listening socket: 8 2016-04-12T18:35:45.241+0000 I NETWORK [signalProcessingThread] removing socket file: /tmp/mongodb-27016.sock 2016-04-12T18:35:45.241+0000 I NETWORK [signalProcessingThread] shutdown: going to flush diaglog... 2016-04-12T18:35:45.241+0000 I NETWORK [signalProcessingThread] shutdown: going to close sockets... 2016-04-12T18:35:45.241+0000 I STORAGE [signalProcessingThread] WiredTigerKVEngine shutting down 2016-04-12T18:35:45.241+0000 I NETWORK [conn92] end connection 127.0.0.1:51268 (1 connection now open) 2016-04-12T18:35:45.241+0000 I NETWORK [conn80] end connection 127.0.0.1:51237 (1 connection now open) 2016-04-12T18:35:45.273+0000 I STORAGE [signalProcessingThread] shutdown: removing fs lock... 2016-04-12T18:35:45.273+0000 I CONTROL [signalProcessingThread] dbexit: rc: 0 2016-04-12T18:35:49.907+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] MongoDB starting : pid=17820 port=27016 dbpath=/var/lib/mongodb-replica/mongodbreplica2 64-bit host=ip-172-31-6-169 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] db version v3.2.1 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] git version: a14d55980c2cdc565d4704a7e3ad37e4e535c1b2 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] modules: none 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] build environment: 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] distmod: ubuntu1404 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] distarch: x86_64 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb.d/mongodbreplica2.conf", net: { http: { RESTInterfaceEnabled: true, enabled: true }, port: 27016 }, processManagement: { pidFilePath: "/var/run/mongodb-replica/mongodbreplica2.pid" }, replication: { oplogSizeMB: 128, replSet: "mongodbreplica" }, storage: { dbPath: "/var/lib/mongodb-replica/mongodbreplica2", mmapv1: { smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb-replica/mongodbreplica2.log" } } 2016-04-12T18:35:50.010+0000 I - [initandlisten] Detected data files in /var/lib/mongodb-replica/mongodbreplica2 created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2016-04-12T18:35:50.010+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-04-12T18:35:51.112+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-04-12T18:35:51.112+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 127182 records totaling to 2916795086 bytes 2016-04-12T18:35:51.113+0000 I STORAGE [initandlisten] Sampling from the oplog between Apr 8 12:54:47:1 and Apr 12 18:35:09:2 to determine where to place markers for truncation 2016-04-12T18:35:51.113+0000 I STORAGE [initandlisten] Taking 1002 samples and assuming that each section of oplog contains approximately 1269 records totaling to 29103276 bytes 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 13:49:12:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 14:47:11:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 15:43:07:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 16:39:36:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 17:45:46:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 18:15:56:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 19:14:45:5 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 20:12:13:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 21:09:09:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 22:05:09:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 23:05:08:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 23:36:08:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 00:32:38:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 01:28:45:6 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 02:25:45:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 03:22:07:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 04:18:38:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 04:48:34:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 05:44:40:5 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 06:40:45:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 07:38:00:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 08:34:02:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 09:30:08:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 10:00:07:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 10:56:41:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 11:52:46:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 12:50:02:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 13:46:08:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 14:47:46:5 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 15:17:37:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 16:14:20:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 17:11:00:6 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 18:07:40:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 19:03:44:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:03:50:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:33:45:7 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 21:32:45:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 22:31:41:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 23:31:44:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 00:31:00:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 01:29:49:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 02:29:40:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 03:28:45:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 04:28:19:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 05:27:35:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 06:27:36:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 06:57:38:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 07:56:16:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 08:56:45:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 09:56:45:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 10:56:45:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 11:56:14:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 12:56:19:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 13:56:13:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 14:56:21:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 15:53:38:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 16:23:39:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 17:23:20:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 18:30:45:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 19:26:47:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 20:23:00:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 21:19:07:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 21:48:22:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 22:44:12:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 23:40:45:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 00:37:00:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 01:32:46:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:29:02:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:58:08:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 03:54:18:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 04:50:46:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 05:47:06:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 06:43:41:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 07:39:35:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 08:09:07:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 09:05:39:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:01:08:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:57:38:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 11:53:39:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 12:49:46:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 13:19:45:4 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 14:19:58:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 15:16:00:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 16:13:02:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 17:10:46:4 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 18:07:53:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 18:46:03:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 19:44:29:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 20:58:45:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 21:59:06:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 22:59:20:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 23:55:50:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 00:34:54:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 01:32:45:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 02:29:41:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 03:26:31:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 04:24:09:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:20:45:5 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:50:45:5 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 18:27:50:3 2016-04-12T18:35:53.455+0000 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2016-04-12T18:35:53.483+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb-replica/mongodbreplica2/diagnostic.data' 2016-04-12T18:35:53.483+0000 I NETWORK [initandlisten] waiting for connections on port 27016 2016-04-12T18:35:53.483+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-04-12T18:35:53.484+0000 I NETWORK [websvr] admin web console waiting for connections on port 28016 2016-04-12T18:35:53.485+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "mongodbreplica", version: 2, protocolVersion: 1, members: [ { _id: 0, host: "localhost:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "localhost:27016", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "localhost:27015", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-04-12T18:35:53.485+0000 I REPL [ReplicationExecutor] This node is localhost:27016 in the config 2016-04-12T18:35:53.485+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-04-12T18:35:53.485+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-04-12T18:35:53.486+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-12T18:35:53.486+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-12T18:35:53.486+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-12T18:35:53.499+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-04-12T18:35:53.499+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-04-12T18:35:53.500+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-12T18:35:58.384+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51726 #1 (1 connection now open) 2016-04-12T18:35:58.410+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51728 #2 (2 connections now open) 2016-04-12T18:36:03.717+0000 I NETWORK [conn1] end connection 127.0.0.1:51726 (1 connection now open) 2016-04-12T18:36:03.717+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51733 #3 (2 connections now open) 2016-04-12T18:36:03.717+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51734 #4 (3 connections now open) 2016-04-12T18:36:04.835+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-12T18:36:04.835+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-12T18:36:04.835+0000 I REPL [ReplicationExecutor] VoteRequester: Got no vote from localhost:27017 because: candidate's term is lower than mine, resp:{ term: 29, voteGranted: false, reason: "candidate's term is lower than mine", ok: 1.0 } 2016-04-12T18:36:04.835+0000 I REPL [ReplicationExecutor] not running for primary, we have been superceded already 2016-04-12T18:36:08.486+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state PRIMARY 2016-04-12T18:36:08.501+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-12T18:36:08.502+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-12T18:36:08.502+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-12T18:37:57.031+0000 I CONTROL [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends 2016-04-12T18:37:57.031+0000 I FTDC [signalProcessingThread] Shutting down full-time diagnostic data capture 2016-04-12T18:37:57.053+0000 I REPL [signalProcessingThread] Stopping replication applier threads 2016-04-12T18:37:58.447+0000 I NETWORK [conn4] end connection 127.0.0.1:51734 (2 connections now open) 2016-04-12T18:37:58.448+0000 I NETWORK [conn3] end connection 127.0.0.1:51733 (1 connection now open) 2016-04-12T18:37:58.511+0000 I NETWORK [conn2] end connection 127.0.0.1:51728 (0 connections now open) 2016-04-12T18:37:58.524+0000 I CONTROL [signalProcessingThread] now exiting 2016-04-12T18:37:58.524+0000 I NETWORK [signalProcessingThread] shutdown: going to close listening sockets... 2016-04-12T18:37:58.524+0000 I NETWORK [signalProcessingThread] closing listening socket: 6 2016-04-12T18:37:58.524+0000 I NETWORK [signalProcessingThread] closing listening socket: 7 2016-04-12T18:37:58.524+0000 I NETWORK [signalProcessingThread] closing listening socket: 8 2016-04-12T18:37:58.524+0000 I NETWORK [signalProcessingThread] removing socket file: /tmp/mongodb-27016.sock 2016-04-12T18:37:58.524+0000 I NETWORK [signalProcessingThread] shutdown: going to flush diaglog... 2016-04-12T18:37:58.524+0000 I NETWORK [signalProcessingThread] shutdown: going to close sockets... 2016-04-12T18:37:58.524+0000 I STORAGE [signalProcessingThread] WiredTigerKVEngine shutting down 2016-04-12T18:37:58.545+0000 I STORAGE [signalProcessingThread] shutdown: removing fs lock... 2016-04-12T18:37:58.545+0000 I CONTROL [signalProcessingThread] dbexit: rc: 0 2016-04-12T18:39:17.536+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] MongoDB starting : pid=18110 port=27016 dbpath=/var/lib/mongodb-replica/mongodbreplica2 64-bit host=ip-172-31-6-169 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] db version v3.2.1 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] git version: a14d55980c2cdc565d4704a7e3ad37e4e535c1b2 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] modules: none 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] build environment: 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] distmod: ubuntu1404 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] distarch: x86_64 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb.d/mongodbreplica2.conf", net: { http: { RESTInterfaceEnabled: true, enabled: true }, port: 27016 }, processManagement: { pidFilePath: "/var/run/mongodb-replica/mongodbreplica2.pid" }, replication: { oplogSizeMB: 128, replSet: "mongodbreplica" }, storage: { dbPath: "/var/lib/mongodb-replica/mongodbreplica2", mmapv1: { smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb-replica/mongodbreplica2.log" } } 2016-04-12T18:39:17.674+0000 I - [initandlisten] Detected data files in /var/lib/mongodb-replica/mongodbreplica2 created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2016-04-12T18:39:17.674+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-04-12T18:39:18.879+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-04-12T18:39:18.879+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 127183 records totaling to 2916795180 bytes 2016-04-12T18:39:18.879+0000 I STORAGE [initandlisten] Sampling from the oplog between Apr 8 12:54:47:1 and Apr 12 18:36:04:1 to determine where to place markers for truncation 2016-04-12T18:39:18.879+0000 I STORAGE [initandlisten] Taking 1002 samples and assuming that each section of oplog contains approximately 1269 records totaling to 29103049 bytes 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 13:49:12:2 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 14:49:50:3 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 15:49:01:1 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 16:51:32:2 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 17:57:49:1 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 18:59:47:1 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 20:00:46:1 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 21:00:36:1 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 21:29:39:2 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 22:29:00:1 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 23:32:46:2 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 00:32:39:2 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 01:32:09:2 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 02:31:16:1 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 03:30:51:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 04:30:39:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 05:30:01:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 06:28:45:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 07:28:42:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 07:58:37:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 08:57:08:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 09:56:46:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 10:53:45:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 11:50:06:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 12:46:45:4 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 13:43:45:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 14:15:45:3 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 15:14:45:3 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 16:11:37:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 17:07:38:3 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 18:04:21:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 19:01:11:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 19:31:10:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:27:44:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 21:23:43:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 22:19:46:3 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 23:16:16:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 00:13:07:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 00:42:31:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 01:39:07:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 02:35:09:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 03:31:40:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 04:28:45:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 05:25:00:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 05:54:14:3 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 06:51:40:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 07:47:36:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 08:44:14:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 09:41:37:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 10:38:13:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 11:08:45:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 12:05:36:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 13:02:15:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 13:59:38:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 14:56:20:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 15:53:38:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 16:23:38:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 17:23:19:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 18:30:17:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 19:27:00:3 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 20:22:45:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 21:19:07:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 21:48:21:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 22:44:45:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 23:40:37:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 00:37:00:6 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 01:32:45:4 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:29:00:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:58:08:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 03:53:48:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 04:51:02:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 05:47:06:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 06:43:41:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 07:39:35:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 08:09:07:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 09:05:39:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:01:09:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:57:37:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 11:53:40:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 12:49:46:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 13:19:44:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 14:19:58:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 15:15:59:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 16:13:00:6 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 17:10:46:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 18:07:52:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 18:46:04:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 19:44:29:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 20:59:12:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 21:59:06:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 22:59:21:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 23:56:00:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 00:34:54:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 01:33:01:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 02:29:41:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 03:26:31:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 04:24:09:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:20:45:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:50:43:3 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 18:27:50:2 2016-04-12T18:39:19.960+0000 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2016-04-12T18:39:19.997+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb-replica/mongodbreplica2/diagnostic.data' 2016-04-12T18:39:19.997+0000 I NETWORK [initandlisten] waiting for connections on port 27016 2016-04-12T18:39:19.997+0000 I NETWORK [websvr] admin web console waiting for connections on port 28016 2016-04-12T18:39:19.997+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-04-12T18:39:19.999+0000 W NETWORK [ReplicationExecutor] Failed to connect to 127.0.0.1:27017, reason: errno:111 Connection refused 2016-04-12T18:39:20.011+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "mongodbreplica", version: 2, protocolVersion: 1, members: [ { _id: 0, host: "localhost:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "localhost:27016", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "localhost:27015", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-04-12T18:39:20.011+0000 I REPL [ReplicationExecutor] This node is localhost:27016 in the config 2016-04-12T18:39:20.011+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-04-12T18:39:20.011+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-04-12T18:39:20.012+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:20.012+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-12T18:39:20.013+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-12T18:39:20.013+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:20.013+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-04-12T18:39:20.013+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:20.014+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-04-12T18:39:20.730+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51772 #1 (1 connection now open) 2016-04-12T18:39:20.730+0000 I NETWORK [conn1] end connection 127.0.0.1:51772 (0 connections now open) 2016-04-12T18:39:20.731+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51774 #2 (1 connection now open) 2016-04-12T18:39:24.740+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51782 #3 (2 connections now open) 2016-04-12T18:39:25.014+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-12T18:39:25.014+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-12T18:39:31.788+0000 I NETWORK [conn2] end connection 127.0.0.1:51774 (1 connection now open) 2016-04-12T18:39:35.016+0000 I ASIO [ReplicationExecutor] dropping unhealthy pooled connection to localhost:27017 2016-04-12T18:39:35.016+0000 I ASIO [ReplicationExecutor] after drop, pool was empty, going to spawn some connections 2016-04-12T18:39:35.016+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:35.016+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:35.016+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state PRIMARY 2016-04-12T18:39:35.017+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:35.018+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-12T18:39:35.019+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-12T18:39:35.019+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T18:39:40.017+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:40.017+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:40.017+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:42.017+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:42.018+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:42.019+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:44.019+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:44.019+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:44.019+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:46.019+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:46.019+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:46.019+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:48.019+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:48.020+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:48.020+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:50.021+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:50.021+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:50.021+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:52.021+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:52.021+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:52.022+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:54.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:54.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:54.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:56.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:56.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:56.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:58.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:58.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:58.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:40:00.024+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:40:00.024+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:40:00.024+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:40:02.024+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:40:02.024+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:40:02.024+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:40:04.025+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:40:04.025+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:40:04.025+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:40:05.015+0000 I CONTROL [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends 2016-04-12T18:40:05.015+0000 I FTDC [signalProcessingThread] Shutting down full-time diagnostic data capture 2016-04-12T18:40:05.017+0000 I REPL [signalProcessingThread] Stopping replication applier threads 2016-04-12T18:40:05.045+0000 W EXECUTOR [rsBackgroundSync] killCursors command task failed: CallbackCanceled Callback canceled 2016-04-12T18:40:06.029+0000 I CONTROL [signalProcessingThread] now exiting 2016-04-12T18:40:06.029+0000 I NETWORK [signalProcessingThread] shutdown: going to close listening sockets... 2016-04-12T18:40:06.029+0000 I NETWORK [signalProcessingThread] closing listening socket: 6 2016-04-12T18:40:06.029+0000 I NETWORK [signalProcessingThread] closing listening socket: 7 2016-04-12T18:40:06.029+0000 I NETWORK [signalProcessingThread] closing listening socket: 8 2016-04-12T18:40:06.029+0000 I NETWORK [signalProcessingThread] removing socket file: /tmp/mongodb-27016.sock 2016-04-12T18:40:06.029+0000 I NETWORK [signalProcessingThread] shutdown: going to flush diaglog... 2016-04-12T18:40:06.029+0000 I NETWORK [signalProcessingThread] shutdown: going to close sockets... 2016-04-12T18:40:06.029+0000 I STORAGE [signalProcessingThread] WiredTigerKVEngine shutting down 2016-04-12T18:40:06.029+0000 I NETWORK [conn3] end connection 127.0.0.1:51782 (0 connections now open) 2016-04-12T18:40:06.101+0000 I STORAGE [signalProcessingThread] shutdown: removing fs lock... 2016-04-12T18:40:06.101+0000 I CONTROL [signalProcessingThread] dbexit: rc: 0 2016-04-12T18:40:15.070+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-04-12T18:40:15.123+0000 I CONTROL [initandlisten] MongoDB starting : pid=18398 port=27016 dbpath=/var/lib/mongodb-replica/mongodbreplica2 64-bit host=ip-172-31-6-169 2016-04-12T18:40:15.123+0000 I CONTROL [initandlisten] db version v3.2.1 2016-04-12T18:40:15.123+0000 I CONTROL [initandlisten] git version: a14d55980c2cdc565d4704a7e3ad37e4e535c1b2 2016-04-12T18:40:15.123+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014 2016-04-12T18:40:15.123+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-04-12T18:40:15.123+0000 I CONTROL [initandlisten] modules: none 2016-04-12T18:40:15.123+0000 I CONTROL [initandlisten] build environment: 2016-04-12T18:40:15.124+0000 I CONTROL [initandlisten] distmod: ubuntu1404 2016-04-12T18:40:15.124+0000 I CONTROL [initandlisten] distarch: x86_64 2016-04-12T18:40:15.124+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-04-12T18:40:15.124+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb.d/mongodbreplica2.conf", net: { http: { RESTInterfaceEnabled: true, enabled: true }, port: 27016 }, processManagement: { pidFilePath: "/var/run/mongodb-replica/mongodbreplica2.pid" }, replication: { oplogSizeMB: 128, replSet: "mongodbreplica" }, storage: { dbPath: "/var/lib/mongodb-replica/mongodbreplica2", mmapv1: { smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb-replica/mongodbreplica2.log" } } 2016-04-12T18:40:15.239+0000 I - [initandlisten] Detected data files in /var/lib/mongodb-replica/mongodbreplica2 created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2016-04-12T18:40:15.239+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-04-12T18:40:16.476+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-04-12T18:40:16.476+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 127184 records totaling to 2916795274 bytes 2016-04-12T18:40:16.477+0000 I STORAGE [initandlisten] Sampling from the oplog between Apr 8 12:54:47:1 and Apr 12 18:39:30:2 to determine where to place markers for truncation 2016-04-12T18:40:16.477+0000 I STORAGE [initandlisten] Taking 1002 samples and assuming that each section of oplog contains approximately 1269 records totaling to 29102821 bytes 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 13:49:12:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 14:47:11:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 15:43:07:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 16:39:36:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 17:45:46:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 18:15:56:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 19:14:45:5 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 20:12:13:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 21:09:09:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 22:05:09:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 23:05:08:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 23:36:08:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 00:32:38:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 01:28:45:6 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 02:25:45:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 03:22:07:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 04:18:38:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 04:48:34:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 05:44:40:5 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 06:40:45:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 07:38:00:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 08:34:02:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 09:30:08:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 10:00:07:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 10:56:41:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 11:52:46:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 12:50:02:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 13:46:08:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 14:47:46:5 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 15:17:37:3 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 16:14:20:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 17:11:00:6 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 18:07:40:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 19:03:44:3 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:03:50:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:33:45:7 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 21:32:45:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 22:31:41:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 23:31:44:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 00:31:00:3 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 01:29:49:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 02:29:40:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 03:28:45:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 04:28:19:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 05:27:35:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 06:27:36:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 06:57:38:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 07:56:16:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 08:56:45:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 09:56:45:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 10:56:45:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 11:56:14:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 12:56:19:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 13:56:13:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 14:56:21:3 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 15:53:38:3 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 16:23:39:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 17:23:20:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 18:30:45:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 19:26:47:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 20:23:00:3 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 21:19:07:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 21:48:22:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 22:44:12:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 23:40:45:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 00:37:00:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 01:32:46:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:29:02:3 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:58:08:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 03:54:18:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 04:50:46:3 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 05:47:06:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 06:43:41:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 07:39:35:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 08:09:07:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 09:05:39:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:01:08:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:57:38:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 11:53:39:3 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 12:49:46:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 13:19:45:4 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 14:19:58:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 15:16:00:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 16:13:02:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 17:10:46:4 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 18:07:53:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 18:46:03:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 19:44:29:3 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 20:58:45:3 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 21:59:06:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 22:59:20:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 23:55:50:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 00:34:54:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 01:32:45:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 02:29:41:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 03:26:31:1 2016-04-12T18:40:17.447+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 04:24:09:2 2016-04-12T18:40:17.447+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:20:45:5 2016-04-12T18:40:17.447+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:50:45:5 2016-04-12T18:40:17.447+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 18:27:50:3 2016-04-12T18:40:17.863+0000 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2016-04-12T18:40:17.887+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb-replica/mongodbreplica2/diagnostic.data' 2016-04-12T18:40:17.887+0000 I NETWORK [initandlisten] waiting for connections on port 27016 2016-04-12T18:40:17.887+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-04-12T18:40:17.896+0000 I NETWORK [websvr] admin web console waiting for connections on port 28016 2016-04-12T18:40:17.897+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "mongodbreplica", version: 2, protocolVersion: 1, members: [ { _id: 0, host: "localhost:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "localhost:27016", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "localhost:27015", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-04-12T18:40:17.897+0000 I REPL [ReplicationExecutor] This node is localhost:27016 in the config 2016-04-12T18:40:17.897+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-04-12T18:40:17.897+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-04-12T18:40:17.898+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-12T18:40:17.898+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-12T18:40:17.898+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-04-12T18:40:17.899+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-04-12T18:40:17.899+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-12T18:40:17.899+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-12T18:40:22.663+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51903 #1 (1 connection now open) 2016-04-12T18:40:22.751+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51905 #2 (2 connections now open) 2016-04-12T18:40:32.901+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state PRIMARY 2016-04-12T18:40:33.901+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-12T18:40:33.901+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-12T18:40:33.902+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T18:40:38.769+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51914 #3 (3 connections now open) 2016-04-12T18:40:38.770+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-12T18:40:38.770+0000 W REPL [ReplicationExecutor] The liveness timeout does not match callback handle, so not resetting it. 2016-04-12T18:40:38.771+0000 I ASIO [ReplicationExecutor] dropping unhealthy pooled connection to localhost:27015 2016-04-12T18:40:38.771+0000 I ASIO [ReplicationExecutor] after drop, pool was empty, going to spawn some connections 2016-04-12T18:40:38.771+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-12T18:40:38.771+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state PRIMARY 2016-04-12T18:40:38.771+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-12T18:40:38.771+0000 I NETWORK [conn1] end connection 127.0.0.1:51903 (2 connections now open) 2016-04-12T18:40:44.772+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-12T18:40:44.773+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-12T18:40:44.773+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T18:40:55.795+0000 I CONTROL [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends 2016-04-12T18:40:55.795+0000 I FTDC [signalProcessingThread] Shutting down full-time diagnostic data capture 2016-04-12T18:40:55.797+0000 I REPL [signalProcessingThread] Stopping replication applier threads 2016-04-12T18:40:57.790+0000 I CONTROL [signalProcessingThread] now exiting 2016-04-12T18:40:57.790+0000 I NETWORK [signalProcessingThread] shutdown: going to close listening sockets... 2016-04-12T18:40:57.790+0000 I NETWORK [signalProcessingThread] closing listening socket: 6 2016-04-12T18:40:57.790+0000 I NETWORK [signalProcessingThread] closing listening socket: 7 2016-04-12T18:40:57.790+0000 I NETWORK [signalProcessingThread] closing listening socket: 8 2016-04-12T18:40:57.790+0000 I NETWORK [signalProcessingThread] removing socket file: /tmp/mongodb-27016.sock 2016-04-12T18:40:57.790+0000 I NETWORK [signalProcessingThread] shutdown: going to flush diaglog... 2016-04-12T18:40:57.790+0000 I NETWORK [signalProcessingThread] shutdown: going to close sockets... 2016-04-12T18:40:57.790+0000 I STORAGE [signalProcessingThread] WiredTigerKVEngine shutting down 2016-04-12T18:40:57.791+0000 I NETWORK [conn2] end connection 127.0.0.1:51905 (1 connection now open) 2016-04-12T18:40:57.791+0000 I NETWORK [conn3] end connection 127.0.0.1:51914 (1 connection now open) 2016-04-12T18:40:57.916+0000 I STORAGE [signalProcessingThread] shutdown: removing fs lock... 2016-04-12T18:40:57.916+0000 I CONTROL [signalProcessingThread] dbexit: rc: 0 2016-04-12T18:42:04.041+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] MongoDB starting : pid=1098 port=27016 dbpath=/var/lib/mongodb-replica/mongodbreplica2 64-bit host=ip-172-31-6-169 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] db version v3.2.1 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] git version: a14d55980c2cdc565d4704a7e3ad37e4e535c1b2 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] modules: none 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] build environment: 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] distmod: ubuntu1404 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] distarch: x86_64 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb.d/mongodbreplica2.conf", net: { http: { RESTInterfaceEnabled: true, enabled: true }, port: 27016 }, processManagement: { pidFilePath: "/var/run/mongodb-replica/mongodbreplica2.pid" }, replication: { oplogSizeMB: 128, replSet: "mongodbreplica" }, storage: { dbPath: "/var/lib/mongodb-replica/mongodbreplica2", mmapv1: { smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb-replica/mongodbreplica2.log" } } 2016-04-12T18:42:04.375+0000 I - [initandlisten] Detected data files in /var/lib/mongodb-replica/mongodbreplica2 created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2016-04-12T18:42:04.375+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-04-12T18:42:05.826+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-04-12T18:42:05.826+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 127186 records totaling to 2916795462 bytes 2016-04-12T18:42:05.827+0000 I STORAGE [initandlisten] Sampling from the oplog between Apr 8 12:54:47:1 and Apr 12 18:40:39:1 to determine where to place markers for truncation 2016-04-12T18:42:05.828+0000 I STORAGE [initandlisten] Taking 1002 samples and assuming that each section of oplog contains approximately 1269 records totaling to 29102365 bytes 2016-04-12T18:42:07.712+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 13:52:46:5 2016-04-12T18:42:07.712+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 14:26:32:1 2016-04-12T18:42:07.712+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 15:25:08:1 2016-04-12T18:42:07.712+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 16:24:21:1 2016-04-12T18:42:07.712+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 17:33:38:3 2016-04-12T18:42:07.712+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 18:35:43:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 19:34:26:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 20:35:14:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 21:34:00:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 22:33:00:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 23:36:44:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 00:08:46:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 01:05:27:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 02:01:19:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 02:56:49:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 03:52:45:3 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 04:48:45:3 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 05:21:09:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 06:16:46:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 07:14:01:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 08:08:45:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 09:04:46:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 10:00:44:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 10:32:42:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 11:29:12:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 12:25:16:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 13:21:15:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 14:21:04:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 15:18:45:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 15:51:02:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 16:47:07:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 17:43:08:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 18:39:08:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 19:35:38:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:31:45:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 21:03:44:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 21:59:38:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 22:55:10:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 23:51:46:3 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 00:47:07:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 01:43:08:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 02:15:08:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 03:11:08:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 04:07:09:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 05:03:07:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 05:59:06:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 06:55:36:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 07:27:11:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 08:23:36:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 09:19:47:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 10:16:45:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 11:13:07:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 12:09:37:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 12:41:46:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 13:38:22:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 14:35:08:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 15:31:40:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 16:27:46:3 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 17:29:45:4 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 18:09:46:4 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 19:05:45:6 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 20:01:53:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 20:57:09:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 21:53:00:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 22:48:45:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 23:20:13:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 00:15:55:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 01:11:43:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:07:45:3 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 03:03:01:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 03:57:47:3 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 04:30:34:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 05:25:45:7 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 06:21:55:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 07:17:43:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 08:13:47:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 09:09:08:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 09:41:06:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:37:06:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 11:32:30:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 12:28:25:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 13:23:52:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 14:23:58:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 14:55:49:1 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 15:51:41:4 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 16:48:45:4 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 17:46:33:1 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 18:52:45:5 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 19:48:46:1 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 20:30:16:1 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 21:37:53:2 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 22:41:43:1 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 23:40:45:2 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 00:50:03:2 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 01:49:47:2 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 02:49:45:1 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 03:48:26:2 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 04:48:50:2 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:48:41:1 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 06:20:44:1 2016-04-12T18:42:07.989+0000 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2016-04-12T18:42:08.070+0000 I NETWORK [websvr] admin web console waiting for connections on port 28016 2016-04-12T18:42:08.075+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb-replica/mongodbreplica2/diagnostic.data' 2016-04-12T18:42:08.075+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-04-12T18:42:08.077+0000 I NETWORK [initandlisten] waiting for connections on port 27016 2016-04-12T18:42:08.077+0000 W NETWORK [ReplicationExecutor] Failed to connect to 127.0.0.1:27017, reason: errno:111 Connection refused 2016-04-12T18:42:08.078+0000 W NETWORK [ReplicationExecutor] Failed to connect to 127.0.0.1:27015, reason: errno:111 Connection refused 2016-04-12T18:42:08.078+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "mongodbreplica", version: 2, protocolVersion: 1, members: [ { _id: 0, host: "localhost:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "localhost:27016", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "localhost:27015", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-04-12T18:42:08.078+0000 I REPL [ReplicationExecutor] This node is localhost:27016 in the config 2016-04-12T18:42:08.078+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-04-12T18:42:08.078+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-04-12T18:42:08.089+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-04-12T18:42:08.092+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-04-12T18:42:08.093+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:42:08.093+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable Connection refused 2016-04-12T18:42:08.093+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:42:08.093+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable Connection refused 2016-04-12T18:42:08.110+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:42:08.110+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable Connection refused 2016-04-12T18:42:08.247+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44336 #1 (1 connection now open) 2016-04-12T18:42:08.249+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44338 #2 (2 connections now open) 2016-04-12T18:42:08.264+0000 I NETWORK [conn1] end connection 127.0.0.1:44336 (1 connection now open) 2016-04-12T18:42:08.361+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44343 #3 (2 connections now open) 2016-04-12T18:42:08.361+0000 I NETWORK [conn3] end connection 127.0.0.1:44343 (1 connection now open) 2016-04-12T18:42:08.362+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44345 #4 (2 connections now open) 2016-04-12T18:42:13.094+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-12T18:42:13.094+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-12T18:42:13.111+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-12T18:42:13.111+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-12T18:42:23.094+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state PRIMARY 2016-04-12T18:42:24.094+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-12T18:42:24.095+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-12T18:42:24.096+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-12T18:43:36.412+0000 I CONTROL [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends 2016-04-12T18:43:36.412+0000 I FTDC [signalProcessingThread] Shutting down full-time diagnostic data capture 2016-04-12T18:43:36.429+0000 I REPL [signalProcessingThread] Stopping replication applier threads 2016-04-12T18:43:38.312+0000 I CONTROL [signalProcessingThread] now exiting 2016-04-12T18:43:38.312+0000 I NETWORK [signalProcessingThread] shutdown: going to close listening sockets... 2016-04-12T18:43:38.312+0000 I NETWORK [signalProcessingThread] closing listening socket: 6 2016-04-12T18:43:38.312+0000 I NETWORK [signalProcessingThread] closing listening socket: 7 2016-04-12T18:43:38.312+0000 I NETWORK [signalProcessingThread] closing listening socket: 8 2016-04-12T18:43:38.312+0000 I NETWORK [signalProcessingThread] removing socket file: /tmp/mongodb-27016.sock 2016-04-12T18:43:38.312+0000 I NETWORK [signalProcessingThread] shutdown: going to flush diaglog... 2016-04-12T18:43:38.312+0000 I NETWORK [signalProcessingThread] shutdown: going to close sockets... 2016-04-12T18:43:38.312+0000 I STORAGE [signalProcessingThread] WiredTigerKVEngine shutting down 2016-04-12T18:43:38.312+0000 I NETWORK [conn2] end connection 127.0.0.1:44338 (1 connection now open) 2016-04-12T18:43:38.313+0000 I NETWORK [conn4] end connection 127.0.0.1:44345 (1 connection now open) 2016-04-12T18:43:38.417+0000 I STORAGE [signalProcessingThread] shutdown: removing fs lock... 2016-04-12T18:43:38.418+0000 I CONTROL [signalProcessingThread] dbexit: rc: 0 2016-04-12T18:43:42.426+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-04-12T18:43:42.432+0000 I CONTROL [initandlisten] MongoDB starting : pid=1950 port=27016 dbpath=/var/lib/mongodb-replica/mongodbreplica2 64-bit host=ip-172-31-6-169 2016-04-12T18:43:42.433+0000 I CONTROL [initandlisten] db version v3.2.4 2016-04-12T18:43:42.433+0000 I CONTROL [initandlisten] git version: e2ee9ffcf9f5a94fad76802e28cc978718bb7a30 2016-04-12T18:43:42.433+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014 2016-04-12T18:43:42.433+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-04-12T18:43:42.433+0000 I CONTROL [initandlisten] modules: none 2016-04-12T18:43:42.433+0000 I CONTROL [initandlisten] build environment: 2016-04-12T18:43:42.433+0000 I CONTROL [initandlisten] distmod: ubuntu1404 2016-04-12T18:43:42.433+0000 I CONTROL [initandlisten] distarch: x86_64 2016-04-12T18:43:42.433+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-04-12T18:43:42.433+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb.d/mongodbreplica2.conf", net: { http: { RESTInterfaceEnabled: true, enabled: true }, port: 27016 }, processManagement: { pidFilePath: "/var/run/mongodb-replica/mongodbreplica2.pid" }, replication: { oplogSizeMB: 128, replSet: "mongodbreplica" }, storage: { dbPath: "/var/lib/mongodb-replica/mongodbreplica2", mmapv1: { smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb-replica/mongodbreplica2.log" } } 2016-04-12T18:43:42.525+0000 I - [initandlisten] Detected data files in /var/lib/mongodb-replica/mongodbreplica2 created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2016-04-12T18:43:42.525+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-04-12T18:43:44.325+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-04-12T18:43:44.334+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 127187 records totaling to 2916795556 bytes 2016-04-12T18:43:44.335+0000 I STORAGE [initandlisten] Sampling from the oplog between Apr 8 12:54:47:1 and Apr 12 18:42:19:1 to determine where to place markers for truncation 2016-04-12T18:43:44.335+0000 I STORAGE [initandlisten] Taking 1002 samples and assuming that each section of oplog contains approximately 1269 records totaling to 29102137 bytes 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 13:26:34:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 14:25:47:3 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 15:25:07:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 16:23:46:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 17:33:37:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 18:35:09:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 19:33:47:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 20:35:13:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 21:33:53:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 22:32:15:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 23:36:40:3 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 00:08:40:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 01:08:37:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 02:07:17:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 03:06:40:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 04:06:08:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 05:04:47:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 06:03:46:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 07:03:14:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 08:02:38:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 09:01:11:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 09:33:45:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 10:30:01:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 11:26:00:3 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 12:22:08:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 13:18:06:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 14:17:46:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 14:51:09:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 15:47:39:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 16:43:36:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 17:39:37:3 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 18:35:43:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 19:31:46:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:04:45:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:59:46:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 21:55:45:5 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 22:51:43:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 23:47:41:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 00:43:42:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 01:15:47:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 02:11:46:3 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 03:07:41:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 04:03:44:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 04:59:42:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 05:55:38:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 06:27:43:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 07:24:07:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 08:19:45:5 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 09:16:45:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 10:13:07:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 11:09:41:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 11:41:45:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 12:38:45:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 13:35:07:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 14:31:42:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 15:27:48:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 16:24:17:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 16:57:08:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 18:07:08:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 19:02:45:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 19:57:50:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 20:53:45:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 21:49:40:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 22:21:42:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 23:17:08:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 00:12:27:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 01:07:59:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:03:42:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:59:08:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 03:31:08:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 04:27:09:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 05:23:00:5 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 06:18:24:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 07:14:21:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 08:09:41:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 08:41:44:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 09:37:47:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:33:38:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 11:29:12:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 12:25:01:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 13:21:00:4 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 13:53:00:3 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 14:52:33:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 15:48:31:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 16:44:45:5 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 17:42:46:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 18:47:46:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 19:21:08:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 20:26:02:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 21:35:00:4 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 22:35:02:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 23:30:44:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 00:36:44:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 01:09:48:3 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 02:05:46:4 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 03:01:47:4 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 03:57:46:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 04:55:25:1 2016-04-12T18:43:46.404+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:52:01:1 2016-04-12T18:43:46.404+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 06:24:07:2 2016-04-12T18:43:46.529+0000 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2016-04-12T18:43:46.553+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb-replica/mongodbreplica2/diagnostic.data' 2016-04-12T18:43:46.554+0000 I NETWORK [initandlisten] waiting for connections on port 27016 2016-04-12T18:43:46.554+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-04-12T18:43:46.554+0000 I NETWORK [websvr] admin web console waiting for connections on port 28016 2016-04-12T18:43:46.564+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "mongodbreplica", version: 2, protocolVersion: 1, members: [ { _id: 0, host: "localhost:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "localhost:27016", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "localhost:27015", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-04-12T18:43:46.564+0000 I REPL [ReplicationExecutor] This node is localhost:27016 in the config 2016-04-12T18:43:46.564+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-04-12T18:43:46.564+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-04-12T18:43:46.564+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-12T18:43:46.565+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-12T18:43:46.565+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-04-12T18:43:46.565+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-04-12T18:43:46.566+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-12T18:43:46.566+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-12T18:43:50.322+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44379 #1 (1 connection now open) 2016-04-12T18:43:51.377+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44381 #2 (2 connections now open) 2016-04-12T18:43:56.566+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state PRIMARY 2016-04-12T18:44:01.567+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-12T18:44:01.568+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-12T18:44:01.569+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T18:45:31.580+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T18:45:45.739+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44405 #3 (3 connections now open) 2016-04-12T18:45:45.739+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44406 #4 (4 connections now open) 2016-04-12T18:45:45.739+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44407 #5 (5 connections now open) 2016-04-12T18:45:45.739+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44408 #6 (6 connections now open) 2016-04-12T18:45:45.739+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44409 #7 (7 connections now open) 2016-04-12T18:45:45.870+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44413 #8 (8 connections now open) 2016-04-12T18:45:45.871+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44415 #9 (9 connections now open) 2016-04-12T18:45:45.902+0000 I NETWORK [conn9] end connection 127.0.0.1:44415 (8 connections now open) 2016-04-12T18:45:45.966+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44418 #10 (9 connections now open) 2016-04-12T18:45:46.071+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44423 #11 (10 connections now open) 2016-04-12T18:45:49.307+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44435 #12 (11 connections now open) 2016-04-12T18:45:49.307+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44436 #13 (12 connections now open) 2016-04-12T18:45:49.322+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44437 #14 (13 connections now open) 2016-04-12T18:45:49.322+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44438 #15 (14 connections now open) 2016-04-12T18:45:49.324+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44439 #16 (15 connections now open) 2016-04-12T18:45:49.510+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44443 #17 (16 connections now open) 2016-04-12T18:45:49.510+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44445 #18 (17 connections now open) 2016-04-12T18:45:49.524+0000 I NETWORK [conn18] end connection 127.0.0.1:44445 (16 connections now open) 2016-04-12T18:45:49.545+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44448 #19 (17 connections now open) 2016-04-12T18:45:49.612+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44453 #20 (18 connections now open) 2016-04-12T18:45:52.736+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44465 #21 (19 connections now open) 2016-04-12T18:45:52.736+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44466 #22 (20 connections now open) 2016-04-12T18:45:52.736+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44467 #23 (21 connections now open) 2016-04-12T18:45:52.736+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44468 #24 (22 connections now open) 2016-04-12T18:45:52.736+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44469 #25 (23 connections now open) 2016-04-12T18:45:52.888+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44473 #26 (24 connections now open) 2016-04-12T18:45:52.888+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44475 #27 (25 connections now open) 2016-04-12T18:45:52.905+0000 I NETWORK [conn27] end connection 127.0.0.1:44475 (24 connections now open) 2016-04-12T18:45:52.974+0000 I ACCESS [conn10] Successfully authenticated as principal oplogger on admin 2016-04-12T18:45:52.991+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44478 #28 (25 connections now open) 2016-04-12T18:45:53.021+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44481 #29 (26 connections now open) 2016-04-12T18:45:53.025+0000 I NETWORK [conn29] end connection 127.0.0.1:44481 (25 connections now open) 2016-04-12T18:45:53.054+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44484 #30 (26 connections now open) 2016-04-12T18:45:53.101+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44489 #31 (27 connections now open) 2016-04-12T18:45:55.233+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44493 #32 (28 connections now open) 2016-04-12T18:45:56.525+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44505 #33 (29 connections now open) 2016-04-12T18:45:56.525+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44506 #34 (30 connections now open) 2016-04-12T18:45:56.525+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44507 #35 (31 connections now open) 2016-04-12T18:45:56.525+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44508 #36 (32 connections now open) 2016-04-12T18:45:56.525+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44509 #37 (33 connections now open) 2016-04-12T18:45:56.757+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44513 #38 (34 connections now open) 2016-04-12T18:45:56.757+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44515 #39 (35 connections now open) 2016-04-12T18:45:56.760+0000 I NETWORK [conn39] end connection 127.0.0.1:44515 (34 connections now open) 2016-04-12T18:45:56.781+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44518 #40 (35 connections now open) 2016-04-12T18:45:56.809+0000 I ACCESS [conn19] Successfully authenticated as principal oplogger on admin 2016-04-12T18:45:56.856+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44521 #41 (36 connections now open) 2016-04-12T18:45:56.861+0000 I NETWORK [conn41] end connection 127.0.0.1:44521 (35 connections now open) 2016-04-12T18:45:56.871+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44526 #42 (36 connections now open) 2016-04-12T18:45:56.908+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44528 #43 (37 connections now open) 2016-04-12T18:45:58.770+0000 I ACCESS [conn40] Successfully authenticated as principal oplogger on admin 2016-04-12T18:45:59.432+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44533 #44 (38 connections now open) 2016-04-12T18:46:00.223+0000 I ACCESS [conn30] Successfully authenticated as principal oplogger on admin 2016-04-12T18:46:00.226+0000 I ACCESS [conn28] Successfully authenticated as principal oplogger on admin 2016-04-12T18:46:00.373+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44535 #45 (39 connections now open) 2016-04-12T18:46:00.423+0000 I NETWORK [conn45] end connection 127.0.0.1:44535 (38 connections now open) 2016-04-12T18:46:00.460+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44538 #46 (39 connections now open) 2016-04-12T18:46:00.509+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44543 #47 (40 connections now open) 2016-04-12T18:46:01.199+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44555 #48 (41 connections now open) 2016-04-12T18:46:01.200+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44556 #49 (42 connections now open) 2016-04-12T18:46:01.202+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44557 #50 (43 connections now open) 2016-04-12T18:46:01.203+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44558 #51 (44 connections now open) 2016-04-12T18:46:01.216+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44559 #52 (45 connections now open) 2016-04-12T18:46:01.315+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44563 #53 (46 connections now open) 2016-04-12T18:46:01.316+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44565 #54 (47 connections now open) 2016-04-12T18:46:01.354+0000 I NETWORK [conn54] end connection 127.0.0.1:44565 (46 connections now open) 2016-04-12T18:46:01.439+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44568 #55 (47 connections now open) 2016-04-12T18:46:01.534+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44573 #56 (48 connections now open) 2016-04-12T18:46:04.118+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44575 #57 (49 connections now open) 2016-04-12T18:46:04.134+0000 I NETWORK [conn57] end connection 127.0.0.1:44575 (48 connections now open) 2016-04-12T18:46:04.239+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44578 #58 (49 connections now open) 2016-04-12T18:46:04.323+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44583 #59 (50 connections now open) 2016-04-12T18:46:04.484+0000 I ACCESS [conn43] Successfully authenticated as principal oplogger on admin 2016-04-12T18:46:05.131+0000 I ACCESS [conn46] Successfully authenticated as principal oplogger on admin 2016-04-12T18:46:08.848+0000 I ACCESS [conn55] Successfully authenticated as principal oplogger on admin 2016-04-12T18:46:08.914+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44585 #60 (51 connections now open) 2016-04-12T18:46:08.919+0000 I NETWORK [conn60] end connection 127.0.0.1:44585 (50 connections now open) 2016-04-12T18:46:08.980+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44588 #61 (51 connections now open) 2016-04-12T18:46:09.062+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44593 #62 (52 connections now open) 2016-04-12T18:46:11.089+0000 I ACCESS [conn58] Successfully authenticated as principal oplogger on admin 2016-04-12T18:46:12.923+0000 I ACCESS [conn61] Successfully authenticated as principal oplogger on admin 2016-04-12T18:49:45.882+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-12T18:49:50.892+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-12T18:49:50.892+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-12T18:49:50.893+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-12T18:51:00.102+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-12T18:58:42.099+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 12 18:57:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 12 18:58:41:2) 2016-04-12T18:58:42.112+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-12T18:58:48.114+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-12T18:58:48.114+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-12T18:58:48.115+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T18:59:45.097+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T19:48:45.075+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 12 19:48:09:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 34, timestamp: Apr 12 19:48:45:5) 2016-04-12T19:48:45.075+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-12T19:48:51.088+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-12T19:48:51.090+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-12T19:49:50.029+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-12T19:49:50.031+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-12T19:49:50.032+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-12T19:51:46.934+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-12T20:14:23.634+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45128 #63 (53 connections now open) 2016-04-12T20:14:23.644+0000 I NETWORK [conn63] end connection 127.0.0.1:45128 (52 connections now open) 2016-04-12T20:14:23.645+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45129 #64 (53 connections now open) 2016-04-12T20:14:23.646+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45130 #65 (54 connections now open) 2016-04-12T20:27:32.660+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45170 #66 (55 connections now open) 2016-04-12T20:35:45.055+0000 I NETWORK [conn65] end connection 127.0.0.1:45130 (54 connections now open) 2016-04-12T20:40:45.042+0000 I NETWORK [conn64] end connection 127.0.0.1:45129 (53 connections now open) 2016-04-12T20:40:45.042+0000 I NETWORK [conn66] end connection 127.0.0.1:45170 (52 connections now open) 2016-04-12T20:58:30.432+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 12 20:57:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 12 20:58:29:1) 2016-04-12T20:58:30.432+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-12T20:58:31.432+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-12T20:58:31.433+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-12T20:58:31.434+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T21:02:45.084+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T22:01:24.493+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 12 22:00:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 34, timestamp: Apr 12 22:01:24:1) 2016-04-12T22:01:24.493+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-12T22:01:49.498+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-12T22:01:49.499+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-12T22:28:45.042+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 12 22:28:12:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 34, timestamp: Apr 12 22:28:45:2) 2016-04-12T22:28:45.042+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-12T22:28:46.042+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T00:32:50.040+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T00:32:50.043+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T00:32:50.043+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T00:36:04.426+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T01:23:25.024+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46509 #67 (53 connections now open) 2016-04-13T01:23:25.025+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46510 #68 (54 connections now open) 2016-04-13T01:23:25.025+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46511 #69 (55 connections now open) 2016-04-13T01:23:25.025+0000 I NETWORK [conn67] end connection 127.0.0.1:46509 (54 connections now open) 2016-04-13T01:31:00.084+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46543 #70 (55 connections now open) 2016-04-13T02:28:45.037+0000 I NETWORK [conn69] end connection 127.0.0.1:46511 (54 connections now open) 2016-04-13T02:33:45.041+0000 I NETWORK [conn68] end connection 127.0.0.1:46510 (53 connections now open) 2016-04-13T02:33:45.042+0000 I NETWORK [conn70] end connection 127.0.0.1:46543 (52 connections now open) 2016-04-13T03:47:31.512+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47444 #71 (53 connections now open) 2016-04-13T03:47:31.513+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47445 #72 (54 connections now open) 2016-04-13T03:47:31.513+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47446 #73 (55 connections now open) 2016-04-13T03:47:31.513+0000 I NETWORK [conn71] end connection 127.0.0.1:47444 (54 connections now open) 2016-04-13T03:47:45.066+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47447 #74 (55 connections now open) 2016-04-13T04:18:43.022+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47667 #75 (56 connections now open) 2016-04-13T04:18:43.023+0000 I NETWORK [conn73] end connection 127.0.0.1:47446 (55 connections now open) 2016-04-13T04:18:43.023+0000 I NETWORK [conn2] end connection 127.0.0.1:44381 (54 connections now open) 2016-04-13T04:19:49.991+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47677 #76 (55 connections now open) 2016-04-13T04:19:49.991+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47678 #77 (56 connections now open) 2016-04-13T04:19:49.992+0000 I NETWORK [conn76] end connection 127.0.0.1:47677 (55 connections now open) 2016-04-13T04:47:35.762+0000 I NETWORK [conn77] end connection 127.0.0.1:47678 (54 connections now open) 2016-04-13T04:47:40.762+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47875 #78 (55 connections now open) 2016-04-13T04:47:40.763+0000 I NETWORK [conn78] end connection 127.0.0.1:47875 (54 connections now open) 2016-04-13T04:47:40.764+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47876 #79 (55 connections now open) 2016-04-13T04:53:30.850+0000 I NETWORK [conn79] end connection 127.0.0.1:47876 (54 connections now open) 2016-04-13T04:53:31.851+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47919 #80 (55 connections now open) 2016-04-13T04:53:31.852+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47920 #81 (56 connections now open) 2016-04-13T04:53:31.852+0000 I NETWORK [conn80] end connection 127.0.0.1:47919 (55 connections now open) 2016-04-13T05:28:51.471+0000 I NETWORK [conn81] end connection 127.0.0.1:47920 (54 connections now open) 2016-04-13T05:28:51.474+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48170 #82 (55 connections now open) 2016-04-13T05:28:51.475+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48171 #83 (56 connections now open) 2016-04-13T05:28:51.477+0000 I NETWORK [conn82] end connection 127.0.0.1:48170 (55 connections now open) 2016-04-13T05:35:42.508+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 05:34:59:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 05:35:42:1) 2016-04-13T05:35:42.508+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T05:35:47.524+0000 I NETWORK [conn83] end connection 127.0.0.1:48171 (54 connections now open) 2016-04-13T05:35:47.526+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T05:35:47.526+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T05:40:47.523+0000 I NETWORK [conn74] end connection 127.0.0.1:47447 (53 connections now open) 2016-04-13T05:40:47.523+0000 I NETWORK [conn72] end connection 127.0.0.1:47445 (52 connections now open) 2016-04-13T05:50:26.822+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 05:49:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 05:50:26:1) 2016-04-13T05:50:26.822+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T05:50:31.832+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T05:50:31.834+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T05:50:31.834+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T05:54:50.082+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T06:12:25.219+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 06:11:48:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 34, timestamp: Apr 13 06:12:25:1) 2016-04-13T06:12:25.219+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T06:12:31.220+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T06:12:31.221+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T06:17:41.322+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T06:17:46.327+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T06:17:46.332+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T06:17:46.332+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T06:21:00.085+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T06:26:29.533+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 06:25:49:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 06:26:29:1) 2016-04-13T06:26:29.545+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T06:26:34.547+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T06:26:34.548+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T06:26:34.549+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T06:27:48.513+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T06:27:48.515+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T06:39:41.762+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 06:39:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 06:39:41:4) 2016-04-13T06:39:41.762+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T06:39:46.775+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T06:39:46.777+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T06:39:46.778+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T06:40:27.242+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 06:39:50:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 34, timestamp: Apr 13 06:40:26:2) 2016-04-13T06:40:27.242+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T06:40:32.243+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T06:40:32.244+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T06:43:02.532+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T06:49:41.564+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 06:49:08:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 34, timestamp: Apr 13 06:49:41:4) 2016-04-13T06:49:41.564+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T06:49:41.566+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T06:49:41.567+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T06:53:08.084+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T06:57:47.183+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48828 #84 (53 connections now open) 2016-04-13T06:57:47.183+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48829 #85 (54 connections now open) 2016-04-13T06:57:47.183+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48830 #86 (55 connections now open) 2016-04-13T06:57:47.183+0000 I NETWORK [conn84] end connection 127.0.0.1:48828 (54 connections now open) 2016-04-13T06:57:50.607+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48831 #87 (55 connections now open) 2016-04-13T08:03:45.262+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 08:03:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 08:03:45:5) 2016-04-13T08:03:45.262+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T08:03:50.263+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T08:03:50.264+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T08:03:50.268+0000 I NETWORK [conn86] end connection 127.0.0.1:48830 (54 connections now open) 2016-04-13T08:04:35.197+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 08:03:53:3) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 08:04:34:1) 2016-04-13T08:04:35.197+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T08:04:45.200+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T08:04:45.201+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T08:04:45.202+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T08:05:47.281+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T08:08:50.267+0000 I NETWORK [conn87] end connection 127.0.0.1:48831 (53 connections now open) 2016-04-13T08:08:50.267+0000 I NETWORK [conn85] end connection 127.0.0.1:48829 (52 connections now open) 2016-04-13T10:04:33.074+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T10:04:33.078+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T10:04:33.078+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T10:05:09.066+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T10:37:50.130+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50389 #88 (53 connections now open) 2016-04-13T10:37:50.131+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50390 #89 (54 connections now open) 2016-04-13T10:37:50.131+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50391 #90 (55 connections now open) 2016-04-13T10:37:50.131+0000 I NETWORK [conn88] end connection 127.0.0.1:50389 (54 connections now open) 2016-04-13T10:39:47.439+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50403 #91 (55 connections now open) 2016-04-13T11:38:28.347+0000 I NETWORK [conn90] end connection 127.0.0.1:50391 (54 connections now open) 2016-04-13T11:38:34.348+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50816 #92 (55 connections now open) 2016-04-13T11:38:34.348+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50817 #93 (56 connections now open) 2016-04-13T11:38:34.349+0000 I NETWORK [conn92] end connection 127.0.0.1:50816 (55 connections now open) 2016-04-13T11:53:42.849+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 11:53:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 11:53:41:2) 2016-04-13T11:53:42.849+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T11:53:42.862+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-13T11:53:43.849+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T11:53:43.850+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T12:08:29.863+0000 I NETWORK [conn93] end connection 127.0.0.1:50817 (54 connections now open) 2016-04-13T12:08:30.890+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51031 #94 (55 connections now open) 2016-04-13T12:08:30.890+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51032 #95 (56 connections now open) 2016-04-13T12:08:30.893+0000 I NETWORK [conn94] end connection 127.0.0.1:51031 (55 connections now open) 2016-04-13T12:11:36.475+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 12:11:00:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 12:11:36:1) 2016-04-13T12:11:36.475+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T12:11:36.505+0000 I NETWORK [conn95] end connection 127.0.0.1:51032 (54 connections now open) 2016-04-13T12:11:42.476+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T12:11:42.477+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T12:16:36.505+0000 I NETWORK [conn89] end connection 127.0.0.1:50390 (53 connections now open) 2016-04-13T12:16:36.506+0000 I NETWORK [conn91] end connection 127.0.0.1:50403 (52 connections now open) 2016-04-13T12:21:24.714+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 12:20:51:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 12:21:24:1) 2016-04-13T12:21:24.715+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T12:21:29.750+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T12:21:29.750+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T12:21:29.751+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T12:21:45.064+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T12:36:45.980+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T12:36:45.980+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T12:36:45.981+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T12:38:52.318+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T13:01:27.797+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 13:00:54:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 13:01:27:1) 2016-04-13T13:01:27.797+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T13:01:33.801+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T13:01:33.802+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T13:01:33.803+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T13:05:00.059+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T13:32:30.598+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 13:31:55:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 34, timestamp: Apr 13 13:32:29:2) 2016-04-13T13:32:30.598+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T13:32:45.601+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T13:32:45.601+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T13:39:42.702+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 13:39:08:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 34, timestamp: Apr 13 13:39:41:2) 2016-04-13T13:39:42.702+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T13:39:48.704+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T13:39:48.704+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T14:09:18.794+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T14:09:24.806+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T14:09:24.807+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T14:09:24.807+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T14:14:10.160+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T15:11:39.819+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 15:10:59:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 15:11:39:1) 2016-04-13T15:11:39.819+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T15:11:45.821+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T15:11:45.823+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T15:11:45.823+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T15:12:57.491+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T15:14:45.871+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T15:14:50.876+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T15:14:50.877+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T15:38:42.340+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 15:38:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 15:38:42:1) 2016-04-13T15:38:42.340+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T15:38:47.346+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T15:38:47.346+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T15:38:47.347+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T15:40:01.210+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T16:23:55.946+0000 I CONTROL [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends 2016-04-13T16:23:55.946+0000 I FTDC [signalProcessingThread] Shutting down full-time diagnostic data capture 2016-04-13T16:23:55.978+0000 I REPL [signalProcessingThread] Stopping replication applier threads 2016-04-13T16:23:56.442+0000 I STORAGE [conn32] got request after shutdown() 2016-04-13T16:23:56.442+0000 I STORAGE [conn47] got request after shutdown() 2016-04-13T16:23:56.543+0000 I STORAGE [conn31] got request after shutdown() 2016-04-13T16:23:57.144+0000 I CONTROL [signalProcessingThread] now exiting 2016-04-13T16:23:57.144+0000 I NETWORK [signalProcessingThread] shutdown: going to close listening sockets... 2016-04-13T16:23:57.144+0000 I NETWORK [signalProcessingThread] closing listening socket: 6 2016-04-13T16:23:57.144+0000 I NETWORK [signalProcessingThread] closing listening socket: 7 2016-04-13T16:23:57.144+0000 I NETWORK [signalProcessingThread] closing listening socket: 8 2016-04-13T16:23:57.144+0000 I NETWORK [signalProcessingThread] removing socket file: /tmp/mongodb-27016.sock 2016-04-13T16:23:57.144+0000 I NETWORK [signalProcessingThread] shutdown: going to flush diaglog... 2016-04-13T16:23:57.144+0000 I NETWORK [signalProcessingThread] shutdown: going to close sockets... 2016-04-13T16:23:57.144+0000 I STORAGE [signalProcessingThread] WiredTigerKVEngine shutting down 2016-04-13T16:23:57.145+0000 I NETWORK [conn1] end connection 127.0.0.1:44379 (48 connections now open) 2016-04-13T16:23:57.145+0000 I NETWORK [conn3] end connection 127.0.0.1:44405 (48 connections now open) 2016-04-13T16:23:57.145+0000 I NETWORK [conn4] end connection 127.0.0.1:44406 (48 connections now open) 2016-04-13T16:23:57.154+0000 I NETWORK [conn5] end connection 127.0.0.1:44407 (48 connections now open) 2016-04-13T16:23:57.154+0000 I NETWORK [conn6] end connection 127.0.0.1:44408 (48 connections now open) 2016-04-13T16:23:57.154+0000 I NETWORK [conn7] end connection 127.0.0.1:44409 (48 connections now open) 2016-04-13T16:23:57.154+0000 I NETWORK [conn8] end connection 127.0.0.1:44413 (48 connections now open) 2016-04-13T16:23:57.154+0000 I NETWORK [conn10] end connection 127.0.0.1:44418 (48 connections now open) 2016-04-13T16:23:57.154+0000 I NETWORK [conn11] end connection 127.0.0.1:44423 (48 connections now open) 2016-04-13T16:23:57.156+0000 I NETWORK [conn12] end connection 127.0.0.1:44435 (48 connections now open) 2016-04-13T16:23:57.156+0000 I NETWORK [conn13] end connection 127.0.0.1:44436 (48 connections now open) 2016-04-13T16:23:57.156+0000 I NETWORK [conn14] end connection 127.0.0.1:44437 (48 connections now open) 2016-04-13T16:23:57.156+0000 I NETWORK [conn15] end connection 127.0.0.1:44438 (48 connections now open) 2016-04-13T16:23:57.156+0000 I NETWORK [conn16] end connection 127.0.0.1:44439 (48 connections now open) 2016-04-13T16:23:57.156+0000 I NETWORK [conn17] end connection 127.0.0.1:44443 (48 connections now open) 2016-04-13T16:23:57.156+0000 I NETWORK [conn19] end connection 127.0.0.1:44448 (48 connections now open) 2016-04-13T16:23:57.157+0000 I NETWORK [conn20] end connection 127.0.0.1:44453 (48 connections now open) 2016-04-13T16:23:57.157+0000 I NETWORK [conn49] end connection 127.0.0.1:44556 (48 connections now open) 2016-04-13T16:23:57.157+0000 I NETWORK [conn48] end connection 127.0.0.1:44555 (48 connections now open) 2016-04-13T16:23:57.157+0000 I NETWORK [conn50] end connection 127.0.0.1:44557 (48 connections now open) 2016-04-13T16:23:57.158+0000 I NETWORK [conn51] end connection 127.0.0.1:44558 (48 connections now open) 2016-04-13T16:23:57.158+0000 I NETWORK [conn52] end connection 127.0.0.1:44559 (48 connections now open) 2016-04-13T16:23:57.158+0000 I NETWORK [conn46] end connection 127.0.0.1:44538 (48 connections now open) 2016-04-13T16:23:57.159+0000 I NETWORK [conn22] end connection 127.0.0.1:44466 (48 connections now open) 2016-04-13T16:23:57.159+0000 I NETWORK [conn21] end connection 127.0.0.1:44465 (48 connections now open) 2016-04-13T16:23:57.159+0000 I NETWORK [conn23] end connection 127.0.0.1:44467 (48 connections now open) 2016-04-13T16:23:57.159+0000 I NETWORK [conn24] end connection 127.0.0.1:44468 (48 connections now open) 2016-04-13T16:23:57.159+0000 I NETWORK [conn25] end connection 127.0.0.1:44469 (48 connections now open) 2016-04-13T16:23:57.161+0000 I NETWORK [conn44] end connection 127.0.0.1:44533 (48 connections now open) 2016-04-13T16:23:57.161+0000 I NETWORK [conn40] end connection 127.0.0.1:44518 (48 connections now open) 2016-04-13T16:23:57.161+0000 I NETWORK [conn42] end connection 127.0.0.1:44526 (48 connections now open) 2016-04-13T16:23:57.162+0000 I NETWORK [conn43] end connection 127.0.0.1:44528 (48 connections now open) 2016-04-13T16:23:57.182+0000 I NETWORK [conn38] end connection 127.0.0.1:44513 (48 connections now open) 2016-04-13T16:23:57.182+0000 I NETWORK [conn34] end connection 127.0.0.1:44506 (48 connections now open) 2016-04-13T16:23:57.182+0000 I NETWORK [conn37] end connection 127.0.0.1:44509 (48 connections now open) 2016-04-13T16:23:57.182+0000 I NETWORK [conn36] end connection 127.0.0.1:44508 (48 connections now open) 2016-04-13T16:23:57.182+0000 I NETWORK [conn28] end connection 127.0.0.1:44478 (48 connections now open) 2016-04-13T16:23:57.182+0000 I NETWORK [conn35] end connection 127.0.0.1:44507 (48 connections now open) 2016-04-13T16:23:57.182+0000 I NETWORK [conn75] end connection 127.0.0.1:47667 (48 connections now open) 2016-04-13T16:23:57.183+0000 I NETWORK [conn62] end connection 127.0.0.1:44593 (48 connections now open) 2016-04-13T16:23:57.183+0000 I NETWORK [conn33] end connection 127.0.0.1:44505 (48 connections now open) 2016-04-13T16:23:57.183+0000 I NETWORK [conn53] end connection 127.0.0.1:44563 (48 connections now open) 2016-04-13T16:23:57.183+0000 I NETWORK [conn59] end connection 127.0.0.1:44583 (48 connections now open) 2016-04-13T16:23:57.183+0000 I NETWORK [conn61] end connection 127.0.0.1:44588 (48 connections now open) 2016-04-13T16:23:57.183+0000 I NETWORK [conn58] end connection 127.0.0.1:44578 (48 connections now open) 2016-04-13T16:23:57.183+0000 I NETWORK [conn56] end connection 127.0.0.1:44573 (48 connections now open) 2016-04-13T16:23:57.184+0000 I NETWORK [conn55] end connection 127.0.0.1:44568 (48 connections now open) 2016-04-13T16:23:57.184+0000 I NETWORK [conn26] end connection 127.0.0.1:44473 (48 connections now open) 2016-04-13T16:23:57.184+0000 I NETWORK [conn30] end connection 127.0.0.1:44484 (48 connections now open) 2016-04-13T16:23:57.427+0000 I STORAGE [signalProcessingThread] shutdown: removing fs lock... 2016-04-13T16:23:57.427+0000 I CONTROL [signalProcessingThread] dbexit: rc: 0 2016-04-13T16:26:47.097+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] MongoDB starting : pid=1087 port=27016 dbpath=/var/lib/mongodb-replica/mongodbreplica2 64-bit host=ip-172-31-6-169 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] db version v3.2.4 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] git version: e2ee9ffcf9f5a94fad76802e28cc978718bb7a30 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] modules: none 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] build environment: 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] distmod: ubuntu1404 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] distarch: x86_64 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb.d/mongodbreplica2.conf", net: { http: { RESTInterfaceEnabled: true, enabled: true }, port: 27016 }, processManagement: { pidFilePath: "/var/run/mongodb-replica/mongodbreplica2.pid" }, replication: { oplogSizeMB: 128, replSet: "mongodbreplica" }, storage: { dbPath: "/var/lib/mongodb-replica/mongodbreplica2", mmapv1: { smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb-replica/mongodbreplica2.log" } } 2016-04-13T16:26:47.516+0000 I - [initandlisten] Detected data files in /var/lib/mongodb-replica/mongodbreplica2 created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2016-04-13T16:26:47.517+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-04-13T16:26:49.253+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-04-13T16:26:49.253+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 126147 records totaling to 2918549203 bytes 2016-04-13T16:26:49.254+0000 I STORAGE [initandlisten] Sampling from the oplog between Apr 9 09:01:12:1 and Apr 13 16:23:45:5 to determine where to place markers for truncation 2016-04-13T16:26:49.254+0000 I STORAGE [initandlisten] Taking 1002 samples and assuming that each section of oplog contains approximately 1258 records totaling to 29105209 bytes 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 09:57:13:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 10:24:38:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 11:22:01:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 12:18:46:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 13:16:06:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 14:16:00:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 15:15:40:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 15:42:45:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 16:39:37:3 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 17:37:02:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 18:33:45:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 19:31:09:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:27:53:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:55:09:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 21:51:45:4 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 22:49:07:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 23:45:45:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 00:42:32:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 01:39:43:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 02:06:28:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 03:03:39:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 04:00:09:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 04:57:39:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 05:54:14:4 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 06:51:46:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 07:18:49:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 08:15:45:5 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 09:15:49:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 10:16:14:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 11:17:02:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 12:17:08:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 13:17:37:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 14:15:00:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 15:11:47:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 15:39:40:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 16:37:09:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 17:43:45:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 18:45:08:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 19:41:44:3 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 20:38:28:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 21:05:43:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 22:01:45:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 22:58:12:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 23:55:08:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 00:51:52:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 01:47:58:3 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:15:39:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 03:11:44:3 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 04:08:27:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 05:05:35:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 06:01:45:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 06:58:33:5 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 07:25:44:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 08:22:32:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 09:19:44:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:15:46:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 11:12:45:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 12:09:06:2 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 12:36:26:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 13:33:10:3 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 14:33:50:3 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 15:31:01:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 16:28:02:3 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 17:27:46:2 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 17:54:31:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 19:01:44:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 19:58:50:2 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 21:15:09:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 22:14:45:4 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 23:14:50:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 23:42:08:2 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 00:49:01:2 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 01:46:45:4 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 02:43:49:2 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 03:41:50:1 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 04:39:45:4 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:06:55:1 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 06:04:42:1 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 18:54:45:4 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 20:06:13:1 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 21:59:45:2 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 23:31:53:2 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 00:09:10:1 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 01:25:01:2 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 02:32:44:3 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 03:30:08:1 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 04:26:54:2 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 05:24:42:1 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 05:52:25:1 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 06:49:41:1 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 07:47:08:2 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 08:43:47:1 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 09:41:00:6 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 10:37:49:1 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 11:05:00:6 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 12:01:52:1 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 12:59:24:1 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 13:58:01:1 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 15:12:48:2 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 16:13:35:1 2016-04-13T16:26:51.959+0000 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2016-04-13T16:26:52.034+0000 I NETWORK [websvr] admin web console waiting for connections on port 28016 2016-04-13T16:26:52.047+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb-replica/mongodbreplica2/diagnostic.data' 2016-04-13T16:26:52.047+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-04-13T16:26:52.050+0000 I NETWORK [initandlisten] waiting for connections on port 27016 2016-04-13T16:26:52.051+0000 W NETWORK [ReplicationExecutor] Failed to connect to 127.0.0.1:27017, reason: errno:111 Connection refused 2016-04-13T16:26:52.062+0000 W NETWORK [ReplicationExecutor] Failed to connect to 127.0.0.1:27015, reason: errno:111 Connection refused 2016-04-13T16:26:52.063+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "mongodbreplica", version: 2, protocolVersion: 1, members: [ { _id: 0, host: "localhost:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "localhost:27016", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "localhost:27015", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-04-13T16:26:52.063+0000 I REPL [ReplicationExecutor] This node is localhost:27016 in the config 2016-04-13T16:26:52.063+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-04-13T16:26:52.063+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-04-13T16:26:52.063+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable: Connection refused 2016-04-13T16:26:52.064+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: Connection refused 2016-04-13T16:26:52.064+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable: Connection refused 2016-04-13T16:26:52.064+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: Connection refused 2016-04-13T16:26:52.064+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable: Connection refused 2016-04-13T16:26:52.064+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: Connection refused 2016-04-13T16:26:52.064+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-04-13T16:26:52.066+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-04-13T16:26:52.365+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37920 #1 (1 connection now open) 2016-04-13T16:26:52.367+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37922 #2 (2 connections now open) 2016-04-13T16:26:52.385+0000 I NETWORK [conn1] end connection 127.0.0.1:37920 (1 connection now open) 2016-04-13T16:26:53.473+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37925 #3 (2 connections now open) 2016-04-13T16:26:53.473+0000 I NETWORK [conn3] end connection 127.0.0.1:37925 (1 connection now open) 2016-04-13T16:26:53.483+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37927 #4 (2 connections now open) 2016-04-13T16:26:57.064+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-13T16:26:57.065+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-13T16:26:57.065+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-13T16:26:57.065+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-13T16:27:02.509+0000 I NETWORK [conn2] end connection 127.0.0.1:37922 (1 connection now open) 2016-04-13T16:27:02.510+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37932 #5 (2 connections now open) 2016-04-13T16:27:07.066+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state PRIMARY 2016-04-13T16:27:07.066+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T16:27:07.067+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T16:27:07.068+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T16:27:13.488+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37939 #6 (3 connections now open) 2016-04-13T16:27:13.489+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37940 #7 (4 connections now open) 2016-04-13T16:27:13.489+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37942 #8 (5 connections now open) 2016-04-13T16:27:13.489+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T16:27:13.489+0000 I ASIO [ReplicationExecutor] dropping unhealthy pooled connection to localhost:27015 2016-04-13T16:27:13.489+0000 I ASIO [ReplicationExecutor] after drop, pool was empty, going to spawn some connections 2016-04-13T16:27:13.489+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-13T16:27:13.489+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state PRIMARY 2016-04-13T16:27:13.490+0000 I NETWORK [conn4] end connection 127.0.0.1:37927 (4 connections now open) 2016-04-13T16:27:13.490+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-13T16:27:18.490+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T16:27:18.492+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T16:27:18.492+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T16:36:03.539+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-14T20:27:51.982+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38316 #9 (5 connections now open) 2016-04-14T20:27:51.983+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38317 #10 (6 connections now open) 2016-04-14T20:27:51.983+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38318 #11 (7 connections now open) 2016-04-14T20:27:51.983+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38319 #12 (8 connections now open) 2016-04-14T20:27:51.983+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38320 #13 (9 connections now open) 2016-04-14T20:27:52.060+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38324 #14 (10 connections now open) 2016-04-14T20:27:52.061+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38326 #15 (11 connections now open) 2016-04-14T20:27:52.111+0000 I NETWORK [conn15] end connection 127.0.0.1:38326 (10 connections now open) 2016-04-14T20:27:52.198+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38329 #16 (11 connections now open) 2016-04-14T20:27:52.277+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38334 #17 (12 connections now open) 2016-04-14T20:27:54.703+0000 I ACCESS [conn16] Successfully authenticated as principal oplogger on admin 2016-04-14T20:27:54.976+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38346 #18 (13 connections now open) 2016-04-14T20:27:54.976+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38347 #19 (14 connections now open) 2016-04-14T20:27:54.976+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38348 #20 (15 connections now open) 2016-04-14T20:27:54.976+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38349 #21 (16 connections now open) 2016-04-14T20:27:54.979+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38350 #22 (17 connections now open) 2016-04-14T20:27:55.071+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38354 #23 (18 connections now open) 2016-04-14T20:27:55.085+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38356 #24 (19 connections now open) 2016-04-14T20:27:55.170+0000 I NETWORK [conn24] end connection 127.0.0.1:38356 (18 connections now open) 2016-04-14T20:27:55.273+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38359 #25 (19 connections now open) 2016-04-14T20:27:55.346+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38364 #26 (20 connections now open) 2016-04-14T20:27:59.361+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38376 #27 (21 connections now open) 2016-04-14T20:27:59.362+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38377 #28 (22 connections now open) 2016-04-14T20:27:59.363+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38378 #29 (23 connections now open) 2016-04-14T20:27:59.376+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38379 #30 (24 connections now open) 2016-04-14T20:27:59.379+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38380 #31 (25 connections now open) 2016-04-14T20:27:59.582+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38384 #32 (26 connections now open) 2016-04-14T20:27:59.583+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38386 #33 (27 connections now open) 2016-04-14T20:27:59.586+0000 I NETWORK [conn33] end connection 127.0.0.1:38386 (26 connections now open) 2016-04-14T20:27:59.635+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38389 #34 (27 connections now open) 2016-04-14T20:27:59.771+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38394 #35 (28 connections now open) 2016-04-14T20:28:00.089+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38396 #36 (29 connections now open) 2016-04-14T20:28:00.120+0000 I NETWORK [conn36] end connection 127.0.0.1:38396 (28 connections now open) 2016-04-14T20:28:00.187+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38399 #37 (29 connections now open) 2016-04-14T20:28:00.222+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38404 #38 (30 connections now open) 2016-04-14T20:28:02.294+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38416 #39 (31 connections now open) 2016-04-14T20:28:02.295+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38417 #40 (32 connections now open) 2016-04-14T20:28:02.295+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38418 #41 (33 connections now open) 2016-04-14T20:28:02.296+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38419 #42 (34 connections now open) 2016-04-14T20:28:02.296+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38420 #43 (35 connections now open) 2016-04-14T20:28:02.440+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38424 #44 (36 connections now open) 2016-04-14T20:28:02.441+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38426 #45 (37 connections now open) 2016-04-14T20:28:02.484+0000 I NETWORK [conn45] end connection 127.0.0.1:38426 (36 connections now open) 2016-04-14T20:28:02.529+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38429 #46 (37 connections now open) 2016-04-14T20:28:02.598+0000 I ACCESS [conn25] Successfully authenticated as principal oplogger on admin 2016-04-14T20:28:02.629+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38434 #47 (38 connections now open) 2016-04-14T20:28:02.694+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38436 #48 (39 connections now open) 2016-04-14T20:28:02.713+0000 I NETWORK [conn48] end connection 127.0.0.1:38436 (38 connections now open) 2016-04-14T20:28:02.731+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38439 #49 (39 connections now open) 2016-04-14T20:28:02.775+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38444 #50 (40 connections now open) 2016-04-14T20:28:04.744+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38456 #51 (41 connections now open) 2016-04-14T20:28:04.744+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38457 #52 (42 connections now open) 2016-04-14T20:28:04.744+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38458 #53 (43 connections now open) 2016-04-14T20:28:04.744+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38459 #54 (44 connections now open) 2016-04-14T20:28:04.744+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38460 #55 (45 connections now open) 2016-04-14T20:28:04.815+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38464 #56 (46 connections now open) 2016-04-14T20:28:04.819+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38466 #57 (47 connections now open) 2016-04-14T20:28:04.912+0000 I NETWORK [conn57] end connection 127.0.0.1:38466 (46 connections now open) 2016-04-14T20:28:04.931+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38469 #58 (47 connections now open) 2016-04-14T20:28:06.087+0000 I ACCESS [conn34] Successfully authenticated as principal oplogger on admin 2016-04-14T20:28:06.158+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38472 #59 (48 connections now open) 2016-04-14T20:28:06.176+0000 I NETWORK [conn59] end connection 127.0.0.1:38472 (47 connections now open) 2016-04-14T20:28:06.225+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38475 #60 (48 connections now open) 2016-04-14T20:28:07.123+0000 I ACCESS [conn37] Successfully authenticated as principal oplogger on admin 2016-04-14T20:28:07.218+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38480 #61 (49 connections now open) 2016-04-14T20:28:07.263+0000 I ACCESS [conn49] Successfully authenticated as principal oplogger on admin 2016-04-14T20:28:08.624+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38484 #62 (50 connections now open) 2016-04-14T20:28:09.548+0000 I ACCESS [conn58] Successfully authenticated as principal oplogger on admin 2016-04-14T20:28:10.332+0000 I ACCESS [conn46] Successfully authenticated as principal oplogger on admin 2016-04-14T20:28:10.369+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38490 #63 (51 connections now open) 2016-04-14T20:28:10.386+0000 I NETWORK [conn63] end connection 127.0.0.1:38490 (50 connections now open) 2016-04-14T20:28:10.438+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38493 #64 (51 connections now open) 2016-04-14T20:28:12.098+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38496 #65 (52 connections now open) 2016-04-14T20:28:12.102+0000 I NETWORK [conn65] end connection 127.0.0.1:38496 (51 connections now open) 2016-04-14T20:28:12.122+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38499 #66 (52 connections now open) 2016-04-14T20:28:12.831+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38504 #67 (53 connections now open) 2016-04-14T20:28:13.073+0000 I ACCESS [conn60] Successfully authenticated as principal oplogger on admin 2016-04-14T20:28:14.467+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38508 #68 (54 connections now open) 2016-04-14T20:28:14.944+0000 I ACCESS [conn64] Successfully authenticated as principal oplogger on admin 2016-04-14T20:28:18.619+0000 I ACCESS [conn66] Successfully authenticated as principal oplogger on admin 2016-04-14T20:34:45.243+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 14 20:33:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 14 20:34:45:5) 2016-04-14T20:34:45.243+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-14T20:34:50.254+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-14T20:34:50.259+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-14T20:34:50.260+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-14T20:38:57.051+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-14T20:57:22.589+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-14T20:57:22.590+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-14T20:57:22.591+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-14T21:02:04.779+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-14T21:14:32.861+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38686 #69 (55 connections now open) 2016-04-14T21:14:32.862+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38687 #70 (56 connections now open) 2016-04-14T21:14:32.862+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38688 #71 (57 connections now open) 2016-04-14T21:14:32.862+0000 I NETWORK [conn69] end connection 127.0.0.1:38686 (56 connections now open) 2016-04-14T21:16:37.850+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 14 21:15:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 14 21:16:37:2) 2016-04-14T21:16:37.850+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-14T21:16:37.882+0000 I NETWORK [conn71] end connection 127.0.0.1:38688 (55 connections now open) 2016-04-14T21:16:42.851+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-14T21:16:42.852+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-14T21:16:42.874+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38702 #72 (56 connections now open) 2016-04-14T21:16:42.875+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38703 #73 (57 connections now open) 2016-04-14T21:16:42.877+0000 I NETWORK [conn72] end connection 127.0.0.1:38702 (56 connections now open) 2016-04-14T21:17:45.304+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38707 #74 (57 connections now open) 2016-04-14T22:24:22.907+0000 I NETWORK [conn73] end connection 127.0.0.1:38703 (56 connections now open) 2016-04-14T22:24:27.923+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38932 #75 (57 connections now open) 2016-04-14T22:24:27.923+0000 I NETWORK [conn75] end connection 127.0.0.1:38932 (56 connections now open) 2016-04-14T22:24:27.927+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38933 #76 (57 connections now open) 2016-04-14T22:32:50.058+0000 I NETWORK [conn76] end connection 127.0.0.1:38933 (56 connections now open) 2016-04-14T22:33:25.084+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38965 #77 (57 connections now open) 2016-04-14T22:33:25.085+0000 I NETWORK [conn77] end connection 127.0.0.1:38965 (56 connections now open) 2016-04-14T22:33:25.085+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38966 #78 (57 connections now open) 2016-04-14T23:27:45.021+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39247 #79 (58 connections now open) 2016-04-14T23:27:45.021+0000 I NETWORK [conn5] end connection 127.0.0.1:37932 (57 connections now open) 2016-04-14T23:27:45.022+0000 I NETWORK [conn78] end connection 127.0.0.1:38966 (56 connections now open) 2016-04-14T23:27:46.021+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39248 #80 (57 connections now open) 2016-04-14T23:27:46.021+0000 I NETWORK [conn80] end connection 127.0.0.1:39248 (56 connections now open) 2016-04-14T23:27:46.022+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39249 #81 (57 connections now open) 2016-04-15T00:31:45.050+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 00:31:10:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 00:31:45:2) 2016-04-15T00:31:45.050+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T00:31:50.057+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T00:31:50.067+0000 I NETWORK [conn81] end connection 127.0.0.1:39249 (56 connections now open) 2016-04-15T00:31:50.068+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T00:32:45.070+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 00:31:59:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 00:32:45:5) 2016-04-15T00:32:45.070+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T00:32:50.071+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T00:32:50.071+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T00:32:50.072+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T00:36:07.883+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T00:36:50.052+0000 I NETWORK [conn74] end connection 127.0.0.1:38707 (55 connections now open) 2016-04-15T00:36:50.052+0000 I NETWORK [conn70] end connection 127.0.0.1:38687 (54 connections now open) 2016-04-15T01:02:33.508+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 01:01:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 15 01:02:32:2) 2016-04-15T01:02:33.509+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T01:02:48.512+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T01:02:48.512+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T01:35:22.051+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T01:35:22.055+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-15T01:35:27.077+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T01:35:27.078+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T01:54:18.324+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T01:54:18.325+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-15T01:54:23.324+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T01:54:23.325+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T01:54:23.325+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-15T02:07:19.748+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 02:06:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 02:07:19:1) 2016-04-15T02:07:19.748+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T02:07:24.768+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T02:07:24.769+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T02:07:24.770+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T02:11:36.518+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T03:20:45.040+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 03:19:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 15 03:20:45:4) 2016-04-15T03:20:45.040+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T03:20:45.041+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T03:20:45.042+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-15T03:28:06.125+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-15T05:50:48.029+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41159 #82 (55 connections now open) 2016-04-15T05:50:48.031+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41160 #83 (56 connections now open) 2016-04-15T05:50:48.031+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41161 #84 (57 connections now open) 2016-04-15T05:50:48.031+0000 I NETWORK [conn82] end connection 127.0.0.1:41159 (56 connections now open) 2016-04-15T05:53:50.329+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41183 #85 (57 connections now open) 2016-04-15T06:04:39.820+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 06:04:00:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 06:04:39:a) 2016-04-15T06:04:39.820+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T06:04:44.823+0000 I NETWORK [conn84] end connection 127.0.0.1:41161 (56 connections now open) 2016-04-15T06:04:45.821+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T06:04:45.822+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T06:09:44.856+0000 I NETWORK [conn85] end connection 127.0.0.1:41183 (55 connections now open) 2016-04-15T06:09:44.856+0000 I NETWORK [conn83] end connection 127.0.0.1:41160 (55 connections now open) 2016-04-15T06:54:31.275+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41620 #86 (55 connections now open) 2016-04-15T06:54:31.277+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41621 #87 (56 connections now open) 2016-04-15T06:54:31.277+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41622 #88 (57 connections now open) 2016-04-15T06:54:31.277+0000 I NETWORK [conn86] end connection 127.0.0.1:41620 (56 connections now open) 2016-04-15T06:55:42.786+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 06:55:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 06:55:42:4) 2016-04-15T06:55:42.786+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T06:55:47.788+0000 I NETWORK [conn88] end connection 127.0.0.1:41622 (55 connections now open) 2016-04-15T06:55:48.787+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T06:55:48.787+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T07:00:47.787+0000 I NETWORK [conn87] end connection 127.0.0.1:41621 (54 connections now open) 2016-04-15T07:45:41.263+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41990 #89 (55 connections now open) 2016-04-15T07:45:41.265+0000 I NETWORK [conn89] end connection 127.0.0.1:41990 (54 connections now open) 2016-04-15T07:45:41.265+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41991 #90 (55 connections now open) 2016-04-15T07:45:41.269+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41992 #91 (56 connections now open) 2016-04-15T07:48:50.062+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42016 #92 (57 connections now open) 2016-04-15T07:54:33.439+0000 I NETWORK [conn91] end connection 127.0.0.1:41992 (56 connections now open) 2016-04-15T07:54:48.444+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42063 #93 (57 connections now open) 2016-04-15T07:54:48.444+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42064 #94 (58 connections now open) 2016-04-15T07:54:48.445+0000 I NETWORK [conn93] end connection 127.0.0.1:42063 (57 connections now open) 2016-04-15T08:14:30.533+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 08:13:56:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 08:14:30:1) 2016-04-15T08:14:30.533+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T08:14:30.556+0000 I NETWORK [conn94] end connection 127.0.0.1:42064 (56 connections now open) 2016-04-15T08:14:35.536+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T08:14:35.538+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T08:15:46.231+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 08:15:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 08:15:45:5) 2016-04-15T08:15:46.231+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T08:15:51.232+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T08:15:51.233+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T08:15:51.233+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T08:16:38.158+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 08:15:56:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 15 08:16:36:2) 2016-04-15T08:16:38.158+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T08:16:48.159+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T08:16:48.160+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T08:18:32.067+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T08:19:30.556+0000 I NETWORK [conn90] end connection 127.0.0.1:41991 (55 connections now open) 2016-04-15T08:19:30.556+0000 I NETWORK [conn92] end connection 127.0.0.1:42016 (54 connections now open) 2016-04-15T08:33:45.519+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 08:33:08:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 15 08:33:45:5) 2016-04-15T08:33:45.519+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T08:33:45.525+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-15T08:33:51.520+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T08:33:51.521+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T09:41:46.852+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 09:41:07:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 15 09:41:46:2) 2016-04-15T09:41:46.852+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T09:41:51.859+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T09:41:51.860+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T09:56:25.144+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 09:55:50:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 15 09:56:25:1) 2016-04-15T09:56:25.147+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T09:56:25.149+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-15T09:56:30.147+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T09:56:30.148+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T09:56:30.150+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-15T10:01:48.397+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-15T10:06:38.642+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 10:05:59:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 10:06:38:1) 2016-04-15T10:06:38.642+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T10:06:44.643+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T10:06:44.644+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T10:16:36.840+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 10:16:02:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 10:16:36:1) 2016-04-15T10:16:36.840+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T10:16:41.844+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T10:16:41.846+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T10:16:41.846+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T10:16:41.849+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T10:16:41.850+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T10:16:42.120+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43088 #95 (55 connections now open) 2016-04-15T10:16:42.121+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43089 #96 (56 connections now open) 2016-04-15T10:16:42.121+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43090 #97 (57 connections now open) 2016-04-15T10:16:42.121+0000 I NETWORK [conn95] end connection 127.0.0.1:43088 (56 connections now open) 2016-04-15T10:17:00.649+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43093 #98 (57 connections now open) 2016-04-15T10:26:33.025+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 10:25:57:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 10:26:31:2) 2016-04-15T10:26:33.025+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T10:26:38.025+0000 I NETWORK [conn97] end connection 127.0.0.1:43090 (56 connections now open) 2016-04-15T10:26:49.028+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T10:26:49.029+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T10:31:33.028+0000 I NETWORK [conn98] end connection 127.0.0.1:43093 (55 connections now open) 2016-04-15T10:31:33.028+0000 I NETWORK [conn96] end connection 127.0.0.1:43089 (54 connections now open) 2016-04-15T11:23:45.040+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43560 #99 (55 connections now open) 2016-04-15T11:23:45.043+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43561 #100 (56 connections now open) 2016-04-15T11:23:45.043+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43562 #101 (57 connections now open) 2016-04-15T11:23:45.043+0000 I NETWORK [conn99] end connection 127.0.0.1:43560 (56 connections now open) 2016-04-15T11:24:46.107+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43572 #102 (57 connections now open) 2016-04-15T11:33:36.250+0000 I NETWORK [conn101] end connection 127.0.0.1:43562 (56 connections now open) 2016-04-15T11:33:46.252+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43634 #103 (57 connections now open) 2016-04-15T11:33:46.252+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43635 #104 (58 connections now open) 2016-04-15T11:33:46.255+0000 I NETWORK [conn103] end connection 127.0.0.1:43634 (57 connections now open) 2016-04-15T11:35:33.285+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43650 #105 (58 connections now open) 2016-04-15T11:35:33.286+0000 I NETWORK [conn79] end connection 127.0.0.1:39247 (57 connections now open) 2016-04-15T11:35:33.286+0000 I NETWORK [conn104] end connection 127.0.0.1:43635 (56 connections now open) 2016-04-15T11:40:33.286+0000 I NETWORK [conn102] end connection 127.0.0.1:43572 (55 connections now open) 2016-04-15T11:40:33.286+0000 I NETWORK [conn100] end connection 127.0.0.1:43561 (54 connections now open) 2016-04-15T11:41:48.230+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43699 #106 (55 connections now open) 2016-04-15T11:41:48.231+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43700 #107 (56 connections now open) 2016-04-15T11:41:48.231+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43701 #108 (57 connections now open) 2016-04-15T11:41:48.231+0000 I NETWORK [conn106] end connection 127.0.0.1:43699 (56 connections now open) 2016-04-15T11:42:48.553+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43709 #109 (57 connections now open) 2016-04-15T12:28:49.138+0000 I NETWORK [conn108] end connection 127.0.0.1:43701 (56 connections now open) 2016-04-15T12:28:49.146+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44036 #110 (57 connections now open) 2016-04-15T12:28:49.146+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44037 #111 (58 connections now open) 2016-04-15T12:28:49.147+0000 I NETWORK [conn110] end connection 127.0.0.1:44036 (57 connections now open) 2016-04-15T13:33:36.673+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 13:33:00:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 13:33:36:1) 2016-04-15T13:33:36.673+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T13:33:41.664+0000 I NETWORK [conn111] end connection 127.0.0.1:44037 (56 connections now open) 2016-04-15T13:33:41.687+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T13:33:41.688+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T13:38:36.674+0000 I NETWORK [conn107] end connection 127.0.0.1:43700 (55 connections now open) 2016-04-15T13:38:36.674+0000 I NETWORK [conn109] end connection 127.0.0.1:43709 (54 connections now open) 2016-04-15T13:40:46.816+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 13:40:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 13:40:45:7) 2016-04-15T13:40:46.816+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T13:40:52.817+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T13:40:52.818+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T15:45:45.059+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 15:45:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 15:45:45:2) 2016-04-15T15:45:45.060+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T15:45:50.061+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T15:45:50.062+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T15:48:44.222+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 15:48:02:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 15:48:43:1) 2016-04-15T15:48:44.222+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T15:48:49.226+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T15:48:49.227+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T15:48:49.228+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T15:49:00.091+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T16:35:45.065+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 16:35:04:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 15 16:35:45:4) 2016-04-15T16:35:45.065+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T16:35:45.066+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T16:35:45.066+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-15T16:35:45.096+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-15T16:39:45.030+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45478 #112 (55 connections now open) 2016-04-15T16:39:45.031+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45479 #113 (56 connections now open) 2016-04-15T16:39:45.031+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45480 #114 (57 connections now open) 2016-04-15T16:39:45.031+0000 I NETWORK [conn112] end connection 127.0.0.1:45478 (56 connections now open) 2016-04-15T16:40:59.187+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45492 #115 (57 connections now open) 2016-04-15T17:29:44.140+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 17:29:05:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 17:29:43:1) 2016-04-15T17:29:44.140+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T17:29:44.162+0000 I NETWORK [conn114] end connection 127.0.0.1:45480 (56 connections now open) 2016-04-15T17:29:50.141+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T17:29:50.142+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T17:34:44.160+0000 I NETWORK [conn113] end connection 127.0.0.1:45479 (55 connections now open) 2016-04-15T17:34:44.160+0000 I NETWORK [conn115] end connection 127.0.0.1:45492 (54 connections now open) 2016-04-15T18:18:45.041+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 18:18:00:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 18:18:45:1) 2016-04-15T18:18:45.042+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T18:18:46.042+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T18:34:33.330+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46232 #116 (55 connections now open) 2016-04-15T18:34:33.331+0000 I NETWORK [conn116] end connection 127.0.0.1:46232 (54 connections now open) 2016-04-15T18:34:33.331+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46233 #117 (55 connections now open) 2016-04-15T18:34:33.334+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46234 #118 (56 connections now open) 2016-04-15T18:42:14.281+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46266 #119 (57 connections now open) 2016-04-15T19:15:45.022+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 19:14:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 19:15:45:1) 2016-04-15T19:15:45.023+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T19:15:50.013+0000 I NETWORK [conn118] end connection 127.0.0.1:46234 (56 connections now open) 2016-04-15T19:15:50.024+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T19:15:50.025+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T19:17:45.076+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 19:17:14:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 19:17:45:4) 2016-04-15T19:17:45.076+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T19:17:45.080+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-15T19:18:20.083+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T19:18:20.083+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T19:18:20.084+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T19:20:45.028+0000 I NETWORK [conn119] end connection 127.0.0.1:46266 (55 connections now open) 2016-04-15T19:20:45.029+0000 I NETWORK [conn117] end connection 127.0.0.1:46233 (54 connections now open) 2016-04-15T19:38:18.803+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T22:25:44.088+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 22:25:09:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 15 22:25:44:1) 2016-04-15T22:25:44.088+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T22:25:49.110+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T22:25:49.111+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T22:46:24.473+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 22:45:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 15 22:46:24:1) 2016-04-15T22:46:24.473+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T22:46:24.481+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-15T22:46:29.478+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T22:46:29.480+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T22:46:29.480+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-15T22:48:38.114+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 22:47:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 22:48:36:2) 2016-04-15T22:48:38.114+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T22:48:39.114+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T22:48:39.115+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T23:18:45.065+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T23:18:46.065+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T23:18:46.069+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T23:18:46.069+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-15T23:36:02.542+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T00:21:18.937+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 00:20:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 00:21:18:1) 2016-04-16T00:21:18.937+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T00:21:24.939+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T00:21:24.939+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T00:21:24.940+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T00:22:49.229+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T00:27:45.072+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 00:27:07:1) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 16 00:27:45:5) 2016-04-16T00:27:45.072+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T00:27:45.074+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T00:27:45.074+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T00:30:31.107+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47857 #120 (55 connections now open) 2016-04-16T00:30:31.109+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47858 #121 (56 connections now open) 2016-04-16T00:30:31.109+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47859 #122 (57 connections now open) 2016-04-16T00:30:31.109+0000 I NETWORK [conn120] end connection 127.0.0.1:47857 (56 connections now open) 2016-04-16T00:32:45.059+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47863 #123 (57 connections now open) 2016-04-16T00:32:45.072+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T00:50:30.495+0000 I NETWORK [conn122] end connection 127.0.0.1:47859 (56 connections now open) 2016-04-16T00:50:35.521+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47949 #124 (57 connections now open) 2016-04-16T00:50:35.522+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47950 #125 (58 connections now open) 2016-04-16T00:50:35.522+0000 I NETWORK [conn124] end connection 127.0.0.1:47949 (57 connections now open) 2016-04-16T01:59:28.727+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 01:58:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 01:59:28:1) 2016-04-16T01:59:28.727+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T01:59:28.730+0000 I NETWORK [conn125] end connection 127.0.0.1:47950 (56 connections now open) 2016-04-16T01:59:33.729+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T01:59:33.731+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T02:04:28.731+0000 I NETWORK [conn123] end connection 127.0.0.1:47863 (55 connections now open) 2016-04-16T02:04:28.731+0000 I NETWORK [conn121] end connection 127.0.0.1:47858 (54 connections now open) 2016-04-16T02:20:45.064+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 02:20:14:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 02:20:45:5) 2016-04-16T02:20:45.064+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T02:20:45.065+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T02:20:45.065+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T02:38:32.412+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T02:38:37.417+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T02:38:37.417+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T02:38:37.418+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T02:39:01.201+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T03:29:17.319+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 03:28:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 03:29:16:1) 2016-04-16T03:29:17.319+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T03:29:23.320+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T03:29:23.321+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T03:29:23.322+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T03:37:00.021+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T04:24:34.501+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T04:24:39.518+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T04:24:39.518+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T04:59:43.046+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T04:59:48.051+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T04:59:48.052+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T04:59:48.054+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T05:00:45.073+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T05:01:15.075+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49171 #126 (55 connections now open) 2016-04-16T05:01:15.076+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49172 #127 (56 connections now open) 2016-04-16T05:01:15.077+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49173 #128 (57 connections now open) 2016-04-16T05:01:15.076+0000 I NETWORK [conn126] end connection 127.0.0.1:49171 (54 connections now open) 2016-04-16T05:06:45.081+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49192 #129 (57 connections now open) 2016-04-16T05:14:22.324+0000 I NETWORK [conn128] end connection 127.0.0.1:49173 (56 connections now open) 2016-04-16T05:14:28.313+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49232 #130 (57 connections now open) 2016-04-16T05:14:28.314+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49233 #131 (58 connections now open) 2016-04-16T05:14:28.314+0000 I NETWORK [conn130] end connection 127.0.0.1:49232 (57 connections now open) 2016-04-16T06:58:45.076+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 06:58:08:3) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 06:58:45:4) 2016-04-16T06:58:45.080+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T06:58:50.083+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T06:58:50.088+0000 I NETWORK [conn131] end connection 127.0.0.1:49233 (56 connections now open) 2016-04-16T06:58:50.089+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T06:58:50.100+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49715 #132 (57 connections now open) 2016-04-16T06:58:50.101+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49716 #133 (58 connections now open) 2016-04-16T06:58:50.104+0000 I NETWORK [conn132] end connection 127.0.0.1:49715 (57 connections now open) 2016-04-16T07:21:43.684+0000 I NETWORK [conn133] end connection 127.0.0.1:49716 (56 connections now open) 2016-04-16T07:21:49.685+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49874 #134 (57 connections now open) 2016-04-16T07:21:49.685+0000 I NETWORK [conn134] end connection 127.0.0.1:49874 (56 connections now open) 2016-04-16T07:21:49.689+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49875 #135 (57 connections now open) 2016-04-16T07:25:39.566+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 07:24:56:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 07:25:39:c) 2016-04-16T07:25:39.566+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T07:25:44.569+0000 I NETWORK [conn135] end connection 127.0.0.1:49875 (56 connections now open) 2016-04-16T07:25:49.568+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T07:25:49.570+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T07:25:50.572+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49906 #136 (57 connections now open) 2016-04-16T07:25:50.573+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49907 #137 (58 connections now open) 2016-04-16T07:25:50.573+0000 I NETWORK [conn136] end connection 127.0.0.1:49906 (57 connections now open) 2016-04-16T08:52:38.335+0000 I NETWORK [conn137] end connection 127.0.0.1:49907 (56 connections now open) 2016-04-16T08:52:43.345+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50510 #138 (57 connections now open) 2016-04-16T08:52:43.345+0000 I NETWORK [conn138] end connection 127.0.0.1:50510 (56 connections now open) 2016-04-16T08:52:43.347+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50511 #139 (57 connections now open) 2016-04-16T08:53:46.089+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 08:53:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 08:53:45:5) 2016-04-16T08:53:46.090+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T08:53:51.093+0000 I NETWORK [conn139] end connection 127.0.0.1:50511 (56 connections now open) 2016-04-16T08:53:51.123+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T08:53:51.124+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T08:58:51.092+0000 I NETWORK [conn127] end connection 127.0.0.1:49172 (55 connections now open) 2016-04-16T08:58:51.092+0000 I NETWORK [conn129] end connection 127.0.0.1:49192 (54 connections now open) 2016-04-16T09:05:52.631+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50613 #140 (55 connections now open) 2016-04-16T09:05:52.631+0000 I NETWORK [conn140] end connection 127.0.0.1:50613 (54 connections now open) 2016-04-16T09:05:52.632+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50614 #141 (55 connections now open) 2016-04-16T09:05:52.634+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50615 #142 (56 connections now open) 2016-04-16T09:09:08.680+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50637 #143 (57 connections now open) 2016-04-16T09:23:44.601+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 09:23:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 09:23:44:1) 2016-04-16T09:23:44.601+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T09:23:49.602+0000 I NETWORK [conn142] end connection 127.0.0.1:50615 (56 connections now open) 2016-04-16T09:23:50.602+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T09:23:50.603+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T09:28:49.602+0000 I NETWORK [conn143] end connection 127.0.0.1:50637 (55 connections now open) 2016-04-16T09:28:49.602+0000 I NETWORK [conn141] end connection 127.0.0.1:50614 (54 connections now open) 2016-04-16T10:15:45.675+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 10:15:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 10:15:45:5) 2016-04-16T10:15:45.675+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T10:15:45.690+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-16T10:15:50.678+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T10:15:50.679+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T10:15:50.679+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T10:17:08.785+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T10:18:33.410+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 10:17:55:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 16 10:18:32:1) 2016-04-16T10:18:33.410+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T10:18:48.417+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T10:18:48.417+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T13:01:46.250+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T13:01:46.252+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T13:01:46.252+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T13:02:02.573+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T13:21:45.046+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 13:21:09:1) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 13:21:45:2) 2016-04-16T13:21:45.046+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T13:21:45.049+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-16T13:21:46.046+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T14:11:45.070+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 14:11:14:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 14:11:45:2) 2016-04-16T14:11:45.070+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T14:12:25.091+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T14:12:25.093+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T14:12:25.094+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T14:17:01.046+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T15:05:44.597+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T15:05:49.605+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T15:05:49.620+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T15:05:49.621+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T15:14:45.070+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T15:23:43.179+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 15:23:03:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 15:23:42:1) 2016-04-16T15:23:43.179+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T15:23:48.180+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T15:23:48.181+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T15:23:48.182+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T15:25:45.079+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T15:32:45.056+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T15:32:50.059+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T15:32:50.059+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T15:32:50.060+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T15:34:46.199+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T17:23:45.054+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 17:23:09:1) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 17:23:45:4) 2016-04-16T17:23:45.054+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T17:23:45.055+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T17:23:45.057+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T17:25:45.043+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 17:25:09:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 16 17:25:45:3) 2016-04-16T17:25:45.044+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T17:25:46.044+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T17:25:46.044+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T17:27:50.066+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54010 #144 (55 connections now open) 2016-04-16T17:27:50.067+0000 I NETWORK [conn144] end connection 127.0.0.1:54010 (54 connections now open) 2016-04-16T17:27:50.068+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54011 #145 (55 connections now open) 2016-04-16T17:27:50.068+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54012 #146 (56 connections now open) 2016-04-16T17:31:02.406+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54035 #147 (57 connections now open) 2016-04-16T18:00:46.559+0000 I NETWORK [conn146] end connection 127.0.0.1:54012 (56 connections now open) 2016-04-16T18:00:46.602+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54242 #148 (57 connections now open) 2016-04-16T18:00:46.604+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54243 #149 (58 connections now open) 2016-04-16T18:00:46.606+0000 I NETWORK [conn148] end connection 127.0.0.1:54242 (57 connections now open) 2016-04-16T18:10:46.128+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 18:10:00:3) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 18:10:45:5) 2016-04-16T18:10:46.129+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T18:10:46.134+0000 I NETWORK [conn149] end connection 127.0.0.1:54243 (56 connections now open) 2016-04-16T18:10:52.132+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T18:10:52.132+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T18:15:46.135+0000 I NETWORK [conn145] end connection 127.0.0.1:54011 (55 connections now open) 2016-04-16T18:15:46.135+0000 I NETWORK [conn147] end connection 127.0.0.1:54035 (54 connections now open) 2016-04-16T18:26:40.423+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54432 #150 (55 connections now open) 2016-04-16T18:26:40.423+0000 I NETWORK [conn150] end connection 127.0.0.1:54432 (54 connections now open) 2016-04-16T18:26:40.424+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54433 #151 (55 connections now open) 2016-04-16T18:26:40.426+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54434 #152 (56 connections now open) 2016-04-16T18:29:01.149+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54451 #153 (57 connections now open) 2016-04-16T19:01:50.071+0000 I NETWORK [conn152] end connection 127.0.0.1:54434 (56 connections now open) 2016-04-16T19:01:50.075+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54685 #154 (57 connections now open) 2016-04-16T19:01:50.076+0000 I NETWORK [conn154] end connection 127.0.0.1:54685 (56 connections now open) 2016-04-16T19:01:50.079+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54686 #155 (57 connections now open) 2016-04-16T20:48:45.055+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 20:48:10:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 20:48:45:2) 2016-04-16T20:48:45.055+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T20:48:46.056+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T20:48:46.057+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T21:01:50.032+0000 I NETWORK [conn155] end connection 127.0.0.1:54686 (56 connections now open) 2016-04-16T21:01:51.033+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:55378 #156 (57 connections now open) 2016-04-16T21:01:51.034+0000 I NETWORK [conn156] end connection 127.0.0.1:55378 (56 connections now open) 2016-04-16T21:01:51.037+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:55379 #157 (57 connections now open) 2016-04-16T21:11:40.496+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 21:11:02:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 21:11:40:2) 2016-04-16T21:11:40.508+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T21:11:45.494+0000 I NETWORK [conn157] end connection 127.0.0.1:55379 (56 connections now open) 2016-04-16T21:11:46.509+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T21:11:46.510+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T21:15:34.613+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 21:14:58:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 21:15:34:1) 2016-04-16T21:15:34.613+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T21:15:34.629+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-16T21:15:40.616+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T21:15:40.617+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T21:16:40.510+0000 I NETWORK [conn151] end connection 127.0.0.1:54433 (55 connections now open) 2016-04-16T21:16:40.510+0000 I NETWORK [conn153] end connection 127.0.0.1:54451 (55 connections now open) 2016-04-16T22:08:23.477+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 22:07:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 22:08:23:1) 2016-04-16T22:08:23.477+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T22:08:28.478+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T22:08:28.479+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T22:08:28.480+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T22:09:39.212+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 22:08:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 16 22:09:38:1) 2016-04-16T22:09:39.212+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T22:09:49.214+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T22:09:49.215+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T22:14:45.049+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T22:38:31.909+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T22:38:37.910+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T22:38:37.910+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T22:38:37.911+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T22:38:45.072+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T23:14:46.457+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 23:14:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 23:14:46:1) 2016-04-16T23:14:46.457+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T23:14:51.470+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T23:14:51.471+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T23:14:51.472+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T23:16:02.392+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T23:21:40.580+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 23:21:03:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 16 23:21:40:1) 2016-04-16T23:21:40.580+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T23:21:45.593+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T23:21:45.596+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T23:21:45.598+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T23:21:45.600+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T23:21:45.600+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T23:21:45.884+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56209 #158 (55 connections now open) 2016-04-16T23:21:45.884+0000 I NETWORK [conn158] end connection 127.0.0.1:56209 (54 connections now open) 2016-04-16T23:21:45.885+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56210 #159 (55 connections now open) 2016-04-16T23:21:45.886+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56211 #160 (56 connections now open) 2016-04-16T23:22:02.532+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T23:22:07.811+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56217 #161 (57 connections now open) 2016-04-16T23:30:45.043+0000 I NETWORK [conn160] end connection 127.0.0.1:56211 (56 connections now open) 2016-04-16T23:35:45.055+0000 I NETWORK [conn159] end connection 127.0.0.1:56210 (55 connections now open) 2016-04-16T23:35:45.055+0000 I NETWORK [conn161] end connection 127.0.0.1:56217 (54 connections now open) 2016-04-17T01:22:46.053+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57022 #162 (55 connections now open) 2016-04-17T01:22:46.055+0000 I NETWORK [conn162] end connection 127.0.0.1:57022 (54 connections now open) 2016-04-17T01:22:46.055+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57023 #163 (55 connections now open) 2016-04-17T01:22:46.056+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57024 #164 (56 connections now open) 2016-04-17T01:35:00.173+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57082 #165 (57 connections now open) 2016-04-17T01:40:45.064+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 01:40:08:4) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 01:40:45:5) 2016-04-17T01:40:45.064+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T01:40:55.063+0000 I NETWORK [conn164] end connection 127.0.0.1:57024 (56 connections now open) 2016-04-17T01:41:05.098+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T01:41:05.099+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T01:45:50.066+0000 I NETWORK [conn163] end connection 127.0.0.1:57023 (55 connections now open) 2016-04-17T01:45:50.066+0000 I NETWORK [conn165] end connection 127.0.0.1:57082 (54 connections now open) 2016-04-17T02:16:45.933+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57334 #166 (55 connections now open) 2016-04-17T02:16:45.935+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57335 #167 (56 connections now open) 2016-04-17T02:16:45.935+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57336 #168 (57 connections now open) 2016-04-17T02:16:45.935+0000 I NETWORK [conn166] end connection 127.0.0.1:57334 (56 connections now open) 2016-04-17T02:18:02.612+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57345 #169 (57 connections now open) 2016-04-17T02:22:45.052+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57373 #170 (58 connections now open) 2016-04-17T02:22:45.053+0000 I NETWORK [conn105] end connection 127.0.0.1:43650 (57 connections now open) 2016-04-17T02:22:45.053+0000 I NETWORK [conn168] end connection 127.0.0.1:57336 (57 connections now open) 2016-04-17T02:22:46.034+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57374 #171 (57 connections now open) 2016-04-17T02:22:46.035+0000 I NETWORK [conn171] end connection 127.0.0.1:57374 (56 connections now open) 2016-04-17T02:22:46.035+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57375 #172 (57 connections now open) 2016-04-17T02:37:45.035+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 02:37:06:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 02:37:45:2) 2016-04-17T02:37:45.035+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T02:37:50.039+0000 I NETWORK [conn172] end connection 127.0.0.1:57375 (56 connections now open) 2016-04-17T02:37:51.036+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T02:37:51.037+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T02:42:50.036+0000 I NETWORK [conn169] end connection 127.0.0.1:57345 (55 connections now open) 2016-04-17T02:42:50.036+0000 I NETWORK [conn167] end connection 127.0.0.1:57335 (54 connections now open) 2016-04-17T05:50:45.062+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 05:50:07:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 05:50:45:2) 2016-04-17T05:50:45.062+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T05:50:50.064+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T05:50:50.066+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T05:51:35.046+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 05:50:55:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 05:51:33:2) 2016-04-17T05:51:35.047+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T05:51:46.054+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-17T05:51:46.055+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-17T05:51:46.055+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-17T05:54:46.023+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T05:54:52.024+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-17T05:54:52.024+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-17T05:56:45.041+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-17T06:35:41.816+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T06:35:41.825+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T06:35:41.828+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-17T06:35:42.835+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59141 #173 (55 connections now open) 2016-04-17T06:35:42.835+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59142 #174 (56 connections now open) 2016-04-17T06:35:42.835+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59143 #175 (57 connections now open) 2016-04-17T06:35:42.836+0000 I NETWORK [conn173] end connection 127.0.0.1:59141 (56 connections now open) 2016-04-17T06:39:01.663+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-17T06:40:49.055+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59180 #176 (57 connections now open) 2016-04-17T06:43:36.946+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 06:42:56:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 06:43:36:1) 2016-04-17T06:43:36.946+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T06:43:41.948+0000 I NETWORK [conn175] end connection 127.0.0.1:59143 (56 connections now open) 2016-04-17T06:43:42.947+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T06:43:42.948+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T06:46:45.071+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 06:46:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 06:46:45:3) 2016-04-17T06:46:45.071+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T06:46:50.073+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T06:46:50.074+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T06:48:41.947+0000 I NETWORK [conn176] end connection 127.0.0.1:59180 (55 connections now open) 2016-04-17T06:48:41.947+0000 I NETWORK [conn174] end connection 127.0.0.1:59142 (54 connections now open) 2016-04-17T06:59:43.318+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 06:58:57:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 06:59:43:1) 2016-04-17T06:59:43.318+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T06:59:48.319+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T06:59:48.321+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T07:15:39.664+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 07:14:58:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 07:15:39:a) 2016-04-17T07:15:39.665+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T07:15:40.665+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T07:15:40.666+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T07:33:45.032+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 07:33:12:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 07:33:45:2) 2016-04-17T07:33:45.033+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T07:33:50.033+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-17T07:33:50.035+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-17T07:33:50.035+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-17T07:33:56.051+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-17T07:34:42.654+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 07:34:02:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 17 07:34:41:2) 2016-04-17T07:34:42.654+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T07:34:47.664+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-17T07:34:47.665+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-17T07:40:46.783+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 07:40:02:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 17 07:40:46:1) 2016-04-17T07:40:46.783+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T07:40:51.790+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-17T07:40:51.791+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-17T07:53:45.049+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 07:53:08:3) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 17 07:53:45:2) 2016-04-17T07:53:45.050+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T07:53:46.050+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T07:53:46.051+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T07:53:46.052+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-17T08:04:39.492+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59788 #177 (55 connections now open) 2016-04-17T08:04:39.494+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59789 #178 (56 connections now open) 2016-04-17T08:04:39.494+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59790 #179 (57 connections now open) 2016-04-17T08:04:39.494+0000 I NETWORK [conn177] end connection 127.0.0.1:59788 (56 connections now open) 2016-04-17T08:06:44.062+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-17T08:07:47.065+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59813 #180 (57 connections now open) 2016-04-17T08:08:39.612+0000 I NETWORK [conn179] end connection 127.0.0.1:59790 (56 connections now open) 2016-04-17T08:08:44.614+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59821 #181 (57 connections now open) 2016-04-17T08:08:44.615+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59822 #182 (58 connections now open) 2016-04-17T08:08:44.616+0000 I NETWORK [conn181] end connection 127.0.0.1:59821 (57 connections now open) 2016-04-17T08:22:35.771+0000 I NETWORK [conn182] end connection 127.0.0.1:59822 (56 connections now open) 2016-04-17T08:22:45.771+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59921 #183 (57 connections now open) 2016-04-17T08:22:45.772+0000 I NETWORK [conn183] end connection 127.0.0.1:59921 (56 connections now open) 2016-04-17T08:22:45.773+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59922 #184 (57 connections now open) 2016-04-17T08:36:46.079+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60021 #185 (58 connections now open) 2016-04-17T08:36:46.083+0000 I NETWORK [conn185] end connection 127.0.0.1:60021 (57 connections now open) 2016-04-17T08:45:45.045+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 08:45:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 08:45:45:2) 2016-04-17T08:45:45.046+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T08:45:50.047+0000 I NETWORK [conn184] end connection 127.0.0.1:59922 (56 connections now open) 2016-04-17T08:45:50.055+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T08:45:50.055+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T08:50:50.047+0000 I NETWORK [conn180] end connection 127.0.0.1:59813 (55 connections now open) 2016-04-17T08:50:50.047+0000 I NETWORK [conn178] end connection 127.0.0.1:59789 (54 connections now open) 2016-04-17T09:08:43.454+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 09:08:04:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 09:08:43:2) 2016-04-17T09:08:43.454+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T09:08:49.455+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-17T09:08:49.457+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-17T09:08:49.458+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-17T09:09:55.530+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-17T09:24:45.944+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T09:24:45.945+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T09:24:45.945+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-17T09:27:45.048+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60394 #186 (55 connections now open) 2016-04-17T09:27:45.050+0000 I NETWORK [conn186] end connection 127.0.0.1:60394 (54 connections now open) 2016-04-17T09:27:45.050+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60395 #187 (55 connections now open) 2016-04-17T09:27:45.051+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60396 #188 (56 connections now open) 2016-04-17T09:27:59.718+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-17T09:33:49.829+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60442 #189 (57 connections now open) 2016-04-17T09:42:42.036+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 09:41:58:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 09:42:41:1) 2016-04-17T09:42:42.036+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T09:42:42.075+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-17T09:42:47.039+0000 I NETWORK [conn188] end connection 127.0.0.1:60396 (56 connections now open) 2016-04-17T09:42:48.038+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T09:42:48.039+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T09:47:47.037+0000 I NETWORK [conn187] end connection 127.0.0.1:60395 (55 connections now open) 2016-04-17T09:47:47.038+0000 I NETWORK [conn189] end connection 127.0.0.1:60442 (54 connections now open) 2016-04-17T09:52:40.467+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60581 #190 (55 connections now open) 2016-04-17T09:52:40.467+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60582 #191 (56 connections now open) 2016-04-17T09:52:40.467+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60583 #192 (57 connections now open) 2016-04-17T09:52:40.467+0000 I NETWORK [conn190] end connection 127.0.0.1:60581 (56 connections now open) 2016-04-17T09:53:01.214+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60587 #193 (57 connections now open) 2016-04-17T10:30:37.227+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 10:29:58:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 10:30:36:1) 2016-04-17T10:30:37.227+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T10:30:37.264+0000 I NETWORK [conn192] end connection 127.0.0.1:60583 (56 connections now open) 2016-04-17T10:30:43.230+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T10:30:43.232+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T10:35:37.262+0000 I NETWORK [conn191] end connection 127.0.0.1:60582 (55 connections now open) 2016-04-17T10:35:37.262+0000 I NETWORK [conn193] end connection 127.0.0.1:60587 (54 connections now open) 2016-04-17T10:40:43.478+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60927 #194 (55 connections now open) 2016-04-17T10:40:43.479+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60928 #195 (56 connections now open) 2016-04-17T10:40:43.479+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60929 #196 (57 connections now open) 2016-04-17T10:40:43.479+0000 I NETWORK [conn194] end connection 127.0.0.1:60927 (56 connections now open) 2016-04-17T10:42:38.220+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60944 #197 (57 connections now open) 2016-04-17T11:16:46.096+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 11:16:07:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 11:16:45:5) 2016-04-17T11:16:46.097+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T11:16:46.128+0000 I NETWORK [conn196] end connection 127.0.0.1:60929 (56 connections now open) 2016-04-17T11:16:52.098+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T11:16:52.099+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T11:21:46.128+0000 I NETWORK [conn197] end connection 127.0.0.1:60944 (55 connections now open) 2016-04-17T11:21:46.128+0000 I NETWORK [conn195] end connection 127.0.0.1:60928 (54 connections now open) 2016-04-17T11:46:37.031+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 11:45:58:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 11:46:36:1) 2016-04-17T11:46:37.032+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T11:46:43.038+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T11:46:43.039+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T12:24:42.792+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33422 #198 (55 connections now open) 2016-04-17T12:24:42.793+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33423 #199 (56 connections now open) 2016-04-17T12:24:42.793+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33424 #200 (57 connections now open) 2016-04-17T12:24:42.794+0000 I NETWORK [conn198] end connection 127.0.0.1:33422 (56 connections now open) 2016-04-17T12:27:02.674+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33443 #201 (57 connections now open) 2016-04-17T12:46:36.230+0000 I NETWORK [conn200] end connection 127.0.0.1:33424 (56 connections now open) 2016-04-17T12:46:46.232+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33580 #202 (57 connections now open) 2016-04-17T12:46:46.234+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33581 #203 (58 connections now open) 2016-04-17T12:46:46.235+0000 I NETWORK [conn202] end connection 127.0.0.1:33580 (57 connections now open) 2016-04-17T13:30:45.044+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 13:30:04:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 13:30:45:2) 2016-04-17T13:30:45.044+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T13:30:45.048+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-17T13:30:46.044+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T13:46:36.625+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 13:45:56:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 13:46:36:1) 2016-04-17T13:46:36.626+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T13:46:36.630+0000 I NETWORK [conn203] end connection 127.0.0.1:33581 (56 connections now open) 2016-04-17T13:46:42.627+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T13:46:42.628+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T13:51:36.631+0000 I NETWORK [conn199] end connection 127.0.0.1:33423 (55 connections now open) 2016-04-17T13:51:36.631+0000 I NETWORK [conn201] end connection 127.0.0.1:33443 (54 connections now open) 2016-04-17T14:11:41.620+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34149 #204 (55 connections now open) 2016-04-17T14:11:41.621+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34150 #205 (56 connections now open) 2016-04-17T14:11:41.621+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34151 #206 (57 connections now open) 2016-04-17T14:11:41.622+0000 I NETWORK [conn204] end connection 127.0.0.1:34149 (56 connections now open) 2016-04-17T14:11:49.160+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34155 #207 (57 connections now open) 2016-04-17T14:14:31.159+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 14:13:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 14:14:31:1) 2016-04-17T14:14:31.159+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T14:14:36.139+0000 I NETWORK [conn206] end connection 127.0.0.1:34151 (56 connections now open) 2016-04-17T14:14:36.174+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T14:14:36.175+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T14:19:31.176+0000 I NETWORK [conn207] end connection 127.0.0.1:34155 (55 connections now open) 2016-04-17T14:19:31.177+0000 I NETWORK [conn205] end connection 127.0.0.1:34150 (54 connections now open) 2016-04-17T14:21:22.254+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 14:20:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 14:21:22:1) 2016-04-17T14:21:22.255+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T14:21:27.256+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T14:21:27.257+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T17:03:45.116+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 17:03:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 17:03:45:2) 2016-04-17T17:03:45.116+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T17:03:50.119+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T17:03:50.120+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T17:03:51.049+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35199 #208 (55 connections now open) 2016-04-17T17:03:51.049+0000 I NETWORK [conn208] end connection 127.0.0.1:35199 (54 connections now open) 2016-04-17T17:03:51.049+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35200 #209 (55 connections now open) 2016-04-17T17:03:51.053+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35201 #210 (56 connections now open) 2016-04-17T17:05:59.588+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35218 #211 (57 connections now open) 2016-04-17T17:17:41.287+0000 I NETWORK [conn210] end connection 127.0.0.1:35201 (56 connections now open) 2016-04-17T17:17:47.288+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35292 #212 (57 connections now open) 2016-04-17T17:17:47.288+0000 I NETWORK [conn212] end connection 127.0.0.1:35292 (56 connections now open) 2016-04-17T17:17:47.290+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35293 #213 (57 connections now open) 2016-04-17T18:27:36.701+0000 I NETWORK [conn213] end connection 127.0.0.1:35293 (56 connections now open) 2016-04-17T18:27:41.714+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35784 #214 (57 connections now open) 2016-04-17T18:27:41.715+0000 I NETWORK [conn214] end connection 127.0.0.1:35784 (56 connections now open) 2016-04-17T18:27:41.715+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35785 #215 (57 connections now open) 2016-04-17T18:44:50.041+0000 I NETWORK [conn215] end connection 127.0.0.1:35785 (56 connections now open) 2016-04-17T18:44:50.049+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35908 #216 (57 connections now open) 2016-04-17T18:44:50.049+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35909 #217 (58 connections now open) 2016-04-17T18:44:50.050+0000 I NETWORK [conn216] end connection 127.0.0.1:35908 (57 connections now open) 2016-04-17T18:48:45.054+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 18:48:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 18:48:45:2) 2016-04-17T18:48:45.054+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T18:48:46.055+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T18:48:46.057+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T18:48:46.058+0000 I NETWORK [conn217] end connection 127.0.0.1:35909 (56 connections now open) 2016-04-17T18:53:45.057+0000 I NETWORK [conn211] end connection 127.0.0.1:35218 (55 connections now open) 2016-04-17T18:53:45.066+0000 I NETWORK [conn209] end connection 127.0.0.1:35200 (55 connections now open) 2016-04-17T19:43:46.097+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 19:43:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 19:43:45:5) 2016-04-17T19:43:46.099+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T19:43:51.102+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-17T19:43:51.103+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-17T19:43:51.104+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-17T19:50:55.385+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-17T20:25:19.650+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T20:25:25.653+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T20:25:25.654+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T20:25:25.656+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-17T20:29:37.572+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-17T21:43:47.252+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36996 #218 (55 connections now open) 2016-04-17T21:43:47.253+0000 I NETWORK [conn218] end connection 127.0.0.1:36996 (54 connections now open) 2016-04-17T21:43:47.253+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36997 #219 (55 connections now open) 2016-04-17T21:43:47.255+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36998 #220 (56 connections now open) 2016-04-17T21:44:46.018+0000 I NETWORK [conn220] end connection 127.0.0.1:36998 (55 connections now open) 2016-04-17T21:44:51.019+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37010 #221 (56 connections now open) 2016-04-17T21:44:51.019+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37011 #222 (57 connections now open) 2016-04-17T21:44:51.020+0000 I NETWORK [conn221] end connection 127.0.0.1:37010 (56 connections now open) 2016-04-17T21:45:35.741+0000 I NETWORK [conn222] end connection 127.0.0.1:37011 (55 connections now open) 2016-04-17T21:45:45.742+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37015 #223 (56 connections now open) 2016-04-17T21:45:45.743+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37016 #224 (57 connections now open) 2016-04-17T21:45:45.743+0000 I NETWORK [conn223] end connection 127.0.0.1:37015 (56 connections now open) 2016-04-17T21:46:00.060+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37017 #225 (57 connections now open) 2016-04-17T21:48:45.057+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 21:48:08:3) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 21:48:45:2) 2016-04-17T21:48:45.058+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T21:48:46.062+0000 I NETWORK [conn224] end connection 127.0.0.1:37016 (56 connections now open) 2016-04-17T21:48:50.062+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-17T21:48:50.063+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-17T21:48:50.064+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-17T21:53:45.063+0000 I NETWORK [conn219] end connection 127.0.0.1:36997 (55 connections now open) 2016-04-17T21:53:45.063+0000 I NETWORK [conn225] end connection 127.0.0.1:37017 (54 connections now open) 2016-04-17T21:54:02.386+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-17T22:41:42.983+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T22:41:47.995+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-17T22:41:47.999+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-18T00:42:50.069+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-18T00:43:05.113+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-18T00:43:05.118+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-18T00:43:05.135+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-18T00:44:57.886+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-18T01:38:55.079+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38541 #226 (55 connections now open) 2016-04-18T01:38:55.086+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38542 #227 (56 connections now open) 2016-04-18T01:38:55.086+0000 I NETWORK [conn226] end connection 127.0.0.1:38541 (55 connections now open) 2016-04-18T01:38:55.102+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38543 #228 (56 connections now open) 2016-04-18T01:38:57.967+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38547 #229 (57 connections now open) 2016-04-18T01:48:21.263+0000 I NETWORK [conn227] end connection 127.0.0.1:38542 (56 connections now open) 2016-04-18T01:48:21.275+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38594 #230 (57 connections now open) 2016-04-18T01:48:21.276+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38595 #231 (58 connections now open) 2016-04-18T01:48:21.276+0000 I NETWORK [conn230] end connection 127.0.0.1:38594 (57 connections now open) 2016-04-18T02:16:04.370+0000 I COMMAND [conn61] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 289ms 2016-04-18T02:16:04.370+0000 I COMMAND [conn68] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 289ms 2016-04-18T02:16:04.370+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 289ms 2016-04-18T02:16:04.370+0000 I COMMAND [conn67] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 289ms 2016-04-18T02:16:04.370+0000 I COMMAND [conn50] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 289ms 2016-04-18T02:16:04.370+0000 I COMMAND [conn47] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 289ms 2016-04-18T02:16:04.370+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 289ms 2016-04-18T02:16:04.370+0000 I COMMAND [conn35] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 289ms 2016-04-18T02:16:04.370+0000 I COMMAND [conn62] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 289ms 2016-04-18T02:16:04.370+0000 I COMMAND [conn32] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 289ms 2016-04-18T02:16:04.372+0000 I COMMAND [conn7] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 36 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:425 locks:{} protocol:op_command 729ms 2016-04-18T02:16:04.372+0000 I COMMAND [conn170] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 36 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:425 locks:{} protocol:op_command 729ms 2016-04-18T02:16:08.098+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 780, after connections: 1270, after extra_info: 1730, after globalLock: 1970, after locks: 2050, after network: 2140, after opcounters: 2140, after opcountersRepl: 2140, after repl: 2760, after storageEngine: 2850, after tcmalloc: 3230, after wiredTiger: 4070, at end: 5960 } 2016-04-18T02:16:09.698+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-18T02:16:11.507+0000 I COMMAND [conn231] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1460564823000|1, t: 35 }, appliedOpTime: { ts: Timestamp 1460564823000|1, t: 35 }, memberId: 0, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1460945758000|2, t: 36 }, appliedOpTime: { ts: Timestamp 1460945758000|2, t: 36 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1460945758000|1, t: 36 }, appliedOpTime: { ts: Timestamp 1460945758000|1, t: 36 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 1035ms 2016-04-18T02:16:12.632+0000 I COMMAND [conn229] command local.oplog.rs command: getMore { getMore: 28435136938, collection: "oplog.rs", maxTimeMS: 5000, term: 36, lastKnownCommittedOpTime: { ts: Timestamp 1460945758000|1, t: 36 } } cursorid:28435136938 keyUpdates:0 writeConflicts:0 numYields:1 nreturned:0 reslen:292 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } protocol:op_command 11062ms 2016-04-18T02:16:13.699+0000 I COMMAND [conn170] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 36 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:394 locks:{} protocol:op_command 1560ms 2016-04-18T02:16:13.988+0000 I COMMAND [conn6] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 36 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:394 locks:{} protocol:op_command 1560ms 2016-04-18T02:16:14.671+0000 I NETWORK [conn229] end connection 127.0.0.1:38547 (56 connections now open) 2016-04-18T02:16:15.622+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38773 #232 (58 connections now open) 2016-04-18T02:16:17.979+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-18T02:16:18.177+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-18T02:16:19.167+0000 I NETWORK [conn170] end connection 127.0.0.1:57373 (56 connections now open) 2016-04-18T02:16:19.167+0000 I NETWORK [conn231] end connection 127.0.0.1:38595 (56 connections now open) 2016-04-18T02:16:19.178+0000 I COMMAND [conn232] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 1302ms 2016-04-18T02:16:19.263+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:16:20.406+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-18T02:16:22.359+0000 I COMMAND [conn6] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 36 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3404ms 2016-04-18T02:16:22.365+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38775 #233 (56 connections now open) 2016-04-18T02:16:24.131+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: HostUnreachable: End of file 2016-04-18T02:16:25.514+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 190, after asserts: 290, after connections: 480, after extra_info: 1160, after globalLock: 1160, after locks: 1160, after network: 1160, after opcounters: 1160, after opcountersRepl: 1160, after repl: 4490, after storageEngine: 4495, after tcmalloc: 4905, after wiredTiger: 6675, at end: 7405 } 2016-04-18T02:16:26.009+0000 I COMMAND [conn23] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 591ms 2016-04-18T02:16:26.009+0000 I COMMAND [conn26] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 591ms 2016-04-18T02:16:26.009+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 591ms 2016-04-18T02:16:26.009+0000 I COMMAND [conn44] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 591ms 2016-04-18T02:16:26.108+0000 I COMMAND [conn232] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 36, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1460945758000|1, t: 36 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 2706ms 2016-04-18T02:16:26.108+0000 I COMMAND [conn32] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1776ms 2016-04-18T02:16:26.108+0000 I COMMAND [conn62] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1776ms 2016-04-18T02:16:26.108+0000 I COMMAND [conn35] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1776ms 2016-04-18T02:16:26.116+0000 I COMMAND [conn233] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1973ms 2016-04-18T02:16:28.509+0000 I COMMAND [conn232] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 36 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 406ms 2016-04-18T02:16:28.509+0000 I COMMAND [conn6] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 36 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2120ms 2016-04-18T02:16:28.509+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-18T02:16:30.157+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-18T02:16:30.639+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-18T02:16:31.543+0000 I NETWORK [conn232] end connection 127.0.0.1:38773 (55 connections now open) 2016-04-18T02:16:31.979+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-18T02:16:31.979+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:16:36.367+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-18T02:16:37.262+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 210, after asserts: 310, after connections: 490, after extra_info: 1180, after globalLock: 1280, after locks: 1290, after network: 1380, after opcounters: 1380, after opcountersRepl: 1380, after repl: 2510, after storageEngine: 2690, after tcmalloc: 2980, after wiredTiger: 4100, at end: 5110 } 2016-04-18T02:16:37.783+0000 I COMMAND [conn7] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 36 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1017ms 2016-04-18T02:16:39.259+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-18T02:16:39.768+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-18T02:16:39.905+0000 I COMMAND [conn56] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 105ms 2016-04-18T02:16:40.148+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 693ms 2016-04-18T02:16:40.148+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 693ms 2016-04-18T02:16:40.182+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:16:40.218+0000 I COMMAND [conn6] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 36, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1460945758000|2, t: 36 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 4819ms 2016-04-18T02:16:40.230+0000 I REPL [ReplicationExecutor] dry election run succeeded, running for election 2016-04-18T02:16:40.231+0000 I REPL [ReplicationExecutor] election succeeded, assuming primary role in term 37 2016-04-18T02:16:40.231+0000 I REPL [ReplicationExecutor] transition to PRIMARY 2016-04-18T02:16:40.234+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-18T02:16:40.234+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-18T02:16:43.438+0000 I REPL [rsSync] transition to primary complete; database writes are now permitted 2016-04-18T02:16:43.577+0000 I COMMAND [conn6] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 37 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:416 locks:{} protocol:op_command 335ms 2016-04-18T02:16:46.526+0000 I COMMAND [conn50] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 197ms 2016-04-18T02:16:46.526+0000 I COMMAND [conn26] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 197ms 2016-04-18T02:16:46.526+0000 I COMMAND [conn47] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 197ms 2016-04-18T02:16:46.526+0000 I COMMAND [conn44] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 197ms 2016-04-18T02:16:46.526+0000 I COMMAND [conn23] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 197ms 2016-04-18T02:16:46.526+0000 I COMMAND [conn67] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 197ms 2016-04-18T02:16:48.525+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38789 #234 (56 connections now open) 2016-04-18T02:16:48.526+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38790 #235 (57 connections now open) 2016-04-18T02:16:49.954+0000 I COMMAND [conn61] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 589ms 2016-04-18T02:16:54.597+0000 I COMMAND [conn233] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 37, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1460945758000|2, t: 36 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 537ms 2016-04-18T02:16:54.597+0000 I COMMAND [conn6] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 37 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:416 locks:{} protocol:op_command 1826ms 2016-04-18T02:16:56.311+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 490, after connections: 810, after extra_info: 1830, after globalLock: 2300, after locks: 2450, after network: 2450, after opcounters: 2450, after opcountersRepl: 2450, after repl: 2820, after storageEngine: 3330, after tcmalloc: 4280, after wiredTiger: 5310, at end: 6990 } 2016-04-18T02:16:57.890+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:17:01.201+0000 I COMMAND [conn234] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1378ms 2016-04-18T02:17:01.201+0000 I COMMAND [conn235] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1378ms 2016-04-18T02:17:10.506+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-18T02:17:13.024+0000 I COMMAND [conn26] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 950ms 2016-04-18T02:17:13.024+0000 I COMMAND [conn47] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 949ms 2016-04-18T02:17:13.024+0000 I COMMAND [conn50] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 949ms 2016-04-18T02:17:13.024+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 949ms 2016-04-18T02:17:13.024+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 950ms 2016-04-18T02:17:13.025+0000 I COMMAND [conn23] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 949ms 2016-04-18T02:17:13.024+0000 I COMMAND [conn67] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 949ms 2016-04-18T02:17:13.024+0000 I COMMAND [conn44] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 949ms 2016-04-18T02:17:14.847+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 870, after connections: 880, after extra_info: 1350, after globalLock: 1670, after locks: 1750, after network: 1760, after opcounters: 1760, after opcountersRepl: 1760, after repl: 2520, after storageEngine: 2800, after tcmalloc: 3080, after wiredTiger: 4680, at end: 6880 } 2016-04-18T02:17:15.433+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 635ms 2016-04-18T02:17:25.836+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-18T02:17:36.259+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 730, after connections: 830, after extra_info: 1550, after globalLock: 1910, after locks: 2110, after network: 2250, after opcounters: 2250, after opcountersRepl: 2250, after repl: 3070, after storageEngine: 3600, after tcmalloc: 4080, after wiredTiger: 4170, at end: 6450 } 2016-04-18T02:17:36.994+0000 I COMMAND [conn26] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1567ms 2016-04-18T02:17:36.994+0000 I COMMAND [conn50] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1567ms 2016-04-18T02:17:40.913+0000 I COMMAND [conn23] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2341ms 2016-04-18T02:17:40.913+0000 I COMMAND [conn47] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2341ms 2016-04-18T02:17:41.531+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:17:49.024+0000 I COMMAND [conn67] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1778ms 2016-04-18T02:17:55.535+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:17:55.681+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 770, after connections: 1760, after extra_info: 2820, after globalLock: 3090, after locks: 3350, after network: 3440, after opcounters: 3440, after opcountersRepl: 3440, after repl: 4270, after storageEngine: 4470, after tcmalloc: 4480, after wiredTiger: 5060, at end: 6820 } 2016-04-18T02:17:58.854+0000 I COMMAND [conn44] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3148ms 2016-04-18T02:18:10.401+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:18:13.597+0000 I COMMAND [conn56] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 427ms 2016-04-18T02:18:13.597+0000 I COMMAND [conn61] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 427ms 2016-04-18T02:18:13.597+0000 I COMMAND [conn68] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 426ms 2016-04-18T02:18:14.232+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 260, after asserts: 550, after connections: 910, after extra_info: 1690, after globalLock: 2180, after locks: 2440, after network: 2730, after opcounters: 2730, after opcountersRepl: 2730, after repl: 5100, after storageEngine: 5420, after tcmalloc: 6180, after wiredTiger: 6820, at end: 7440 } 2016-04-18T02:18:22.796+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:18:36.254+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 500, after asserts: 780, after connections: 1380, after extra_info: 2250, after globalLock: 2770, after locks: 3360, after network: 3850, after opcounters: 4230, after opcountersRepl: 4700, after repl: 5940, after storageEngine: 6480, after tcmalloc: 7320, after wiredTiger: 8600, at end: 10580 } 2016-04-18T02:18:36.853+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:18:51.243+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:19:01.578+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 370, after asserts: 720, after connections: 810, after extra_info: 1340, after globalLock: 1740, after locks: 1840, after network: 1980, after opcounters: 1980, after opcountersRepl: 1980, after repl: 2750, after storageEngine: 3110, after tcmalloc: 4300, after wiredTiger: 6320, at end: 7680 } 2016-04-18T02:19:04.348+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:19:18.704+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:19:26.359+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 690, after connections: 890, after extra_info: 1470, after globalLock: 1950, after locks: 2300, after network: 2490, after opcounters: 2770, after opcountersRepl: 2770, after repl: 6060, after storageEngine: 6340, after tcmalloc: 6750, after wiredTiger: 8020, at end: 10110 } 2016-04-18T02:19:35.006+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:19:46.397+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 870, after connections: 1050, after extra_info: 2010, after globalLock: 2280, after locks: 2370, after network: 2370, after opcounters: 2370, after opcountersRepl: 2370, after repl: 2700, after storageEngine: 2800, after tcmalloc: 3290, after wiredTiger: 4710, at end: 5760 } 2016-04-18T02:19:48.192+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:19:55.448+0000 I NETWORK [conn235] end connection 127.0.0.1:38790 (56 connections now open) 2016-04-18T02:19:55.448+0000 I NETWORK [conn234] end connection 127.0.0.1:38789 (56 connections now open) 2016-04-18T02:19:55.771+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 194ms 2016-04-18T02:20:03.612+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:20:06.605+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 610, after connections: 610, after extra_info: 800, after globalLock: 800, after locks: 810, after network: 810, after opcounters: 900, after opcountersRepl: 900, after repl: 2520, after storageEngine: 2960, after tcmalloc: 3580, after wiredTiger: 4820, at end: 5850 } 2016-04-18T02:20:08.458+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38799 #236 (56 connections now open) 2016-04-18T02:20:09.932+0000 I COMMAND [conn50] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1446ms 2016-04-18T02:20:09.932+0000 I COMMAND [conn23] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1446ms 2016-04-18T02:20:09.932+0000 I COMMAND [conn26] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1446ms 2016-04-18T02:20:10.575+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38800 #237 (57 connections now open) 2016-04-18T02:20:11.106+0000 I COMMAND [conn44] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 579ms 2016-04-18T02:20:11.106+0000 I COMMAND [conn47] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 579ms 2016-04-18T02:20:11.106+0000 I COMMAND [conn67] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 579ms 2016-04-18T02:20:11.599+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38801 #238 (58 connections now open) 2016-04-18T02:20:12.721+0000 I COMMAND [conn68] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1719ms 2016-04-18T02:20:12.721+0000 I COMMAND [conn61] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1719ms 2016-04-18T02:20:12.721+0000 I COMMAND [conn56] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1719ms 2016-04-18T02:20:15.260+0000 I COMMAND [conn236] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1722ms 2016-04-18T02:20:16.442+0000 I COMMAND [conn237] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1589ms 2016-04-18T02:20:17.420+0000 I COMMAND [conn238] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1782ms 2016-04-18T02:20:17.598+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:20:25.498+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 550, after connections: 640, after extra_info: 1550, after globalLock: 1810, after locks: 1990, after network: 2080, after opcounters: 2080, after opcountersRepl: 2080, after repl: 5740, after storageEngine: 6100, after tcmalloc: 6800, after wiredTiger: 8050, at end: 10460 } 2016-04-18T02:20:31.731+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:20:40.703+0000 I NETWORK [conn236] end connection 127.0.0.1:38799 (57 connections now open) 2016-04-18T02:20:40.703+0000 I NETWORK [conn237] end connection 127.0.0.1:38800 (57 connections now open) 2016-04-18T02:20:42.730+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 530, after asserts: 540, after connections: 620, after extra_info: 1170, after globalLock: 1480, after locks: 1790, after network: 1980, after opcounters: 1980, after opcountersRepl: 1980, after repl: 2800, after storageEngine: 2910, after tcmalloc: 3730, after wiredTiger: 4140, at end: 5490 } 2016-04-18T02:20:43.367+0000 I COMMAND [conn44] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2124ms 2016-04-18T02:20:43.367+0000 I COMMAND [conn67] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2124ms 2016-04-18T02:20:43.367+0000 I COMMAND [conn47] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2124ms 2016-04-18T02:20:44.226+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:20:58.860+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 181ms 2016-04-18T02:20:59.454+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:21:02.716+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 630, after connections: 630, after extra_info: 1210, after globalLock: 1580, after locks: 1680, after network: 1770, after opcounters: 1770, after opcountersRepl: 1770, after repl: 2710, after storageEngine: 3240, after tcmalloc: 3770, after wiredTiger: 5310, at end: 7680 } 2016-04-18T02:21:13.037+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:21:14.513+0000 I NETWORK [conn228] end connection 127.0.0.1:38543 (55 connections now open) 2016-04-18T02:21:19.545+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 370, after asserts: 590, after connections: 720, after extra_info: 830, after globalLock: 920, after locks: 920, after network: 920, after opcounters: 920, after opcountersRepl: 920, after repl: 2300, after storageEngine: 2690, after tcmalloc: 2980, after wiredTiger: 3830, at end: 5280 } 2016-04-18T02:21:25.637+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:21:32.417+0000 I COMMAND [conn56] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 453ms 2016-04-18T02:21:32.417+0000 I COMMAND [conn26] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 453ms 2016-04-18T02:21:32.417+0000 I COMMAND [conn61] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 452ms 2016-04-18T02:21:32.417+0000 I COMMAND [conn68] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 453ms 2016-04-18T02:21:32.417+0000 I COMMAND [conn23] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 453ms 2016-04-18T02:21:32.417+0000 I COMMAND [conn50] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 453ms 2016-04-18T02:21:33.608+0000 I NETWORK [conn238] end connection 127.0.0.1:38801 (54 connections now open) 2016-04-18T02:21:38.928+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 350, after asserts: 530, after connections: 620, after extra_info: 1520, after globalLock: 2360, after locks: 3120, after network: 3350, after opcounters: 3450, after opcountersRepl: 3450, after repl: 5150, after storageEngine: 5630, after tcmalloc: 5960, after wiredTiger: 6000, at end: 6770 } 2016-04-18T02:21:39.399+0000 I COMMAND [conn44] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 183ms 2016-04-18T02:21:39.399+0000 I COMMAND [conn67] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 183ms 2016-04-18T02:21:39.399+0000 I COMMAND [conn47] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 183ms 2016-04-18T02:21:40.225+0000 I COMMAND [conn50] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 922ms 2016-04-18T02:21:40.225+0000 I COMMAND [conn68] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 922ms 2016-04-18T02:21:40.225+0000 I COMMAND [conn56] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 922ms 2016-04-18T02:21:40.225+0000 I COMMAND [conn61] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 922ms 2016-04-18T02:21:40.225+0000 I COMMAND [conn23] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 922ms 2016-04-18T02:21:40.225+0000 I COMMAND [conn26] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 922ms 2016-04-18T02:21:40.672+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:21:50.640+0000 I COMMAND [conn44] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1508ms 2016-04-18T02:21:50.640+0000 I COMMAND [conn47] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1508ms 2016-04-18T02:21:50.640+0000 I COMMAND [conn67] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1508ms 2016-04-18T02:21:53.305+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 450, after connections: 530, after extra_info: 1070, after globalLock: 1480, after locks: 1580, after network: 1580, after opcounters: 1580, after opcountersRepl: 1580, after repl: 2320, after storageEngine: 2590, after tcmalloc: 2810, after wiredTiger: 4040, at end: 4940 } 2016-04-18T02:21:54.776+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:21:57.167+0000 I COMMAND [conn50] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 986ms 2016-04-18T02:21:57.167+0000 I COMMAND [conn23] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 986ms 2016-04-18T02:21:58.649+0000 I NETWORK [conn233] end connection 127.0.0.1:38775 (53 connections now open) 2016-04-18T02:21:59.279+0000 I COMMAND [conn26] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 803ms 2016-04-18T02:22:00.902+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 183ms 2016-04-18T02:22:08.292+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:22:13.139+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 420, after asserts: 620, after connections: 990, after extra_info: 1600, after globalLock: 1920, after locks: 2180, after network: 2480, after opcounters: 2480, after opcountersRepl: 2480, after repl: 3620, after storageEngine: 4020, after tcmalloc: 4420, after wiredTiger: 5370, at end: 5870 } 2016-04-18T02:22:14.763+0000 I COMMAND [conn67] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 194ms 2016-04-18T02:22:14.763+0000 I COMMAND [conn68] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 194ms 2016-04-18T02:22:14.763+0000 I COMMAND [conn56] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 194ms 2016-04-18T02:22:14.763+0000 I COMMAND [conn47] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 194ms 2016-04-18T02:22:14.763+0000 I COMMAND [conn44] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 194ms 2016-04-18T02:22:14.763+0000 I COMMAND [conn61] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 194ms 2016-04-18T02:22:15.873+0000 I COMMAND [conn26] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1310ms 2016-04-18T02:22:15.873+0000 I COMMAND [conn23] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1310ms 2016-04-18T02:22:15.873+0000 I COMMAND [conn50] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1310ms 2016-04-18T02:22:21.064+0000 I COMMAND [conn47] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1325ms 2016-04-18T02:22:21.064+0000 I COMMAND [conn68] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1325ms 2016-04-18T02:22:21.064+0000 I COMMAND [conn56] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1325ms 2016-04-18T02:22:21.064+0000 I COMMAND [conn61] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1325ms 2016-04-18T02:22:21.064+0000 I COMMAND [conn44] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1325ms 2016-04-18T02:22:21.064+0000 I COMMAND [conn67] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1325ms 2016-04-18T02:22:22.099+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:22:28.399+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 290, after extra_info: 1150, after globalLock: 1280, after locks: 1380, after network: 1380, after opcounters: 1380, after opcountersRepl: 1380, after repl: 2600, after storageEngine: 2870, after tcmalloc: 3720, after wiredTiger: 4570, at end: 5690 } 2016-04-18T02:22:35.991+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:22:40.688+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 670, after connections: 880, after extra_info: 1070, after globalLock: 1070, after locks: 1070, after network: 1070, after opcounters: 1070, after opcountersRepl: 1070, after repl: 1080, after storageEngine: 1080, after tcmalloc: 1080, after wiredTiger: 1970, at end: 4190 } 2016-04-18T02:22:49.540+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:22:59.968+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 500, after asserts: 720, after connections: 960, after extra_info: 1720, after globalLock: 1990, after locks: 2040, after network: 2130, after opcounters: 2130, after opcountersRepl: 2130, after repl: 2970, after storageEngine: 3370, after tcmalloc: 3890, after wiredTiger: 5120, at end: 7280 } 2016-04-18T02:23:02.489+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:23:03.266+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 189ms 2016-04-18T02:23:14.064+0000 I COMMAND [conn50] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 944ms 2016-04-18T02:23:17.185+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:23:19.802+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 100, after asserts: 110, after connections: 180, after extra_info: 1070, after globalLock: 1500, after locks: 1510, after network: 1640, after opcounters: 1780, after opcountersRepl: 1780, after repl: 3450, after storageEngine: 3720, after tcmalloc: 4130, after wiredTiger: 5000, at end: 6870 } 2016-04-18T02:23:24.732+0000 I COMMAND [conn26] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 552ms 2016-04-18T02:23:31.603+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:23:33.604+0000 I COMMAND [conn23] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 559ms 2016-04-18T02:23:37.290+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 670, after asserts: 870, after connections: 970, after extra_info: 1650, after globalLock: 1840, after locks: 1930, after network: 2010, after opcounters: 2010, after opcountersRepl: 2010, after repl: 3070, after storageEngine: 3530, after tcmalloc: 4200, after wiredTiger: 4320, at end: 5940 } 2016-04-18T02:23:45.628+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:23:59.838+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 930, after asserts: 1220, after connections: 1590, after extra_info: 2800, after globalLock: 3090, after locks: 3090, after network: 3190, after opcounters: 3190, after opcountersRepl: 3190, after repl: 4030, after storageEngine: 4310, after tcmalloc: 4780, after wiredTiger: 5840, at end: 7540 } 2016-04-18T02:23:59.961+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:24:15.357+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:24:18.684+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:24:23.966+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 490, after connections: 770, after extra_info: 1570, after globalLock: 1750, after locks: 1850, after network: 1940, after opcounters: 1940, after opcountersRepl: 1940, after repl: 3950, after storageEngine: 4350, after tcmalloc: 5690, after wiredTiger: 6760, at end: 8600 } 2016-04-18T02:24:32.412+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:24:35.449+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:24:46.154+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 540, after connections: 1060, after extra_info: 1810, after globalLock: 2170, after locks: 2270, after network: 2360, after opcounters: 2360, after opcountersRepl: 2360, after repl: 2950, after storageEngine: 3400, after tcmalloc: 4070, after wiredTiger: 4830, at end: 6930 } 2016-04-18T02:24:51.784+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:25:05.382+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:25:07.703+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 530, after asserts: 800, after connections: 990, after extra_info: 1580, after globalLock: 2070, after locks: 2350, after network: 2440, after opcounters: 2440, after opcountersRepl: 2440, after repl: 3290, after storageEngine: 4020, after tcmalloc: 4370, after wiredTiger: 5950, at end: 7530 } 2016-04-18T02:25:19.833+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:25:32.193+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 500, after connections: 590, after extra_info: 1420, after globalLock: 1980, after locks: 2350, after network: 2730, after opcounters: 3160, after opcountersRepl: 3170, after repl: 3880, after storageEngine: 4330, after tcmalloc: 4960, after wiredTiger: 6600, at end: 8760 } 2016-04-18T02:25:33.969+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:25:51.319+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:25:55.871+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 350, after asserts: 530, after connections: 880, after extra_info: 1690, after globalLock: 1960, after locks: 2140, after network: 2140, after opcounters: 2140, after opcountersRepl: 2140, after repl: 3310, after storageEngine: 3760, after tcmalloc: 4130, after wiredTiger: 5440, at end: 7850 } 2016-04-18T02:26:05.430+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 182ms 2016-04-18T02:26:06.530+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:26:18.980+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 550, after asserts: 910, after connections: 1210, after extra_info: 2000, after globalLock: 2190, after locks: 2290, after network: 2370, after opcounters: 2370, after opcountersRepl: 2370, after repl: 3320, after storageEngine: 4040, after tcmalloc: 4930, after wiredTiger: 6080, at end: 7400 } 2016-04-18T02:26:20.972+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:26:35.587+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:26:42.475+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 550, after connections: 680, after extra_info: 1080, after globalLock: 1440, after locks: 1910, after network: 2100, after opcounters: 2270, after opcountersRepl: 2270, after repl: 5080, after storageEngine: 5610, after tcmalloc: 5990, after wiredTiger: 7410, at end: 9320 } 2016-04-18T02:26:49.586+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:26:53.408+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:27:04.085+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:27:06.942+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 176ms 2016-04-18T02:27:07.039+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 590, after connections: 690, after extra_info: 1360, after globalLock: 1870, after locks: 2090, after network: 2270, after opcounters: 2460, after opcountersRepl: 2460, after repl: 3530, after storageEngine: 4090, after tcmalloc: 4550, after wiredTiger: 6280, at end: 8280 } 2016-04-18T02:27:08.493+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:27:10.009+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:27:19.406+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:27:24.516+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:27:31.149+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 440, after connections: 610, after extra_info: 1420, after globalLock: 1740, after locks: 1840, after network: 1920, after opcounters: 1920, after opcountersRepl: 1920, after repl: 2940, after storageEngine: 3570, after tcmalloc: 4140, after wiredTiger: 5920, at end: 7440 } 2016-04-18T02:27:35.359+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:27:37.402+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:27:38.367+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:27:50.658+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:27:50.750+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 670, after asserts: 880, after connections: 980, after extra_info: 1500, after globalLock: 1810, after locks: 2170, after network: 2380, after opcounters: 2390, after opcountersRepl: 2390, after repl: 3230, after storageEngine: 3630, after tcmalloc: 4200, after wiredTiger: 5560, at end: 7910 } 2016-04-18T02:27:53.556+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:28:09.771+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:28:15.443+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 370, after asserts: 470, after connections: 470, after extra_info: 1200, after globalLock: 1690, after locks: 2080, after network: 2180, after opcounters: 2180, after opcountersRepl: 2180, after repl: 4710, after storageEngine: 4970, after tcmalloc: 5070, after wiredTiger: 6170, at end: 7590 } 2016-04-18T02:28:22.815+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:28:25.329+0000 I COMMAND [conn26] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1733ms 2016-04-18T02:28:25.329+0000 I COMMAND [conn50] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1733ms 2016-04-18T02:28:25.329+0000 I COMMAND [conn23] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1732ms 2016-04-18T02:28:33.504+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 250, after asserts: 550, after connections: 840, after extra_info: 1450, after globalLock: 1860, after locks: 2160, after network: 2260, after opcounters: 2260, after opcountersRepl: 2260, after repl: 3880, after storageEngine: 4420, after tcmalloc: 5300, after wiredTiger: 6990, at end: 9940 } 2016-04-18T02:28:43.343+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:28:59.674+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:29:04.793+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 230, after asserts: 420, after connections: 520, after extra_info: 1070, after globalLock: 1700, after locks: 2240, after network: 2460, after opcounters: 2870, after opcountersRepl: 3280, after repl: 5300, after storageEngine: 5840, after tcmalloc: 6540, after wiredTiger: 8200, at end: 10390 } 2016-04-18T02:29:07.106+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2130ms 2016-04-18T02:29:09.212+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 178ms 2016-04-18T02:29:15.420+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:29:15.427+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1933ms 2016-04-18T02:29:21.925+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1318ms 2016-04-18T02:29:29.046+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:29:30.642+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 820, after connections: 1000, after extra_info: 1820, after globalLock: 2240, after locks: 2650, after network: 3090, after opcounters: 3100, after opcountersRepl: 3100, after repl: 3990, after storageEngine: 4760, after tcmalloc: 5600, after wiredTiger: 7400, at end: 9800 } 2016-04-18T02:29:31.003+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:29:45.815+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:29:46.440+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:29:51.220+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:29:59.752+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:30:01.115+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 420, after asserts: 690, after connections: 1090, after extra_info: 2030, after globalLock: 2540, after locks: 3000, after network: 3390, after opcounters: 3590, after opcountersRepl: 3590, after repl: 7070, after storageEngine: 7580, after tcmalloc: 8360, after wiredTiger: 10580, at end: 12940 } 2016-04-18T02:30:06.794+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:30:10.803+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 215ms 2016-04-18T02:30:13.080+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 214ms 2016-04-18T02:30:14.206+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:30:22.215+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:30:28.702+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:30:32.553+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 880, after asserts: 1230, after connections: 1600, after extra_info: 2840, after globalLock: 3150, after locks: 3240, after network: 3330, after opcounters: 3330, after opcountersRepl: 3330, after repl: 7660, after storageEngine: 8170, after tcmalloc: 8680, after wiredTiger: 10880, at end: 13450 } 2016-04-18T02:30:35.082+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:30:38.625+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:30:43.875+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:30:53.088+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:30:54.805+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 460, after asserts: 730, after connections: 830, after extra_info: 1620, after globalLock: 1830, after locks: 2220, after network: 2400, after opcounters: 2400, after opcountersRepl: 2400, after repl: 3140, after storageEngine: 3840, after tcmalloc: 4910, after wiredTiger: 6220, at end: 7330 } 2016-04-18T02:31:00.114+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:31:02.830+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:31:08.430+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:31:14.399+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:31:19.898+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 800, after connections: 1070, after extra_info: 1760, after globalLock: 2030, after locks: 2480, after network: 2570, after opcounters: 2570, after opcountersRepl: 2570, after repl: 4260, after storageEngine: 4660, after tcmalloc: 5560, after wiredTiger: 7030, at end: 9550 } 2016-04-18T02:31:22.955+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:31:29.796+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:31:33.825+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:31:40.123+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:31:44.011+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:31:47.338+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 520, after asserts: 810, after connections: 910, after extra_info: 2010, after globalLock: 2480, after locks: 2880, after network: 3150, after opcounters: 3150, after opcountersRepl: 3150, after repl: 4950, after storageEngine: 5290, after tcmalloc: 5680, after wiredTiger: 7170, at end: 9190 } 2016-04-18T02:31:55.822+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:31:58.509+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:32:08.578+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:32:13.475+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 600, after asserts: 970, after connections: 1460, after extra_info: 2720, after globalLock: 3030, after locks: 3220, after network: 3310, after opcounters: 3310, after opcountersRepl: 3310, after repl: 4570, after storageEngine: 5050, after tcmalloc: 5320, after wiredTiger: 6680, at end: 8080 } 2016-04-18T02:32:13.930+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:32:15.248+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 119ms 2016-04-18T02:32:16.798+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:32:31.077+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:32:34.493+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:32:38.605+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:32:44.683+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 910, after connections: 1270, after extra_info: 2330, after globalLock: 2730, after locks: 3120, after network: 3480, after opcounters: 3660, after opcountersRepl: 3660, after repl: 7850, after storageEngine: 8270, after tcmalloc: 8820, after wiredTiger: 11220, at end: 13160 } 2016-04-18T02:32:51.444+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:32:53.906+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:33:06.106+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 600, after connections: 1000, after extra_info: 1630, after globalLock: 2020, after locks: 2340, after network: 2460, after opcounters: 2460, after opcountersRepl: 2460, after repl: 3020, after storageEngine: 3390, after tcmalloc: 4120, after wiredTiger: 5460, at end: 7190 } 2016-04-18T02:33:06.602+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:33:08.209+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:33:11.066+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:33:16.634+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 109ms 2016-04-18T02:33:23.422+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:33:26.204+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:33:26.716+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 650, after connections: 1120, after extra_info: 2320, after globalLock: 2770, after locks: 3210, after network: 3340, after opcounters: 3340, after opcountersRepl: 3340, after repl: 4250, after storageEngine: 4730, after tcmalloc: 5100, after wiredTiger: 5810, at end: 7800 } 2016-04-18T02:33:40.294+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:33:47.574+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 560, after connections: 830, after extra_info: 1770, after globalLock: 2490, after locks: 2770, after network: 3120, after opcounters: 3220, after opcountersRepl: 3220, after repl: 5430, after storageEngine: 5870, after tcmalloc: 6010, after wiredTiger: 7040, at end: 9000 } 2016-04-18T02:33:55.754+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:34:08.908+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 530, after asserts: 730, after connections: 920, after extra_info: 1440, after globalLock: 1670, after locks: 1770, after network: 1770, after opcounters: 1770, after opcountersRepl: 1770, after repl: 2990, after storageEngine: 3570, after tcmalloc: 4680, after wiredTiger: 6950, at end: 8550 } 2016-04-18T02:34:10.589+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:34:25.164+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:34:33.191+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 510, after connections: 880, after extra_info: 2070, after globalLock: 2340, after locks: 2640, after network: 2720, after opcounters: 2720, after opcountersRepl: 2720, after repl: 4680, after storageEngine: 5420, after tcmalloc: 5860, after wiredTiger: 7880, at end: 8900 } 2016-04-18T02:34:38.751+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:34:53.017+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 580, after connections: 750, after extra_info: 1330, after globalLock: 1520, after locks: 1700, after network: 1790, after opcounters: 1790, after opcountersRepl: 1790, after repl: 2850, after storageEngine: 3030, after tcmalloc: 3220, after wiredTiger: 4590, at end: 6220 } 2016-04-18T02:34:54.695+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:35:10.694+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:35:14.516+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 310, after asserts: 600, after connections: 1050, after extra_info: 1740, after globalLock: 1950, after locks: 2260, after network: 2440, after opcounters: 2440, after opcountersRepl: 2440, after repl: 3610, after storageEngine: 3960, after tcmalloc: 4620, after wiredTiger: 5370, at end: 7750 } 2016-04-18T02:35:23.803+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:35:32.532+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 390, after connections: 510, after extra_info: 1270, after globalLock: 1550, after locks: 1850, after network: 1950, after opcounters: 1960, after opcountersRepl: 1960, after repl: 3040, after storageEngine: 3220, after tcmalloc: 3690, after wiredTiger: 4900, at end: 5840 } 2016-04-18T02:35:37.683+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:35:52.086+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:35:54.005+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 600, after asserts: 870, after connections: 1090, after extra_info: 1940, after globalLock: 2150, after locks: 2260, after network: 2340, after opcounters: 2340, after opcountersRepl: 2340, after repl: 3160, after storageEngine: 3340, after tcmalloc: 3830, after wiredTiger: 6750, at end: 8280 } 2016-04-18T02:36:05.019+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:36:16.877+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 750, after connections: 1010, after extra_info: 1880, after globalLock: 2440, after locks: 2720, after network: 2820, after opcounters: 2820, after opcountersRepl: 2820, after repl: 3790, after storageEngine: 4130, after tcmalloc: 4470, after wiredTiger: 6880, at end: 7990 } 2016-04-18T02:36:18.375+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 174ms 2016-04-18T02:36:18.930+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:36:34.473+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:36:38.352+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 220, after asserts: 490, after connections: 710, after extra_info: 1700, after globalLock: 1970, after locks: 2150, after network: 2150, after opcounters: 2150, after opcountersRepl: 2150, after repl: 3880, after storageEngine: 4060, after tcmalloc: 4580, after wiredTiger: 5750, at end: 7490 } 2016-04-18T02:36:50.516+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:36:56.864+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 670, after connections: 760, after extra_info: 1490, after globalLock: 1700, after locks: 1700, after network: 1710, after opcounters: 1710, after opcountersRepl: 1710, after repl: 4070, after storageEngine: 4450, after tcmalloc: 4930, after wiredTiger: 6160, at end: 7351 } 2016-04-18T02:36:56.866+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38826 #239 (54 connections now open) 2016-04-18T02:37:04.663+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:37:14.370+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 590, after connections: 590, after extra_info: 1340, after globalLock: 1820, after locks: 1920, after network: 1920, after opcounters: 1920, after opcountersRepl: 1920, after repl: 1930, after storageEngine: 1930, after tcmalloc: 1930, after wiredTiger: 2720, at end: 4250 } 2016-04-18T02:37:19.663+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:37:33.342+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 230, after asserts: 520, after connections: 990, after extra_info: 1660, after globalLock: 2030, after locks: 2220, after network: 2490, after opcounters: 2490, after opcountersRepl: 2490, after repl: 4430, after storageEngine: 4960, after tcmalloc: 5780, after wiredTiger: 7720, at end: 9730 } 2016-04-18T02:37:34.222+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:37:48.007+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:37:55.977+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 370, after asserts: 460, after connections: 550, after extra_info: 1100, after globalLock: 1630, after locks: 1980, after network: 2160, after opcounters: 2160, after opcountersRepl: 2160, after repl: 3880, after storageEngine: 4260, after tcmalloc: 4550, after wiredTiger: 5960, at end: 8040 } 2016-04-18T02:38:03.314+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:38:19.308+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:38:19.580+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 550, after connections: 1000, after extra_info: 1840, after globalLock: 2100, after locks: 2180, after network: 2290, after opcounters: 2640, after opcountersRepl: 2640, after repl: 3610, after storageEngine: 4240, after tcmalloc: 5140, after wiredTiger: 6680, at end: 7930 } 2016-04-18T02:38:35.816+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:38:41.511+0000 I NETWORK [conn239] end connection 127.0.0.1:38826 (53 connections now open) 2016-04-18T02:38:45.344+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 590, after connections: 890, after extra_info: 1740, after globalLock: 2120, after locks: 2320, after network: 2320, after opcounters: 2320, after opcountersRepl: 2320, after repl: 3790, after storageEngine: 4200, after tcmalloc: 5030, after wiredTiger: 7090, at end: 9210 } 2016-04-18T02:38:52.546+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:38:58.703+0000 I COMMAND [conn44] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 1122ms 2016-04-18T02:39:07.411+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:39:11.092+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:39:12.109+0000 I COMMAND [conn47] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 1108ms 2016-04-18T02:39:19.564+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 660, after asserts: 840, after connections: 960, after extra_info: 2000, after globalLock: 2460, after locks: 3140, after network: 3530, after opcounters: 3700, after opcountersRepl: 3700, after repl: 10190, after storageEngine: 10510, after tcmalloc: 11380, after wiredTiger: 12980, at end: 15160 } 2016-04-18T02:39:26.051+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:39:27.443+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:39:28.942+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:39:29.600+0000 I COMMAND [conn67] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 901ms 2016-04-18T02:39:42.890+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:39:45.716+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:39:46.132+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 600, after asserts: 850, after connections: 940, after extra_info: 1610, after globalLock: 2030, after locks: 2180, after network: 2360, after opcounters: 2360, after opcountersRepl: 2360, after repl: 3400, after storageEngine: 4020, after tcmalloc: 4700, after wiredTiger: 6440, at end: 9620 } 2016-04-18T02:40:01.101+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:40:01.421+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:40:04.200+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:40:14.064+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:40:14.072+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 750, after asserts: 1070, after connections: 1270, after extra_info: 2710, after globalLock: 3080, after locks: 3170, after network: 3270, after opcounters: 3270, after opcountersRepl: 3270, after repl: 5450, after storageEngine: 5990, after tcmalloc: 6520, after wiredTiger: 8220, at end: 11790 } 2016-04-18T02:40:19.989+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:40:20.749+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 211ms 2016-04-18T02:40:24.580+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 764ms 2016-04-18T02:40:34.358+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:40:37.753+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 660, after connections: 1520, after extra_info: 3160, after globalLock: 3260, after locks: 3260, after network: 3340, after opcounters: 3520, after opcountersRepl: 3520, after repl: 4810, after storageEngine: 5090, after tcmalloc: 6060, after wiredTiger: 7170, at end: 8790 } 2016-04-18T02:40:48.141+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:41:01.044+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:41:04.783+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 640, after asserts: 910, after connections: 1360, after extra_info: 2330, after globalLock: 3060, after locks: 3070, after network: 3160, after opcounters: 3260, after opcountersRepl: 3260, after repl: 4890, after storageEngine: 5180, after tcmalloc: 6160, after wiredTiger: 9490, at end: 11320 } 2016-04-18T02:41:15.848+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:41:22.623+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 174ms 2016-04-18T02:41:26.226+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:41:29.985+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:41:33.765+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 530, after asserts: 750, after connections: 920, after extra_info: 1670, after globalLock: 2070, after locks: 2710, after network: 3070, after opcounters: 3360, after opcountersRepl: 3710, after repl: 8550, after storageEngine: 8970, after tcmalloc: 9510, after wiredTiger: 10670, at end: 11880 } 2016-04-18T02:41:40.849+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:41:43.539+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T02:41:46.539+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:41:53.618+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 750, after asserts: 1100, after connections: 1410, after extra_info: 2580, after globalLock: 3160, after locks: 3170, after network: 3260, after opcounters: 3260, after opcountersRepl: 3260, after repl: 5400, after storageEngine: 5840, after tcmalloc: 6120, after wiredTiger: 8210, at end: 9310 } 2016-04-18T02:41:59.557+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:41:59.648+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 941ms 2016-04-18T02:42:01.738+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:42:04.938+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:42:10.997+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:42:13.273+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 360, after connections: 360, after extra_info: 1140, after globalLock: 1510, after locks: 1790, after network: 1880, after opcounters: 1880, after opcountersRepl: 1880, after repl: 2610, after storageEngine: 2920, after tcmalloc: 3190, after wiredTiger: 5720, at end: 7590 } 2016-04-18T02:42:15.067+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 666ms 2016-04-18T02:42:18.784+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:42:24.616+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 180ms 2016-04-18T02:42:32.140+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:42:35.672+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 660, after connections: 960, after extra_info: 1910, after globalLock: 2210, after locks: 2300, after network: 2470, after opcounters: 2470, after opcountersRepl: 2470, after repl: 3510, after storageEngine: 3740, after tcmalloc: 4190, after wiredTiger: 5450, at end: 7270 } 2016-04-18T02:42:46.592+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:42:54.378+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 360, after asserts: 570, after connections: 660, after extra_info: 1250, after globalLock: 1420, after locks: 1420, after network: 1520, after opcounters: 1790, after opcountersRepl: 1790, after repl: 2400, after storageEngine: 2930, after tcmalloc: 3600, after wiredTiger: 4620, at end: 5330 } 2016-04-18T02:43:00.625+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:43:14.534+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:43:15.844+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 670, after connections: 800, after extra_info: 1400, after globalLock: 1820, after locks: 2080, after network: 2440, after opcounters: 2710, after opcountersRepl: 2800, after repl: 3540, after storageEngine: 3900, after tcmalloc: 4570, after wiredTiger: 5530, at end: 7420 } 2016-04-18T02:43:28.944+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:43:36.645+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 190, after asserts: 460, after connections: 930, after extra_info: 1760, after globalLock: 2160, after locks: 2690, after network: 3050, after opcounters: 3260, after opcountersRepl: 3260, after repl: 5670, after storageEngine: 6260, after tcmalloc: 7010, after wiredTiger: 8010, at end: 10050 } 2016-04-18T02:43:45.984+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:43:59.064+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 650, after connections: 940, after extra_info: 1700, after globalLock: 2160, after locks: 2370, after network: 2560, after opcounters: 2560, after opcountersRepl: 2560, after repl: 3850, after storageEngine: 4350, after tcmalloc: 4950, after wiredTiger: 6660, at end: 8750 } 2016-04-18T02:43:59.642+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:44:13.470+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:44:19.554+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 640, after connections: 950, after extra_info: 1600, after globalLock: 1880, after locks: 2150, after network: 2250, after opcounters: 2250, after opcountersRepl: 2250, after repl: 5480, after storageEngine: 6140, after tcmalloc: 6330, after wiredTiger: 6610, at end: 8370 } 2016-04-18T02:44:26.038+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 122ms 2016-04-18T02:44:28.096+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 183ms 2016-04-18T02:44:29.432+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:44:40.218+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 760, after connections: 970, after extra_info: 2010, after globalLock: 2490, after locks: 2950, after network: 3210, after opcounters: 3390, after opcountersRepl: 3480, after repl: 4340, after storageEngine: 5010, after tcmalloc: 5380, after wiredTiger: 6580, at end: 7570 } 2016-04-18T02:44:44.064+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:44:55.113+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3249ms 2016-04-18T02:44:57.727+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:44:58.561+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 770, after asserts: 780, after connections: 780, after extra_info: 1270, after globalLock: 1550, after locks: 1730, after network: 1830, after opcounters: 1830, after opcountersRepl: 1830, after repl: 2910, after storageEngine: 3690, after tcmalloc: 4300, after wiredTiger: 6080, at end: 7990 } 2016-04-18T02:45:04.187+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:45:04.876+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3777ms 2016-04-18T02:45:11.562+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:45:12.480+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1840ms 2016-04-18T02:45:17.541+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:45:18.923+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 880, after connections: 980, after extra_info: 1610, after globalLock: 1790, after locks: 1970, after network: 2050, after opcounters: 2050, after opcountersRepl: 2050, after repl: 3300, after storageEngine: 3790, after tcmalloc: 4510, after wiredTiger: 5740, at end: 7350 } 2016-04-18T02:45:20.268+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T02:45:25.470+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:45:34.652+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:45:36.207+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:45:39.872+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:45:41.773+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 750, after connections: 1260, after extra_info: 2080, after globalLock: 2560, after locks: 2740, after network: 2830, after opcounters: 2830, after opcountersRepl: 2830, after repl: 3750, after storageEngine: 4220, after tcmalloc: 4700, after wiredTiger: 5660, at end: 7420 } 2016-04-18T02:45:48.726+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:45:52.560+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:46:01.925+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:46:02.725+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 350, after asserts: 670, after connections: 850, after extra_info: 1170, after globalLock: 1530, after locks: 2070, after network: 2250, after opcounters: 2260, after opcountersRepl: 2260, after repl: 3160, after storageEngine: 3610, after tcmalloc: 4560, after wiredTiger: 6580, at end: 8000 } 2016-04-18T02:46:05.217+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T02:46:08.953+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:46:21.595+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:46:24.914+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:46:24.921+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:46:33.681+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 800, after asserts: 1070, after connections: 1320, after extra_info: 2100, after globalLock: 2650, after locks: 2820, after network: 2820, after opcounters: 2820, after opcountersRepl: 2820, after repl: 8110, after storageEngine: 8740, after tcmalloc: 9130, after wiredTiger: 11310, at end: 13790 } 2016-04-18T02:46:39.544+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:46:42.077+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:46:56.760+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:46:57.576+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 660, after asserts: 760, after connections: 1340, after extra_info: 2060, after globalLock: 2570, after locks: 3240, after network: 3420, after opcounters: 3420, after opcountersRepl: 3420, after repl: 4360, after storageEngine: 4760, after tcmalloc: 5440, after wiredTiger: 7460, at end: 9220 } 2016-04-18T02:47:10.864+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:47:14.109+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:47:22.120+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 670, after asserts: 890, after connections: 1000, after extra_info: 1430, after globalLock: 1710, after locks: 1930, after network: 2020, after opcounters: 2020, after opcountersRepl: 2020, after repl: 4750, after storageEngine: 5340, after tcmalloc: 5880, after wiredTiger: 7410, at end: 8030 } 2016-04-18T02:47:27.959+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:47:30.515+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:47:31.038+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:47:45.446+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:47:45.534+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 560, after asserts: 770, after connections: 1120, after extra_info: 2050, after globalLock: 2430, after locks: 2790, after network: 2970, after opcounters: 2970, after opcountersRepl: 2970, after repl: 4180, after storageEngine: 4800, after tcmalloc: 5290, after wiredTiger: 7080, at end: 8810 } 2016-04-18T02:47:48.459+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:48:05.916+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:48:11.867+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 790, after asserts: 980, after connections: 1100, after extra_info: 1930, after globalLock: 2420, after locks: 2940, after network: 3030, after opcounters: 3030, after opcountersRepl: 3030, after repl: 5230, after storageEngine: 5590, after tcmalloc: 6040, after wiredTiger: 7070, at end: 8250 } 2016-04-18T02:48:20.979+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:48:30.863+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 192ms 2016-04-18T02:48:34.948+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:48:37.107+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 470, after connections: 840, after extra_info: 1450, after globalLock: 1830, after locks: 2200, after network: 2290, after opcounters: 2290, after opcountersRepl: 2290, after repl: 3680, after storageEngine: 3820, after tcmalloc: 4260, after wiredTiger: 5660, at end: 7740 } 2016-04-18T02:48:49.142+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:48:53.567+0000 I COMMAND [conn67] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3296ms 2016-04-18T02:48:53.567+0000 I COMMAND [conn44] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3296ms 2016-04-18T02:48:53.567+0000 I COMMAND [conn47] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3296ms 2016-04-18T02:49:00.017+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 530, after asserts: 790, after connections: 1150, after extra_info: 1830, after globalLock: 2060, after locks: 2150, after network: 2150, after opcounters: 2150, after opcountersRepl: 2150, after repl: 3990, after storageEngine: 4390, after tcmalloc: 4870, after wiredTiger: 6910, at end: 9660 } 2016-04-18T02:49:05.535+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:49:08.535+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:49:21.606+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 200, after asserts: 660, after connections: 1190, after extra_info: 3020, after globalLock: 3340, after locks: 3520, after network: 3520, after opcounters: 3520, after opcountersRepl: 3520, after repl: 4350, after storageEngine: 4970, after tcmalloc: 5460, after wiredTiger: 5790, at end: 7570 } 2016-04-18T02:49:22.162+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:49:23.185+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:49:25.494+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:49:28.947+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 952ms 2016-04-18T02:49:38.174+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:49:40.744+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:49:48.586+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 470, after connections: 560, after extra_info: 650, after globalLock: 1370, after locks: 1940, after network: 2320, after opcounters: 2540, after opcountersRepl: 2540, after repl: 8620, after storageEngine: 8990, after tcmalloc: 9340, after wiredTiger: 10790, at end: 12660 } 2016-04-18T02:49:55.891+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:50:10.700+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:50:11.090+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 600, after asserts: 800, after connections: 1130, after extra_info: 1670, after globalLock: 2140, after locks: 2690, after network: 2960, after opcounters: 3130, after opcountersRepl: 3130, after repl: 3990, after storageEngine: 4440, after tcmalloc: 5240, after wiredTiger: 6590, at end: 7670 } 2016-04-18T02:50:24.625+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:50:34.546+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 460, after asserts: 570, after connections: 660, after extra_info: 1330, after globalLock: 1840, after locks: 2140, after network: 2230, after opcounters: 2230, after opcountersRepl: 2230, after repl: 4010, after storageEngine: 4570, after tcmalloc: 5060, after wiredTiger: 7030, at end: 9580 } 2016-04-18T02:50:40.178+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:50:56.623+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:50:57.746+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 370, after asserts: 540, after connections: 830, after extra_info: 1810, after globalLock: 2280, after locks: 2380, after network: 2390, after opcounters: 2390, after opcountersRepl: 2390, after repl: 3490, after storageEngine: 3880, after tcmalloc: 4830, after wiredTiger: 6190, at end: 7570 } 2016-04-18T02:50:59.382+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:51:12.721+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:51:15.632+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:51:17.306+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:51:21.153+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 758ms 2016-04-18T02:51:24.337+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 410, after connections: 510, after extra_info: 1580, after globalLock: 1980, after locks: 2170, after network: 2250, after opcounters: 2250, after opcountersRepl: 2250, after repl: 3640, after storageEngine: 4100, after tcmalloc: 4730, after wiredTiger: 7130, at end: 9000 } 2016-04-18T02:51:27.588+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 1028ms 2016-04-18T02:51:28.957+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:51:32.472+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:51:33.512+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 305ms 2016-04-18T02:51:46.753+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:51:49.230+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 450, after connections: 530, after extra_info: 900, after globalLock: 1290, after locks: 2130, after network: 2490, after opcounters: 2890, after opcountersRepl: 3070, after repl: 4070, after storageEngine: 4600, after tcmalloc: 5500, after wiredTiger: 7700, at end: 10500 } 2016-04-18T02:51:49.778+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:51:50.562+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:52:04.092+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:52:05.391+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2095ms 2016-04-18T02:52:07.582+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:52:08.738+0000 I COMMAND [conn50] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 765ms 2016-04-18T02:52:17.405+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 580, after asserts: 850, after connections: 1030, after extra_info: 1900, after globalLock: 2260, after locks: 2450, after network: 2450, after opcounters: 2450, after opcountersRepl: 2450, after repl: 6190, after storageEngine: 6740, after tcmalloc: 7310, after wiredTiger: 9260, at end: 11090 } 2016-04-18T02:52:18.315+0000 I COMMAND [conn26] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 333ms 2016-04-18T02:52:19.543+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2078ms 2016-04-18T02:52:23.144+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:52:26.299+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:52:26.598+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:52:28.920+0000 I COMMAND [conn23] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 809ms 2016-04-18T02:52:36.785+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2950ms 2016-04-18T02:52:38.463+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:52:40.430+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 750, after asserts: 940, after connections: 1390, after extra_info: 2210, after globalLock: 2580, after locks: 2670, after network: 2670, after opcounters: 2670, after opcountersRepl: 2670, after repl: 4470, after storageEngine: 5030, after tcmalloc: 5740, after wiredTiger: 6720, at end: 8580 } 2016-04-18T02:52:40.859+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:52:59.007+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:53:03.409+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:53:13.141+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 640, after connections: 820, after extra_info: 1100, after globalLock: 1200, after locks: 1280, after network: 1370, after opcounters: 1370, after opcountersRepl: 1370, after repl: 8040, after storageEngine: 8750, after tcmalloc: 9630, after wiredTiger: 11670, at end: 13570 } 2016-04-18T02:53:18.483+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:53:20.634+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:53:24.330+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:53:35.944+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:53:37.297+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 820, after connections: 1210, after extra_info: 2030, after globalLock: 2430, after locks: 3180, after network: 3450, after opcounters: 3830, after opcountersRepl: 3840, after repl: 4790, after storageEngine: 5360, after tcmalloc: 6030, after wiredTiger: 7240, at end: 9260 } 2016-04-18T02:53:39.249+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:53:52.495+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:53:56.676+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:53:59.048+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:54:05.542+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 630, after connections: 1200, after extra_info: 2170, after globalLock: 2700, after locks: 3070, after network: 3340, after opcounters: 3640, after opcountersRepl: 3640, after repl: 5000, after storageEngine: 5540, after tcmalloc: 6300, after wiredTiger: 8050, at end: 10000 } 2016-04-18T02:54:05.924+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:54:07.459+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38846 #240 (54 connections now open) 2016-04-18T02:54:09.597+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38847 #241 (55 connections now open) 2016-04-18T02:54:13.672+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:54:19.146+0000 I COMMAND [conn241] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2217ms 2016-04-18T02:54:19.964+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:54:22.019+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:54:25.498+0000 I COMMAND [conn240] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1717ms 2016-04-18T02:54:27.572+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:54:29.249+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 330, after asserts: 760, after connections: 1340, after extra_info: 2510, after globalLock: 2860, after locks: 3230, after network: 3540, after opcounters: 3640, after opcountersRepl: 3640, after repl: 5020, after storageEngine: 5590, after tcmalloc: 6070, after wiredTiger: 7930, at end: 10420 } 2016-04-18T02:54:33.464+0000 I COMMAND [conn50] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2740ms 2016-04-18T02:54:34.203+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:54:41.451+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:54:47.616+0000 I COMMAND [conn26] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2645ms 2016-04-18T02:54:48.594+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:54:52.161+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:54:52.690+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 490, after connections: 850, after extra_info: 1920, after globalLock: 2370, after locks: 2620, after network: 2630, after opcounters: 2630, after opcountersRepl: 2630, after repl: 3440, after storageEngine: 3970, after tcmalloc: 4620, after wiredTiger: 6920, at end: 8560 } 2016-04-18T02:54:58.079+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:55:04.357+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:55:10.425+0000 I COMMAND [conn23] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 4771ms 2016-04-18T02:55:13.175+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:55:19.888+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 420, after asserts: 860, after connections: 1050, after extra_info: 1320, after globalLock: 1580, after locks: 1670, after network: 1760, after opcounters: 1760, after opcountersRepl: 1760, after repl: 5410, after storageEngine: 5820, after tcmalloc: 6540, after wiredTiger: 7590, at end: 8770 } 2016-04-18T02:55:19.977+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:55:22.788+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:55:27.096+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:55:33.617+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:55:34.091+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 722ms 2016-04-18T02:55:35.661+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 173ms 2016-04-18T02:55:41.587+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:55:43.232+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 500, after asserts: 810, after connections: 940, after extra_info: 1960, after globalLock: 2320, after locks: 2510, after network: 2600, after opcounters: 2600, after opcountersRepl: 2600, after repl: 3880, after storageEngine: 4140, after tcmalloc: 4860, after wiredTiger: 6430, at end: 7480 } 2016-04-18T02:55:54.984+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:56:08.286+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 360, after asserts: 630, after connections: 1160, after extra_info: 1880, after globalLock: 2190, after locks: 2190, after network: 2280, after opcounters: 2280, after opcountersRepl: 2280, after repl: 3660, after storageEngine: 4290, after tcmalloc: 5070, after wiredTiger: 6330, at end: 8010 } 2016-04-18T02:56:11.222+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:56:16.354+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:56:31.782+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 700, after connections: 900, after extra_info: 1780, after globalLock: 2280, after locks: 2640, after network: 2910, after opcounters: 2910, after opcountersRepl: 2910, after repl: 4190, after storageEngine: 4570, after tcmalloc: 5040, after wiredTiger: 6500, at end: 8190 } 2016-04-18T02:56:31.962+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:56:34.668+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:56:34.868+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:56:37.765+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 124ms 2016-04-18T02:56:49.474+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:56:53.995+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 865ms 2016-04-18T02:56:54.146+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:57:02.396+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 760, after connections: 1050, after extra_info: 2380, after globalLock: 2820, after locks: 3150, after network: 3160, after opcounters: 3160, after opcountersRepl: 3160, after repl: 5920, after storageEngine: 6510, after tcmalloc: 7420, after wiredTiger: 8580, at end: 10490 } 2016-04-18T02:57:03.300+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 700ms 2016-04-18T02:57:04.377+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:57:17.622+0000 I NETWORK [conn240] end connection 127.0.0.1:38846 (54 connections now open) 2016-04-18T02:57:21.027+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:57:23.563+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:57:33.192+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 460, after asserts: 700, after connections: 980, after extra_info: 1820, after globalLock: 2380, after locks: 2900, after network: 3210, after opcounters: 3220, after opcountersRepl: 3220, after repl: 7200, after storageEngine: 7890, after tcmalloc: 8730, after wiredTiger: 10140, at end: 12540 } 2016-04-18T02:57:39.727+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:57:39.826+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 219ms 2016-04-18T02:57:42.526+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:57:44.891+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:57:58.546+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:57:59.625+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 970, after connections: 1350, after extra_info: 2160, after globalLock: 2540, after locks: 2630, after network: 2720, after opcounters: 2720, after opcountersRepl: 2720, after repl: 3940, after storageEngine: 4510, after tcmalloc: 5340, after wiredTiger: 6820, at end: 9000 } 2016-04-18T02:58:02.568+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:58:17.677+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:58:21.546+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:58:25.188+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:58:31.794+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 830, after asserts: 1190, after connections: 1970, after extra_info: 2990, after globalLock: 3170, after locks: 3270, after network: 3360, after opcounters: 3360, after opcountersRepl: 3360, after repl: 7610, after storageEngine: 8220, after tcmalloc: 8950, after wiredTiger: 11100, at end: 13600 } 2016-04-18T02:58:36.241+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:58:41.228+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:58:42.818+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 212ms 2016-04-18T02:58:51.919+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:58:56.084+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:58:58.964+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:59:01.103+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 680, after asserts: 1060, after connections: 1290, after extra_info: 1950, after globalLock: 2430, after locks: 2980, after network: 3160, after opcounters: 3340, after opcountersRepl: 3340, after repl: 5000, after storageEngine: 5320, after tcmalloc: 6170, after wiredTiger: 7430, at end: 10030 } 2016-04-18T02:59:06.676+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:59:13.182+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:59:21.015+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:59:23.629+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 740, after asserts: 1000, after connections: 1390, after extra_info: 1810, after globalLock: 2260, after locks: 2540, after network: 2640, after opcounters: 2640, after opcountersRepl: 2640, after repl: 3840, after storageEngine: 4020, after tcmalloc: 4550, after wiredTiger: 6220, at end: 7920 } 2016-04-18T02:59:24.331+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:59:31.490+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:59:36.140+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:59:44.006+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:59:47.229+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 530, after asserts: 820, after connections: 1350, after extra_info: 2290, after globalLock: 2900, after locks: 3530, after network: 3790, after opcounters: 3800, after opcountersRepl: 3800, after repl: 5350, after storageEngine: 5350, after tcmalloc: 5440, after wiredTiger: 6780, at end: 7970 } 2016-04-18T02:59:47.913+0000 I NETWORK [conn241] end connection 127.0.0.1:38847 (53 connections now open) 2016-04-18T02:59:48.691+0000 I COMMAND [conn67] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 989ms 2016-04-18T02:59:48.691+0000 I COMMAND [conn47] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 989ms 2016-04-18T02:59:48.691+0000 I COMMAND [conn44] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 989ms 2016-04-18T02:59:49.494+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:59:54.139+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T02:59:58.477+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:00:06.861+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3340ms 2016-04-18T03:00:08.040+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:00:11.732+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:00:16.111+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 460, after asserts: 900, after connections: 1450, after extra_info: 2570, after globalLock: 3010, after locks: 3110, after network: 3290, after opcounters: 3290, after opcountersRepl: 3290, after repl: 6110, after storageEngine: 6790, after tcmalloc: 7380, after wiredTiger: 8690, at end: 10760 } 2016-04-18T03:00:17.089+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:00:21.548+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3544ms 2016-04-18T03:00:24.772+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:00:32.466+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:00:34.919+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1461ms 2016-04-18T03:00:37.751+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:00:41.445+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 680, after asserts: 940, after connections: 1070, after extra_info: 1800, after globalLock: 2200, after locks: 2370, after network: 2460, after opcounters: 2460, after opcountersRepl: 2460, after repl: 3720, after storageEngine: 4620, after tcmalloc: 5470, after wiredTiger: 7050, at end: 8850 } 2016-04-18T03:00:41.590+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T03:00:45.155+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 181ms 2016-04-18T03:00:47.378+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:00:55.160+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:00:58.176+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:01:02.965+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:01:08.445+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 960, after connections: 1150, after extra_info: 1890, after globalLock: 2490, after locks: 2800, after network: 3270, after opcounters: 3550, after opcountersRepl: 3960, after repl: 5970, after storageEngine: 6780, after tcmalloc: 7790, after wiredTiger: 9520, at end: 11870 } 2016-04-18T03:01:09.000+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:01:17.514+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:01:23.998+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:01:26.978+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:01:31.817+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:01:33.965+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 800, after connections: 1350, after extra_info: 2540, after globalLock: 2820, after locks: 3090, after network: 3270, after opcounters: 3480, after opcountersRepl: 3480, after repl: 4880, after storageEngine: 5330, after tcmalloc: 6260, after wiredTiger: 8230, at end: 9960 } 2016-04-18T03:01:38.151+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:01:46.690+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:01:54.489+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:02:01.795+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:02:01.979+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:02:04.119+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 680, after connections: 1190, after extra_info: 2170, after globalLock: 2880, after locks: 3480, after network: 3860, after opcounters: 4060, after opcountersRepl: 4060, after repl: 7260, after storageEngine: 8010, after tcmalloc: 8670, after wiredTiger: 10740, at end: 12160 } 2016-04-18T03:02:10.802+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:02:15.456+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:02:25.531+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 260, after asserts: 480, after connections: 660, after extra_info: 1850, after globalLock: 2220, after locks: 2310, after network: 2310, after opcounters: 2310, after opcountersRepl: 2310, after repl: 3220, after storageEngine: 3680, after tcmalloc: 3880, after wiredTiger: 4500, at end: 6190 } 2016-04-18T03:02:25.621+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:02:25.624+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:02:30.797+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:02:40.345+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:02:43.828+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:02:47.404+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 370, after asserts: 720, after connections: 1040, after extra_info: 2020, after globalLock: 2480, after locks: 2680, after network: 2680, after opcounters: 2680, after opcountersRepl: 2680, after repl: 4860, after storageEngine: 5660, after tcmalloc: 5980, after wiredTiger: 6610, at end: 8760 } 2016-04-18T03:02:56.940+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:03:10.158+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:03:12.669+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 710, after asserts: 890, after connections: 1240, after extra_info: 2150, after globalLock: 2520, after locks: 2970, after network: 3500, after opcounters: 3640, after opcountersRepl: 3640, after repl: 4830, after storageEngine: 5270, after tcmalloc: 5810, after wiredTiger: 7560, at end: 9540 } 2016-04-18T03:03:13.127+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:03:27.434+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:03:30.298+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:03:31.616+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:03:38.152+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 190, after asserts: 370, after connections: 480, after extra_info: 1170, after globalLock: 1670, after locks: 2020, after network: 2410, after opcounters: 2580, after opcountersRepl: 2580, after repl: 4790, after storageEngine: 5340, after tcmalloc: 5620, after wiredTiger: 7060, at end: 8950 } 2016-04-18T03:03:41.825+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:03:46.335+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:03:47.499+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 175ms 2016-04-18T03:03:54.990+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 527ms 2016-04-18T03:03:58.820+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:04:00.521+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 560, after connections: 820, after extra_info: 1230, after globalLock: 1350, after locks: 1440, after network: 1440, after opcounters: 1440, after opcountersRepl: 1440, after repl: 2390, after storageEngine: 2960, after tcmalloc: 3200, after wiredTiger: 4360, at end: 6430 } 2016-04-18T03:04:11.847+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:04:19.413+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 480, after connections: 490, after extra_info: 1050, after globalLock: 1440, after locks: 1560, after network: 1560, after opcounters: 1560, after opcountersRepl: 1560, after repl: 4020, after storageEngine: 4290, after tcmalloc: 4860, after wiredTiger: 6350, at end: 8030 } 2016-04-18T03:04:28.604+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:04:32.519+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 790, after connections: 990, after extra_info: 1830, after globalLock: 2030, after locks: 2220, after network: 2310, after opcounters: 2310, after opcountersRepl: 2310, after repl: 5340, after storageEngine: 5900, after tcmalloc: 6410, after wiredTiger: 6430, at end: 6520 } 2016-04-18T03:04:38.358+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:04:42.252+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:04:52.253+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:04:52.793+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:04:54.501+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 810, after connections: 1170, after extra_info: 2130, after globalLock: 2510, after locks: 2600, after network: 2600, after opcounters: 2600, after opcountersRepl: 2600, after repl: 3410, after storageEngine: 3840, after tcmalloc: 4470, after wiredTiger: 6590, at end: 8250 } 2016-04-18T03:04:56.323+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:04:59.269+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 795ms 2016-04-18T03:05:06.287+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:05:10.144+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 579ms 2016-04-18T03:05:10.370+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:05:18.098+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 620, after connections: 710, after extra_info: 1040, after globalLock: 1040, after locks: 1140, after network: 1140, after opcounters: 1140, after opcountersRepl: 1140, after repl: 3380, after storageEngine: 4110, after tcmalloc: 4900, after wiredTiger: 6040, at end: 8200 } 2016-04-18T03:05:24.803+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:05:31.561+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:05:36.204+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3582ms 2016-04-18T03:05:38.223+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:05:40.325+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 520, after asserts: 520, after connections: 520, after extra_info: 1220, after globalLock: 1320, after locks: 1320, after network: 1400, after opcounters: 1400, after opcountersRepl: 1400, after repl: 3780, after storageEngine: 4320, after tcmalloc: 4950, after wiredTiger: 6590, at end: 8830 } 2016-04-18T03:05:46.779+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:05:48.122+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 179ms 2016-04-18T03:05:50.775+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:05:50.775+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1939ms 2016-04-18T03:05:52.659+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:05:59.507+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:06:01.648+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 710, after connections: 990, after extra_info: 1620, after globalLock: 1710, after locks: 1800, after network: 1880, after opcounters: 1880, after opcountersRepl: 1880, after repl: 2760, after storageEngine: 3600, after tcmalloc: 4230, after wiredTiger: 5600, at end: 7130 } 2016-04-18T03:06:03.162+0000 I COMMAND [conn50] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 573ms 2016-04-18T03:06:06.362+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:06:06.363+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2378ms 2016-04-18T03:06:08.726+0000 I COMMAND [conn26] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 769ms 2016-04-18T03:06:17.897+0000 I COMMAND [conn23] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 564ms 2016-04-18T03:06:20.807+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:06:23.003+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 550, after asserts: 730, after connections: 730, after extra_info: 1440, after globalLock: 1700, after locks: 1890, after network: 2250, after opcounters: 2340, after opcountersRepl: 2340, after repl: 2430, after storageEngine: 2430, after tcmalloc: 2670, after wiredTiger: 4220, at end: 6010 } 2016-04-18T03:06:36.490+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:06:39.166+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:06:41.460+0000 I COMMAND [conn44] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3854ms 2016-04-18T03:06:41.459+0000 I COMMAND [conn67] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3854ms 2016-04-18T03:06:41.460+0000 I COMMAND [conn47] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3854ms 2016-04-18T03:06:46.582+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 860, after connections: 1550, after extra_info: 2110, after globalLock: 2310, after locks: 2790, after network: 2920, after opcounters: 2920, after opcountersRepl: 2920, after repl: 3110, after storageEngine: 3580, after tcmalloc: 4200, after wiredTiger: 6290, at end: 8580 } 2016-04-18T03:06:51.749+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:06:54.067+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:06:54.433+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:07:03.660+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:07:06.886+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 780, after connections: 1010, after extra_info: 1490, after globalLock: 1680, after locks: 1680, after network: 1780, after opcounters: 1780, after opcountersRepl: 1780, after repl: 2960, after storageEngine: 3320, after tcmalloc: 3810, after wiredTiger: 5790, at end: 8040 } 2016-04-18T03:07:07.009+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:07:21.019+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38869 #242 (54 connections now open) 2016-04-18T03:07:22.257+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:07:29.175+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 740, after connections: 752, after extra_info: 752, after globalLock: 752, after locks: 752, after network: 752, after opcounters: 752, after opcountersRepl: 752, after repl: 2832, after storageEngine: 3222, after tcmalloc: 3332, after wiredTiger: 4872, at end: 6562 } 2016-04-18T03:07:35.295+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:07:48.620+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 800, after connections: 1170, after extra_info: 1750, after globalLock: 1850, after locks: 1950, after network: 2080, after opcounters: 2080, after opcountersRepl: 2080, after repl: 3040, after storageEngine: 3460, after tcmalloc: 4230, after wiredTiger: 5810, at end: 7570 } 2016-04-18T03:07:52.336+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:08:08.200+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:08:15.655+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 460, after asserts: 560, after connections: 660, after extra_info: 1450, after globalLock: 1920, after locks: 2370, after network: 2380, after opcounters: 2380, after opcountersRepl: 2380, after repl: 4640, after storageEngine: 4980, after tcmalloc: 5560, after wiredTiger: 6820, at end: 8950 } 2016-04-18T03:08:22.760+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:08:25.324+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:08:37.126+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 560, after asserts: 850, after connections: 1050, after extra_info: 1540, after globalLock: 1910, after locks: 2000, after network: 2090, after opcounters: 2090, after opcountersRepl: 2090, after repl: 3620, after storageEngine: 4070, after tcmalloc: 4450, after wiredTiger: 6010, at end: 7160 } 2016-04-18T03:08:38.953+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:08:42.319+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T03:08:44.293+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:08:44.295+0000 I NETWORK [conn242] end connection 127.0.0.1:38869 (53 connections now open) 2016-04-18T03:08:56.785+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 220, after asserts: 490, after connections: 670, after extra_info: 1400, after globalLock: 1770, after locks: 1780, after network: 1780, after opcounters: 1780, after opcountersRepl: 1780, after repl: 3120, after storageEngine: 3780, after tcmalloc: 4500, after wiredTiger: 5880, at end: 6630 } 2016-04-18T03:08:56.908+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:08:58.575+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:09:03.100+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:09:11.398+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:09:17.116+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:09:19.476+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 670, after asserts: 850, after connections: 1110, after extra_info: 1760, after globalLock: 2050, after locks: 2320, after network: 2720, after opcounters: 3230, after opcountersRepl: 3490, after repl: 4760, after storageEngine: 5310, after tcmalloc: 6100, after wiredTiger: 7560, at end: 9590 } 2016-04-18T03:09:25.652+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:09:31.829+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:09:38.642+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 730, after connections: 900, after extra_info: 1540, after globalLock: 1890, after locks: 2020, after network: 2110, after opcounters: 2110, after opcountersRepl: 2110, after repl: 3340, after storageEngine: 3540, after tcmalloc: 3890, after wiredTiger: 4550, at end: 5870 } 2016-04-18T03:09:39.577+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:09:41.303+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:09:45.622+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:09:53.147+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:09:58.866+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:10:00.451+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 610, after asserts: 960, after connections: 1160, after extra_info: 1820, after globalLock: 2090, after locks: 2380, after network: 2640, after opcounters: 2740, after opcountersRepl: 2740, after repl: 4080, after storageEngine: 4600, after tcmalloc: 5000, after wiredTiger: 6130, at end: 8460 } 2016-04-18T03:10:12.123+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:10:16.586+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:10:19.915+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 690, after asserts: 880, after connections: 980, after extra_info: 1450, after globalLock: 1720, after locks: 1810, after network: 1900, after opcounters: 1900, after opcountersRepl: 1900, after repl: 2610, after storageEngine: 2790, after tcmalloc: 3650, after wiredTiger: 4440, at end: 5450 } 2016-04-18T03:10:24.134+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 575ms 2016-04-18T03:10:26.473+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:10:29.848+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:10:31.517+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:10:41.383+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:10:41.562+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 830, after connections: 1090, after extra_info: 1970, after globalLock: 2600, after locks: 3070, after network: 3340, after opcounters: 3340, after opcountersRepl: 3340, after repl: 4720, after storageEngine: 4830, after tcmalloc: 4830, after wiredTiger: 5710, at end: 7680 } 2016-04-18T03:10:43.562+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:11:02.905+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:11:06.395+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 760, after connections: 960, after extra_info: 1600, after globalLock: 1910, after locks: 2130, after network: 2220, after opcounters: 2220, after opcountersRepl: 2220, after repl: 4050, after storageEngine: 4420, after tcmalloc: 5260, after wiredTiger: 6670, at end: 7830 } 2016-04-18T03:11:17.193+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:11:28.318+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 630, after connections: 940, after extra_info: 1400, after globalLock: 1600, after locks: 1700, after network: 1830, after opcounters: 1830, after opcountersRepl: 1830, after repl: 3260, after storageEngine: 3560, after tcmalloc: 4010, after wiredTiger: 5920, at end: 7720 } 2016-04-18T03:11:31.274+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:11:45.123+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 1208ms 2016-04-18T03:11:47.582+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:11:52.571+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 260, after asserts: 530, after connections: 820, after extra_info: 1450, after globalLock: 1810, after locks: 1980, after network: 2150, after opcounters: 2150, after opcountersRepl: 2150, after repl: 3240, after storageEngine: 3670, after tcmalloc: 4040, after wiredTiger: 5610, at end: 7980 } 2016-04-18T03:11:59.576+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 541ms 2016-04-18T03:12:01.428+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:12:14.056+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 640, after asserts: 920, after connections: 1000, after extra_info: 1750, after globalLock: 2210, after locks: 2570, after network: 2960, after opcounters: 3330, after opcountersRepl: 3410, after repl: 4460, after storageEngine: 4910, after tcmalloc: 5520, after wiredTiger: 6870, at end: 8190 } 2016-04-18T03:12:17.518+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:12:22.469+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:12:37.163+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:12:39.464+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:12:39.857+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:12:40.263+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 730, after connections: 960, after extra_info: 1680, after globalLock: 2130, after locks: 2310, after network: 2610, after opcounters: 2700, after opcountersRepl: 2700, after repl: 4340, after storageEngine: 4840, after tcmalloc: 5620, after wiredTiger: 7260, at end: 9270 } 2016-04-18T03:12:50.691+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 119ms 2016-04-18T03:12:53.625+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:12:56.816+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:13:10.391+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 770, after connections: 910, after extra_info: 1870, after globalLock: 2330, after locks: 2510, after network: 2970, after opcounters: 3470, after opcountersRepl: 3830, after repl: 8350, after storageEngine: 8930, after tcmalloc: 9870, after wiredTiger: 11520, at end: 13180 } 2016-04-18T03:13:12.826+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:13:14.876+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:13:30.411+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:13:34.643+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:13:34.643+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:13:43.152+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 520, after asserts: 880, after connections: 1250, after extra_info: 2230, after globalLock: 2430, after locks: 2890, after network: 3170, after opcounters: 3400, after opcountersRepl: 3750, after repl: 8660, after storageEngine: 9220, after tcmalloc: 10130, after wiredTiger: 11270, at end: 13300 } 2016-04-18T03:13:49.180+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:13:52.544+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:14:06.160+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 620, after asserts: 890, after connections: 1460, after extra_info: 2600, after globalLock: 2790, after locks: 2890, after network: 3030, after opcounters: 3030, after opcountersRepl: 3030, after repl: 3600, after storageEngine: 4090, after tcmalloc: 4940, after wiredTiger: 6200, at end: 8010 } 2016-04-18T03:14:08.941+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:14:22.275+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:14:25.242+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:14:32.594+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 840, after connections: 1160, after extra_info: 1550, after globalLock: 1910, after locks: 2400, after network: 2630, after opcounters: 2720, after opcountersRepl: 2720, after repl: 6810, after storageEngine: 7250, after tcmalloc: 7940, after wiredTiger: 9400, at end: 10680 } 2016-04-18T03:14:39.196+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:14:40.729+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:14:41.490+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:14:53.205+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 106ms 2016-04-18T03:14:54.286+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:14:54.555+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 680, after connections: 990, after extra_info: 1520, after globalLock: 1980, after locks: 2510, after network: 2600, after opcounters: 2600, after opcountersRepl: 2600, after repl: 3600, after storageEngine: 3880, after tcmalloc: 4250, after wiredTiger: 5460, at end: 7730 } 2016-04-18T03:14:56.850+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:15:13.723+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:15:21.888+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 470, after connections: 600, after extra_info: 970, after globalLock: 1210, after locks: 1520, after network: 1890, after opcounters: 1900, after opcountersRepl: 1900, after repl: 5470, after storageEngine: 5780, after tcmalloc: 6320, after wiredTiger: 7870, at end: 9580 } 2016-04-18T03:15:28.794+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:15:42.867+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:15:45.087+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 640, after connections: 820, after extra_info: 1280, after globalLock: 1620, after locks: 2070, after network: 2450, after opcounters: 2740, after opcountersRepl: 2750, after repl: 3140, after storageEngine: 3650, after tcmalloc: 4570, after wiredTiger: 5880, at end: 8150 } 2016-04-18T03:15:49.043+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2096ms 2016-04-18T03:15:54.931+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 191ms 2016-04-18T03:15:57.333+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 170ms 2016-04-18T03:16:00.059+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:16:08.665+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 690, after connections: 1150, after extra_info: 1530, after globalLock: 1810, after locks: 1890, after network: 1990, after opcounters: 2090, after opcountersRepl: 2090, after repl: 4370, after storageEngine: 4710, after tcmalloc: 4890, after wiredTiger: 5330, at end: 6970 } 2016-04-18T03:16:15.671+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1959ms 2016-04-18T03:16:15.675+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:16:26.016+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:16:29.286+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:16:35.423+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 270, after asserts: 530, after connections: 720, after extra_info: 1190, after globalLock: 1720, after locks: 1920, after network: 1920, after opcounters: 1920, after opcountersRepl: 1920, after repl: 4100, after storageEngine: 5010, after tcmalloc: 6240, after wiredTiger: 8380, at end: 9760 } 2016-04-18T03:16:40.300+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:16:41.947+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:16:43.308+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 4070ms 2016-04-18T03:16:46.928+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:16:53.680+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:16:58.895+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 104ms 2016-04-18T03:17:01.158+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:17:01.919+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 680, after asserts: 920, after connections: 1100, after extra_info: 1580, after globalLock: 1910, after locks: 2090, after network: 2090, after opcounters: 2090, after opcountersRepl: 2090, after repl: 6200, after storageEngine: 6560, after tcmalloc: 7440, after wiredTiger: 9050, at end: 11060 } 2016-04-18T03:17:14.985+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:17:29.287+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:17:30.134+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 690, after asserts: 880, after connections: 1300, after extra_info: 2190, after globalLock: 2460, after locks: 3020, after network: 3390, after opcounters: 3570, after opcountersRepl: 3570, after repl: 5780, after storageEngine: 6440, after tcmalloc: 6880, after wiredTiger: 8270, at end: 10600 } 2016-04-18T03:17:37.280+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:17:42.873+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:17:52.063+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:17:53.855+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 590, after asserts: 870, after connections: 1180, after extra_info: 2160, after globalLock: 2340, after locks: 2440, after network: 2530, after opcounters: 2530, after opcountersRepl: 2530, after repl: 3860, after storageEngine: 4230, after tcmalloc: 4940, after wiredTiger: 7670, at end: 9180 } 2016-04-18T03:17:55.471+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:18:00.784+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 172ms 2016-04-18T03:18:01.208+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:18:06.344+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:18:15.265+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:18:19.806+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 770, after connections: 1240, after extra_info: 1860, after globalLock: 1990, after locks: 2210, after network: 2210, after opcounters: 2210, after opcountersRepl: 2210, after repl: 3440, after storageEngine: 3970, after tcmalloc: 4910, after wiredTiger: 6630, at end: 8710 } 2016-04-18T03:18:28.555+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:18:42.202+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 570, after connections: 570, after extra_info: 860, after globalLock: 1040, after locks: 1400, after network: 1520, after opcounters: 1520, after opcountersRepl: 1520, after repl: 2770, after storageEngine: 3210, after tcmalloc: 3830, after wiredTiger: 6990, at end: 9250 } 2016-04-18T03:18:43.734+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:18:46.732+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:19:00.522+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:19:03.601+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:19:03.693+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:19:10.838+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 500, after asserts: 680, after connections: 950, after extra_info: 1690, after globalLock: 2110, after locks: 2440, after network: 2640, after opcounters: 2740, after opcountersRepl: 2740, after repl: 7670, after storageEngine: 8190, after tcmalloc: 8780, after wiredTiger: 10250, at end: 11680 } 2016-04-18T03:19:17.954+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:19:20.246+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:19:35.272+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 270, after asserts: 540, after connections: 550, after extra_info: 1040, after globalLock: 1340, after locks: 1530, after network: 1890, after opcounters: 2400, after opcountersRepl: 2580, after repl: 3600, after storageEngine: 4200, after tcmalloc: 5170, after wiredTiger: 7100, at end: 9200 } 2016-04-18T03:19:35.571+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:19:53.183+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:20:01.015+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 780, after connections: 790, after extra_info: 1460, after globalLock: 1770, after locks: 1990, after network: 2000, after opcounters: 2000, after opcountersRepl: 2000, after repl: 3010, after storageEngine: 3460, after tcmalloc: 3640, after wiredTiger: 5110, at end: 7150 } 2016-04-18T03:20:02.730+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 130ms 2016-04-18T03:20:06.421+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:20:21.373+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:20:24.148+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 740, after asserts: 940, after connections: 1350, after extra_info: 2120, after globalLock: 2700, after locks: 3170, after network: 3180, after opcounters: 3180, after opcountersRepl: 3180, after repl: 5120, after storageEngine: 5530, after tcmalloc: 6220, after wiredTiger: 7530, at end: 9400 } 2016-04-18T03:20:35.629+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:20:48.816+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 660, after asserts: 890, after connections: 1060, after extra_info: 1330, after globalLock: 1800, after locks: 2250, after network: 2340, after opcounters: 2340, after opcountersRepl: 2340, after repl: 3590, after storageEngine: 4000, after tcmalloc: 4410, after wiredTiger: 6270, at end: 8030 } 2016-04-18T03:20:49.966+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:21:05.229+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:21:13.019+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 330, after asserts: 520, after connections: 750, after extra_info: 1280, after globalLock: 1770, after locks: 1790, after network: 1790, after opcounters: 1790, after opcountersRepl: 1790, after repl: 4760, after storageEngine: 5130, after tcmalloc: 5680, after wiredTiger: 7800, at end: 9250 } 2016-04-18T03:21:18.513+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:21:29.240+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 560, after connections: 950, after extra_info: 1720, after globalLock: 1900, after locks: 2120, after network: 2310, after opcounters: 2310, after opcountersRepl: 2310, after repl: 3030, after storageEngine: 3240, after tcmalloc: 3620, after wiredTiger: 4710, at end: 6310 } 2016-04-18T03:21:34.519+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:21:48.303+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 510, after connections: 600, after extra_info: 800, after globalLock: 1010, after locks: 1250, after network: 1250, after opcounters: 1250, after opcountersRepl: 1250, after repl: 2150, after storageEngine: 2550, after tcmalloc: 3600, after wiredTiger: 4680, at end: 6610 } 2016-04-18T03:21:48.998+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:22:04.935+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:22:06.280+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 520, after connections: 870, after extra_info: 1450, after globalLock: 1770, after locks: 1770, after network: 1770, after opcounters: 1770, after opcountersRepl: 1770, after repl: 3200, after storageEngine: 3600, after tcmalloc: 4380, after wiredTiger: 6280, at end: 7770 } 2016-04-18T03:22:07.290+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:22:17.972+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:22:24.239+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:22:26.257+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:22:27.839+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 860, after connections: 960, after extra_info: 2020, after globalLock: 2410, after locks: 2590, after network: 2680, after opcounters: 2680, after opcountersRepl: 2680, after repl: 3790, after storageEngine: 4350, after tcmalloc: 4570, after wiredTiger: 5890, at end: 7370 } 2016-04-18T03:22:32.020+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:22:35.782+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:22:42.014+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 420, after asserts: 700, after connections: 910, after extra_info: 1520, after globalLock: 1960, after locks: 2070, after network: 2160, after opcounters: 2160, after opcountersRepl: 2160, after repl: 2960, after storageEngine: 2960, after tcmalloc: 3610, after wiredTiger: 4550, at end: 5810 } 2016-04-18T03:22:46.603+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:23:00.939+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:23:03.609+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 590, after connections: 680, after extra_info: 1100, after globalLock: 1390, after locks: 1590, after network: 1890, after opcounters: 2090, after opcountersRepl: 2290, after repl: 3670, after storageEngine: 4360, after tcmalloc: 4640, after wiredTiger: 6600, at end: 8060 } 2016-04-18T03:23:05.057+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 103ms 2016-04-18T03:23:14.036+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:23:24.368+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 490, after connections: 690, after extra_info: 1470, after globalLock: 1840, after locks: 1950, after network: 1950, after opcounters: 1950, after opcountersRepl: 1950, after repl: 2820, after storageEngine: 3210, after tcmalloc: 3760, after wiredTiger: 7420, at end: 8290 } 2016-04-18T03:23:27.919+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:23:43.584+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:23:47.573+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 550, after asserts: 730, after connections: 830, after extra_info: 1680, after globalLock: 1860, after locks: 2220, after network: 2400, after opcounters: 2680, after opcountersRepl: 2760, after repl: 4060, after storageEngine: 4250, after tcmalloc: 4740, after wiredTiger: 6170, at end: 7290 } 2016-04-18T03:23:57.686+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:24:05.949+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 170, after asserts: 170, after connections: 510, after extra_info: 1320, after globalLock: 1500, after locks: 1700, after network: 1950, after opcounters: 1970, after opcountersRepl: 1970, after repl: 3090, after storageEngine: 3420, after tcmalloc: 4460, after wiredTiger: 5990, at end: 7410 } 2016-04-18T03:24:10.654+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:24:24.828+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 770, after connections: 1310, after extra_info: 2140, after globalLock: 2490, after locks: 2670, after network: 2750, after opcounters: 2750, after opcountersRepl: 2750, after repl: 3710, after storageEngine: 4030, after tcmalloc: 4530, after wiredTiger: 5400, at end: 7040 } 2016-04-18T03:24:25.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:24:42.685+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:24:49.775+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 590, after asserts: 870, after connections: 1070, after extra_info: 1650, after globalLock: 2020, after locks: 2640, after network: 2820, after opcounters: 3140, after opcountersRepl: 3590, after repl: 4460, after storageEngine: 4570, after tcmalloc: 5170, after wiredTiger: 7740, at end: 9490 } 2016-04-18T03:24:55.539+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:25:08.296+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:25:09.403+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 630, after asserts: 930, after connections: 1030, after extra_info: 1800, after globalLock: 2000, after locks: 2210, after network: 2480, after opcounters: 2580, after opcountersRepl: 2710, after repl: 3630, after storageEngine: 3980, after tcmalloc: 4440, after wiredTiger: 6140, at end: 7620 } 2016-04-18T03:25:22.061+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:25:30.213+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 670, after connections: 870, after extra_info: 1360, after globalLock: 1630, after locks: 1960, after network: 2320, after opcounters: 2700, after opcountersRepl: 2710, after repl: 4500, after storageEngine: 4810, after tcmalloc: 5570, after wiredTiger: 7440, at end: 8900 } 2016-04-18T03:25:36.422+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:25:45.543+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 310, after asserts: 410, after connections: 510, after extra_info: 1140, after globalLock: 1400, after locks: 1600, after network: 1870, after opcounters: 1960, after opcountersRepl: 1960, after repl: 2460, after storageEngine: 2850, after tcmalloc: 3110, after wiredTiger: 4960, at end: 5370 } 2016-04-18T03:25:49.981+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 788ms 2016-04-18T03:25:50.347+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:26:01.063+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 590, after connections: 970, after extra_info: 1250, after globalLock: 1730, after locks: 2160, after network: 2330, after opcounters: 2330, after opcountersRepl: 2330, after repl: 2440, after storageEngine: 2440, after tcmalloc: 2910, after wiredTiger: 4980, at end: 5230 } 2016-04-18T03:26:04.418+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:26:07.412+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 197ms 2016-04-18T03:26:19.032+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:26:21.857+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 350, after asserts: 620, after connections: 900, after extra_info: 1600, after globalLock: 1960, after locks: 2110, after network: 2200, after opcounters: 2200, after opcountersRepl: 2200, after repl: 4130, after storageEngine: 4650, after tcmalloc: 5240, after wiredTiger: 6590, at end: 8530 } 2016-04-18T03:26:32.392+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:26:45.230+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 550, after asserts: 740, after connections: 1210, after extra_info: 1940, after globalLock: 2430, after locks: 2820, after network: 2940, after opcounters: 2940, after opcountersRepl: 2940, after repl: 3850, after storageEngine: 4420, after tcmalloc: 5330, after wiredTiger: 7340, at end: 10680 } 2016-04-18T03:26:46.358+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:27:01.032+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:27:09.587+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 420, after asserts: 810, after connections: 1090, after extra_info: 2230, after globalLock: 2520, after locks: 2780, after network: 2970, after opcounters: 3050, after opcountersRepl: 3050, after repl: 4850, after storageEngine: 5450, after tcmalloc: 6670, after wiredTiger: 8300, at end: 11000 } 2016-04-18T03:27:14.454+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:27:27.598+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:27:31.351+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 350, after asserts: 540, after connections: 1100, after extra_info: 1660, after globalLock: 1920, after locks: 2010, after network: 2100, after opcounters: 2100, after opcountersRepl: 2100, after repl: 3280, after storageEngine: 3670, after tcmalloc: 4240, after wiredTiger: 5300, at end: 7050 } 2016-04-18T03:27:32.028+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:27:40.386+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:27:47.799+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:27:47.977+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:27:52.217+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 360, after asserts: 540, after connections: 670, after extra_info: 1110, after globalLock: 1560, after locks: 1740, after network: 1820, after opcounters: 1820, after opcountersRepl: 1820, after repl: 3230, after storageEngine: 3610, after tcmalloc: 4090, after wiredTiger: 5460, at end: 7330 } 2016-04-18T03:27:53.501+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:28:01.292+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:28:06.910+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:28:09.990+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 180, after asserts: 390, after connections: 480, after extra_info: 580, after globalLock: 580, after locks: 580, after network: 580, after opcounters: 580, after opcountersRepl: 580, after repl: 1330, after storageEngine: 1790, after tcmalloc: 2460, after wiredTiger: 3700, at end: 5710 } 2016-04-18T03:28:18.789+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 913ms 2016-04-18T03:28:19.530+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:28:29.200+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 270, after asserts: 310, after connections: 480, after extra_info: 580, after globalLock: 1010, after locks: 1600, after network: 1700, after opcounters: 1700, after opcountersRepl: 1700, after repl: 3070, after storageEngine: 3180, after tcmalloc: 3650, after wiredTiger: 4960, at end: 6700 } 2016-04-18T03:28:33.711+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:28:35.597+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 790ms 2016-04-18T03:28:48.550+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:28:48.828+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 130, after asserts: 240, after connections: 330, after extra_info: 900, after globalLock: 1360, after locks: 1800, after network: 1980, after opcounters: 1980, after opcountersRepl: 1980, after repl: 3640, after storageEngine: 4030, after tcmalloc: 4710, after wiredTiger: 5740, at end: 7600 } 2016-04-18T03:29:02.085+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:29:07.895+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 530, after connections: 710, after extra_info: 1430, after globalLock: 1790, after locks: 2090, after network: 2180, after opcounters: 2180, after opcountersRepl: 2180, after repl: 2940, after storageEngine: 3260, after tcmalloc: 3810, after wiredTiger: 5040, at end: 6250 } 2016-04-18T03:29:09.495+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 125ms 2016-04-18T03:29:15.181+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:29:28.249+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 350, after asserts: 640, after connections: 970, after extra_info: 1490, after globalLock: 1810, after locks: 1910, after network: 2000, after opcounters: 2000, after opcountersRepl: 2000, after repl: 3160, after storageEngine: 3370, after tcmalloc: 4130, after wiredTiger: 5630, at end: 7460 } 2016-04-18T03:29:29.887+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:29:44.546+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:29:47.476+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:29:50.825+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 650, after connections: 1060, after extra_info: 1800, after globalLock: 2110, after locks: 2310, after network: 2380, after opcounters: 2380, after opcountersRepl: 2380, after repl: 5520, after storageEngine: 5870, after tcmalloc: 6270, after wiredTiger: 7450, at end: 8600 } 2016-04-18T03:29:58.809+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:30:01.480+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T03:30:03.716+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:30:09.463+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 490, after connections: 580, after extra_info: 1420, after globalLock: 1820, after locks: 2120, after network: 2220, after opcounters: 2220, after opcountersRepl: 2220, after repl: 3900, after storageEngine: 4160, after tcmalloc: 4600, after wiredTiger: 6000, at end: 6750 } 2016-04-18T03:30:16.546+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:30:18.993+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T03:30:20.916+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:30:26.017+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 950, after connections: 1420, after extra_info: 1900, after globalLock: 2270, after locks: 2560, after network: 2660, after opcounters: 2660, after opcountersRepl: 2660, after repl: 3840, after storageEngine: 4100, after tcmalloc: 4560, after wiredTiger: 4990, at end: 6070 } 2016-04-18T03:30:34.119+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:30:36.681+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:30:36.975+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:30:45.280+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 340, after asserts: 530, after connections: 900, after extra_info: 1850, after globalLock: 2210, after locks: 2680, after network: 2870, after opcounters: 3190, after opcountersRepl: 3370, after repl: 4350, after storageEngine: 4830, after tcmalloc: 5220, after wiredTiger: 6280, at end: 7920 } 2016-04-18T03:30:47.987+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:30:51.896+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:31:05.531+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:31:06.215+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 510, after connections: 670, after extra_info: 1270, after globalLock: 1360, after locks: 1440, after network: 1440, after opcounters: 1440, after opcountersRepl: 1440, after repl: 2360, after storageEngine: 2680, after tcmalloc: 2760, after wiredTiger: 4320, at end: 6180 } 2016-04-18T03:31:21.134+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:31:30.721+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 460, after connections: 990, after extra_info: 1670, after globalLock: 2080, after locks: 2320, after network: 2530, after opcounters: 2540, after opcountersRepl: 2540, after repl: 5170, after storageEngine: 5410, after tcmalloc: 5890, after wiredTiger: 7620, at end: 9330 } 2016-04-18T03:31:36.689+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:31:50.205+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:31:53.192+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 270, after asserts: 620, after connections: 930, after extra_info: 1510, after globalLock: 1870, after locks: 2080, after network: 2170, after opcounters: 2170, after opcountersRepl: 2170, after repl: 2700, after storageEngine: 3050, after tcmalloc: 3440, after wiredTiger: 4920, at end: 6980 } 2016-04-18T03:32:05.159+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:32:17.703+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 560, after asserts: 660, after connections: 1090, after extra_info: 1720, after globalLock: 1900, after locks: 2080, after network: 2180, after opcounters: 2180, after opcountersRepl: 2180, after repl: 3380, after storageEngine: 3960, after tcmalloc: 4750, after wiredTiger: 6140, at end: 8890 } 2016-04-18T03:32:19.592+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2170ms 2016-04-18T03:32:20.671+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:32:27.189+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:32:40.652+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:32:42.306+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:32:42.306+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 720, after connections: 810, after extra_info: 1610, after globalLock: 1870, after locks: 1870, after network: 1870, after opcounters: 1870, after opcountersRepl: 1870, after repl: 3440, after storageEngine: 3760, after tcmalloc: 4030, after wiredTiger: 5630, at end: 7180 } 2016-04-18T03:32:42.313+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:32:49.936+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2795ms 2016-04-18T03:32:58.143+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:33:00.950+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:33:10.792+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 222ms 2016-04-18T03:33:10.879+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 530, after asserts: 800, after connections: 1190, after extra_info: 2340, after globalLock: 2630, after locks: 2750, after network: 2840, after opcounters: 2840, after opcountersRepl: 2840, after repl: 6330, after storageEngine: 6700, after tcmalloc: 7430, after wiredTiger: 9510, at end: 12280 } 2016-04-18T03:33:12.562+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2451ms 2016-04-18T03:33:14.261+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:33:17.626+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:33:31.664+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:33:33.788+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:33:35.860+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 800, after connections: 1080, after extra_info: 2260, after globalLock: 2460, after locks: 2670, after network: 2760, after opcounters: 2760, after opcountersRepl: 2760, after repl: 4510, after storageEngine: 5010, after tcmalloc: 5920, after wiredTiger: 7210, at end: 8860 } 2016-04-18T03:33:37.523+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:33:44.791+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:33:51.746+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:33:58.755+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:34:02.331+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:34:02.961+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 680, after connections: 1180, after extra_info: 2060, after globalLock: 2430, after locks: 2530, after network: 2540, after opcounters: 2540, after opcountersRepl: 2540, after repl: 3600, after storageEngine: 4020, after tcmalloc: 4620, after wiredTiger: 6410, at end: 7710 } 2016-04-18T03:34:08.933+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:34:12.038+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:34:12.139+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 288ms 2016-04-18T03:34:25.221+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 650, after connections: 830, after extra_info: 1750, after globalLock: 2100, after locks: 2100, after network: 2190, after opcounters: 2190, after opcountersRepl: 2190, after repl: 3400, after storageEngine: 3880, after tcmalloc: 4430, after wiredTiger: 5520, at end: 6930 } 2016-04-18T03:34:25.807+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:34:27.980+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:34:30.075+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:34:42.894+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:34:45.776+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:34:49.706+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 420, after asserts: 790, after connections: 1340, after extra_info: 2250, after globalLock: 2880, after locks: 3170, after network: 3350, after opcounters: 3350, after opcountersRepl: 3350, after repl: 6780, after storageEngine: 6980, after tcmalloc: 7190, after wiredTiger: 7700, at end: 9970 } 2016-04-18T03:35:00.157+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:35:03.045+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:35:04.399+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:35:13.498+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 176ms 2016-04-18T03:35:14.211+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 700, after connections: 1070, after extra_info: 2020, after globalLock: 2320, after locks: 2760, after network: 2940, after opcounters: 2940, after opcountersRepl: 2940, after repl: 4280, after storageEngine: 4750, after tcmalloc: 5200, after wiredTiger: 7510, at end: 10070 } 2016-04-18T03:35:17.587+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:35:21.630+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:35:37.297+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:35:40.022+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 490, after connections: 580, after extra_info: 1270, after globalLock: 1450, after locks: 1640, after network: 1640, after opcounters: 1640, after opcountersRepl: 1640, after repl: 2790, after storageEngine: 3280, after tcmalloc: 3760, after wiredTiger: 5450, at end: 7290 } 2016-04-18T03:35:50.933+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:36:01.251+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 460, after asserts: 470, after connections: 470, after extra_info: 1250, after globalLock: 1540, after locks: 1810, after network: 2070, after opcounters: 2080, after opcountersRepl: 2080, after repl: 3410, after storageEngine: 3860, after tcmalloc: 4720, after wiredTiger: 6290, at end: 7820 } 2016-04-18T03:36:07.480+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:36:14.847+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 181ms 2016-04-18T03:36:20.711+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:36:24.464+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 350, after asserts: 550, after connections: 840, after extra_info: 1680, after globalLock: 2050, after locks: 2250, after network: 2250, after opcounters: 2250, after opcountersRepl: 2250, after repl: 3650, after storageEngine: 4100, after tcmalloc: 4830, after wiredTiger: 5580, at end: 7690 } 2016-04-18T03:36:34.208+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:36:36.804+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:36:48.347+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 730, after asserts: 1180, after connections: 1830, after extra_info: 3000, after globalLock: 3660, after locks: 3970, after network: 4240, after opcounters: 4340, after opcountersRepl: 4340, after repl: 5760, after storageEngine: 6210, after tcmalloc: 7230, after wiredTiger: 8360, at end: 10400 } 2016-04-18T03:36:50.852+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:36:51.844+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:36:54.582+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:37:02.793+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:37:07.837+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:37:09.724+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 590, after asserts: 820, after connections: 910, after extra_info: 1500, after globalLock: 1780, after locks: 1980, after network: 2060, after opcounters: 2060, after opcountersRepl: 2060, after repl: 5220, after storageEngine: 5380, after tcmalloc: 5870, after wiredTiger: 6510, at end: 8010 } 2016-04-18T03:37:21.502+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:37:30.460+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 630, after connections: 1070, after extra_info: 1780, after globalLock: 2200, after locks: 2730, after network: 2890, after opcounters: 3210, after opcountersRepl: 3210, after repl: 4120, after storageEngine: 4480, after tcmalloc: 5210, after wiredTiger: 5950, at end: 6730 } 2016-04-18T03:37:35.413+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:37:48.605+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:37:52.245+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 420, after asserts: 590, after connections: 870, after extra_info: 1620, after globalLock: 1810, after locks: 1910, after network: 1910, after opcounters: 1910, after opcountersRepl: 1910, after repl: 3240, after storageEngine: 3810, after tcmalloc: 4510, after wiredTiger: 6400, at end: 7890 } 2016-04-18T03:38:03.327+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:38:06.768+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:38:13.843+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 500, after asserts: 770, after connections: 1130, after extra_info: 2060, after globalLock: 2510, after locks: 2990, after network: 3180, after opcounters: 3180, after opcountersRepl: 3180, after repl: 3980, after storageEngine: 4080, after tcmalloc: 4500, after wiredTiger: 5090, at end: 7100 } 2016-04-18T03:38:20.748+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:38:22.721+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:38:23.645+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:38:35.213+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:38:35.969+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 480, after connections: 490, after extra_info: 930, after globalLock: 1320, after locks: 1590, after network: 1860, after opcounters: 1960, after opcountersRepl: 2080, after repl: 2950, after storageEngine: 3320, after tcmalloc: 3720, after wiredTiger: 5170, at end: 6970 } 2016-04-18T03:38:35.974+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:38:36.496+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38893 #243 (54 connections now open) 2016-04-18T03:38:40.515+0000 I COMMAND [conn26] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1447ms 2016-04-18T03:38:40.515+0000 I COMMAND [conn50] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1447ms 2016-04-18T03:38:40.515+0000 I COMMAND [conn23] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1447ms 2016-04-18T03:38:42.475+0000 I COMMAND [conn243] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1519ms 2016-04-18T03:38:50.161+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:38:51.290+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 530, after connections: 530, after extra_info: 1130, after globalLock: 1530, after locks: 1810, after network: 2080, after opcounters: 2430, after opcountersRepl: 2430, after repl: 3740, after storageEngine: 3930, after tcmalloc: 4040, after wiredTiger: 5100, at end: 6990 } 2016-04-18T03:39:03.155+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:39:16.963+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 760, after connections: 1320, after extra_info: 2130, after globalLock: 2430, after locks: 2780, after network: 3060, after opcounters: 3340, after opcountersRepl: 3430, after repl: 5690, after storageEngine: 6090, after tcmalloc: 6270, after wiredTiger: 8760, at end: 11500 } 2016-04-18T03:39:23.193+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:39:39.202+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:39:41.798+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 430, after asserts: 740, after connections: 1060, after extra_info: 1790, after globalLock: 2470, after locks: 2870, after network: 2970, after opcounters: 2970, after opcountersRepl: 2970, after repl: 4770, after storageEngine: 5120, after tcmalloc: 5560, after wiredTiger: 7210, at end: 8660 } 2016-04-18T03:39:53.565+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:40:02.575+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 580, after asserts: 850, after connections: 1250, after extra_info: 1840, after globalLock: 2400, after locks: 2790, after network: 2980, after opcounters: 3070, after opcountersRepl: 3070, after repl: 4350, after storageEngine: 4760, after tcmalloc: 5450, after wiredTiger: 6970, at end: 8620 } 2016-04-18T03:40:08.093+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:40:23.820+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:40:26.735+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 810, after connections: 1070, after extra_info: 2180, after globalLock: 2370, after locks: 2450, after network: 2630, after opcounters: 2720, after opcountersRepl: 2720, after repl: 3890, after storageEngine: 3990, after tcmalloc: 4240, after wiredTiger: 5780, at end: 7150 } 2016-04-18T03:40:39.288+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:40:42.352+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:40:46.163+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 800ms 2016-04-18T03:40:53.321+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 640, after asserts: 1030, after connections: 1390, after extra_info: 2380, after globalLock: 2740, after locks: 3050, after network: 3490, after opcounters: 3910, after opcountersRepl: 4010, after repl: 4860, after storageEngine: 5430, after tcmalloc: 6270, after wiredTiger: 7800, at end: 9370 } 2016-04-18T03:40:55.906+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:40:57.972+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:40:58.419+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:41:13.403+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:41:15.693+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:41:20.901+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 300, after connections: 300, after extra_info: 950, after globalLock: 1440, after locks: 2050, after network: 2150, after opcounters: 2150, after opcountersRepl: 2150, after repl: 4390, after storageEngine: 4970, after tcmalloc: 5830, after wiredTiger: 7310, at end: 9160 } 2016-04-18T03:41:29.679+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:41:32.267+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:41:34.703+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:41:41.826+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:41:43.420+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 740, after connections: 1010, after extra_info: 1690, after globalLock: 2240, after locks: 2590, after network: 2790, after opcounters: 2790, after opcountersRepl: 2790, after repl: 3560, after storageEngine: 3750, after tcmalloc: 4310, after wiredTiger: 5960, at end: 7900 } 2016-04-18T03:41:45.716+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:42:00.763+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:42:09.649+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 560, after asserts: 570, after connections: 620, after extra_info: 1600, after globalLock: 1810, after locks: 2180, after network: 2290, after opcounters: 2290, after opcountersRepl: 2290, after repl: 4260, after storageEngine: 4700, after tcmalloc: 4830, after wiredTiger: 7970, at end: 9740 } 2016-04-18T03:42:15.605+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:42:17.010+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 135ms 2016-04-18T03:42:30.237+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:42:33.039+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 600, after connections: 790, after extra_info: 1550, after globalLock: 1860, after locks: 2140, after network: 2490, after opcounters: 2580, after opcountersRepl: 2580, after repl: 3660, after storageEngine: 4030, after tcmalloc: 4400, after wiredTiger: 6070, at end: 8440 } 2016-04-18T03:42:45.136+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:42:52.257+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 650, after connections: 930, after extra_info: 1660, after globalLock: 2140, after locks: 2410, after network: 2540, after opcounters: 2540, after opcountersRepl: 2540, after repl: 3540, after storageEngine: 4110, after tcmalloc: 4650, after wiredTiger: 6060, at end: 8250 } 2016-04-18T03:42:59.781+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:43:11.093+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 720, after connections: 1100, after extra_info: 1590, after globalLock: 2110, after locks: 2600, after network: 2710, after opcounters: 2710, after opcountersRepl: 2710, after repl: 3720, after storageEngine: 4080, after tcmalloc: 4430, after wiredTiger: 6940, at end: 8330 } 2016-04-18T03:43:14.524+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:43:27.662+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 750, after connections: 1130, after extra_info: 1890, after globalLock: 2160, after locks: 2430, after network: 2700, after opcounters: 2790, after opcountersRepl: 2790, after repl: 3450, after storageEngine: 3880, after tcmalloc: 4360, after wiredTiger: 4650, at end: 5780 } 2016-04-18T03:43:27.855+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:43:41.622+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:43:46.368+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 550, after connections: 560, after extra_info: 910, after globalLock: 1090, after locks: 1090, after network: 1100, after opcounters: 1100, after opcountersRepl: 1100, after repl: 2010, after storageEngine: 2610, after tcmalloc: 3160, after wiredTiger: 4590, at end: 6060 } 2016-04-18T03:43:54.844+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:44:03.712+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 360, after asserts: 490, after connections: 620, after extra_info: 1340, after globalLock: 1490, after locks: 1500, after network: 1500, after opcounters: 1500, after opcountersRepl: 1500, after repl: 2420, after storageEngine: 2730, after tcmalloc: 3190, after wiredTiger: 4860, at end: 5750 } 2016-04-18T03:44:08.946+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:44:18.896+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 172ms 2016-04-18T03:44:22.015+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 580, after connections: 770, after extra_info: 1300, after globalLock: 1510, after locks: 1630, after network: 1810, after opcounters: 1810, after opcountersRepl: 1810, after repl: 2430, after storageEngine: 2690, after tcmalloc: 3300, after wiredTiger: 4800, at end: 7060 } 2016-04-18T03:44:23.164+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:44:38.029+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:44:41.432+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 740, after connections: 1020, after extra_info: 1320, after globalLock: 1600, after locks: 1950, after network: 2230, after opcounters: 2330, after opcountersRepl: 2330, after repl: 3390, after storageEngine: 3670, after tcmalloc: 4220, after wiredTiger: 5370, at end: 7750 } 2016-04-18T03:44:42.758+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 532ms 2016-04-18T03:44:51.686+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:45:00.506+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 567ms 2016-04-18T03:45:03.883+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 510, after connections: 680, after extra_info: 1160, after globalLock: 1500, after locks: 1610, after network: 1700, after opcounters: 1700, after opcountersRepl: 1700, after repl: 2380, after storageEngine: 3130, after tcmalloc: 3860, after wiredTiger: 5670, at end: 6860 } 2016-04-18T03:45:04.065+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:45:19.141+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:45:20.670+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 106ms 2016-04-18T03:45:20.890+0000 I NETWORK [conn243] end connection 127.0.0.1:38893 (53 connections now open) 2016-04-18T03:45:22.965+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 360, after asserts: 560, after connections: 660, after extra_info: 1110, after globalLock: 1660, after locks: 1670, after network: 1760, after opcounters: 1850, after opcountersRepl: 1850, after repl: 2590, after storageEngine: 2990, after tcmalloc: 3880, after wiredTiger: 5800, at end: 6990 } 2016-04-18T03:45:32.819+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:45:40.549+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 500, after asserts: 670, after connections: 1010, after extra_info: 1640, after globalLock: 1830, after locks: 1960, after network: 1960, after opcounters: 1960, after opcountersRepl: 1960, after repl: 3410, after storageEngine: 3670, after tcmalloc: 3910, after wiredTiger: 5050, at end: 6630 } 2016-04-18T03:45:46.702+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:45:58.511+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 370, after connections: 730, after extra_info: 1720, after globalLock: 1920, after locks: 2110, after network: 2120, after opcounters: 2120, after opcountersRepl: 2120, after repl: 2980, after storageEngine: 3280, after tcmalloc: 4150, after wiredTiger: 6240, at end: 8350 } 2016-04-18T03:45:58.964+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:46:15.782+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:46:21.752+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 106ms 2016-04-18T03:46:24.152+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 570, after connections: 580, after extra_info: 1440, after globalLock: 1880, after locks: 1890, after network: 1980, after opcounters: 1980, after opcountersRepl: 1980, after repl: 5080, after storageEngine: 5520, after tcmalloc: 5970, after wiredTiger: 7750, at end: 9980 } 2016-04-18T03:46:30.668+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:46:44.982+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 580, after connections: 1030, after extra_info: 1870, after globalLock: 2070, after locks: 2420, after network: 2640, after opcounters: 2640, after opcountersRepl: 2640, after repl: 3680, after storageEngine: 4140, after tcmalloc: 5100, after wiredTiger: 6620, at end: 8070 } 2016-04-18T03:46:45.068+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:47:03.394+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:47:05.184+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 670, after connections: 1120, after extra_info: 1730, after globalLock: 2280, after locks: 2590, after network: 2810, after opcounters: 2900, after opcountersRepl: 2900, after repl: 4160, after storageEngine: 4660, after tcmalloc: 5290, after wiredTiger: 7050, at end: 8850 } 2016-04-18T03:47:18.959+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:47:24.434+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 670, after asserts: 940, after connections: 1120, after extra_info: 2010, after globalLock: 2280, after locks: 2460, after network: 2640, after opcounters: 2640, after opcountersRepl: 2640, after repl: 4370, after storageEngine: 4650, after tcmalloc: 4830, after wiredTiger: 5460, at end: 6800 } 2016-04-18T03:47:33.876+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:47:47.580+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 750, after asserts: 1060, after connections: 1600, after extra_info: 2440, after globalLock: 3020, after locks: 3280, after network: 3380, after opcounters: 3380, after opcountersRepl: 3380, after repl: 4030, after storageEngine: 4550, after tcmalloc: 5290, after wiredTiger: 6650, at end: 8400 } 2016-04-18T03:47:48.126+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:47:51.228+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:48:04.036+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:48:07.026+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:48:11.088+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:48:13.178+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 680, after connections: 980, after extra_info: 1520, after globalLock: 1890, after locks: 1890, after network: 1890, after opcounters: 1890, after opcountersRepl: 1890, after repl: 4210, after storageEngine: 4710, after tcmalloc: 5200, after wiredTiger: 7740, at end: 10180 } 2016-04-18T03:48:17.591+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:48:24.823+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:48:29.988+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 450, after connections: 800, after extra_info: 1180, after globalLock: 1490, after locks: 1580, after network: 1580, after opcounters: 1580, after opcountersRepl: 1580, after repl: 3130, after storageEngine: 3490, after tcmalloc: 3790, after wiredTiger: 3920, at end: 4750 } 2016-04-18T03:48:29.988+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:48:34.872+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T03:48:38.443+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:48:39.141+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2940ms 2016-04-18T03:48:39.141+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2940ms 2016-04-18T03:48:46.272+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1769ms 2016-04-18T03:48:48.648+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:48:48.865+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:48:52.379+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:48:54.428+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 750, after connections: 1100, after extra_info: 1930, after globalLock: 2210, after locks: 2410, after network: 2500, after opcounters: 2500, after opcountersRepl: 2500, after repl: 3510, after storageEngine: 4100, after tcmalloc: 4820, after wiredTiger: 7580, at end: 9770 } 2016-04-18T03:49:03.098+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:49:06.821+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:49:18.052+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:49:19.043+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 560, after asserts: 930, after connections: 1320, after extra_info: 1850, after globalLock: 2450, after locks: 2820, after network: 3140, after opcounters: 3280, after opcountersRepl: 3280, after repl: 4440, after storageEngine: 4910, after tcmalloc: 6100, after wiredTiger: 7530, at end: 8930 } 2016-04-18T03:49:20.657+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:49:21.106+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:49:32.653+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:49:35.591+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:49:41.116+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 970, after connections: 1200, after extra_info: 2230, after globalLock: 2420, after locks: 2680, after network: 2860, after opcounters: 2860, after opcountersRepl: 2860, after repl: 5930, after storageEngine: 6290, after tcmalloc: 6470, after wiredTiger: 7680, at end: 9780 } 2016-04-18T03:49:50.030+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:49:51.728+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:49:54.188+0000 I COMMAND [conn47] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 726ms 2016-04-18T03:50:04.126+0000 I COMMAND [conn67] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 690ms 2016-04-18T03:50:05.999+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 660, after asserts: 1020, after connections: 1510, after extra_info: 2550, after globalLock: 2950, after locks: 3130, after network: 3130, after opcounters: 3130, after opcountersRepl: 3130, after repl: 4510, after storageEngine: 5050, after tcmalloc: 5750, after wiredTiger: 7050, at end: 9530 } 2016-04-18T03:50:06.214+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:50:08.019+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:50:12.680+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:50:13.085+0000 I COMMAND [conn44] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 640ms 2016-04-18T03:50:21.555+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 831ms 2016-04-18T03:50:21.555+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:50:24.001+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 180ms 2016-04-18T03:50:27.774+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:50:33.292+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 940, after connections: 1490, after extra_info: 2310, after globalLock: 2650, after locks: 3280, after network: 3910, after opcounters: 4080, after opcountersRepl: 4080, after repl: 4900, after storageEngine: 5510, after tcmalloc: 6270, after wiredTiger: 7750, at end: 10600 } 2016-04-18T03:50:35.939+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:50:39.093+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:50:43.279+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:50:51.044+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:50:57.364+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:50:58.810+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 680, after asserts: 1020, after connections: 1310, after extra_info: 2430, after globalLock: 2700, after locks: 2720, after network: 2790, after opcounters: 2790, after opcountersRepl: 2790, after repl: 4230, after storageEngine: 4790, after tcmalloc: 5400, after wiredTiger: 6490, at end: 9030 } 2016-04-18T03:51:12.845+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:51:23.891+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 780, after connections: 870, after extra_info: 1430, after globalLock: 1930, after locks: 2570, after network: 2890, after opcounters: 2980, after opcountersRepl: 2980, after repl: 4150, after storageEngine: 4570, after tcmalloc: 5640, after wiredTiger: 6570, at end: 8480 } 2016-04-18T03:51:26.545+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 289ms 2016-04-18T03:51:26.813+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:51:28.577+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 281ms 2016-04-18T03:51:31.217+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:51:42.724+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:51:42.995+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 465ms 2016-04-18T03:51:46.445+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:51:48.474+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 560, after asserts: 940, after connections: 1430, after extra_info: 2460, after globalLock: 2560, after locks: 2560, after network: 2560, after opcounters: 2560, after opcountersRepl: 2560, after repl: 3870, after storageEngine: 4150, after tcmalloc: 5620, after wiredTiger: 7000, at end: 9710 } 2016-04-18T03:51:50.674+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:51:56.364+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:51:59.635+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:52:13.974+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:52:16.170+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:52:16.470+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 590, after connections: 890, after extra_info: 1820, after globalLock: 2100, after locks: 2550, after network: 2910, after opcounters: 2910, after opcountersRepl: 2910, after repl: 4340, after storageEngine: 4580, after tcmalloc: 5100, after wiredTiger: 6960, at end: 9890 } 2016-04-18T03:52:17.609+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:52:30.122+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 169ms 2016-04-18T03:52:30.231+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:52:33.771+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:52:45.449+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 750, after asserts: 1270, after connections: 2100, after extra_info: 3450, after globalLock: 3850, after locks: 4370, after network: 4570, after opcounters: 4970, after opcountersRepl: 5580, after repl: 7050, after storageEngine: 7400, after tcmalloc: 8180, after wiredTiger: 9450, at end: 11340 } 2016-04-18T03:52:48.719+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:52:51.558+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:52:52.984+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:52:57.070+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 7115ms 2016-04-18T03:53:08.388+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:53:12.046+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 590, after asserts: 960, after connections: 1300, after extra_info: 2080, after globalLock: 2280, after locks: 2390, after network: 2480, after opcounters: 2480, after opcountersRepl: 2480, after repl: 3310, after storageEngine: 3800, after tcmalloc: 4700, after wiredTiger: 6620, at end: 9600 } 2016-04-18T03:53:12.243+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:53:18.186+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 9982ms 2016-04-18T03:53:27.891+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:53:31.742+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:53:36.799+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:53:40.023+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 560, after asserts: 830, after connections: 1450, after extra_info: 2580, after globalLock: 2900, after locks: 3280, after network: 3740, after opcounters: 3830, after opcountersRepl: 3830, after repl: 7000, after storageEngine: 7400, after tcmalloc: 7830, after wiredTiger: 9410, at end: 11290 } 2016-04-18T03:53:42.293+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:53:48.759+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:53:59.445+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:54:02.929+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:54:07.588+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:54:07.858+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 370, after asserts: 750, after connections: 1380, after extra_info: 2370, after globalLock: 2690, after locks: 2780, after network: 2970, after opcounters: 3070, after opcountersRepl: 3070, after repl: 6630, after storageEngine: 6990, after tcmalloc: 7270, after wiredTiger: 8950, at end: 11860 } 2016-04-18T03:54:13.996+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:54:19.065+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:54:28.414+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 850, after connections: 1130, after extra_info: 1530, after globalLock: 1830, after locks: 2110, after network: 2280, after opcounters: 2280, after opcountersRepl: 2280, after repl: 3370, after storageEngine: 3760, after tcmalloc: 4060, after wiredTiger: 5220, at end: 6520 } 2016-04-18T03:54:28.614+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:54:33.971+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:54:36.311+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:54:44.817+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:54:48.261+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:54:57.570+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 870, after connections: 1260, after extra_info: 2170, after globalLock: 2990, after locks: 3260, after network: 3690, after opcounters: 4170, after opcountersRepl: 4170, after repl: 9400, after storageEngine: 9970, after tcmalloc: 10760, after wiredTiger: 12310, at end: 14220 } 2016-04-18T03:55:02.369+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:55:04.239+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:55:06.105+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:55:18.436+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:55:19.549+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:55:19.766+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 780, after connections: 1040, after extra_info: 1500, after globalLock: 1940, after locks: 2210, after network: 2420, after opcounters: 2420, after opcountersRepl: 2420, after repl: 3910, after storageEngine: 4440, after tcmalloc: 5480, after wiredTiger: 6880, at end: 8640 } 2016-04-18T03:55:23.158+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 640ms 2016-04-18T03:55:31.884+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 180ms 2016-04-18T03:55:32.902+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:55:36.162+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:55:42.878+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 770, after asserts: 960, after connections: 1220, after extra_info: 2160, after globalLock: 2520, after locks: 2690, after network: 2790, after opcounters: 3060, after opcountersRepl: 3060, after repl: 6870, after storageEngine: 7340, after tcmalloc: 7790, after wiredTiger: 8770, at end: 9860 } 2016-04-18T03:55:47.885+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:55:47.896+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:55:51.484+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:56:01.594+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:56:03.408+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 840, after connections: 1200, after extra_info: 2090, after globalLock: 2270, after locks: 2270, after network: 2380, after opcounters: 2590, after opcountersRepl: 2590, after repl: 3670, after storageEngine: 4140, after tcmalloc: 4990, after wiredTiger: 6620, at end: 8160 } 2016-04-18T03:56:04.802+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:56:19.664+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:56:26.807+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 570, after connections: 740, after extra_info: 1130, after globalLock: 1410, after locks: 1670, after network: 2060, after opcounters: 2160, after opcountersRepl: 2160, after repl: 3270, after storageEngine: 3950, after tcmalloc: 5000, after wiredTiger: 5840, at end: 7730 } 2016-04-18T03:56:31.786+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:56:46.781+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2260ms 2016-04-18T03:56:48.563+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:56:49.411+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 500, after asserts: 1070, after connections: 1170, after extra_info: 2300, after globalLock: 2740, after locks: 3140, after network: 3450, after opcounters: 3530, after opcountersRepl: 3530, after repl: 4390, after storageEngine: 4930, after tcmalloc: 5680, after wiredTiger: 7180, at end: 8990 } 2016-04-18T03:57:04.238+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:57:06.397+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:57:16.635+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 580, after asserts: 970, after connections: 1330, after extra_info: 2410, after globalLock: 2680, after locks: 3510, after network: 3610, after opcounters: 3610, after opcountersRepl: 3610, after repl: 7430, after storageEngine: 7790, after tcmalloc: 8440, after wiredTiger: 10480, at end: 12980 } 2016-04-18T03:57:21.056+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:57:24.825+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:57:25.295+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:57:33.884+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 104ms 2016-04-18T03:57:36.623+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:57:39.920+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 670, after connections: 960, after extra_info: 1740, after globalLock: 2320, after locks: 2330, after network: 2430, after opcounters: 2610, after opcountersRepl: 2610, after repl: 4060, after storageEngine: 4320, after tcmalloc: 4840, after wiredTiger: 6180, at end: 7730 } 2016-04-18T03:57:39.923+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:57:53.998+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:58:01.638+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 780, after connections: 1060, after extra_info: 1370, after globalLock: 1740, after locks: 2090, after network: 2180, after opcounters: 2180, after opcountersRepl: 2180, after repl: 2280, after storageEngine: 2640, after tcmalloc: 3330, after wiredTiger: 5340, at end: 6760 } 2016-04-18T03:58:07.683+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:58:23.013+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:58:25.813+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 860, after asserts: 1150, after connections: 1430, after extra_info: 2440, after globalLock: 2910, after locks: 3480, after network: 3920, after opcounters: 4250, after opcountersRepl: 4520, after repl: 5880, after storageEngine: 6070, after tcmalloc: 6570, after wiredTiger: 8050, at end: 10040 } 2016-04-18T03:58:26.438+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:58:35.932+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 264ms 2016-04-18T03:58:40.894+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:58:44.589+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:58:46.490+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:58:53.243+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 800, after connections: 1070, after extra_info: 2150, after globalLock: 2440, after locks: 2530, after network: 2610, after opcounters: 2610, after opcountersRepl: 2610, after repl: 4710, after storageEngine: 5370, after tcmalloc: 5690, after wiredTiger: 7250, at end: 9070 } 2016-04-18T03:59:00.141+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:59:02.766+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:59:12.465+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 750, after asserts: 1070, after connections: 1470, after extra_info: 2250, after globalLock: 2820, after locks: 3240, after network: 3660, after opcounters: 3750, after opcountersRepl: 3750, after repl: 4910, after storageEngine: 5640, after tcmalloc: 6220, after wiredTiger: 7750, at end: 8930 } 2016-04-18T03:59:16.870+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:59:20.770+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T03:59:23.743+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:59:36.999+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 730, after connections: 1000, after extra_info: 1860, after globalLock: 2250, after locks: 2600, after network: 2960, after opcounters: 3140, after opcountersRepl: 3410, after repl: 5190, after storageEngine: 5460, after tcmalloc: 5850, after wiredTiger: 7680, at end: 9710 } 2016-04-18T03:59:37.633+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:59:38.130+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 549ms 2016-04-18T03:59:38.514+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:59:40.360+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:59:54.679+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:59:57.953+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:00:05.192+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 860, after asserts: 1150, after connections: 1500, after extra_info: 2190, after globalLock: 2800, after locks: 3220, after network: 3400, after opcounters: 3400, after opcountersRepl: 3400, after repl: 7500, after storageEngine: 8140, after tcmalloc: 8620, after wiredTiger: 9860, at end: 10880 } 2016-04-18T04:00:11.898+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:00:13.878+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:00:15.505+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:00:32.943+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:00:37.383+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:00:41.229+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 298ms 2016-04-18T04:00:46.274+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 730, after asserts: 1070, after connections: 1440, after extra_info: 2790, after globalLock: 2970, after locks: 3320, after network: 3500, after opcounters: 3500, after opcountersRepl: 3500, after repl: 5000, after storageEngine: 6030, after tcmalloc: 11070, after wiredTiger: 16080, at end: 23490 } 2016-04-18T04:00:54.508+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:01:07.464+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:01:35.326+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:01:40.852+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:01:42.659+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T04:01:46.823+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1124ms 2016-04-18T04:01:53.213+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:01:54.673+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 275ms 2016-04-18T04:02:18.849+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:02:38.261+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1110, after asserts: 3460, after connections: 4600, after extra_info: 14410, after globalLock: 16150, after locks: 16360, after network: 16360, after opcounters: 16360, after opcountersRepl: 16360, after repl: 28620, after storageEngine: 30010, after tcmalloc: 33990, after wiredTiger: 42340, at end: 61440 } 2016-04-18T04:02:38.261+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:02:56.473+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 241ms 2016-04-18T04:02:57.302+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:03:05.864+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 774ms 2016-04-18T04:03:08.336+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:03:31.905+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:03:34.690+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:03:40.221+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:03:53.541+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1580, after asserts: 2260, after connections: 2570, after extra_info: 5930, after globalLock: 7310, after locks: 7310, after network: 7450, after opcounters: 7450, after opcountersRepl: 7450, after repl: 10790, after storageEngine: 11190, after tcmalloc: 14360, after wiredTiger: 14630, at end: 18440 } 2016-04-18T04:03:53.574+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:04:00.586+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:04:15.029+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 456ms 2016-04-18T04:04:17.828+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:04:20.456+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:04:20.525+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1790ms 2016-04-18T04:04:33.605+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:04:38.169+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:04:51.368+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:04:51.968+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:05:04.307+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T04:05:06.955+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 260, after asserts: 2140, after connections: 2530, after extra_info: 3270, after globalLock: 3270, after locks: 3270, after network: 3270, after opcounters: 3270, after opcountersRepl: 3270, after repl: 8110, after storageEngine: 8660, after tcmalloc: 8780, after wiredTiger: 11480, at end: 22690 } 2016-04-18T04:05:14.324+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:05:23.541+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 995ms 2016-04-18T04:05:24.025+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:05:37.938+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:05:43.608+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:05:55.923+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:06:08.447+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1630, after asserts: 3330, after connections: 3730, after extra_info: 4670, after globalLock: 4670, after locks: 4670, after network: 4670, after opcounters: 4670, after opcountersRepl: 4670, after repl: 4880, after storageEngine: 6840, after tcmalloc: 8990, after wiredTiger: 13690, at end: 25490 } 2016-04-18T04:06:08.186+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T04:06:24.250+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:06:25.384+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 821ms 2016-04-18T04:06:46.489+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:06:58.011+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:07:22.012+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:07:28.251+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 729ms 2016-04-18T04:07:29.869+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 107ms 2016-04-18T04:07:29.884+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:07:40.853+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:07:53.359+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T04:08:05.535+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1190, after asserts: 1700, after connections: 1880, after extra_info: 6240, after globalLock: 7480, after locks: 9560, after network: 13200, after opcounters: 14240, after opcountersRepl: 18120, after repl: 35580, after storageEngine: 36280, after tcmalloc: 36350, after wiredTiger: 43200, at end: 55390 } 2016-04-18T04:08:13.162+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:08:34.282+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 287ms 2016-04-18T04:08:39.738+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:08:47.052+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:09:03.506+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:09:11.847+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:09:11.991+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:09:19.274+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1260, after asserts: 2390, after connections: 4080, after extra_info: 5560, after globalLock: 5740, after locks: 5740, after network: 5740, after opcounters: 5740, after opcountersRepl: 5740, after repl: 9410, after storageEngine: 12090, after tcmalloc: 14800, after wiredTiger: 19120, at end: 23640 } 2016-04-18T04:09:38.550+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:09:41.424+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 295ms 2016-04-18T04:09:58.571+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:10:20.768+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:10:31.743+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:10:42.217+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:10:44.673+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 372ms 2016-04-18T04:10:53.201+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1451ms 2016-04-18T04:10:58.096+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T04:11:09.736+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3330, after asserts: 5490, after connections: 8430, after extra_info: 10690, after globalLock: 11870, after locks: 12050, after network: 12050, after opcounters: 12050, after opcountersRepl: 12050, after repl: 28140, after storageEngine: 29420, after tcmalloc: 31290, after wiredTiger: 37960, at end: 45870 } 2016-04-18T04:11:09.834+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:11:33.754+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:11:42.012+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:11:55.270+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 131ms 2016-04-18T04:12:04.867+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1950ms 2016-04-18T04:12:05.222+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:12:18.628+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:12:36.283+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:13:01.618+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:13:15.723+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 178ms 2016-04-18T04:13:25.842+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:13:32.312+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 251ms 2016-04-18T04:13:32.313+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2650, after asserts: 5460, after connections: 5840, after extra_info: 10620, after globalLock: 12470, after locks: 19630, after network: 19950, after opcounters: 19950, after opcountersRepl: 19950, after repl: 35670, after storageEngine: 37230, after tcmalloc: 45650, after wiredTiger: 65820, at end: 85110 } 2016-04-18T04:13:39.348+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 176ms 2016-04-18T04:13:59.876+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:14:12.644+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:14:42.996+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:14:46.314+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 510ms 2016-04-18T04:14:59.893+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:15:01.367+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:15:17.985+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:15:32.361+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:15:34.836+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3770, after asserts: 4830, after connections: 5250, after extra_info: 9530, after globalLock: 10290, after locks: 10290, after network: 10370, after opcounters: 10370, after opcountersRepl: 10370, after repl: 20610, after storageEngine: 25180, after tcmalloc: 32250, after wiredTiger: 38240, at end: 48210 } 2016-04-18T04:15:51.791+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 127ms 2016-04-18T04:15:59.386+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1191ms 2016-04-18T04:16:08.162+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 290ms 2016-04-18T04:16:15.882+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:16:28.504+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:16:56.985+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:17:07.165+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:17:17.606+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 524ms 2016-04-18T04:17:19.090+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:17:32.438+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:17:40.732+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 422ms 2016-04-18T04:17:56.609+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 212ms 2016-04-18T04:18:15.122+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4090, after asserts: 4690, after connections: 5020, after extra_info: 8080, after globalLock: 11840, after locks: 16220, after network: 16510, after opcounters: 16510, after opcountersRepl: 16510, after repl: 30360, after storageEngine: 33070, after tcmalloc: 37210, after wiredTiger: 51730, at end: 81610 } 2016-04-18T04:18:18.677+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:18:32.570+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:19:08.769+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 763ms 2016-04-18T04:19:14.806+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:19:18.216+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 614ms 2016-04-18T04:19:26.483+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 137ms 2016-04-18T04:19:32.549+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:19:55.842+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:20:08.004+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:20:34.891+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2206ms 2016-04-18T04:20:44.494+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 280ms 2016-04-18T04:20:54.482+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1460, after asserts: 2240, after connections: 2770, after extra_info: 8290, after globalLock: 9910, after locks: 10700, after network: 11090, after opcounters: 11090, after opcountersRepl: 11090, after repl: 37600, after storageEngine: 43900, after tcmalloc: 48370, after wiredTiger: 54000, at end: 60730 } 2016-04-18T04:20:57.332+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:20:57.783+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:21:17.223+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:21:47.844+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 318ms 2016-04-18T04:21:58.683+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 945ms 2016-04-18T04:22:28.759+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:22:46.665+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:23:14.991+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 342ms 2016-04-18T04:23:25.675+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 348ms 2016-04-18T04:23:32.753+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:23:34.581+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 446ms 2016-04-18T04:23:47.074+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:23:54.011+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1970, after asserts: 5310, after connections: 9880, after extra_info: 15160, after globalLock: 17140, after locks: 20300, after network: 21530, after opcounters: 21530, after opcountersRepl: 21530, after repl: 33870, after storageEngine: 36100, after tcmalloc: 38700, after wiredTiger: 55670, at end: 57630 } 2016-04-18T04:24:12.413+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:24:25.127+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:24:34.846+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:24:38.673+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 539ms 2016-04-18T04:24:44.868+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T04:25:01.609+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:25:18.624+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:25:48.401+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:25:50.321+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2570, after asserts: 3570, after connections: 4130, after extra_info: 13010, after globalLock: 14040, after locks: 14820, after network: 15300, after opcounters: 15300, after opcountersRepl: 15300, after repl: 28800, after storageEngine: 31000, after tcmalloc: 34000, after wiredTiger: 40760, at end: 48990 } 2016-04-18T04:26:00.382+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 331ms 2016-04-18T04:26:00.818+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:26:01.261+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 301ms 2016-04-18T04:26:16.296+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 2098ms 2016-04-18T04:26:30.990+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:26:47.596+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:26:58.736+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:27:03.114+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 264ms 2016-04-18T04:27:04.323+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 108ms 2016-04-18T04:27:22.379+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:27:34.109+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:28:11.371+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 572ms 2016-04-18T04:28:23.461+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 165ms 2016-04-18T04:28:25.622+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:28:27.619+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 215ms 2016-04-18T04:28:35.808+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:28:38.368+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 610, after asserts: 2160, after connections: 4230, after extra_info: 8990, after globalLock: 13140, after locks: 13750, after network: 13750, after opcounters: 13750, after opcountersRepl: 13750, after repl: 43800, after storageEngine: 47370, after tcmalloc: 53880, after wiredTiger: 61950, at end: 77510 } 2016-04-18T04:29:04.820+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:29:18.749+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:29:33.490+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:29:38.227+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 402ms 2016-04-18T04:29:42.924+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:30:14.464+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:30:35.775+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:30:45.872+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 509ms 2016-04-18T04:30:49.405+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 971ms 2016-04-18T04:31:00.897+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 145ms 2016-04-18T04:31:11.750+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1820, after asserts: 2630, after connections: 3580, after extra_info: 8900, after globalLock: 11230, after locks: 11930, after network: 12440, after opcounters: 13430, after opcountersRepl: 13430, after repl: 35770, after storageEngine: 39740, after tcmalloc: 43810, after wiredTiger: 55380, at end: 69600 } 2016-04-18T04:31:15.960+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:31:30.643+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:32:08.467+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:32:10.448+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 485ms 2016-04-18T04:32:21.132+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1367ms 2016-04-18T04:32:25.856+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:32:26.195+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 445ms 2016-04-18T04:32:32.725+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:33:02.122+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:33:13.184+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:33:34.225+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 656ms 2016-04-18T04:33:38.676+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3100, after asserts: 3200, after connections: 3460, after extra_info: 12960, after globalLock: 14270, after locks: 14990, after network: 15190, after opcounters: 15190, after opcountersRepl: 15190, after repl: 30930, after storageEngine: 33500, after tcmalloc: 35740, after wiredTiger: 45190, at end: 50410 } 2016-04-18T04:33:40.024+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 673ms 2016-04-18T04:33:41.681+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:33:51.120+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:34:08.902+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:34:19.597+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:34:19.596+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:34:43.855+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1181ms 2016-04-18T04:34:48.948+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:34:53.892+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 573ms 2016-04-18T04:34:57.968+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:35:35.345+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:35:38.975+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2310, after asserts: 2590, after connections: 2740, after extra_info: 6020, after globalLock: 7070, after locks: 8990, after network: 9320, after opcounters: 9730, after opcountersRepl: 10920, after repl: 36900, after storageEngine: 41330, after tcmalloc: 41830, after wiredTiger: 49870, at end: 56500 } 2016-04-18T04:35:47.077+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:36:21.130+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:36:34.351+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:36:34.812+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:37:02.270+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:37:02.181+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 113ms 2016-04-18T04:37:08.112+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1557ms 2016-04-18T04:37:13.541+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:37:17.465+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-04-18T04:37:23.222+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 990, after asserts: 2100, after connections: 3610, after extra_info: 9370, after globalLock: 11510, after locks: 13680, after network: 16960, after opcounters: 17250, after opcountersRepl: 17250, after repl: 21660, after storageEngine: 24320, after tcmalloc: 26450, after wiredTiger: 36060, at end: 41800 } 2016-04-18T04:37:48.124+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:38:00.059+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:38:20.903+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 219ms 2016-04-18T04:38:25.930+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:38:28.382+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 657ms 2016-04-18T04:38:30.215+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 755ms 2016-04-18T04:38:34.189+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:38:39.734+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:39:14.047+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:39:22.554+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:39:33.559+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4180, after asserts: 8020, after connections: 10260, after extra_info: 14180, after globalLock: 16020, after locks: 16020, after network: 16190, after opcounters: 16190, after opcountersRepl: 16190, after repl: 27440, after storageEngine: 30040, after tcmalloc: 38090, after wiredTiger: 46270, at end: 57720 } 2016-04-18T04:39:42.624+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T04:39:48.721+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:39:52.145+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1023ms 2016-04-18T04:40:10.666+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:40:45.010+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:40:57.957+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 302ms 2016-04-18T04:40:58.104+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:41:03.124+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:41:31.431+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:41:39.288+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:41:56.703+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4320, after asserts: 6190, after connections: 8560, after extra_info: 12070, after globalLock: 13530, after locks: 14250, after network: 14250, after opcounters: 14250, after opcountersRepl: 14250, after repl: 32850, after storageEngine: 36210, after tcmalloc: 43270, after wiredTiger: 48880, at end: 66590 } 2016-04-18T04:42:00.716+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 257ms 2016-04-18T04:42:05.286+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1167ms 2016-04-18T04:42:11.921+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:42:13.875+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 249ms 2016-04-18T04:42:53.022+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:43:22.565+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 167ms 2016-04-18T04:43:24.121+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:43:29.513+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 462ms 2016-04-18T04:43:36.156+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 168ms 2016-04-18T04:43:46.645+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:43:57.638+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T04:44:17.339+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1730, after asserts: 4500, after connections: 5850, after extra_info: 7960, after globalLock: 8140, after locks: 8140, after network: 8140, after opcounters: 8140, after opcountersRepl: 8140, after repl: 11580, after storageEngine: 15560, after tcmalloc: 18170, after wiredTiger: 28130, at end: 46020 } 2016-04-18T04:44:29.486+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:44:44.321+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 332ms 2016-04-18T04:44:56.357+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 562ms 2016-04-18T04:44:56.096+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:45:05.044+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T04:45:23.695+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:45:59.143+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:46:13.771+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 243ms 2016-04-18T04:46:18.013+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:46:22.651+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:46:24.888+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1350ms 2016-04-18T04:46:52.464+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:47:10.184+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:47:16.283+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2130, after asserts: 4290, after connections: 6520, after extra_info: 9570, after globalLock: 12790, after locks: 15490, after network: 15740, after opcounters: 15740, after opcountersRepl: 15740, after repl: 40090, after storageEngine: 47630, after tcmalloc: 56850, after wiredTiger: 63800, at end: 72990 } 2016-04-18T04:47:30.415+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 235ms 2016-04-18T04:47:44.999+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 348ms 2016-04-18T04:47:56.753+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:48:01.272+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 161ms 2016-04-18T04:48:11.375+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:48:58.924+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:49:07.109+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 217ms 2016-04-18T04:49:11.334+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:49:20.604+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1933ms 2016-04-18T04:49:27.405+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:49:36.757+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 149ms 2016-04-18T04:49:53.531+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T04:50:01.516+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2520, after asserts: 4320, after connections: 6370, after extra_info: 9500, after globalLock: 10600, after locks: 11010, after network: 11280, after opcounters: 11280, after opcountersRepl: 11280, after repl: 29760, after storageEngine: 36640, after tcmalloc: 39740, after wiredTiger: 47220, at end: 58680 } 2016-04-18T04:50:13.681+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:50:45.127+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2366ms 2016-04-18T04:50:53.025+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 156ms 2016-04-18T04:50:53.712+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:51:04.604+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:51:39.438+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:51:55.848+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 145ms 2016-04-18T04:51:56.872+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:51:57.111+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:52:07.995+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 635ms 2016-04-18T04:52:17.618+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 167ms 2016-04-18T04:52:31.317+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:52:50.250+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:53:01.907+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2490, after asserts: 3280, after connections: 3570, after extra_info: 9560, after globalLock: 12730, after locks: 15160, after network: 16450, after opcounters: 19940, after opcountersRepl: 20410, after repl: 42170, after storageEngine: 44590, after tcmalloc: 50570, after wiredTiger: 59740, at end: 66590 } 2016-04-18T04:53:26.417+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:53:30.420+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 806ms 2016-04-18T04:53:39.656+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:54:15.942+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:54:31.799+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 231ms 2016-04-18T04:54:35.454+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:54:35.665+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 208ms 2016-04-18T04:54:46.668+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:55:07.093+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T04:55:23.154+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3250, after asserts: 3510, after connections: 4690, after extra_info: 10770, after globalLock: 11510, after locks: 11530, after network: 11960, after opcounters: 14820, after opcountersRepl: 14940, after repl: 36550, after storageEngine: 38500, after tcmalloc: 45170, after wiredTiger: 54440, at end: 69210 } 2016-04-18T04:55:28.536+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:55:37.543+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 290ms 2016-04-18T04:55:39.535+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 878ms 2016-04-18T04:55:41.191+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:55:42.324+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T04:55:49.773+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:56:23.262+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:56:41.068+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:56:44.543+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 213ms 2016-04-18T04:56:54.275+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:57:08.152+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:57:19.591+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1300, after asserts: 3700, after connections: 4650, after extra_info: 11180, after globalLock: 14230, after locks: 15930, after network: 18320, after opcounters: 18320, after opcountersRepl: 18320, after repl: 26870, after storageEngine: 29210, after tcmalloc: 30930, after wiredTiger: 37280, at end: 47930 } 2016-04-18T04:57:22.207+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:57:47.031+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 115ms 2016-04-18T04:57:50.470+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1435ms 2016-04-18T04:57:50.576+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:57:51.323+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 224ms 2016-04-18T04:58:03.843+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:58:04.390+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:58:11.517+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:58:27.104+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T04:58:40.758+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:58:53.772+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 252ms 2016-04-18T04:58:55.089+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:59:03.498+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2400, after asserts: 4080, after connections: 6550, after extra_info: 9700, after globalLock: 12370, after locks: 15040, after network: 17160, after opcounters: 17780, after opcountersRepl: 17780, after repl: 26170, after storageEngine: 30290, after tcmalloc: 33870, after wiredTiger: 38750, at end: 46760 } 2016-04-18T04:59:03.595+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:59:25.657+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:59:36.120+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:59:40.097+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:59:58.773+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 120ms 2016-04-18T05:00:07.213+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 839ms 2016-04-18T05:00:07.218+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:00:16.955+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:00:26.904+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:00:48.440+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 530, after asserts: 530, after connections: 2260, after extra_info: 5470, after globalLock: 7530, after locks: 9080, after network: 10090, after opcounters: 10450, after opcountersRepl: 10450, after repl: 23060, after storageEngine: 27550, after tcmalloc: 33450, after wiredTiger: 41780, at end: 52210 } 2016-04-18T05:00:51.530+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:00:56.301+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:01:13.482+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 466ms 2016-04-18T05:01:19.554+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:01:20.200+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 138ms 2016-04-18T05:01:20.348+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:01:30.427+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:01:40.628+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:02:01.970+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:02:13.890+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:02:14.182+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:02:14.364+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2300, after asserts: 2740, after connections: 2860, after extra_info: 4360, after globalLock: 5900, after locks: 6640, after network: 7420, after opcounters: 9030, after opcountersRepl: 9380, after repl: 16130, after storageEngine: 20130, after tcmalloc: 25040, after wiredTiger: 25220, at end: 31940 } 2016-04-18T05:02:22.991+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 157ms 2016-04-18T05:02:30.674+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 540ms 2016-04-18T05:02:44.181+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:02:48.032+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:03:13.858+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:03:27.127+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:03:45.702+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 117ms 2016-04-18T05:03:51.069+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:03:53.654+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 608ms 2016-04-18T05:04:01.048+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 230ms 2016-04-18T05:04:04.862+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:04:09.935+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4400, after asserts: 6780, after connections: 10020, after extra_info: 13220, after globalLock: 13530, after locks: 13530, after network: 13530, after opcounters: 13530, after opcountersRepl: 13530, after repl: 20310, after storageEngine: 21980, after tcmalloc: 27040, after wiredTiger: 37530, at end: 45900 } 2016-04-18T05:04:11.753+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 28025ms 2016-04-18T05:04:20.726+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:04:38.974+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T05:04:46.072+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:05:06.295+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 600ms 2016-04-18T05:05:17.986+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 817ms 2016-04-18T05:05:28.766+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:05:38.564+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:06:11.636+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:06:19.949+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 116ms 2016-04-18T05:06:25.319+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1534ms 2016-04-18T05:06:27.399+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2640, after asserts: 3520, after connections: 8110, after extra_info: 12970, after globalLock: 14430, after locks: 15140, after network: 15850, after opcounters: 16580, after opcountersRepl: 16580, after repl: 39730, after storageEngine: 41960, after tcmalloc: 47190, after wiredTiger: 49870, at end: 69020 } 2016-04-18T05:06:27.605+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:06:27.990+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:06:50.456+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:07:08.208+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:07:28.560+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 204ms 2016-04-18T05:07:39.917+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 883ms 2016-04-18T05:07:48.496+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:07:52.474+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1066ms 2016-04-18T05:08:04.752+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:08:17.495+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2050, after asserts: 2630, after connections: 4520, after extra_info: 8140, after globalLock: 8340, after locks: 8560, after network: 8620, after opcounters: 8620, after opcountersRepl: 8620, after repl: 30550, after storageEngine: 37070, after tcmalloc: 42590, after wiredTiger: 44550, at end: 57780 } 2016-04-18T05:08:19.459+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:08:31.042+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 21634ms 2016-04-18T05:08:45.515+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:09:00.040+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:09:00.303+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 182ms 2016-04-18T05:09:08.705+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1598ms 2016-04-18T05:09:26.902+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:09:32.641+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:09:47.018+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:10:10.422+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T05:10:20.093+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 284ms 2016-04-18T05:10:22.976+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:10:24.122+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 812ms 2016-04-18T05:10:29.480+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3410, after asserts: 5660, after connections: 8840, after extra_info: 11730, after globalLock: 15020, after locks: 19180, after network: 21040, after opcounters: 21410, after opcountersRepl: 21410, after repl: 36750, after storageEngine: 39600, after tcmalloc: 42550, after wiredTiger: 51120, at end: 57040 } 2016-04-18T05:10:35.036+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:11:02.912+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:11:16.511+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:11:24.835+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 116ms 2016-04-18T05:11:30.323+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 848ms 2016-04-18T05:11:39.944+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 227ms 2016-04-18T05:11:49.388+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:11:58.498+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:11:58.498+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:12:24.386+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:12:24.519+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:12:30.689+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5800, after asserts: 6440, after connections: 6730, after extra_info: 11040, after globalLock: 11950, after locks: 12020, after network: 12120, after opcounters: 12120, after opcountersRepl: 12120, after repl: 33230, after storageEngine: 35850, after tcmalloc: 37600, after wiredTiger: 43880, at end: 51480 } 2016-04-18T05:12:41.811+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 204ms 2016-04-18T05:12:46.534+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 105ms 2016-04-18T05:12:51.490+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:13:02.576+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:13:34.194+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:13:47.973+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 229ms 2016-04-18T05:13:47.973+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:13:51.183+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:14:00.156+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3353ms 2016-04-18T05:14:28.328+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:14:37.404+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2880, after asserts: 3890, after connections: 4650, after extra_info: 9010, after globalLock: 11600, after locks: 16480, after network: 19290, after opcounters: 19690, after opcountersRepl: 19690, after repl: 36770, after storageEngine: 37540, after tcmalloc: 44310, after wiredTiger: 55190, at end: 61910 } 2016-04-18T05:14:41.051+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:15:00.283+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:15:05.175+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1556ms 2016-04-18T05:15:16.695+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1984ms 2016-04-18T05:15:21.251+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:15:29.449+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:15:58.201+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:16:11.072+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:16:14.260+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:16:20.499+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1890, after asserts: 1890, after connections: 3920, after extra_info: 5860, after globalLock: 5950, after locks: 5950, after network: 5950, after opcounters: 5950, after opcountersRepl: 5950, after repl: 12190, after storageEngine: 14950, after tcmalloc: 18710, after wiredTiger: 24750, at end: 28930 } 2016-04-18T05:16:24.100+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 239ms 2016-04-18T05:16:27.800+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1451ms 2016-04-18T05:16:35.153+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 146ms 2016-04-18T05:16:39.995+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:16:50.310+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:17:27.574+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:17:38.436+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:17:40.967+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 183ms 2016-04-18T05:17:49.170+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 282ms 2016-04-18T05:17:56.476+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 130ms 2016-04-18T05:18:15.561+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:18:29.583+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1710, after asserts: 3450, after connections: 7440, after extra_info: 17140, after globalLock: 18560, after locks: 18890, after network: 19010, after opcounters: 19010, after opcountersRepl: 19010, after repl: 44490, after storageEngine: 49590, after tcmalloc: 51940, after wiredTiger: 65380, at end: 75730 } 2016-04-18T05:18:37.002+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:18:42.215+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:18:59.860+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 154ms 2016-04-18T05:19:06.902+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1811ms 2016-04-18T05:19:16.132+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:19:34.374+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:20:09.618+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:20:16.870+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 167ms 2016-04-18T05:20:24.906+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1907ms 2016-04-18T05:20:30.158+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:20:38.673+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 107ms 2016-04-18T05:21:15.713+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:21:35.743+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:21:36.214+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:21:53.150+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4260, after asserts: 7620, after connections: 11440, after extra_info: 17910, after globalLock: 22510, after locks: 24820, after network: 24950, after opcounters: 24950, after opcountersRepl: 24950, after repl: 65750, after storageEngine: 70600, after tcmalloc: 78090, after wiredTiger: 97480, at end: 112700 } 2016-04-18T05:21:53.150+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 259ms 2016-04-18T05:22:06.752+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:22:15.785+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 467ms 2016-04-18T05:22:42.521+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:23:19.147+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 141ms 2016-04-18T05:23:20.437+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:23:23.898+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1168ms 2016-04-18T05:23:40.975+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 185ms 2016-04-18T05:23:41.831+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:24:15.355+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:24:42.414+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:25:01.666+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 158ms 2016-04-18T05:25:11.754+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 836ms 2016-04-18T05:25:17.992+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:25:18.456+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:25:36.059+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6940, after asserts: 8120, after connections: 9110, after extra_info: 17490, after globalLock: 26010, after locks: 29730, after network: 31020, after opcounters: 32060, after opcountersRepl: 32060, after repl: 58530, after storageEngine: 66640, after tcmalloc: 69530, after wiredTiger: 76870, at end: 87530 } 2016-04-18T05:25:39.343+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:26:20.128+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-04-18T05:26:28.992+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1133ms 2016-04-18T05:26:41.010+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:27:04.032+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:27:22.117+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:27:34.739+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 433ms 2016-04-18T05:27:48.240+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 188ms 2016-04-18T05:27:52.479+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 120ms 2016-04-18T05:27:57.066+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:28:11.797+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:28:27.716+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:28:51.597+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T05:28:54.343+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 131ms 2016-04-18T05:29:04.552+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 390ms 2016-04-18T05:29:05.456+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3100, after asserts: 5080, after connections: 8340, after extra_info: 21300, after globalLock: 23260, after locks: 24820, after network: 24920, after opcounters: 24920, after opcountersRepl: 24920, after repl: 56550, after storageEngine: 61130, after tcmalloc: 66870, after wiredTiger: 75480, at end: 92510 } 2016-04-18T05:29:05.542+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:29:09.685+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1464ms 2016-04-18T05:29:48.183+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:30:13.337+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:30:26.449+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-04-18T05:30:26.982+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 151ms 2016-04-18T05:30:43.404+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:31:09.806+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T05:31:30.094+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 531ms 2016-04-18T05:31:33.478+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:31:34.209+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 325ms 2016-04-18T05:32:01.344+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:32:20.432+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1150, after asserts: 4460, after connections: 5780, after extra_info: 14080, after globalLock: 16830, after locks: 18460, after network: 18980, after opcounters: 23810, after opcountersRepl: 28570, after repl: 60500, after storageEngine: 63940, after tcmalloc: 71630, after wiredTiger: 83800, at end: 100900 } 2016-04-18T05:32:20.871+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:32:38.263+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 108ms 2016-04-18T05:32:45.855+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 739ms 2016-04-18T05:33:03.984+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:33:26.631+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:33:29.070+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:33:47.073+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T05:33:51.606+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 184ms 2016-04-18T05:33:59.094+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:33:59.390+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 383ms 2016-04-18T05:34:06.193+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 165ms 2016-04-18T05:34:31.635+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3270, after asserts: 4790, after connections: 6920, after extra_info: 12830, after globalLock: 13580, after locks: 14000, after network: 14190, after opcounters: 16060, after opcountersRepl: 16530, after repl: 20840, after storageEngine: 24320, after tcmalloc: 28980, after wiredTiger: 43070, at end: 54910 } 2016-04-18T05:34:34.065+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:34:40.172+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:35:17.508+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:35:19.663+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 117ms 2016-04-18T05:35:27.117+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:35:39.281+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:35:54.876+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:36:13.830+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:36:25.976+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:36:25.682+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 120ms 2016-04-18T05:36:33.583+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1890, after asserts: 2280, after connections: 2610, after extra_info: 7560, after globalLock: 8570, after locks: 8570, after network: 9990, after opcounters: 11080, after opcountersRepl: 11470, after repl: 22530, after storageEngine: 24550, after tcmalloc: 27080, after wiredTiger: 32970, at end: 41170 } 2016-04-18T05:36:35.589+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1450ms 2016-04-18T05:36:42.813+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 137ms 2016-04-18T05:36:46.404+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:37:01.268+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:37:27.156+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:37:37.458+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:37:47.174+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 144ms 2016-04-18T05:38:00.599+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 553ms 2016-04-18T05:38:08.000+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 196ms 2016-04-18T05:38:12.926+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:38:32.352+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:38:49.175+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1660, after asserts: 4860, after connections: 5560, after extra_info: 10860, after globalLock: 14300, after locks: 16050, after network: 16270, after opcounters: 16270, after opcountersRepl: 16270, after repl: 24500, after storageEngine: 26750, after tcmalloc: 32990, after wiredTiger: 51640, at end: 65630 } 2016-04-18T05:38:52.632+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T05:39:13.868+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 256ms 2016-04-18T05:39:25.651+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 317ms 2016-04-18T05:39:28.661+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:39:49.974+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:40:28.592+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 105ms 2016-04-18T05:40:32.171+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:40:40.610+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 487ms 2016-04-18T05:40:54.110+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 131ms 2016-04-18T05:41:08.300+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:41:22.261+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:41:45.882+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2980, after asserts: 4690, after connections: 6450, after extra_info: 14310, after globalLock: 16150, after locks: 17290, after network: 17680, after opcounters: 17680, after opcountersRepl: 17680, after repl: 46570, after storageEngine: 51060, after tcmalloc: 53030, after wiredTiger: 70320, at end: 82190 } 2016-04-18T05:41:46.906+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T05:42:01.388+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 473ms 2016-04-18T05:42:14.155+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 269ms 2016-04-18T05:42:16.398+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:43:00.775+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:43:18.003+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 477ms 2016-04-18T05:43:27.254+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:43:31.757+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 664ms 2016-04-18T05:43:53.197+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 189ms 2016-04-18T05:44:11.284+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:44:29.491+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:44:54.748+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:45:05.872+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:45:06.044+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2770, after asserts: 3830, after connections: 7930, after extra_info: 15620, after globalLock: 17750, after locks: 19890, after network: 20860, after opcounters: 20860, after opcountersRepl: 20860, after repl: 39310, after storageEngine: 42080, after tcmalloc: 52190, after wiredTiger: 65770, at end: 83290 } 2016-04-18T05:45:06.776+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 186ms 2016-04-18T05:45:09.099+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:45:14.045+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 901ms 2016-04-18T05:45:27.734+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 130ms 2016-04-18T05:45:44.492+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:46:02.950+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:46:37.523+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 164ms 2016-04-18T05:46:50.734+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:46:51.846+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1229ms 2016-04-18T05:47:11.869+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 484ms 2016-04-18T05:47:20.182+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:47:28.403+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:47:46.540+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4250, after asserts: 6310, after connections: 7620, after extra_info: 15740, after globalLock: 24790, after locks: 29380, after network: 29750, after opcounters: 29900, after opcountersRepl: 29900, after repl: 37570, after storageEngine: 42000, after tcmalloc: 43150, after wiredTiger: 61700, at end: 70710 } 2016-04-18T05:48:15.565+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:48:21.344+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:48:22.407+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 305ms 2016-04-18T05:48:27.803+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2876ms 2016-04-18T05:48:29.199+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:48:33.552+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T05:49:03.202+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:49:21.899+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:49:44.591+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-04-18T05:49:51.379+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:49:54.348+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 460ms 2016-04-18T05:50:06.274+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T05:50:11.845+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:50:13.144+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1160, after asserts: 4210, after connections: 4630, after extra_info: 9900, after globalLock: 12080, after locks: 14410, after network: 16590, after opcounters: 17530, after opcountersRepl: 17530, after repl: 23560, after storageEngine: 25540, after tcmalloc: 29480, after wiredTiger: 39500, at end: 57550 } 2016-04-18T05:51:04.941+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:51:16.139+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 198ms 2016-04-18T05:51:21.561+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:51:21.629+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:51:28.891+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 315ms 2016-04-18T05:51:40.759+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-04-18T05:51:50.690+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 4195ms 2016-04-18T05:52:15.159+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:52:30.282+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2950, after asserts: 4020, after connections: 5300, after extra_info: 7910, after globalLock: 10410, after locks: 11850, after network: 12130, after opcounters: 12130, after opcountersRepl: 12130, after repl: 15540, after storageEngine: 18350, after tcmalloc: 22480, after wiredTiger: 28050, at end: 36810 } 2016-04-18T05:52:30.400+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:52:58.389+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:52:58.130+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1159ms 2016-04-18T05:53:22.190+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:53:45.777+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:54:08.163+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 265ms 2016-04-18T05:54:19.386+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1589ms 2016-04-18T05:54:20.608+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:54:27.292+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 116ms 2016-04-18T05:54:36.470+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T05:54:52.220+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:54:59.089+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5180, after asserts: 7660, after connections: 10040, after extra_info: 12800, after globalLock: 14200, after locks: 18950, after network: 21150, after opcounters: 21840, after opcountersRepl: 21840, after repl: 29530, after storageEngine: 35840, after tcmalloc: 40260, after wiredTiger: 49740, at end: 65360 } 2016-04-18T05:55:29.013+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 158ms 2016-04-18T05:55:32.254+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:55:42.804+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 116ms 2016-04-18T05:55:47.115+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:55:50.369+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T05:56:22.888+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:56:30.956+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:56:36.180+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:56:56.411+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:57:02.394+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 783ms 2016-04-18T05:57:10.084+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:57:11.988+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1010ms 2016-04-18T05:57:28.127+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1242ms 2016-04-18T05:57:28.127+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4350, after asserts: 7370, after connections: 9250, after extra_info: 12940, after globalLock: 13660, after locks: 14640, after network: 15410, after opcounters: 18100, after opcountersRepl: 18190, after repl: 25080, after storageEngine: 27750, after tcmalloc: 31050, after wiredTiger: 48460, at end: 55980 } 2016-04-18T05:57:48.051+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:58:12.192+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:58:38.001+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 254ms 2016-04-18T05:58:41.093+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:58:45.682+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:58:46.479+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 291ms 2016-04-18T05:58:57.567+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:58:57.790+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 130ms 2016-04-18T05:59:39.368+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:59:53.604+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:59:59.757+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4240, after asserts: 6980, after connections: 11610, after extra_info: 19720, after globalLock: 21480, after locks: 21480, after network: 22260, after opcounters: 22410, after opcountersRepl: 22410, after repl: 44980, after storageEngine: 47510, after tcmalloc: 54060, after wiredTiger: 70540, at end: 87810 } 2016-04-18T06:00:04.955+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 172ms 2016-04-18T06:00:18.807+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 335ms 2016-04-18T06:00:33.059+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1129ms 2016-04-18T06:00:43.177+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:01:00.816+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:01:41.499+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:01:48.495+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:01:50.836+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 522ms 2016-04-18T06:01:56.151+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:02:02.099+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1545ms 2016-04-18T06:02:11.881+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 175ms 2016-04-18T06:02:27.122+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:02:51.059+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3580, after asserts: 5390, after connections: 8690, after extra_info: 13790, after globalLock: 15030, after locks: 15330, after network: 15480, after opcounters: 16370, after opcountersRepl: 16370, after repl: 48650, after storageEngine: 51280, after tcmalloc: 56380, after wiredTiger: 68250, at end: 74720 } 2016-04-18T06:02:51.059+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:03:17.072+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:03:22.723+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 274ms 2016-04-18T06:03:32.358+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 895ms 2016-04-18T06:03:37.461+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T06:04:02.188+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:04:16.971+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:04:21.184+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:04:46.812+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 257ms 2016-04-18T06:04:59.541+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:05:01.118+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 205ms 2016-04-18T06:05:18.948+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:05:33.940+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2010, after asserts: 3840, after connections: 5720, after extra_info: 8460, after globalLock: 8520, after locks: 9930, after network: 10690, after opcounters: 10690, after opcountersRepl: 10690, after repl: 20170, after storageEngine: 22770, after tcmalloc: 29180, after wiredTiger: 46520, at end: 59300 } 2016-04-18T06:06:04.980+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 164ms 2016-04-18T06:06:18.786+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:06:18.462+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 512ms 2016-04-18T06:06:40.739+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:07:17.270+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:07:33.011+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:07:35.023+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 142ms 2016-04-18T06:07:36.672+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:07:50.576+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 289ms 2016-04-18T06:08:23.372+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:08:33.729+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2770, after asserts: 3790, after connections: 5430, after extra_info: 10930, after globalLock: 14680, after locks: 17130, after network: 17750, after opcounters: 20220, after opcountersRepl: 21220, after repl: 59910, after storageEngine: 64140, after tcmalloc: 67640, after wiredTiger: 77780, at end: 90770 } 2016-04-18T06:08:44.762+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:08:57.801+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T06:09:10.310+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1200ms 2016-04-18T06:09:20.475+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 103ms 2016-04-18T06:09:23.837+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:09:41.576+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:10:07.660+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:10:28.892+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 325ms 2016-04-18T06:10:32.708+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:10:44.867+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 373ms 2016-04-18T06:10:52.568+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 218ms 2016-04-18T06:10:58.780+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:11:20.005+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:11:36.067+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:11:36.729+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2750, after asserts: 4920, after connections: 6780, after extra_info: 10170, after globalLock: 12390, after locks: 12960, after network: 15360, after opcounters: 17600, after opcountersRepl: 19090, after repl: 49710, after storageEngine: 51400, after tcmalloc: 54260, after wiredTiger: 56700, at end: 68130 } 2016-04-18T06:11:54.286+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:12:03.462+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 662ms 2016-04-18T06:12:07.404+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1219ms 2016-04-18T06:12:13.254+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 371ms 2016-04-18T06:12:29.088+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:12:50.029+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:13:16.676+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 523ms 2016-04-18T06:13:21.952+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:13:31.623+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:13:32.083+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:14:02.486+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:14:09.242+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4110, after asserts: 5750, after connections: 5950, after extra_info: 12630, after globalLock: 13020, after locks: 13020, after network: 13020, after opcounters: 13020, after opcountersRepl: 13020, after repl: 36340, after storageEngine: 38350, after tcmalloc: 43150, after wiredTiger: 47530, at end: 56800 } 2016-04-18T06:14:15.805+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:14:25.358+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 316ms 2016-04-18T06:14:33.123+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 779ms 2016-04-18T06:14:41.569+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 252ms 2016-04-18T06:14:55.819+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 20426ms 2016-04-18T06:14:56.054+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:15:06.456+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:15:35.387+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:15:35.930+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:15:50.260+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 253ms 2016-04-18T06:15:51.399+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:16:09.432+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:16:16.182+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1750, after asserts: 4000, after connections: 7030, after extra_info: 11370, after globalLock: 15120, after locks: 15290, after network: 15290, after opcounters: 15290, after opcountersRepl: 15290, after repl: 20630, after storageEngine: 22450, after tcmalloc: 25610, after wiredTiger: 30270, at end: 37270 } 2016-04-18T06:16:19.864+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:16:46.998+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:16:53.855+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 566ms 2016-04-18T06:16:55.179+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:17:18.501+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:17:31.079+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:17:57.155+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 285ms 2016-04-18T06:17:57.798+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:17:58.838+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 299ms 2016-04-18T06:18:06.974+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1213ms 2016-04-18T06:18:11.886+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:18:12.901+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:18:21.709+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1850, after asserts: 3430, after connections: 3430, after extra_info: 6940, after globalLock: 11350, after locks: 12200, after network: 13350, after opcounters: 14050, after opcountersRepl: 14420, after repl: 28240, after storageEngine: 34270, after tcmalloc: 40970, after wiredTiger: 49460, at end: 59930 } 2016-04-18T06:18:27.332+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T06:18:49.231+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:19:20.583+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-04-18T06:19:25.926+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:19:26.580+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 106ms 2016-04-18T06:19:26.724+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 144ms 2016-04-18T06:19:45.497+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:20:03.928+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:20:13.569+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:20:27.986+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 209ms 2016-04-18T06:20:42.071+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:20:55.803+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1410, after asserts: 3970, after connections: 5330, after extra_info: 7860, after globalLock: 9480, after locks: 11650, after network: 12830, after opcounters: 15990, after opcountersRepl: 18100, after repl: 38190, after storageEngine: 45190, after tcmalloc: 49360, after wiredTiger: 60840, at end: 67830 } 2016-04-18T06:20:57.990+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:21:30.764+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:21:43.069+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 343ms 2016-04-18T06:21:46.383+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1521ms 2016-04-18T06:21:55.775+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:22:01.088+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 153ms 2016-04-18T06:22:31.757+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:22:45.351+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:22:45.452+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:23:11.271+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 223ms 2016-04-18T06:23:17.026+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4640, after asserts: 6200, after connections: 10690, after extra_info: 14030, after globalLock: 15830, after locks: 16090, after network: 16370, after opcounters: 16370, after opcountersRepl: 16370, after repl: 27390, after storageEngine: 28870, after tcmalloc: 29560, after wiredTiger: 40490, at end: 51830 } 2016-04-18T06:23:20.446+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:23:23.948+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 563ms 2016-04-18T06:23:31.353+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 167ms 2016-04-18T06:23:36.896+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:24:18.536+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:24:38.789+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:24:48.077+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 149ms 2016-04-18T06:24:56.261+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 385ms 2016-04-18T06:25:03.675+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 116ms 2016-04-18T06:25:23.848+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:25:36.959+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:26:12.344+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 556ms 2016-04-18T06:26:16.334+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:26:16.701+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 482ms 2016-04-18T06:26:17.117+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 260ms 2016-04-18T06:26:25.605+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:26:29.905+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1560, after asserts: 2400, after connections: 6220, after extra_info: 14280, after globalLock: 16800, after locks: 19770, after network: 21390, after opcounters: 21390, after opcountersRepl: 21390, after repl: 48580, after storageEngine: 53530, after tcmalloc: 56140, after wiredTiger: 64910, at end: 77940 } 2016-04-18T06:26:54.920+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T06:27:19.618+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 211ms 2016-04-18T06:27:21.030+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 142ms 2016-04-18T06:27:24.771+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:28:01.397+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:28:21.252+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:28:22.665+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 372ms 2016-04-18T06:28:38.950+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2146ms 2016-04-18T06:28:48.894+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 138ms 2016-04-18T06:28:55.790+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:29:08.595+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:29:14.488+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:29:21.713+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5480, after asserts: 9720, after connections: 12770, after extra_info: 15680, after globalLock: 21680, after locks: 23140, after network: 23770, after opcounters: 23770, after opcountersRepl: 23770, after repl: 28170, after storageEngine: 30720, after tcmalloc: 35140, after wiredTiger: 45290, at end: 62080 } 2016-04-18T06:29:48.680+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T06:29:57.398+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T06:30:08.282+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1058ms 2016-04-18T06:30:23.429+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 883ms 2016-04-18T06:30:36.293+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:31:02.297+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:31:34.764+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 218ms 2016-04-18T06:31:38.280+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:31:45.870+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 595ms 2016-04-18T06:31:47.036+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 463ms 2016-04-18T06:32:00.385+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:32:14.387+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:32:36.240+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T06:32:56.535+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3940, after asserts: 4430, after connections: 5400, after extra_info: 8820, after globalLock: 11590, after locks: 12760, after network: 12870, after opcounters: 12870, after opcountersRepl: 12870, after repl: 36580, after storageEngine: 41830, after tcmalloc: 48380, after wiredTiger: 56760, at end: 70190 } 2016-04-18T06:32:56.535+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:33:00.878+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 312ms 2016-04-18T06:33:41.515+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:33:52.736+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:34:11.880+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-18T06:34:28.682+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 760ms 2016-04-18T06:34:30.184+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:34:51.654+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:35:17.815+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:35:44.322+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 181ms 2016-04-18T06:35:44.322+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T06:35:51.384+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 641ms 2016-04-18T06:36:08.240+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:36:11.093+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2490, after asserts: 4060, after connections: 5160, after extra_info: 15330, after globalLock: 19200, after locks: 22550, after network: 23190, after opcounters: 23370, after opcountersRepl: 23370, after repl: 61430, after storageEngine: 64690, after tcmalloc: 69000, after wiredTiger: 90330, at end: 101380 } 2016-04-18T06:36:11.093+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1139ms 2016-04-18T06:36:27.505+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:37:20.390+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 126ms 2016-04-18T06:37:28.280+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 890ms 2016-04-18T06:37:28.494+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:37:37.595+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:37:39.084+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T06:37:53.366+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:38:24.475+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:38:47.450+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 165ms 2016-04-18T06:38:53.367+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:38:54.105+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1220, after asserts: 2670, after connections: 3780, after extra_info: 9210, after globalLock: 10470, after locks: 13450, after network: 14280, after opcounters: 14280, after opcountersRepl: 14280, after repl: 26000, after storageEngine: 30040, after tcmalloc: 33590, after wiredTiger: 38740, at end: 50110 } 2016-04-18T06:39:00.310+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2276ms 2016-04-18T06:39:15.177+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 360ms 2016-04-18T06:39:48.062+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:40:08.452+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:40:39.206+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 101ms 2016-04-18T06:40:48.891+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:40:57.205+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 912ms 2016-04-18T06:41:04.568+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:41:05.632+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 177ms 2016-04-18T06:41:22.130+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:41:50.316+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T06:41:57.932+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:42:09.540+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4020, after asserts: 6380, after connections: 13190, after extra_info: 19940, after globalLock: 24420, after locks: 27480, after network: 28560, after opcounters: 28950, after opcountersRepl: 28950, after repl: 38580, after storageEngine: 41670, after tcmalloc: 50490, after wiredTiger: 56250, at end: 65860 } 2016-04-18T06:42:13.933+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 155ms 2016-04-18T06:42:16.666+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:42:29.334+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 548ms 2016-04-18T06:42:32.884+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 151ms 2016-04-18T06:43:11.121+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:43:39.987+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 131ms 2016-04-18T06:43:54.277+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1108ms 2016-04-18T06:43:55.572+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:43:58.072+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:44:07.233+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 153ms 2016-04-18T06:44:43.591+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:45:16.011+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 122ms 2016-04-18T06:45:19.468+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:45:24.434+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1345ms 2016-04-18T06:45:30.536+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 526ms 2016-04-18T06:46:06.125+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1830, after asserts: 3220, after connections: 3880, after extra_info: 15200, after globalLock: 16710, after locks: 18290, after network: 18550, after opcounters: 18550, after opcountersRepl: 18550, after repl: 50060, after storageEngine: 55530, after tcmalloc: 62820, after wiredTiger: 78140, at end: 97450 } 2016-04-18T06:46:08.619+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:46:15.714+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:46:42.889+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 143ms 2016-04-18T06:47:02.453+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 738ms 2016-04-18T06:47:15.145+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 144ms 2016-04-18T06:47:32.689+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:47:42.982+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:47:45.411+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:48:29.301+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:48:36.224+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3210ms 2016-04-18T06:48:44.597+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:48:52.133+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 734ms 2016-04-18T06:49:28.442+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:49:53.685+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:50:06.923+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3620, after asserts: 5870, after connections: 6960, after extra_info: 18490, after globalLock: 20930, after locks: 22530, after network: 23640, after opcounters: 26310, after opcountersRepl: 26940, after repl: 64160, after storageEngine: 67930, after tcmalloc: 73060, after wiredTiger: 81450, at end: 93980 } 2016-04-18T06:50:33.734+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:51:02.446+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 108ms 2016-04-18T06:51:07.314+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:51:12.388+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 374ms 2016-04-18T06:51:17.710+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 145ms 2016-04-18T06:51:28.533+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:51:59.155+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:52:28.509+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:52:37.619+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 150ms 2016-04-18T06:52:53.365+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2128ms 2016-04-18T06:53:01.493+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1236ms 2016-04-18T06:53:04.687+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:53:27.864+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:53:53.551+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:53:56.720+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1420, after asserts: 3470, after connections: 7370, after extra_info: 11370, after globalLock: 15610, after locks: 18300, after network: 19020, after opcounters: 19020, after opcountersRepl: 19020, after repl: 49620, after storageEngine: 55120, after tcmalloc: 59950, after wiredTiger: 77710, at end: 95070 } 2016-04-18T06:54:05.046+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 107ms 2016-04-18T06:54:19.946+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 479ms 2016-04-18T06:54:30.154+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 154ms 2016-04-18T06:54:44.339+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:54:49.376+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:55:13.468+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T06:55:34.875+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 146ms 2016-04-18T06:55:46.550+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2711ms 2016-04-18T06:55:48.909+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:55:55.649+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 302ms 2016-04-18T06:56:03.373+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:56:38.836+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:57:03.299+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:57:09.523+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2295ms 2016-04-18T06:57:23.749+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 871ms 2016-04-18T06:57:42.966+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3480, after asserts: 6770, after connections: 11300, after extra_info: 16870, after globalLock: 24210, after locks: 26540, after network: 29490, after opcounters: 32130, after opcountersRepl: 32820, after repl: 61400, after storageEngine: 71590, after tcmalloc: 79710, after wiredTiger: 89300, at end: 103340 } 2016-04-18T06:57:48.710+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:58:02.895+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:58:08.234+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:58:44.833+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 231ms 2016-04-18T06:59:02.172+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:59:08.714+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3155ms 2016-04-18T06:59:17.329+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T06:59:19.555+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:00:08.125+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:00:24.370+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:00:35.982+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 456ms 2016-04-18T07:00:40.620+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4100, after asserts: 5040, after connections: 6150, after extra_info: 9610, after globalLock: 10410, after locks: 13210, after network: 14880, after opcounters: 15180, after opcountersRepl: 15180, after repl: 34990, after storageEngine: 38070, after tcmalloc: 45800, after wiredTiger: 53950, at end: 72370 } 2016-04-18T07:00:40.784+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 118ms 2016-04-18T07:01:04.500+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:01:16.534+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:01:16.721+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:01:45.494+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3409ms 2016-04-18T07:01:45.793+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:01:47.516+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 125ms 2016-04-18T07:02:01.426+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:02:24.911+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:02:57.925+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 347ms 2016-04-18T07:03:06.452+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:03:08.561+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2637ms 2016-04-18T07:03:16.971+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 240ms 2016-04-18T07:03:19.036+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:03:38.156+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2100, after asserts: 4760, after connections: 11680, after extra_info: 23760, after globalLock: 26950, after locks: 34530, after network: 41600, after opcounters: 42280, after opcountersRepl: 42280, after repl: 52500, after storageEngine: 54930, after tcmalloc: 64480, after wiredTiger: 74710, at end: 81650 } 2016-04-18T07:04:01.576+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:04:25.594+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 178ms 2016-04-18T07:04:33.969+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:04:35.250+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 545ms 2016-04-18T07:04:35.564+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 272ms 2016-04-18T07:04:38.017+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:04:54.936+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:05:22.137+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:05:38.028+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 386ms 2016-04-18T07:05:48.019+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 234ms 2016-04-18T07:05:52.783+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 102ms 2016-04-18T07:06:13.330+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:06:30.329+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3690, after asserts: 6130, after connections: 8710, after extra_info: 13850, after globalLock: 17360, after locks: 22930, after network: 27060, after opcounters: 29130, after opcountersRepl: 29420, after repl: 43870, after storageEngine: 45680, after tcmalloc: 51530, after wiredTiger: 58830, at end: 68140 } 2016-04-18T07:06:34.878+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:06:59.187+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 115ms 2016-04-18T07:07:07.647+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 927ms 2016-04-18T07:07:09.483+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:07:09.812+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T07:07:21.039+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:07:33.825+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:07:59.581+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T07:08:11.676+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-04-18T07:08:18.113+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:08:21.813+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3005ms 2016-04-18T07:08:30.346+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1172ms 2016-04-18T07:08:50.818+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:09:01.075+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:09:21.358+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5310, after asserts: 10850, after connections: 13360, after extra_info: 19040, after globalLock: 21460, after locks: 23120, after network: 24310, after opcounters: 24310, after opcountersRepl: 24310, after repl: 36120, after storageEngine: 41550, after tcmalloc: 47630, after wiredTiger: 56880, at end: 70390 } 2016-04-18T07:09:36.167+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 350ms 2016-04-18T07:09:51.801+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 451ms 2016-04-18T07:10:02.506+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 119ms 2016-04-18T07:10:07.324+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:10:33.391+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:10:42.142+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:11:10.658+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T07:11:16.106+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 167ms 2016-04-18T07:11:16.596+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 154ms 2016-04-18T07:11:18.568+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:11:50.463+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:12:12.681+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2390, after asserts: 4090, after connections: 6630, after extra_info: 9190, after globalLock: 10720, after locks: 11020, after network: 11780, after opcounters: 12810, after opcountersRepl: 12810, after repl: 32260, after storageEngine: 37270, after tcmalloc: 38290, after wiredTiger: 40310, at end: 56340 } 2016-04-18T07:12:15.405+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:12:21.910+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 4635ms 2016-04-18T07:12:35.205+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:13:07.084+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:13:26.358+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:13:30.875+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 125ms 2016-04-18T07:13:30.875+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:13:55.074+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:14:09.188+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:14:34.360+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T07:14:40.906+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:14:42.919+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 244ms 2016-04-18T07:14:52.174+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:15:05.314+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3520, after asserts: 5130, after connections: 7240, after extra_info: 11320, after globalLock: 13900, after locks: 15120, after network: 18310, after opcounters: 19570, after opcountersRepl: 19570, after repl: 39560, after storageEngine: 40270, after tcmalloc: 43560, after wiredTiger: 50800, at end: 66070 } 2016-04-18T07:15:35.530+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:15:45.503+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 448ms 2016-04-18T07:15:45.557+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:15:46.813+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:15:52.362+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1236ms 2016-04-18T07:16:33.708+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:16:54.033+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:17:06.126+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 184ms 2016-04-18T07:17:08.643+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:17:14.417+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2532ms 2016-04-18T07:17:58.545+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:18:19.088+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:18:19.088+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 584ms 2016-04-18T07:18:20.836+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6030, after asserts: 6950, after connections: 7570, after extra_info: 9790, after globalLock: 10150, after locks: 11230, after network: 13170, after opcounters: 13300, after opcountersRepl: 13300, after repl: 21840, after storageEngine: 33110, after tcmalloc: 35500, after wiredTiger: 47940, at end: 58630 } 2016-04-18T07:18:33.870+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 4159ms 2016-04-18T07:18:59.064+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:19:02.029+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:19:29.699+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:19:46.431+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:19:53.809+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 439ms 2016-04-18T07:20:16.558+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 5547ms 2016-04-18T07:20:28.819+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:20:33.157+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 377ms 2016-04-18T07:20:56.074+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:21:27.630+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:21:58.740+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T07:22:04.189+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 776ms 2016-04-18T07:22:19.311+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:22:28.825+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2400, after asserts: 3340, after connections: 12940, after extra_info: 21970, after globalLock: 28130, after locks: 30340, after network: 33850, after opcounters: 35440, after opcountersRepl: 35830, after repl: 87260, after storageEngine: 88580, after tcmalloc: 92180, after wiredTiger: 100230, at end: 117040 } 2016-04-18T07:22:28.881+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:22:33.995+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:23:00.184+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 5183ms 2016-04-18T07:23:07.663+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 316ms 2016-04-18T07:23:16.235+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2313ms 2016-04-18T07:23:27.043+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 187ms 2016-04-18T07:23:27.331+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:23:46.404+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:24:38.903+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 540ms 2016-04-18T07:24:39.348+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:24:45.206+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 775ms 2016-04-18T07:24:54.678+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:25:40.410+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:25:46.886+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-04-18T07:25:48.340+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 744ms 2016-04-18T07:26:09.801+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:26:10.002+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6190, after asserts: 8250, after connections: 12610, after extra_info: 25460, after globalLock: 27150, after locks: 27930, after network: 28130, after opcounters: 28610, after opcountersRepl: 28610, after repl: 61570, after storageEngine: 69830, after tcmalloc: 71970, after wiredTiger: 86010, at end: 105130 } 2016-04-18T07:26:24.544+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:26:40.931+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:26:52.661+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 375ms 2016-04-18T07:27:17.725+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 754ms 2016-04-18T07:27:20.018+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:27:31.082+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:28:18.287+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:28:26.382+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 901ms 2016-04-18T07:28:29.077+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:28:37.579+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 559ms 2016-04-18T07:28:49.584+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 172ms 2016-04-18T07:29:08.727+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:29:20.404+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:29:32.938+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4420, after asserts: 6440, after connections: 7360, after extra_info: 10610, after globalLock: 16610, after locks: 18670, after network: 18930, after opcounters: 19510, after opcountersRepl: 19510, after repl: 47800, after storageEngine: 49320, after tcmalloc: 53200, after wiredTiger: 72170, at end: 81840 } 2016-04-18T07:29:54.062+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:29:57.050+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 538ms 2016-04-18T07:30:01.549+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1982ms 2016-04-18T07:30:03.694+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:30:07.694+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:30:12.604+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 137ms 2016-04-18T07:30:54.196+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:31:08.310+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:31:27.680+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 183ms 2016-04-18T07:31:29.350+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 145ms 2016-04-18T07:31:29.522+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 171ms 2016-04-18T07:31:48.158+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:32:10.104+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:32:31.809+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 176ms 2016-04-18T07:32:33.336+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 900, after asserts: 4570, after connections: 7200, after extra_info: 9450, after globalLock: 10100, after locks: 10100, after network: 10100, after opcounters: 10100, after opcountersRepl: 10100, after repl: 20970, after storageEngine: 26530, after tcmalloc: 31780, after wiredTiger: 47540, at end: 63160 } 2016-04-18T07:32:41.260+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1127ms 2016-04-18T07:32:41.480+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:32:50.379+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:33:10.389+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:33:42.759+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 127ms 2016-04-18T07:33:43.504+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:33:51.579+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 505ms 2016-04-18T07:33:56.974+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 216ms 2016-04-18T07:34:03.111+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:34:56.345+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:34:58.578+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 113ms 2016-04-18T07:35:04.809+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3149ms 2016-04-18T07:35:14.432+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:35:19.534+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 835ms 2016-04-18T07:35:59.540+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:36:07.986+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:36:26.514+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2510, after asserts: 6180, after connections: 6550, after extra_info: 8950, after globalLock: 14250, after locks: 17420, after network: 19510, after opcounters: 19760, after opcountersRepl: 19760, after repl: 61060, after storageEngine: 66620, after tcmalloc: 68820, after wiredTiger: 80750, at end: 106580 } 2016-04-18T07:36:27.016+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 332ms 2016-04-18T07:36:27.184+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:36:37.561+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1099ms 2016-04-18T07:36:41.911+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1309ms 2016-04-18T07:37:16.736+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:37:44.275+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:37:54.006+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 177ms 2016-04-18T07:38:13.429+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 270ms 2016-04-18T07:38:22.561+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:38:23.317+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 152ms 2016-04-18T07:38:45.292+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:39:19.630+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 1850, after connections: 4440, after extra_info: 10900, after globalLock: 15200, after locks: 18060, after network: 20030, after opcounters: 25130, after opcountersRepl: 26680, after repl: 42100, after storageEngine: 45490, after tcmalloc: 49470, after wiredTiger: 55890, at end: 70830 } 2016-04-18T07:39:20.154+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:39:40.466+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 265ms 2016-04-18T07:39:42.483+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:39:43.957+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 427ms 2016-04-18T07:39:48.963+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 422ms 2016-04-18T07:40:01.431+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:40:23.785+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T07:40:44.629+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:41:02.513+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 397ms 2016-04-18T07:41:02.868+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:41:14.485+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:41:26.811+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:41:33.041+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1570, after asserts: 4010, after connections: 4770, after extra_info: 6690, after globalLock: 7060, after locks: 7060, after network: 7060, after opcounters: 7060, after opcountersRepl: 7060, after repl: 13880, after storageEngine: 16720, after tcmalloc: 18000, after wiredTiger: 24470, at end: 32120 } 2016-04-18T07:41:39.108+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:41:55.635+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:41:58.515+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:42:05.835+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 149ms 2016-04-18T07:42:13.584+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:42:31.450+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:42:48.911+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:43:02.734+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:43:15.553+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 123ms 2016-04-18T07:43:32.988+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 176ms 2016-04-18T07:43:34.113+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:43:40.233+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 504ms 2016-04-18T07:43:42.151+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:44:06.632+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:44:09.190+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:44:26.059+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4870, after asserts: 9550, after connections: 9980, after extra_info: 16880, after globalLock: 19590, after locks: 20620, after network: 21130, after opcounters: 21130, after opcountersRepl: 21130, after repl: 34310, after storageEngine: 37160, after tcmalloc: 39520, after wiredTiger: 49640, at end: 61800 } 2016-04-18T07:44:29.602+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T07:44:46.145+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 169ms 2016-04-18T07:44:47.991+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 139ms 2016-04-18T07:44:48.192+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:45:21.824+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:45:42.438+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:45:49.544+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 218ms 2016-04-18T07:46:02.815+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1627ms 2016-04-18T07:46:08.447+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:46:08.952+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 256ms 2016-04-18T07:46:17.605+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:46:20.309+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:46:42.420+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:46:48.351+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2270, after asserts: 2770, after connections: 3670, after extra_info: 7890, after globalLock: 8050, after locks: 8050, after network: 8050, after opcounters: 8050, after opcountersRepl: 8050, after repl: 21100, after storageEngine: 22320, after tcmalloc: 26120, after wiredTiger: 29640, at end: 39970 } 2016-04-18T07:46:50.457+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:47:10.793+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 131ms 2016-04-18T07:47:16.617+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1223ms 2016-04-18T07:47:31.226+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:47:45.210+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:48:16.024+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:48:24.447+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 464ms 2016-04-18T07:48:27.930+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 551ms 2016-04-18T07:48:33.172+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:48:38.553+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3570, after asserts: 5190, after connections: 5440, after extra_info: 12710, after globalLock: 14320, after locks: 14470, after network: 14560, after opcounters: 14560, after opcountersRepl: 14560, after repl: 32270, after storageEngine: 36660, after tcmalloc: 40720, after wiredTiger: 47410, at end: 49270 } 2016-04-18T07:48:40.296+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:49:07.835+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:49:11.514+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:49:36.997+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 271ms 2016-04-18T07:49:37.418+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:49:44.796+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 195ms 2016-04-18T07:49:58.203+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 171ms 2016-04-18T07:50:01.582+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:50:31.050+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:50:39.446+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:50:52.066+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:50:58.959+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 7490, after asserts: 8240, after connections: 10310, after extra_info: 14250, after globalLock: 16830, after locks: 17740, after network: 18250, after opcounters: 18250, after opcountersRepl: 18250, after repl: 24380, after storageEngine: 26730, after tcmalloc: 28190, after wiredTiger: 33120, at end: 49990 } 2016-04-18T07:51:05.620+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 252ms 2016-04-18T07:51:15.149+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 663ms 2016-04-18T07:51:29.558+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 119ms 2016-04-18T07:51:29.238+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:51:42.190+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:52:16.237+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:52:31.590+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:52:36.456+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 254ms 2016-04-18T07:52:42.015+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 203ms 2016-04-18T07:52:49.014+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 244ms 2016-04-18T07:52:56.249+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1670, after asserts: 4250, after connections: 8380, after extra_info: 11000, after globalLock: 13550, after locks: 14160, after network: 15580, after opcounters: 17120, after opcountersRepl: 17120, after repl: 32710, after storageEngine: 35990, after tcmalloc: 39800, after wiredTiger: 47240, at end: 57260 } 2016-04-18T07:53:01.140+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:53:12.374+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:53:15.889+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:53:42.180+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:53:51.366+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1378ms 2016-04-18T07:53:54.802+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1580ms 2016-04-18T07:53:55.635+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:53:58.829+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 216ms 2016-04-18T07:54:29.343+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:54:41.094+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:55:03.923+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 166ms 2016-04-18T07:55:07.211+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:55:15.422+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3547ms 2016-04-18T07:55:24.873+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:55:33.255+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2660, after asserts: 4430, after connections: 12450, after extra_info: 19440, after globalLock: 21330, after locks: 22410, after network: 24680, after opcounters: 26680, after opcountersRepl: 29300, after repl: 43510, after storageEngine: 47480, after tcmalloc: 51300, after wiredTiger: 60120, at end: 72610 } 2016-04-18T07:55:42.540+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:56:12.014+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T07:56:18.938+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 813ms 2016-04-18T07:56:28.590+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1309ms 2016-04-18T07:56:32.010+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:56:33.116+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 346ms 2016-04-18T07:57:12.434+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:57:33.971+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:57:49.037+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 120ms 2016-04-18T07:57:57.893+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:58:01.450+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2203ms 2016-04-18T07:58:05.329+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 876ms 2016-04-18T07:58:23.263+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:58:31.003+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:58:31.978+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5260, after asserts: 6870, after connections: 7490, after extra_info: 11630, after globalLock: 16210, after locks: 18250, after network: 18620, after opcounters: 18620, after opcountersRepl: 18620, after repl: 36000, after storageEngine: 41780, after tcmalloc: 44960, after wiredTiger: 64380, at end: 75960 } 2016-04-18T07:58:45.856+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T07:59:17.086+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 113ms 2016-04-18T07:59:27.755+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1222ms 2016-04-18T07:59:48.923+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 338ms 2016-04-18T07:59:49.009+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:00:17.888+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:00:50.298+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:01:00.819+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1025ms 2016-04-18T08:01:09.767+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:01:40.278+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:01:49.583+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:01:51.742+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:02:09.789+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4580, after asserts: 7510, after connections: 7980, after extra_info: 11430, after globalLock: 15030, after locks: 18970, after network: 21210, after opcounters: 21800, after opcountersRepl: 21800, after repl: 40100, after storageEngine: 42580, after tcmalloc: 44320, after wiredTiger: 53470, at end: 73680 } 2016-04-18T08:02:40.754+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:02:48.777+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:03:08.541+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 175ms 2016-04-18T08:03:17.066+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2685ms 2016-04-18T08:03:28.917+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 556ms 2016-04-18T08:03:34.748+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:03:54.840+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:04:38.566+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2206ms 2016-04-18T08:04:39.724+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:04:53.536+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 490ms 2016-04-18T08:05:02.443+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:05:02.960+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 333ms 2016-04-18T08:05:03.831+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2970, after asserts: 4620, after connections: 8550, after extra_info: 16490, after globalLock: 18650, after locks: 22710, after network: 24890, after opcounters: 26530, after opcountersRepl: 26670, after repl: 53120, after storageEngine: 57480, after tcmalloc: 69080, after wiredTiger: 74660, at end: 89270 } 2016-04-18T08:05:10.073+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:05:51.065+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:06:12.604+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:06:18.309+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 154ms 2016-04-18T08:06:29.445+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 468ms 2016-04-18T08:06:46.797+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 273ms 2016-04-18T08:07:03.612+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:07:20.429+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:07:47.478+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:08:09.582+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 717ms 2016-04-18T08:08:10.260+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3170, after asserts: 5100, after connections: 5540, after extra_info: 12280, after globalLock: 17810, after locks: 19830, after network: 19990, after opcounters: 19990, after opcountersRepl: 19990, after repl: 25380, after storageEngine: 28820, after tcmalloc: 35600, after wiredTiger: 45560, at end: 58410 } 2016-04-18T08:08:18.723+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1484ms 2016-04-18T08:08:23.606+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:08:41.569+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:09:23.580+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:09:34.319+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 177ms 2016-04-18T08:09:48.845+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 297ms 2016-04-18T08:09:49.414+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:09:59.658+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 208ms 2016-04-18T08:10:45.078+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:11:06.045+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:11:15.845+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 206ms 2016-04-18T08:11:38.522+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2929ms 2016-04-18T08:12:02.066+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:12:33.309+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1510, after asserts: 2460, after connections: 2700, after extra_info: 8110, after globalLock: 9270, after locks: 10310, after network: 11490, after opcounters: 11490, after opcountersRepl: 11490, after repl: 57940, after storageEngine: 60260, after tcmalloc: 67370, after wiredTiger: 89520, at end: 114770 } 2016-04-18T08:12:36.120+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:12:55.249+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2477ms 2016-04-18T08:13:01.080+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:13:13.584+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 748ms 2016-04-18T08:13:25.652+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T08:13:27.739+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 248ms 2016-04-18T08:13:57.153+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:14:46.270+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:14:53.495+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 186ms 2016-04-18T08:15:10.632+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 599ms 2016-04-18T08:15:18.376+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:15:28.468+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 349ms 2016-04-18T08:16:08.115+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:16:24.255+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:16:48.722+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6170, after asserts: 11620, after connections: 13520, after extra_info: 30870, after globalLock: 32020, after locks: 35190, after network: 35910, after opcounters: 35910, after opcountersRepl: 35910, after repl: 65110, after storageEngine: 71140, after tcmalloc: 80440, after wiredTiger: 88840, at end: 110410 } 2016-04-18T08:16:49.722+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 164ms 2016-04-18T08:17:12.468+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:17:13.048+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 549ms 2016-04-18T08:17:34.821+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 147ms 2016-04-18T08:17:58.351+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T08:19:02.813+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 130ms 2016-04-18T08:19:04.766+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:19:17.960+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 526ms 2016-04-18T08:19:29.788+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 176ms 2016-04-18T08:20:16.624+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:20:38.635+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-04-18T08:20:40.263+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:20:50.192+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1036ms 2016-04-18T08:21:42.717+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3420, after asserts: 5710, after connections: 11430, after extra_info: 32610, after globalLock: 39410, after locks: 41230, after network: 42300, after opcounters: 42480, after opcountersRepl: 42480, after repl: 91790, after storageEngine: 94630, after tcmalloc: 97570, after wiredTiger: 105570, at end: 124790 } 2016-04-18T08:21:42.012+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:21:44.841+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 8351ms 2016-04-18T08:21:57.502+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 242ms 2016-04-18T08:21:59.799+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:22:04.994+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 450ms 2016-04-18T08:22:13.801+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:22:17.583+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 321ms 2016-04-18T08:23:12.034+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:23:23.088+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 888ms 2016-04-18T08:23:29.483+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 664ms 2016-04-18T08:23:37.567+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 318ms 2016-04-18T08:23:41.179+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:24:38.581+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:24:51.483+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 179ms 2016-04-18T08:25:07.311+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 847ms 2016-04-18T08:25:07.048+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:25:19.547+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 495ms 2016-04-18T08:25:35.863+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:26:03.417+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3490, after asserts: 6500, after connections: 8600, after extra_info: 12990, after globalLock: 17900, after locks: 23210, after network: 24640, after opcounters: 24640, after opcountersRepl: 24640, after repl: 57830, after storageEngine: 69790, after tcmalloc: 76210, after wiredTiger: 92000, at end: 119180 } 2016-04-18T08:26:11.700+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:26:31.423+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 111ms 2016-04-18T08:26:54.193+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1685ms 2016-04-18T08:26:53.921+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:26:55.243+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:27:02.038+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 299ms 2016-04-18T08:28:07.005+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:28:17.298+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 354ms 2016-04-18T08:28:22.941+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:28:33.713+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 784ms 2016-04-18T08:28:50.260+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 330ms 2016-04-18T08:29:29.311+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:29:59.233+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:30:04.081+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-04-18T08:30:38.188+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 948ms 2016-04-18T08:30:53.242+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 476ms 2016-04-18T08:31:06.003+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:31:21.312+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:31:47.672+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5160, after asserts: 8300, after connections: 13830, after extra_info: 21070, after globalLock: 34020, after locks: 37860, after network: 39640, after opcounters: 40040, after opcountersRepl: 40040, after repl: 80980, after storageEngine: 98550, after tcmalloc: 110960, after wiredTiger: 129340, at end: 154850 } 2016-04-18T08:31:47.495+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:32:13.015+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 250ms 2016-04-18T08:32:30.076+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 871ms 2016-04-18T08:32:41.356+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T08:33:15.193+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:33:34.611+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T08:34:01.347+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 210ms 2016-04-18T08:34:12.899+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 709ms 2016-04-18T08:34:31.346+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:34:34.141+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 153ms 2016-04-18T08:34:55.094+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:35:37.617+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:35:42.689+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 172ms 2016-04-18T08:35:48.792+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1325ms 2016-04-18T08:35:54.351+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:35:54.500+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4550, after asserts: 6140, after connections: 6720, after extra_info: 11560, after globalLock: 15870, after locks: 18390, after network: 20060, after opcounters: 22200, after opcountersRepl: 22410, after repl: 55050, after storageEngine: 57370, after tcmalloc: 58330, after wiredTiger: 66240, at end: 78050 } 2016-04-18T08:35:56.088+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:36:51.017+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 253ms 2016-04-18T08:36:51.160+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:37:00.163+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T08:37:13.998+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:37:52.892+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:38:03.204+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 170ms 2016-04-18T08:38:16.442+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:38:16.924+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 8502ms 2016-04-18T08:38:31.868+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 178ms 2016-04-18T08:38:41.068+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4010, after asserts: 7280, after connections: 9520, after extra_info: 18500, after globalLock: 19990, after locks: 20010, after network: 20180, after opcounters: 20180, after opcountersRepl: 20180, after repl: 46060, after storageEngine: 49520, after tcmalloc: 53990, after wiredTiger: 63400, at end: 76490 } 2016-04-18T08:38:55.579+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:39:09.169+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:39:37.155+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:39:39.661+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 168ms 2016-04-18T08:39:52.470+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 4322ms 2016-04-18T08:39:57.990+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 127ms 2016-04-18T08:40:11.336+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:40:28.593+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:41:15.944+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1239ms 2016-04-18T08:41:19.834+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:41:22.244+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 472ms 2016-04-18T08:41:27.965+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 125ms 2016-04-18T08:41:57.338+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:42:13.817+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:42:22.925+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 9360, after asserts: 13850, after connections: 15120, after extra_info: 16350, after globalLock: 19440, after locks: 22760, after network: 30800, after opcounters: 32010, after opcountersRepl: 33230, after repl: 45380, after storageEngine: 48200, after tcmalloc: 50590, after wiredTiger: 57720, at end: 81230 } 2016-04-18T08:42:32.604+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 101ms 2016-04-18T08:42:47.102+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 265ms 2016-04-18T08:42:55.218+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:42:58.855+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-04-18T08:43:22.818+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:43:34.634+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:44:12.520+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 143ms 2016-04-18T08:44:21.598+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:44:29.940+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2303ms 2016-04-18T08:44:43.550+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 329ms 2016-04-18T08:44:58.370+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:45:14.036+0000 W NETWORK [HostnameCanonicalizationWorker] Failed to obtain address information for hostname ip-172-31-6-169: Name or service not known 2016-04-18T08:45:51.471+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 412ms 2016-04-18T08:45:52.640+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:46:02.061+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 518ms 2016-04-18T08:46:02.007+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3480, after asserts: 5020, after connections: 5920, after extra_info: 9590, after globalLock: 13780, after locks: 14790, after network: 16850, after opcounters: 17060, after opcountersRepl: 17060, after repl: 45160, after storageEngine: 49030, after tcmalloc: 53150, after wiredTiger: 64900, at end: 72800 } 2016-04-18T08:46:09.417+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:46:16.716+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 153ms 2016-04-18T08:46:49.439+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:47:04.526+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:47:18.627+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 265ms 2016-04-18T08:47:24.151+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 106ms 2016-04-18T08:47:26.046+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:47:30.765+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 190ms 2016-04-18T08:47:50.626+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T08:48:08.828+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:48:34.553+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-04-18T08:48:48.424+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 601ms 2016-04-18T08:48:53.434+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:48:56.807+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3400, after asserts: 5710, after connections: 6470, after extra_info: 15740, after globalLock: 17740, after locks: 19370, after network: 20330, after opcounters: 20330, after opcountersRepl: 20330, after repl: 54160, after storageEngine: 57120, after tcmalloc: 60900, after wiredTiger: 69030, at end: 75620 } 2016-04-18T08:48:59.277+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 177ms 2016-04-18T08:49:06.366+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:49:43.930+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:50:03.176+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:50:03.801+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1123ms 2016-04-18T08:50:17.061+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 502ms 2016-04-18T08:50:34.180+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:50:34.451+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 115ms 2016-04-18T08:50:37.864+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:50:40.659+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:51:08.399+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:51:25.656+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2120, after asserts: 3160, after connections: 3710, after extra_info: 7320, after globalLock: 9660, after locks: 12590, after network: 15110, after opcounters: 15340, after opcountersRepl: 15340, after repl: 24660, after storageEngine: 26660, after tcmalloc: 28390, after wiredTiger: 37880, at end: 51740 } 2016-04-18T08:51:32.142+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:51:46.609+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 154ms 2016-04-18T08:52:02.045+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1458ms 2016-04-18T08:52:13.397+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:52:13.939+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 177ms 2016-04-18T08:52:34.623+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:53:07.387+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:53:28.819+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:53:31.684+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:53:33.034+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 145ms 2016-04-18T08:53:41.956+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 437ms 2016-04-18T08:53:43.799+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 790ms 2016-04-18T08:54:08.706+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:54:16.784+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1950, after asserts: 3940, after connections: 6620, after extra_info: 16490, after globalLock: 18730, after locks: 19350, after network: 21530, after opcounters: 22220, after opcountersRepl: 22220, after repl: 39800, after storageEngine: 42110, after tcmalloc: 43840, after wiredTiger: 47460, at end: 60840 } 2016-04-18T08:54:34.615+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:54:54.462+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 368ms 2016-04-18T08:55:04.986+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 774ms 2016-04-18T08:55:12.444+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:55:18.180+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T08:55:27.549+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:55:43.709+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:56:23.820+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:56:28.646+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 406ms 2016-04-18T08:56:35.334+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:56:36.229+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2140ms 2016-04-18T08:56:38.609+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:56:41.920+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 712ms 2016-04-18T08:57:12.524+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:57:26.833+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4700, after asserts: 5240, after connections: 5640, after extra_info: 7830, after globalLock: 12060, after locks: 13260, after network: 16150, after opcounters: 18340, after opcountersRepl: 20400, after repl: 46630, after storageEngine: 47750, after tcmalloc: 51900, after wiredTiger: 62230, at end: 78170 } 2016-04-18T08:57:31.491+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:57:54.310+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 147ms 2016-04-18T08:58:00.131+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:58:05.092+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 397ms 2016-04-18T08:58:18.210+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-18T08:58:26.614+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:59:10.185+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:59:20.444+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 316ms 2016-04-18T08:59:22.749+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:59:32.182+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:59:31.187+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 4462ms 2016-04-18T08:59:40.359+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 416ms 2016-04-18T08:59:40.567+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2700, after asserts: 3190, after connections: 3680, after extra_info: 3890, after globalLock: 7660, after locks: 9610, after network: 9920, after opcounters: 9920, after opcountersRepl: 9920, after repl: 14450, after storageEngine: 19100, after tcmalloc: 23710, after wiredTiger: 39210, at end: 49270 } 2016-04-18T09:00:09.626+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:00:23.075+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T09:00:50.461+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 127ms 2016-04-18T09:01:15.869+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 970ms 2016-04-18T09:01:15.948+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:01:31.174+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:01:58.343+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:02:15.243+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:02:23.163+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2460, after asserts: 3670, after connections: 4200, after extra_info: 11360, after globalLock: 13060, after locks: 20520, after network: 26140, after opcounters: 29400, after opcountersRepl: 33270, after repl: 43020, after storageEngine: 46900, after tcmalloc: 51660, after wiredTiger: 63000, at end: 69960 } 2016-04-18T09:02:24.050+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 280ms 2016-04-18T09:02:31.660+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1683ms 2016-04-18T09:02:40.681+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T09:02:45.331+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 182ms 2016-04-18T09:03:05.478+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T09:03:24.813+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:03:59.335+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 374ms 2016-04-18T09:04:03.267+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:04:07.839+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 658ms 2016-04-18T09:04:24.233+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:04:55.781+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:04:57.737+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 890, after asserts: 1600, after connections: 2890, after extra_info: 5100, after globalLock: 8080, after locks: 11420, after network: 15640, after opcounters: 16230, after opcountersRepl: 16230, after repl: 32220, after storageEngine: 35650, after tcmalloc: 41010, after wiredTiger: 48370, at end: 51780 } 2016-04-18T09:05:02.579+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:05:13.324+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T09:05:17.626+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 819ms 2016-04-18T09:05:32.820+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 169ms 2016-04-18T09:05:32.534+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T09:05:49.687+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:06:09.722+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T09:06:44.040+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 155ms 2016-04-18T09:06:47.879+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:06:52.401+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 618ms 2016-04-18T09:06:56.389+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:07:00.602+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1132ms 2016-04-18T09:07:19.303+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5040, after asserts: 6170, after connections: 7880, after extra_info: 11400, after globalLock: 11690, after locks: 11690, after network: 12090, after opcounters: 16880, after opcountersRepl: 18000, after repl: 27200, after storageEngine: 27490, after tcmalloc: 31380, after wiredTiger: 39620, at end: 54490 } 2016-04-18T09:07:23.345+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:07:40.723+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:08:01.775+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T09:08:18.617+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 868ms 2016-04-18T09:08:31.627+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 404ms 2016-04-18T09:08:32.195+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:08:43.444+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 221ms 2016-04-18T09:08:50.964+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T09:09:29.523+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:09:50.514+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-04-18T09:09:51.308+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 104ms 2016-04-18T09:09:52.254+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:10:05.843+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1006ms 2016-04-18T09:10:39.880+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:10:49.705+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3600, after asserts: 4990, after connections: 5700, after extra_info: 7570, after globalLock: 7680, after locks: 8960, after network: 10320, after opcounters: 10610, after opcountersRepl: 10610, after repl: 46400, after storageEngine: 48980, after tcmalloc: 53560, after wiredTiger: 65440, at end: 79650 } 2016-04-18T09:10:54.536+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:11:16.377+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-04-18T09:11:17.739+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T09:11:18.629+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 101ms 2016-04-18T09:11:22.184+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1510ms 2016-04-18T09:11:37.491+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T09:11:59.942+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:12:31.636+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 375ms 2016-04-18T09:12:34.188+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:12:42.451+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 149ms 2016-04-18T09:12:53.377+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:13:23.854+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:13:37.915+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:13:53.358+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-18T09:13:53.556+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4080, after asserts: 6890, after connections: 8980, after extra_info: 15740, after globalLock: 18370, after locks: 18910, after network: 19050, after opcounters: 19050, after opcountersRepl: 19050, after repl: 39040, after storageEngine: 40770, after tcmalloc: 43350, after wiredTiger: 52830, at end: 71020 } 2016-04-18T09:14:09.002+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1344ms 2016-04-18T09:14:11.319+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:14:12.725+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T09:14:22.933+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T09:14:36.948+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:15:24.881+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 120ms 2016-04-18T09:15:34.025+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T09:15:41.447+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 422ms 2016-04-18T09:15:51.007+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 150ms 2016-04-18T09:15:57.771+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:16:34.193+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:16:51.413+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:16:59.380+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3960, after asserts: 5570, after connections: 6220, after extra_info: 12580, after globalLock: 16950, after locks: 20110, after network: 23830, after opcounters: 23830, after opcountersRepl: 23830, after repl: 46490, after storageEngine: 53680, after tcmalloc: 56930, after wiredTiger: 68870, at end: 80010 } 2016-04-18T09:16:59.290+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 222ms 2016-04-18T09:17:20.753+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 380ms 2016-04-18T09:17:31.881+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 216ms 2016-04-18T09:17:47.056+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:18:19.040+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:18:29.836+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T09:18:41.247+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 188ms 2016-04-18T09:18:58.569+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 896ms 2016-04-18T09:19:07.752+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T09:19:17.634+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-04-18T09:19:36.565+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:20:23.205+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 462ms 2016-04-18T09:20:29.473+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:20:33.143+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 542ms 2016-04-18T09:20:43.771+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 216ms 2016-04-18T09:20:44.849+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:20:45.136+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3620, after asserts: 4700, after connections: 8160, after extra_info: 13460, after globalLock: 17930, after locks: 20300, after network: 21360, after opcounters: 21510, after opcountersRepl: 21510, after repl: 53670, after storageEngine: 56260, after tcmalloc: 59240, after wiredTiger: 73940, at end: 92620 } 2016-04-18T09:21:44.787+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:21:51.885+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 186ms 2016-04-18T09:22:04.772+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:22:05.454+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1223ms 2016-04-18T09:22:24.808+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 294ms 2016-04-18T09:22:43.968+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T09:23:24.099+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T09:23:38.501+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 247ms 2016-04-18T09:23:52.347+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:23:55.523+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1142ms 2016-04-18T09:24:08.232+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 143ms 2016-04-18T09:24:57.319+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:25:22.934+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 356ms 2016-04-18T09:25:29.416+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:25:29.506+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2830, after asserts: 7410, after connections: 8340, after extra_info: 17410, after globalLock: 24800, after locks: 28160, after network: 33600, after opcounters: 40900, after opcountersRepl: 44090, after repl: 74920, after storageEngine: 79190, after tcmalloc: 89540, after wiredTiger: 108400, at end: 122250 } 2016-04-18T09:25:45.329+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 13614ms 2016-04-18T09:26:05.170+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T09:26:55.648+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:27:15.794+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:27:25.369+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 264ms 2016-04-18T09:27:43.069+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 575ms 2016-04-18T09:27:53.821+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T09:27:55.345+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 343ms 2016-04-18T09:28:24.941+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T09:29:01.303+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:29:17.442+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 434ms 2016-04-18T09:29:30.614+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1815ms 2016-04-18T09:29:47.894+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 779ms 2016-04-18T09:30:12.007+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:30:28.285+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3550, after asserts: 5790, after connections: 6370, after extra_info: 13180, after globalLock: 17420, after locks: 20550, after network: 20970, after opcounters: 20970, after opcountersRepl: 20970, after repl: 78090, after storageEngine: 81590, after tcmalloc: 84630, after wiredTiger: 102060, at end: 113920 } 2016-04-18T09:30:59.529+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:31:08.031+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 120ms 2016-04-18T09:31:17.092+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 681ms 2016-04-18T09:31:35.451+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 132ms 2016-04-18T09:32:06.927+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:32:20.677+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T09:32:40.315+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:32:50.875+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T09:33:04.579+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 279ms 2016-04-18T09:33:22.104+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 602ms 2016-04-18T09:33:29.523+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:33:31.176+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 163ms 2016-04-18T09:33:48.699+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:34:10.012+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:34:32.884+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2500, after asserts: 3290, after connections: 3890, after extra_info: 6300, after globalLock: 10710, after locks: 14000, after network: 18000, after opcounters: 20880, after opcountersRepl: 20880, after repl: 32140, after storageEngine: 36040, after tcmalloc: 40810, after wiredTiger: 62820, at end: 77960 } 2016-04-18T09:34:52.229+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1545ms 2016-04-18T09:35:05.573+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 344ms 2016-04-18T09:35:09.408+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T09:35:19.197+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:35:35.675+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:36:13.660+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:36:24.991+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1006ms 2016-04-18T09:36:37.453+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 512ms 2016-04-18T09:36:40.207+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:36:53.870+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T09:37:34.673+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:37:48.629+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1780, after asserts: 2410, after connections: 4310, after extra_info: 9500, after globalLock: 17120, after locks: 19580, after network: 22380, after opcounters: 25700, after opcountersRepl: 27640, after repl: 68060, after storageEngine: 70890, after tcmalloc: 75090, after wiredTiger: 91200, at end: 104030 } 2016-04-18T09:37:52.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:38:05.973+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 114ms 2016-04-18T09:38:21.384+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2526ms 2016-04-18T09:38:26.932+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:38:27.953+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 147ms 2016-04-18T09:38:59.379+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:39:29.286+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:39:34.150+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 111ms 2016-04-18T09:39:41.927+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 443ms 2016-04-18T09:39:51.379+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1817ms 2016-04-18T09:40:11.998+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:40:27.331+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:40:48.990+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4360, after asserts: 6280, after connections: 7070, after extra_info: 12030, after globalLock: 13900, after locks: 14560, after network: 14960, after opcounters: 14960, after opcountersRepl: 14960, after repl: 24010, after storageEngine: 28560, after tcmalloc: 30830, after wiredTiger: 48680, at end: 62000 } 2016-04-18T09:41:03.270+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T09:41:07.809+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:41:15.309+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1039ms 2016-04-18T09:41:26.147+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 240ms 2016-04-18T09:41:29.382+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:42:29.820+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:42:37.518+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 163ms 2016-04-18T09:42:49.295+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 411ms 2016-04-18T09:42:52.822+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:43:01.252+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 167ms 2016-04-18T09:43:29.505+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:43:50.491+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T09:44:18.792+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 206ms 2016-04-18T09:44:30.155+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 588ms 2016-04-18T09:44:32.505+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:44:45.079+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 644ms 2016-04-18T09:44:47.929+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3320, after asserts: 4120, after connections: 4460, after extra_info: 12110, after globalLock: 18270, after locks: 21190, after network: 21740, after opcounters: 21740, after opcountersRepl: 21740, after repl: 49200, after storageEngine: 51560, after tcmalloc: 59340, after wiredTiger: 69150, at end: 94540 } 2016-04-18T09:44:59.448+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:45:54.072+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:45:56.117+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-04-18T09:46:02.392+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1305ms 2016-04-18T09:46:08.325+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:46:14.967+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 407ms 2016-04-18T09:46:46.433+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:46:58.794+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T09:47:27.092+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 120ms 2016-04-18T09:47:32.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:47:35.071+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 878ms 2016-04-18T09:47:43.263+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 171ms 2016-04-18T09:47:46.397+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3970, after asserts: 7280, after connections: 12120, after extra_info: 20060, after globalLock: 22700, after locks: 23950, after network: 24180, after opcounters: 24180, after opcountersRepl: 24180, after repl: 35130, after storageEngine: 38150, after tcmalloc: 41920, after wiredTiger: 53500, at end: 66790 } 2016-04-18T09:47:51.881+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T09:48:40.936+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:48:48.012+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 203ms 2016-04-18T09:48:53.330+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 667ms 2016-04-18T09:49:01.136+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T09:49:05.189+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 137ms 2016-04-18T09:49:39.107+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T09:49:57.598+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:50:24.835+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 153ms 2016-04-18T09:50:37.503+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2221ms 2016-04-18T09:50:38.574+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:50:40.957+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 130ms 2016-04-18T09:50:52.425+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:50:59.048+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2560, after asserts: 4560, after connections: 6740, after extra_info: 14200, after globalLock: 17030, after locks: 17720, after network: 18640, after opcounters: 19720, after opcountersRepl: 19720, after repl: 60670, after storageEngine: 63480, after tcmalloc: 65710, after wiredTiger: 72110, at end: 80910 } 2016-04-18T09:51:12.156+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T09:51:44.546+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 208ms 2016-04-18T09:51:56.850+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1939ms 2016-04-18T09:52:09.374+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:52:25.163+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:53:03.793+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:53:12.949+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 436ms 2016-04-18T09:53:18.558+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:53:22.493+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1313ms 2016-04-18T09:53:56.391+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:54:11.059+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:54:11.059+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2440, after asserts: 4260, after connections: 5300, after extra_info: 11170, after globalLock: 15530, after locks: 18010, after network: 19950, after opcounters: 20720, after opcountersRepl: 20720, after repl: 47520, after storageEngine: 49910, after tcmalloc: 53380, after wiredTiger: 58980, at end: 69340 } 2016-04-18T09:54:29.149+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T09:54:39.600+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 874ms 2016-04-18T09:54:49.925+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:55:12.270+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:55:50.078+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 172ms 2016-04-18T09:55:54.379+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:56:04.899+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1156ms 2016-04-18T09:56:16.174+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 151ms 2016-04-18T09:56:20.201+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:56:42.717+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:56:52.624+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:57:13.786+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1690, after asserts: 4110, after connections: 5490, after extra_info: 13370, after globalLock: 15420, after locks: 15590, after network: 15720, after opcounters: 15720, after opcountersRepl: 15720, after repl: 43310, after storageEngine: 46250, after tcmalloc: 53020, after wiredTiger: 67020, at end: 83990 } 2016-04-18T09:57:22.847+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 174ms 2016-04-18T09:57:33.482+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 999ms 2016-04-18T09:57:40.712+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-04-18T09:57:44.191+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:57:57.853+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:58:25.777+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:58:41.410+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:58:46.962+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 114ms 2016-04-18T09:58:47.817+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 228ms 2016-04-18T09:59:22.110+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T09:59:26.019+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2820, after asserts: 4180, after connections: 5900, after extra_info: 11610, after globalLock: 15480, after locks: 17460, after network: 18270, after opcounters: 18270, after opcountersRepl: 18270, after repl: 43810, after storageEngine: 47840, after tcmalloc: 51530, after wiredTiger: 62460, at end: 69460 } 2016-04-18T09:59:38.168+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:59:49.236+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 896ms 2016-04-18T09:59:57.392+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 712ms 2016-04-18T10:00:00.667+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:00:16.344+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:00:55.255+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:01:03.236+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 108ms 2016-04-18T10:01:15.806+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:01:18.070+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1315ms 2016-04-18T10:01:47.056+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:02:02.786+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3800, after asserts: 4660, after connections: 6450, after extra_info: 13070, after globalLock: 15920, after locks: 17170, after network: 17520, after opcounters: 17520, after opcountersRepl: 17520, after repl: 45360, after storageEngine: 48330, after tcmalloc: 50710, after wiredTiger: 56940, at end: 67200 } 2016-04-18T10:02:03.434+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:02:21.401+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 255ms 2016-04-18T10:02:33.302+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 601ms 2016-04-18T10:02:40.336+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 142ms 2016-04-18T10:02:44.521+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:02:54.258+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:03:17.379+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:03:29.943+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:03:49.934+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 347ms 2016-04-18T10:04:01.583+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 486ms 2016-04-18T10:04:01.649+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:04:07.101+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 182ms 2016-04-18T10:04:07.953+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:04:13.654+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2370, after asserts: 2770, after connections: 3890, after extra_info: 6790, after globalLock: 8910, after locks: 12630, after network: 14060, after opcounters: 14060, after opcountersRepl: 14060, after repl: 36080, after storageEngine: 38030, after tcmalloc: 41230, after wiredTiger: 45720, at end: 50730 } 2016-04-18T10:04:36.499+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:04:48.020+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:05:09.393+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 118ms 2016-04-18T10:05:16.469+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 427ms 2016-04-18T10:05:21.154+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 236ms 2016-04-18T10:05:26.515+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 34465ms 2016-04-18T10:05:27.038+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:05:40.961+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:06:02.910+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:06:27.998+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 314ms 2016-04-18T10:06:30.293+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:06:32.603+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1860, after asserts: 3120, after connections: 3670, after extra_info: 9950, after globalLock: 11530, after locks: 13170, after network: 15010, after opcounters: 15010, after opcountersRepl: 15010, after repl: 42870, after storageEngine: 44250, after tcmalloc: 48150, after wiredTiger: 54500, at end: 67870 } 2016-04-18T10:06:37.283+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 864ms 2016-04-18T10:06:41.073+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:06:45.567+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 106ms 2016-04-18T10:07:14.105+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:07:37.488+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:07:46.776+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 151ms 2016-04-18T10:07:55.094+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1476ms 2016-04-18T10:08:10.437+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:08:24.659+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:09:02.570+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 444ms 2016-04-18T10:09:05.100+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:09:07.128+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 593ms 2016-04-18T10:09:11.085+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2510, after asserts: 4460, after connections: 8940, after extra_info: 14500, after globalLock: 18120, after locks: 19570, after network: 19660, after opcounters: 19660, after opcountersRepl: 19660, after repl: 42580, after storageEngine: 45970, after tcmalloc: 48080, after wiredTiger: 62870, at end: 69010 } 2016-04-18T10:09:14.711+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:09:53.396+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:10:10.399+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 416ms 2016-04-18T10:10:16.972+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:10:19.579+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1024ms 2016-04-18T10:10:29.792+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 109ms 2016-04-18T10:10:54.908+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:11:12.680+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:11:35.087+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 124ms 2016-04-18T10:11:38.048+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:11:41.298+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 531ms 2016-04-18T10:11:49.131+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 270ms 2016-04-18T10:11:51.168+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:11:57.693+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2990, after asserts: 6290, after connections: 8750, after extra_info: 18060, after globalLock: 22580, after locks: 24300, after network: 25900, after opcounters: 26340, after opcountersRepl: 26340, after repl: 52890, after storageEngine: 53930, after tcmalloc: 55360, after wiredTiger: 59040, at end: 66760 } 2016-04-18T10:12:06.092+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:12:22.298+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:12:36.011+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:12:54.553+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 279ms 2016-04-18T10:13:11.129+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2394ms 2016-04-18T10:13:14.357+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:13:32.834+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:14:16.000+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 247ms 2016-04-18T10:14:17.378+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:14:21.492+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 539ms 2016-04-18T10:14:29.985+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4800, after asserts: 7080, after connections: 11340, after extra_info: 16330, after globalLock: 20070, after locks: 23860, after network: 24370, after opcounters: 24370, after opcountersRepl: 24370, after repl: 34370, after storageEngine: 36460, after tcmalloc: 38360, after wiredTiger: 45860, at end: 52540 } 2016-04-18T10:14:31.121+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:14:56.412+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 42702ms 2016-04-18T10:15:02.963+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:15:10.794+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:15:29.086+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 168ms 2016-04-18T10:15:33.935+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 813ms 2016-04-18T10:15:36.361+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T10:15:47.177+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:16:05.241+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:16:36.828+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:16:46.087+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1220, after asserts: 4120, after connections: 5450, after extra_info: 9690, after globalLock: 11990, after locks: 13040, after network: 14070, after opcounters: 14070, after opcountersRepl: 14070, after repl: 44700, after storageEngine: 46690, after tcmalloc: 51050, after wiredTiger: 55160, at end: 64710 } 2016-04-18T10:16:49.634+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:16:50.887+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 967ms 2016-04-18T10:16:56.653+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 782ms 2016-04-18T10:17:05.820+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 212ms 2016-04-18T10:17:21.595+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:17:45.766+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:18:07.148+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 121ms 2016-04-18T10:18:14.052+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 263ms 2016-04-18T10:18:14.250+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:18:22.728+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:18:41.591+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1940, after asserts: 2640, after connections: 2980, after extra_info: 5790, after globalLock: 6250, after locks: 6390, after network: 6390, after opcounters: 6390, after opcountersRepl: 6390, after repl: 11900, after storageEngine: 13880, after tcmalloc: 15550, after wiredTiger: 21130, at end: 30070 } 2016-04-18T10:18:42.256+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:19:17.462+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 106ms 2016-04-18T10:19:23.539+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:19:25.109+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 545ms 2016-04-18T10:19:32.465+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 107ms 2016-04-18T10:19:43.833+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:20:03.550+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:20:28.612+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:20:40.279+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 121ms 2016-04-18T10:20:50.845+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1087ms 2016-04-18T10:21:04.989+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:21:19.070+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:21:35.186+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3600, after asserts: 5380, after connections: 7600, after extra_info: 15710, after globalLock: 18420, after locks: 19960, after network: 20500, after opcounters: 20500, after opcountersRepl: 20500, after repl: 40690, after storageEngine: 41720, after tcmalloc: 45950, after wiredTiger: 64240, at end: 75400 } 2016-04-18T10:21:55.593+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1618ms 2016-04-18T10:21:57.800+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 150ms 2016-04-18T10:22:03.989+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:22:57.285+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:22:59.937+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 231ms 2016-04-18T10:23:14.634+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:23:14.848+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2000ms 2016-04-18T10:23:52.117+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:24:10.998+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:24:25.040+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1345ms 2016-04-18T10:24:28.807+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:24:37.767+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T10:24:41.907+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:24:49.768+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5220, after asserts: 6520, after connections: 6800, after extra_info: 8560, after globalLock: 11430, after locks: 13370, after network: 13580, after opcounters: 13580, after opcountersRepl: 13580, after repl: 34600, after storageEngine: 38090, after tcmalloc: 40710, after wiredTiger: 52340, at end: 61410 } 2016-04-18T10:25:11.436+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:25:28.947+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:25:46.539+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1237ms 2016-04-18T10:26:03.763+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 218ms 2016-04-18T10:26:05.866+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:26:34.270+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:27:14.855+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:27:18.059+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 353ms 2016-04-18T10:27:32.252+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 808ms 2016-04-18T10:27:38.820+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:27:42.022+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 520ms 2016-04-18T10:27:58.544+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5540, after asserts: 7190, after connections: 10340, after extra_info: 20310, after globalLock: 22060, after locks: 24590, after network: 24910, after opcounters: 24910, after opcountersRepl: 24910, after repl: 54310, after storageEngine: 58770, after tcmalloc: 63310, after wiredTiger: 76200, at end: 92460 } 2016-04-18T10:28:17.811+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:28:43.792+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 114ms 2016-04-18T10:28:53.698+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:29:04.886+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 408ms 2016-04-18T10:29:10.175+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 532ms 2016-04-18T10:29:38.614+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:30:00.241+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:30:23.219+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 498ms 2016-04-18T10:30:35.068+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:30:36.957+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 711ms 2016-04-18T10:30:48.326+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:31:01.982+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3690, after asserts: 5160, after connections: 5580, after extra_info: 8160, after globalLock: 10000, after locks: 11830, after network: 14190, after opcounters: 15900, after opcountersRepl: 17000, after repl: 39950, after storageEngine: 42570, after tcmalloc: 48890, after wiredTiger: 57270, at end: 74570 } 2016-04-18T10:31:29.835+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:31:41.308+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:31:45.304+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 120ms 2016-04-18T10:31:54.613+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1135ms 2016-04-18T10:32:08.031+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 150ms 2016-04-18T10:32:12.421+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:32:21.050+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:32:58.440+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:33:14.960+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 187ms 2016-04-18T10:33:15.269+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:33:20.540+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1410, after asserts: 3580, after connections: 5910, after extra_info: 11460, after globalLock: 12100, after locks: 13520, after network: 16320, after opcounters: 16410, after opcountersRepl: 16410, after repl: 24930, after storageEngine: 27650, after tcmalloc: 31890, after wiredTiger: 44780, at end: 52160 } 2016-04-18T10:33:49.954+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:34:06.240+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:34:17.292+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 192ms 2016-04-18T10:34:26.023+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1965ms 2016-04-18T10:34:35.753+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:34:37.874+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 191ms 2016-04-18T10:34:54.832+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:35:15.347+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:35:48.162+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 806ms 2016-04-18T10:35:48.397+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2290, after asserts: 5650, after connections: 6670, after extra_info: 10680, after globalLock: 12330, after locks: 13640, after network: 14510, after opcounters: 14620, after opcountersRepl: 14620, after repl: 40800, after storageEngine: 47290, after tcmalloc: 54740, after wiredTiger: 62390, at end: 73440 } 2016-04-18T10:35:51.472+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:35:55.554+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 790ms 2016-04-18T10:36:10.626+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:36:47.297+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:37:07.865+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 181ms 2016-04-18T10:37:09.088+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:37:13.684+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1558ms 2016-04-18T10:37:40.459+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:37:57.772+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:38:21.165+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 150ms 2016-04-18T10:38:22.588+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2650, after asserts: 3430, after connections: 5140, after extra_info: 12620, after globalLock: 15170, after locks: 16290, after network: 16290, after opcounters: 16290, after opcountersRepl: 16290, after repl: 34760, after storageEngine: 38030, after tcmalloc: 41170, after wiredTiger: 50340, at end: 58220 } 2016-04-18T10:38:28.739+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 734ms 2016-04-18T10:38:35.195+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:38:38.698+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 123ms 2016-04-18T10:39:00.721+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:39:51.361+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:39:52.723+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 152ms 2016-04-18T10:39:58.161+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1408ms 2016-04-18T10:40:06.346+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:40:08.603+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 304ms 2016-04-18T10:40:31.430+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:40:49.053+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:40:52.839+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2240, after asserts: 4410, after connections: 6420, after extra_info: 11580, after globalLock: 13990, after locks: 15210, after network: 15580, after opcounters: 15580, after opcountersRepl: 15580, after repl: 29070, after storageEngine: 30410, after tcmalloc: 35350, after wiredTiger: 44700, at end: 60020 } 2016-04-18T10:41:19.110+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 847ms 2016-04-18T10:41:37.282+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:41:52.198+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:42:27.043+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 147ms 2016-04-18T10:42:29.529+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:42:36.816+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 598ms 2016-04-18T10:42:44.739+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:43:21.516+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:43:28.128+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3360, after asserts: 6930, after connections: 7630, after extra_info: 10250, after globalLock: 13690, after locks: 15030, after network: 16200, after opcounters: 16630, after opcountersRepl: 16630, after repl: 35120, after storageEngine: 36990, after tcmalloc: 41470, after wiredTiger: 45950, at end: 52290 } 2016-04-18T10:43:28.227+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:43:38.287+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 419ms 2016-04-18T10:43:49.665+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 163ms 2016-04-18T10:44:03.683+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:44:25.036+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:44:53.035+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 159ms 2016-04-18T10:45:01.749+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 999ms 2016-04-18T10:45:03.051+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:45:23.837+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:45:50.643+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:46:03.849+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2970, after asserts: 4320, after connections: 9640, after extra_info: 17380, after globalLock: 21960, after locks: 24870, after network: 27510, after opcounters: 30050, after opcountersRepl: 30230, after repl: 49310, after storageEngine: 51840, after tcmalloc: 55200, after wiredTiger: 66250, at end: 76770 } 2016-04-18T10:46:10.961+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 122ms 2016-04-18T10:46:11.341+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:46:20.262+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1319ms 2016-04-18T10:46:42.367+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:47:05.842+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:47:16.460+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:47:27.573+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1381ms 2016-04-18T10:47:38.965+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1382ms 2016-04-18T10:47:49.846+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:47:59.835+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:48:33.232+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:48:44.542+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1590, after asserts: 3200, after connections: 5850, after extra_info: 15790, after globalLock: 19210, after locks: 21930, after network: 23420, after opcounters: 24340, after opcountersRepl: 24340, after repl: 46560, after storageEngine: 47080, after tcmalloc: 51480, after wiredTiger: 60070, at end: 69040 } 2016-04-18T10:48:46.988+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:48:51.872+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 464ms 2016-04-18T10:48:58.927+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 598ms 2016-04-18T10:49:03.288+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-18T10:49:18.781+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:49:42.799+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:50:06.862+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 116ms 2016-04-18T10:50:12.372+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:50:16.316+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1575ms 2016-04-18T10:50:38.111+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:51:06.977+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2480, after asserts: 4880, after connections: 7380, after extra_info: 10660, after globalLock: 14260, after locks: 16810, after network: 17710, after opcounters: 17710, after opcountersRepl: 17710, after repl: 39660, after storageEngine: 41060, after tcmalloc: 41780, after wiredTiger: 53690, at end: 66050 } 2016-04-18T10:51:07.377+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:51:29.356+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:51:30.336+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 480ms 2016-04-18T10:51:46.094+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 428ms 2016-04-18T10:51:57.695+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 206ms 2016-04-18T10:52:19.662+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:52:36.551+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:52:58.941+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 951ms 2016-04-18T10:53:08.299+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 246ms 2016-04-18T10:53:30.087+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:53:47.818+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:54:17.728+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 7950, after asserts: 8750, after connections: 9780, after extra_info: 15270, after globalLock: 16900, after locks: 19110, after network: 21050, after opcounters: 21310, after opcountersRepl: 21310, after repl: 40320, after storageEngine: 43910, after tcmalloc: 48540, after wiredTiger: 58070, at end: 66170 } 2016-04-18T10:54:22.448+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:54:24.849+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 168ms 2016-04-18T10:54:27.102+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:54:30.076+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2415ms 2016-04-18T10:54:36.715+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 335ms 2016-04-18T10:55:10.640+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:55:34.006+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:55:47.574+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 151ms 2016-04-18T10:55:55.997+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 396ms 2016-04-18T10:55:59.367+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:56:01.023+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 237ms 2016-04-18T10:56:20.155+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:56:32.688+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1780, after asserts: 3660, after connections: 4050, after extra_info: 8380, after globalLock: 8860, after locks: 9010, after network: 9100, after opcounters: 9100, after opcountersRepl: 9100, after repl: 17670, after storageEngine: 20450, after tcmalloc: 23840, after wiredTiger: 38240, at end: 48500 } 2016-04-18T10:56:59.102+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:57:12.946+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 149ms 2016-04-18T10:57:17.408+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 684ms 2016-04-18T10:57:17.374+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:57:25.229+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-18T10:57:51.578+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:58:06.719+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:58:08.521+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 3234ms 2016-04-18T10:58:33.436+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-18T10:58:38.838+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:58:41.773+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 150ms 2016-04-18T10:58:51.533+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 123ms 2016-04-18T10:58:52.166+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4860, after asserts: 6740, after connections: 10440, after extra_info: 16690, after globalLock: 17930, after locks: 18050, after network: 18160, after opcounters: 18160, after opcountersRepl: 18160, after repl: 43140, after storageEngine: 45640, after tcmalloc: 46700, after wiredTiger: 53020, at end: 64560 } 2016-04-18T10:58:57.721+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:59:27.326+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:59:47.958+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:00:02.178+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 227ms 2016-04-18T11:00:10.542+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1516ms 2016-04-18T11:00:23.801+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 217ms 2016-04-18T11:00:24.887+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:00:35.609+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:01:06.132+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:01:18.133+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:01:29.240+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3220, after asserts: 5150, after connections: 6710, after extra_info: 14450, after globalLock: 16900, after locks: 16980, after network: 18060, after opcounters: 19860, after opcountersRepl: 19860, after repl: 38230, after storageEngine: 42380, after tcmalloc: 46470, after wiredTiger: 62030, at end: 74140 } 2016-04-18T11:01:32.422+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 385ms 2016-04-18T11:01:45.452+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 604ms 2016-04-18T11:01:59.736+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:02:13.333+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:02:49.718+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:02:51.266+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 270ms 2016-04-18T11:02:56.619+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 452ms 2016-04-18T11:03:06.059+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:03:36.034+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:03:59.716+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:04:01.487+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 119ms 2016-04-18T11:04:01.598+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3880, after asserts: 4800, after connections: 5250, after extra_info: 8180, after globalLock: 10180, after locks: 10480, after network: 10900, after opcounters: 10900, after opcountersRepl: 10900, after repl: 31870, after storageEngine: 34500, after tcmalloc: 43820, after wiredTiger: 55100, at end: 69400 } 2016-04-18T11:04:11.369+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1035ms 2016-04-18T11:04:22.533+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 176ms 2016-04-18T11:04:47.407+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:04:56.576+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:05:23.982+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:05:29.943+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 560ms 2016-04-18T11:05:38.085+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 145ms 2016-04-18T11:05:41.637+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:05:47.557+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 109ms 2016-04-18T11:06:22.183+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:06:34.515+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:06:50.880+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2870, after asserts: 4580, after connections: 7730, after extra_info: 15430, after globalLock: 17500, after locks: 18430, after network: 20330, after opcounters: 23640, after opcountersRepl: 25700, after repl: 33430, after storageEngine: 37620, after tcmalloc: 43460, after wiredTiger: 52710, at end: 69190 } 2016-04-18T11:06:55.144+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 953ms 2016-04-18T11:07:01.444+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:07:04.164+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 539ms 2016-04-18T11:07:11.479+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 119ms 2016-04-18T11:07:20.154+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:08:01.509+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:08:15.003+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:08:23.527+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 912ms 2016-04-18T11:08:34.408+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 162ms 2016-04-18T11:08:45.449+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T11:08:46.636+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:08:47.378+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:09:04.566+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5190, after asserts: 6930, after connections: 7860, after extra_info: 9220, after globalLock: 9550, after locks: 9720, after network: 9850, after opcounters: 9850, after opcountersRepl: 9850, after repl: 19330, after storageEngine: 20160, after tcmalloc: 27270, after wiredTiger: 29330, at end: 45830 } 2016-04-18T11:09:04.803+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:09:18.981+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:09:48.941+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 298ms 2016-04-18T11:09:52.209+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:10:04.013+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 917ms 2016-04-18T11:10:19.825+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 321ms 2016-04-18T11:10:44.992+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:10:58.964+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:11:33.518+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 533ms 2016-04-18T11:11:39.137+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:11:48.957+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2620, after asserts: 3760, after connections: 4090, after extra_info: 6200, after globalLock: 9500, after locks: 10100, after network: 10270, after opcounters: 10270, after opcountersRepl: 10270, after repl: 36220, after storageEngine: 38470, after tcmalloc: 43290, after wiredTiger: 51880, at end: 64850 } 2016-04-18T11:11:50.814+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:12:16.451+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:12:34.110+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:12:42.083+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 818ms 2016-04-18T11:12:45.837+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 262ms 2016-04-18T11:12:58.949+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 190ms 2016-04-18T11:13:07.390+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:13:28.164+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:13:58.563+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:13:59.714+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5600, after asserts: 6290, after connections: 6450, after extra_info: 6990, after globalLock: 8090, after locks: 8900, after network: 8900, after opcounters: 8900, after opcountersRepl: 8900, after repl: 18460, after storageEngine: 21250, after tcmalloc: 29090, after wiredTiger: 33240, at end: 49460 } 2016-04-18T11:14:08.185+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 155ms 2016-04-18T11:14:18.351+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1150ms 2016-04-18T11:14:33.848+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:14:49.936+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:15:20.344+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:15:28.922+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 141ms 2016-04-18T11:15:35.949+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 606ms 2016-04-18T11:15:36.989+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:15:37.641+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 176ms 2016-04-18T11:16:03.678+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:16:20.201+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:16:33.026+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3500, after asserts: 4450, after connections: 4820, after extra_info: 6530, after globalLock: 8070, after locks: 11950, after network: 13370, after opcounters: 13940, after opcountersRepl: 13940, after repl: 32110, after storageEngine: 36030, after tcmalloc: 43710, after wiredTiger: 53410, at end: 74960 } 2016-04-18T11:16:39.173+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 107ms 2016-04-18T11:16:40.573+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 341ms 2016-04-18T11:16:56.834+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:17:21.943+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:17:43.109+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 314ms 2016-04-18T11:18:02.056+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:18:04.412+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 4247ms 2016-04-18T11:18:18.317+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 193ms 2016-04-18T11:18:19.451+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:18:55.788+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:19:17.528+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:19:19.006+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3340, after asserts: 5510, after connections: 7330, after extra_info: 20000, after globalLock: 23010, after locks: 24670, after network: 25160, after opcounters: 25160, after opcountersRepl: 25160, after repl: 38630, after storageEngine: 41930, after tcmalloc: 49610, after wiredTiger: 59550, at end: 74800 } 2016-04-18T11:19:30.824+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 132ms 2016-04-18T11:19:40.073+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 597ms 2016-04-18T11:20:08.880+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:20:29.654+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:20:43.351+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 116ms 2016-04-18T11:20:53.730+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 407ms 2016-04-18T11:21:04.278+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 118ms 2016-04-18T11:21:08.175+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:21:32.952+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:22:08.749+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 45041ms 2016-04-18T11:22:13.727+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 787ms 2016-04-18T11:22:21.949+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 175ms 2016-04-18T11:22:24.858+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:22:39.733+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:22:42.247+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2220, after asserts: 3910, after connections: 8900, after extra_info: 16350, after globalLock: 20610, after locks: 22300, after network: 23110, after opcounters: 24150, after opcountersRepl: 24150, after repl: 60420, after storageEngine: 62240, after tcmalloc: 65430, after wiredTiger: 73530, at end: 82710 } 2016-04-18T11:23:01.201+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:23:33.717+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 850ms 2016-04-18T11:23:44.430+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 668ms 2016-04-18T11:23:50.732+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:23:54.107+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 114ms 2016-04-18T11:24:37.911+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:25:08.228+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:25:11.792+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 397ms 2016-04-18T11:25:23.175+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 532ms 2016-04-18T11:25:32.592+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:25:33.400+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1217ms 2016-04-18T11:25:49.582+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:26:09.111+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1540, after asserts: 2600, after connections: 3010, after extra_info: 8180, after globalLock: 11550, after locks: 14130, after network: 16930, after opcounters: 19620, after opcountersRepl: 19620, after repl: 33930, after storageEngine: 37910, after tcmalloc: 39780, after wiredTiger: 56830, at end: 72960 } 2016-04-18T11:26:33.506+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:26:49.209+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 116ms 2016-04-18T11:27:04.213+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1341ms 2016-04-18T11:27:10.917+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:27:53.283+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:28:06.219+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:28:12.822+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 127ms 2016-04-18T11:28:22.950+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 624ms 2016-04-18T11:28:33.733+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1129ms 2016-04-18T11:28:46.766+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:29:02.822+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2620, after asserts: 4710, after connections: 6610, after extra_info: 9600, after globalLock: 11120, after locks: 12920, after network: 13670, after opcounters: 13670, after opcountersRepl: 13670, after repl: 31470, after storageEngine: 34220, after tcmalloc: 39500, after wiredTiger: 53210, at end: 62370 } 2016-04-18T11:29:06.334+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:29:47.972+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1284ms 2016-04-18T11:29:50.145+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:29:52.644+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 540ms 2016-04-18T11:29:57.702+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:30:02.055+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 101ms 2016-04-18T11:30:23.141+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:30:40.779+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:31:14.494+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 257ms 2016-04-18T11:31:20.248+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:31:23.647+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 822ms 2016-04-18T11:31:33.382+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:31:34.872+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1898ms 2016-04-18T11:31:35.275+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4150, after asserts: 8740, after connections: 10220, after extra_info: 14570, after globalLock: 17810, after locks: 18470, after network: 18710, after opcounters: 18710, after opcountersRepl: 18710, after repl: 44760, after storageEngine: 48450, after tcmalloc: 52070, after wiredTiger: 63690, at end: 69960 } 2016-04-18T11:32:14.231+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:32:31.749+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:32:42.907+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 531ms 2016-04-18T11:32:51.439+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 760ms 2016-04-18T11:32:58.120+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 147ms 2016-04-18T11:33:12.921+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:33:40.594+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:34:01.969+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-04-18T11:34:13.376+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:34:19.238+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3572ms 2016-04-18T11:34:27.724+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:34:43.030+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2760, after asserts: 4670, after connections: 5160, after extra_info: 10420, after globalLock: 13630, after locks: 15320, after network: 16570, after opcounters: 21030, after opcountersRepl: 23690, after repl: 51520, after storageEngine: 52450, after tcmalloc: 58180, after wiredTiger: 77480, at end: 89970 } 2016-04-18T11:35:07.221+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:35:23.407+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 234ms 2016-04-18T11:35:34.298+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:35:39.472+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1262ms 2016-04-18T11:35:52.256+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 130ms 2016-04-18T11:36:06.563+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:36:29.540+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:36:58.071+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 329ms 2016-04-18T11:37:08.065+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 141ms 2016-04-18T11:37:09.518+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:37:19.900+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 109ms 2016-04-18T11:37:30.357+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:38:06.427+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:38:07.317+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5640, after asserts: 7190, after connections: 8800, after extra_info: 12110, after globalLock: 14900, after locks: 17360, after network: 17750, after opcounters: 18600, after opcountersRepl: 18600, after repl: 42070, after storageEngine: 45660, after tcmalloc: 52020, after wiredTiger: 65310, at end: 75670 } 2016-04-18T11:38:30.773+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 327ms 2016-04-18T11:38:37.788+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:38:42.281+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 403ms 2016-04-18T11:38:52.664+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:39:20.676+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:39:38.257+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:39:51.898+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 163ms 2016-04-18T11:39:59.727+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 459ms 2016-04-18T11:40:10.768+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:40:10.960+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1089ms 2016-04-18T11:40:30.103+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:40:50.480+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5020, after asserts: 6470, after connections: 8550, after extra_info: 15780, after globalLock: 19570, after locks: 22450, after network: 24580, after opcounters: 24600, after opcountersRepl: 24600, after repl: 35590, after storageEngine: 40560, after tcmalloc: 48580, after wiredTiger: 59240, at end: 70330 } 2016-04-18T11:41:06.107+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:41:31.200+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 563ms 2016-04-18T11:41:41.055+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:42:18.740+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:42:38.838+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T11:42:46.047+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:42:50.892+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1468ms 2016-04-18T11:42:57.739+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T11:43:15.760+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:43:34.907+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:43:43.923+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2820, after asserts: 3820, after connections: 5670, after extra_info: 8550, after globalLock: 11990, after locks: 17050, after network: 18100, after opcounters: 20460, after opcountersRepl: 21280, after repl: 36700, after storageEngine: 39270, after tcmalloc: 44050, after wiredTiger: 52090, at end: 63930 } 2016-04-18T11:44:05.155+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 483ms 2016-04-18T11:44:13.178+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 315ms 2016-04-18T11:44:24.208+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1169ms 2016-04-18T11:44:35.518+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:44:42.785+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:45:08.811+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:45:23.207+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:45:35.839+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 863ms 2016-04-18T11:45:52.814+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 5579ms 2016-04-18T11:45:54.687+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:45:57.630+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T11:46:14.504+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3300, after asserts: 4680, after connections: 7420, after extra_info: 12270, after globalLock: 15380, after locks: 16250, after network: 16540, after opcounters: 16540, after opcountersRepl: 16540, after repl: 39260, after storageEngine: 39900, after tcmalloc: 42650, after wiredTiger: 51850, at end: 60030 } 2016-04-18T11:46:15.624+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:46:42.956+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:47:14.347+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 472ms 2016-04-18T11:47:21.312+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1440ms 2016-04-18T11:47:23.266+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 210ms 2016-04-18T11:47:41.222+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:48:06.952+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:48:30.940+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 330ms 2016-04-18T11:48:38.276+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 122ms 2016-04-18T11:48:42.361+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2471ms 2016-04-18T11:48:54.172+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:49:10.838+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:49:27.754+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4550, after asserts: 6510, after connections: 7340, after extra_info: 12720, after globalLock: 14480, after locks: 14480, after network: 14480, after opcounters: 14480, after opcountersRepl: 14480, after repl: 29310, after storageEngine: 34310, after tcmalloc: 40120, after wiredTiger: 50470, at end: 66060 } 2016-04-18T11:49:50.919+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:49:51.829+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 200ms 2016-04-18T11:50:05.534+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 829ms 2016-04-18T11:50:17.299+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:50:46.706+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:50:55.614+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:51:13.075+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 259ms 2016-04-18T11:51:25.986+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 106ms 2016-04-18T11:51:28.963+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:52:05.050+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:52:24.064+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3070, after asserts: 3660, after connections: 4070, after extra_info: 9090, after globalLock: 11850, after locks: 15140, after network: 16340, after opcounters: 16340, after opcountersRepl: 16340, after repl: 43800, after storageEngine: 45720, after tcmalloc: 47080, after wiredTiger: 58960, at end: 66040 } 2016-04-18T11:52:39.095+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:52:42.908+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 172ms 2016-04-18T11:52:55.322+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:52:55.884+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 384ms 2016-04-18T11:53:00.471+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 224ms 2016-04-18T11:53:45.528+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:54:04.415+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:54:11.510+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 218ms 2016-04-18T11:54:15.820+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 111ms 2016-04-18T11:54:47.005+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:55:02.110+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:55:18.489+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 103ms 2016-04-18T11:55:23.644+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1570ms 2016-04-18T11:55:34.812+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T11:55:35.638+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:55:55.074+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2100, after asserts: 3340, after connections: 5090, after extra_info: 9540, after globalLock: 13930, after locks: 16230, after network: 19480, after opcounters: 23140, after opcountersRepl: 25420, after repl: 51860, after storageEngine: 52970, after tcmalloc: 56890, after wiredTiger: 73970, at end: 88540 } 2016-04-18T11:56:01.961+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:56:34.034+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:56:50.633+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 127ms 2016-04-18T11:56:53.477+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:57:03.069+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 568ms 2016-04-18T11:57:15.595+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 182ms 2016-04-18T11:57:27.981+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:57:47.717+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:58:23.234+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-04-18T11:58:25.534+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:58:33.015+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 553ms 2016-04-18T11:58:43.731+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:58:43.673+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T11:58:48.526+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1750, after asserts: 4090, after connections: 6330, after extra_info: 14840, after globalLock: 16230, after locks: 16440, after network: 16770, after opcounters: 16770, after opcountersRepl: 16770, after repl: 42120, after storageEngine: 44660, after tcmalloc: 48590, after wiredTiger: 61430, at end: 75610 } 2016-04-18T11:59:27.253+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:59:37.912+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:59:54.011+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 243ms 2016-04-18T12:00:03.131+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 777ms 2016-04-18T12:00:17.103+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:00:41.453+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:01:14.678+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T12:01:22.897+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:01:25.296+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1018ms 2016-04-18T12:01:28.800+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 168ms 2016-04-18T12:01:32.653+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:01:32.791+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4150, after asserts: 5780, after connections: 10650, after extra_info: 25150, after globalLock: 27980, after locks: 30650, after network: 32820, after opcounters: 33180, after opcountersRepl: 33180, after repl: 59700, after storageEngine: 63960, after tcmalloc: 68170, after wiredTiger: 79220, at end: 89280 } 2016-04-18T12:02:15.951+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:02:34.255+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 172ms 2016-04-18T12:02:35.007+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:02:43.828+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 526ms 2016-04-18T12:03:01.315+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 285ms 2016-04-18T12:03:15.800+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:03:31.256+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:04:11.036+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2410, after asserts: 3850, after connections: 4730, after extra_info: 8240, after globalLock: 10150, after locks: 11450, after network: 11660, after opcounters: 11660, after opcountersRepl: 11660, after repl: 29080, after storageEngine: 31850, after tcmalloc: 38140, after wiredTiger: 49200, at end: 61190 } 2016-04-18T12:04:11.715+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:04:12.199+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 456ms 2016-04-18T12:04:27.445+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T12:04:33.633+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:05:25.434+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:05:41.978+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 166ms 2016-04-18T12:05:42.129+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:05:43.854+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 404ms 2016-04-18T12:05:48.474+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 300ms 2016-04-18T12:06:09.902+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:06:29.616+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:07:01.628+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 282ms 2016-04-18T12:07:06.485+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:07:14.981+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1052ms 2016-04-18T12:07:16.315+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 354ms 2016-04-18T12:07:23.361+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3830, after asserts: 6030, after connections: 7800, after extra_info: 15960, after globalLock: 16820, after locks: 16890, after network: 17910, after opcounters: 19640, after opcountersRepl: 19720, after repl: 44190, after storageEngine: 47080, after tcmalloc: 51240, after wiredTiger: 63520, at end: 72700 } 2016-04-18T12:07:23.842+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:08:03.642+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:08:18.343+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:08:26.321+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 102ms 2016-04-18T12:08:42.391+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1250ms 2016-04-18T12:08:59.224+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:09:16.842+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:09:57.310+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 258ms 2016-04-18T12:09:59.809+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:10:03.038+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 469ms 2016-04-18T12:10:07.609+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:10:14.819+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-04-18T12:10:20.164+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3490, after asserts: 5520, after connections: 9080, after extra_info: 17340, after globalLock: 21420, after locks: 21830, after network: 21830, after opcounters: 21830, after opcountersRepl: 21830, after repl: 55680, after storageEngine: 58450, after tcmalloc: 59150, after wiredTiger: 67390, at end: 79880 } 2016-04-18T12:10:48.188+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:11:05.233+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:11:18.706+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 306ms 2016-04-18T12:11:31.966+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 4857ms 2016-04-18T12:11:46.464+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:12:05.931+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:12:39.868+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:12:44.370+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 844ms 2016-04-18T12:12:54.762+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 588ms 2016-04-18T12:12:56.852+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:13:13.323+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2780, after asserts: 7330, after connections: 12120, after extra_info: 16410, after globalLock: 23410, after locks: 27000, after network: 28800, after opcounters: 28800, after opcountersRepl: 28800, after repl: 45630, after storageEngine: 48810, after tcmalloc: 52340, after wiredTiger: 63610, at end: 82900 } 2016-04-18T12:13:42.808+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:14:05.830+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:14:11.378+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 615ms 2016-04-18T12:14:13.270+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 656ms 2016-04-18T12:14:20.264+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 141ms 2016-04-18T12:14:38.176+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:14:56.188+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:15:33.331+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 191ms 2016-04-18T12:15:43.389+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:15:45.603+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1522ms 2016-04-18T12:15:51.576+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T12:16:01.590+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:16:03.618+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3690, after asserts: 5160, after connections: 8890, after extra_info: 17980, after globalLock: 21120, after locks: 25490, after network: 26640, after opcounters: 26970, after opcountersRepl: 26970, after repl: 55010, after storageEngine: 58950, after tcmalloc: 62500, after wiredTiger: 80400, at end: 88130 } 2016-04-18T12:16:49.409+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:17:04.797+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 235ms 2016-04-18T12:17:08.678+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:17:18.778+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1062ms 2016-04-18T12:17:27.149+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 156ms 2016-04-18T12:17:55.212+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:18:16.946+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:18:39.032+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 356ms 2016-04-18T12:18:48.956+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1421ms 2016-04-18T12:19:01.452+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3580, after asserts: 5120, after connections: 7920, after extra_info: 13840, after globalLock: 18790, after locks: 20710, after network: 20880, after opcounters: 20880, after opcountersRepl: 20880, after repl: 52280, after storageEngine: 53840, after tcmalloc: 54370, after wiredTiger: 61550, at end: 70280 } 2016-04-18T12:19:04.396+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:19:04.477+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 216ms 2016-04-18T12:19:08.511+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 4449ms 2016-04-18T12:19:26.747+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:20:15.554+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 209ms 2016-04-18T12:20:16.512+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:20:28.685+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2194ms 2016-04-18T12:20:34.617+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:20:36.897+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 284ms 2016-04-18T12:21:19.893+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:21:41.794+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:21:48.568+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 137ms 2016-04-18T12:21:55.064+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4070, after asserts: 4860, after connections: 5210, after extra_info: 12620, after globalLock: 15980, after locks: 17780, after network: 17910, after opcounters: 17910, after opcountersRepl: 17910, after repl: 27970, after storageEngine: 29600, after tcmalloc: 34170, after wiredTiger: 45060, at end: 62060 } 2016-04-18T12:21:56.963+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 349ms 2016-04-18T12:22:18.599+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:22:19.318+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-04-18T12:22:38.827+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:23:21.235+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:23:22.454+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 863ms 2016-04-18T12:23:32.322+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:23:51.765+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:24:08.173+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:24:33.137+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 674ms 2016-04-18T12:24:42.783+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:24:44.103+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 703ms 2016-04-18T12:24:44.517+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 300ms 2016-04-18T12:24:58.230+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:25:02.455+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3000, after asserts: 5620, after connections: 8450, after extra_info: 13530, after globalLock: 16900, after locks: 20920, after network: 22530, after opcounters: 22530, after opcountersRepl: 22530, after repl: 47320, after storageEngine: 49350, after tcmalloc: 54840, after wiredTiger: 64430, at end: 74680 } 2016-04-18T12:25:47.458+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T12:25:48.378+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:25:57.819+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 895ms 2016-04-18T12:26:10.211+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:26:10.288+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 116ms 2016-04-18T12:26:50.599+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:27:06.244+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:27:17.418+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2200, after asserts: 3270, after connections: 3780, after extra_info: 8510, after globalLock: 11050, after locks: 12570, after network: 12950, after opcounters: 12950, after opcountersRepl: 12950, after repl: 23890, after storageEngine: 24320, after tcmalloc: 27270, after wiredTiger: 31790, at end: 46240 } 2016-04-18T12:27:28.448+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 511ms 2016-04-18T12:27:39.276+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 816ms 2016-04-18T12:27:39.952+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:27:54.242+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 103ms 2016-04-18T12:28:14.436+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:28:44.065+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:29:00.788+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:29:06.745+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 538ms 2016-04-18T12:29:19.745+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1393ms 2016-04-18T12:29:31.187+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 131ms 2016-04-18T12:29:39.398+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:30:04.569+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:30:19.432+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3000, after asserts: 6580, after connections: 9010, after extra_info: 22990, after globalLock: 24930, after locks: 26400, after network: 26880, after opcounters: 26880, after opcountersRepl: 26880, after repl: 35800, after storageEngine: 38950, after tcmalloc: 42110, after wiredTiger: 56920, at end: 71210 } 2016-04-18T12:30:40.154+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 440ms 2016-04-18T12:30:49.851+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 274ms 2016-04-18T12:30:50.478+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:30:55.224+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 115ms 2016-04-18T12:31:01.850+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:31:45.287+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:32:08.595+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 171ms 2016-04-18T12:32:09.068+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:32:18.019+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1318ms 2016-04-18T12:32:19.711+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 952ms 2016-04-18T12:33:00.397+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:33:19.110+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:33:33.233+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 310ms 2016-04-18T12:33:46.893+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:33:51.187+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 682ms 2016-04-18T12:34:02.621+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1870, after asserts: 3790, after connections: 6640, after extra_info: 10910, after globalLock: 12610, after locks: 14790, after network: 15260, after opcounters: 15260, after opcountersRepl: 15260, after repl: 47070, after storageEngine: 49880, after tcmalloc: 55020, after wiredTiger: 63840, at end: 74200 } 2016-04-18T12:34:02.638+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 276ms 2016-04-18T12:34:02.606+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:34:54.212+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:35:05.778+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:35:14.122+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 247ms 2016-04-18T12:35:37.759+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:35:51.389+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:36:26.830+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 369ms 2016-04-18T12:36:29.899+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:36:34.000+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 111ms 2016-04-18T12:36:50.798+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:37:06.991+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4180, after asserts: 6580, after connections: 9640, after extra_info: 14540, after globalLock: 17730, after locks: 18920, after network: 20690, after opcounters: 20930, after opcountersRepl: 20930, after repl: 48870, after storageEngine: 52390, after tcmalloc: 54520, after wiredTiger: 69150, at end: 82310 } 2016-04-18T12:37:17.374+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:37:52.787+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 105ms 2016-04-18T12:38:00.845+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 400ms 2016-04-18T12:38:01.642+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:38:33.633+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:39:10.053+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:39:12.634+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 143ms 2016-04-18T12:39:21.399+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1189ms 2016-04-18T12:39:23.403+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:39:25.980+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 189ms 2016-04-18T12:39:51.092+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:40:07.497+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2300, after asserts: 4130, after connections: 5590, after extra_info: 10710, after globalLock: 14220, after locks: 16490, after network: 17660, after opcounters: 18450, after opcountersRepl: 18760, after repl: 41880, after storageEngine: 45080, after tcmalloc: 51060, after wiredTiger: 61630, at end: 78130 } 2016-04-18T12:40:08.289+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:40:27.832+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 286ms 2016-04-18T12:40:48.578+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:41:06.341+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:41:37.944+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 279ms 2016-04-18T12:41:45.597+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:41:53.011+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 853ms 2016-04-18T12:42:00.455+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 285ms 2016-04-18T12:42:00.143+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:42:43.154+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:43:00.116+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:43:14.973+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3530, after asserts: 4420, after connections: 8210, after extra_info: 13640, after globalLock: 15200, after locks: 17280, after network: 17810, after opcounters: 17810, after opcountersRepl: 17810, after repl: 43440, after storageEngine: 47000, after tcmalloc: 54820, after wiredTiger: 65090, at end: 81350 } 2016-04-18T12:43:14.973+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-04-18T12:43:28.461+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 846ms 2016-04-18T12:43:33.975+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:43:35.003+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 181ms 2016-04-18T12:44:05.601+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:44:41.556+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:44:43.655+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 581ms 2016-04-18T12:44:54.387+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1692ms 2016-04-18T12:45:00.820+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:45:02.116+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 295ms 2016-04-18T12:45:06.193+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 5425ms 2016-04-18T12:45:31.798+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:45:42.322+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:46:06.904+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2660, after asserts: 4640, after connections: 6340, after extra_info: 13000, after globalLock: 13980, after locks: 14370, after network: 14630, after opcounters: 14630, after opcountersRepl: 14630, after repl: 21280, after storageEngine: 27380, after tcmalloc: 30940, after wiredTiger: 41280, at end: 55010 } 2016-04-18T12:46:13.379+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 259ms 2016-04-18T12:46:14.670+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:46:17.200+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 712ms 2016-04-18T12:46:29.674+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 124ms 2016-04-18T12:46:44.590+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:47:04.248+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:47:35.604+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 432ms 2016-04-18T12:47:45.705+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:47:50.483+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1125ms 2016-04-18T12:47:57.885+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 766ms 2016-04-18T12:48:04.202+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:48:40.822+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:49:03.422+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4160, after asserts: 6650, after connections: 9290, after extra_info: 12910, after globalLock: 18530, after locks: 22140, after network: 24370, after opcounters: 31330, after opcountersRepl: 31550, after repl: 56810, after storageEngine: 60060, after tcmalloc: 69610, after wiredTiger: 79920, at end: 93340 } 2016-04-18T12:49:04.936+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:49:08.480+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 389ms 2016-04-18T12:49:10.641+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 778ms 2016-04-18T12:49:24.000+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 125ms 2016-04-18T12:49:43.433+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:50:03.441+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:50:29.305+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 196ms 2016-04-18T12:50:37.607+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 557ms 2016-04-18T12:50:43.000+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:51:11.531+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:51:37.491+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2120, after asserts: 4300, after connections: 6530, after extra_info: 13800, after globalLock: 15370, after locks: 15600, after network: 16660, after opcounters: 17740, after opcountersRepl: 17740, after repl: 39390, after storageEngine: 40900, after tcmalloc: 44640, after wiredTiger: 50250, at end: 65030 } 2016-04-18T12:51:47.313+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 275ms 2016-04-18T12:51:52.038+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:51:53.296+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 566ms 2016-04-18T12:52:02.104+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:52:38.776+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:52:55.071+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 189ms 2016-04-18T12:52:54.850+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:52:57.323+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 211ms 2016-04-18T12:53:18.805+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:53:38.150+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:53:59.853+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 231ms 2016-04-18T12:54:16.045+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 703ms 2016-04-18T12:54:23.954+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:54:36.464+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:54:36.204+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2790, after asserts: 3390, after connections: 4050, after extra_info: 8220, after globalLock: 11670, after locks: 13250, after network: 14380, after opcounters: 15110, after opcountersRepl: 15110, after repl: 42800, after storageEngine: 47950, after tcmalloc: 57410, after wiredTiger: 64670, at end: 73670 } 2016-04-18T12:55:14.253+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:55:26.418+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 479ms 2016-04-18T12:55:29.932+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 343ms 2016-04-18T12:55:33.228+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:56:12.712+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:56:31.075+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:56:40.239+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 110ms 2016-04-18T12:56:47.613+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 128ms 2016-04-18T12:56:55.084+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:57:17.880+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5240, after asserts: 6060, after connections: 6850, after extra_info: 12340, after globalLock: 13760, after locks: 13760, after network: 13810, after opcounters: 15640, after opcountersRepl: 15640, after repl: 33870, after storageEngine: 36950, after tcmalloc: 41450, after wiredTiger: 47040, at end: 65170 } 2016-04-18T12:57:18.225+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:57:24.856+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:57:54.863+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:57:55.020+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 195ms 2016-04-18T12:57:55.481+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 290ms 2016-04-18T12:57:55.564+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:57:55.564+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:57:55.564+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:58:23.264+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:58:45.653+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:58:57.581+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 497ms 2016-04-18T12:59:11.179+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 608ms 2016-04-18T12:59:15.207+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:59:15.391+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 334ms 2016-04-18T12:59:34.127+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:59:45.427+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2600, after asserts: 5770, after connections: 8200, after extra_info: 15600, after globalLock: 17840, after locks: 19150, after network: 20580, after opcounters: 21000, after opcountersRepl: 21000, after repl: 42020, after storageEngine: 43580, after tcmalloc: 45350, after wiredTiger: 57920, at end: 69660 } 2016-04-18T12:59:49.923+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:00:19.664+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 239ms 2016-04-18T13:00:24.445+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:00:27.999+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 800ms 2016-04-18T13:00:30.652+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1291ms 2016-04-18T13:00:36.318+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:01:00.613+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:01:13.438+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:01:40.159+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2010ms 2016-04-18T13:01:48.321+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 281ms 2016-04-18T13:01:49.612+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:02:00.317+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2800, after asserts: 4550, after connections: 7980, after extra_info: 13120, after globalLock: 15450, after locks: 16670, after network: 16760, after opcounters: 16760, after opcountersRepl: 16760, after repl: 34250, after storageEngine: 35820, after tcmalloc: 39000, after wiredTiger: 48780, at end: 52330 } 2016-04-18T13:02:02.349+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:02:36.057+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:02:45.804+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:02:57.607+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 186ms 2016-04-18T13:03:08.154+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1177ms 2016-04-18T13:03:18.186+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 107ms 2016-04-18T13:03:23.751+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:03:34.767+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:04:04.501+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:04:20.206+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:04:27.395+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1821ms 2016-04-18T13:04:32.938+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4360, after asserts: 6910, after connections: 10220, after extra_info: 13980, after globalLock: 17300, after locks: 22110, after network: 22530, after opcounters: 22530, after opcountersRepl: 22530, after repl: 39920, after storageEngine: 42450, after tcmalloc: 50910, after wiredTiger: 61050, at end: 70970 } 2016-04-18T13:04:35.993+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1571ms 2016-04-18T13:05:00.281+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:05:15.476+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:05:40.616+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:05:44.755+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 166ms 2016-04-18T13:05:58.169+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1457ms 2016-04-18T13:06:03.155+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:06:06.785+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 173ms 2016-04-18T13:06:40.160+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:06:58.329+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:07:04.640+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1640, after asserts: 3050, after connections: 5850, after extra_info: 9130, after globalLock: 10340, after locks: 10990, after network: 11470, after opcounters: 12380, after opcountersRepl: 12380, after repl: 39770, after storageEngine: 42850, after tcmalloc: 46880, after wiredTiger: 49240, at end: 60110 } 2016-04-18T13:07:14.589+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 512ms 2016-04-18T13:07:22.035+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:07:25.965+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1162ms 2016-04-18T13:07:56.381+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:08:31.095+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:08:38.435+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:08:38.447+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3829ms 2016-04-18T13:09:13.164+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:09:33.681+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:09:41.178+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1070, after asserts: 1670, after connections: 1940, after extra_info: 2460, after globalLock: 2460, after locks: 2460, after network: 2460, after opcounters: 2460, after opcountersRepl: 2460, after repl: 10060, after storageEngine: 13460, after tcmalloc: 18400, after wiredTiger: 27610, at end: 37350 } 2016-04-18T13:09:41.925+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 114ms 2016-04-18T13:09:51.018+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1276ms 2016-04-18T13:10:27.741+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:10:43.461+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:11:03.608+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 329ms 2016-04-18T13:11:10.945+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 728ms 2016-04-18T13:11:22.148+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:11:23.201+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 281ms 2016-04-18T13:11:53.121+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:12:00.271+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2760, after asserts: 3580, after connections: 5200, after extra_info: 10720, after globalLock: 14770, after locks: 16940, after network: 18600, after opcounters: 18600, after opcountersRepl: 18600, after repl: 26720, after storageEngine: 28450, after tcmalloc: 30210, after wiredTiger: 40600, at end: 48530 } 2016-04-18T13:12:12.467+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:12:25.872+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 410ms 2016-04-18T13:12:40.468+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:12:57.037+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:13:12.081+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:13:32.367+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 687ms 2016-04-18T13:13:41.013+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1607ms 2016-04-18T13:13:42.456+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:13:49.816+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 806ms 2016-04-18T13:14:05.867+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:14:37.106+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:14:59.754+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:15:00.971+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 384ms 2016-04-18T13:15:07.441+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4780, after asserts: 5720, after connections: 6840, after extra_info: 10050, after globalLock: 12940, after locks: 15410, after network: 19160, after opcounters: 20240, after opcountersRepl: 20240, after repl: 50850, after storageEngine: 52680, after tcmalloc: 56470, after wiredTiger: 68020, at end: 78180 } 2016-04-18T13:15:11.206+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 863ms 2016-04-18T13:15:11.407+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 169ms 2016-04-18T13:15:11.416+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:15:35.470+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:15:53.488+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:16:14.249+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 927ms 2016-04-18T13:16:23.108+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 535ms 2016-04-18T13:16:32.019+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 121ms 2016-04-18T13:16:40.445+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:17:05.250+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:17:37.884+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 416ms 2016-04-18T13:17:45.397+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:17:52.269+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1513ms 2016-04-18T13:17:59.839+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 142ms 2016-04-18T13:18:00.227+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3830, after asserts: 5310, after connections: 8950, after extra_info: 17020, after globalLock: 19450, after locks: 21320, after network: 22180, after opcounters: 22830, after opcountersRepl: 22940, after repl: 50420, after storageEngine: 52350, after tcmalloc: 54370, after wiredTiger: 63820, at end: 76380 } 2016-04-18T13:18:04.586+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:18:52.817+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:19:06.981+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:19:13.160+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 258ms 2016-04-18T13:19:25.550+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 415ms 2016-04-18T13:19:40.181+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 289ms 2016-04-18T13:19:40.504+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:19:52.935+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:20:42.678+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:20:49.369+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 151ms 2016-04-18T13:20:49.770+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5620, after asserts: 5930, after connections: 6250, after extra_info: 10840, after globalLock: 13670, after locks: 14810, after network: 14980, after opcounters: 14980, after opcountersRepl: 14980, after repl: 39860, after storageEngine: 45040, after tcmalloc: 49030, after wiredTiger: 55380, at end: 66450 } 2016-04-18T13:20:53.116+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:20:53.163+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 202ms 2016-04-18T13:21:32.921+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:21:48.617+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:21:54.875+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 269ms 2016-04-18T13:22:07.976+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 113ms 2016-04-18T13:22:15.174+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 225ms 2016-04-18T13:22:23.316+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:22:46.038+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:23:25.813+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 528ms 2016-04-18T13:23:33.095+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:23:48.010+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1907ms 2016-04-18T13:23:51.919+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5220, after asserts: 5610, after connections: 6260, after extra_info: 10580, after globalLock: 12700, after locks: 14010, after network: 14130, after opcounters: 14130, after opcountersRepl: 14130, after repl: 51660, after storageEngine: 56300, after tcmalloc: 58310, after wiredTiger: 73770, at end: 88200 } 2016-04-18T13:23:52.140+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:23:54.421+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 657ms 2016-04-18T13:24:23.148+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:24:47.858+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:25:04.362+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 325ms 2016-04-18T13:25:14.370+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 950ms 2016-04-18T13:25:29.029+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:25:47.820+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:26:27.180+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 347ms 2016-04-18T13:26:41.918+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:26:41.918+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 655ms 2016-04-18T13:26:59.416+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1770, after asserts: 3220, after connections: 6760, after extra_info: 12870, after globalLock: 17810, after locks: 21390, after network: 24640, after opcounters: 26200, after opcountersRepl: 26820, after repl: 43930, after storageEngine: 48350, after tcmalloc: 53370, after wiredTiger: 64420, at end: 74130 } 2016-04-18T13:27:00.979+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:27:41.338+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:27:49.962+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 118ms 2016-04-18T13:28:03.119+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 868ms 2016-04-18T13:28:03.776+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:28:20.063+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-04-18T13:28:52.540+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:29:01.248+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:29:36.337+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 754ms 2016-04-18T13:29:43.842+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:29:47.716+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 501ms 2016-04-18T13:29:55.475+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:29:59.544+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T13:30:22.549+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:30:23.294+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5310, after asserts: 11070, after connections: 13270, after extra_info: 21930, after globalLock: 25780, after locks: 28160, after network: 29110, after opcounters: 29110, after opcountersRepl: 29110, after repl: 52940, after storageEngine: 56440, after tcmalloc: 62060, after wiredTiger: 72570, at end: 88910 } 2016-04-18T13:30:43.559+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:31:07.529+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 196ms 2016-04-18T13:31:25.275+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1201ms 2016-04-18T13:31:36.317+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:32:08.997+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:32:31.154+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:32:46.353+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 335ms 2016-04-18T13:33:00.660+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1837ms 2016-04-18T13:33:10.221+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 209ms 2016-04-18T13:33:10.738+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:33:31.279+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:33:47.312+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4240, after asserts: 6320, after connections: 7880, after extra_info: 13940, after globalLock: 16420, after locks: 18570, after network: 19070, after opcounters: 19070, after opcountersRepl: 19070, after repl: 25890, after storageEngine: 29120, after tcmalloc: 33750, after wiredTiger: 52540, at end: 59790 } 2016-04-18T13:34:08.762+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:34:20.190+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 154ms 2016-04-18T13:34:31.399+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 388ms 2016-04-18T13:34:43.933+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T13:34:57.039+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:35:38.236+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:35:48.445+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 356ms 2016-04-18T13:35:56.770+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:35:57.231+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 115ms 2016-04-18T13:36:29.926+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:36:45.869+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 500, after asserts: 1920, after connections: 2910, after extra_info: 8190, after globalLock: 8390, after locks: 10190, after network: 11770, after opcounters: 11770, after opcountersRepl: 11770, after repl: 29850, after storageEngine: 32980, after tcmalloc: 36420, after wiredTiger: 49090, at end: 63430 } 2016-04-18T13:36:58.781+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 114ms 2016-04-18T13:37:02.053+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:37:11.990+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 482ms 2016-04-18T13:37:24.717+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 163ms 2016-04-18T13:37:44.395+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:38:01.001+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:38:36.214+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 180ms 2016-04-18T13:38:38.929+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:38:45.032+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 214ms 2016-04-18T13:39:03.710+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:39:24.042+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:39:57.831+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 381ms 2016-04-18T13:40:11.061+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:40:14.026+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 131ms 2016-04-18T13:40:22.388+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3120, after asserts: 5220, after connections: 10230, after extra_info: 12000, after globalLock: 13370, after locks: 15060, after network: 16520, after opcounters: 16520, after opcountersRepl: 16520, after repl: 46350, after storageEngine: 50350, after tcmalloc: 55940, after wiredTiger: 65100, at end: 76060 } 2016-04-18T13:40:23.665+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:41:11.134+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:41:16.007+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 427ms 2016-04-18T13:41:24.086+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:41:28.495+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1057ms 2016-04-18T13:41:34.302+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 102ms 2016-04-18T13:42:01.378+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:42:18.891+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:42:46.555+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 711ms 2016-04-18T13:42:55.580+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2130, after asserts: 4710, after connections: 10060, after extra_info: 20840, after globalLock: 22290, after locks: 23120, after network: 23530, after opcounters: 23530, after opcountersRepl: 23530, after repl: 43250, after storageEngine: 45070, after tcmalloc: 46720, after wiredTiger: 49540, at end: 58060 } 2016-04-18T13:42:58.887+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:43:01.039+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2232ms 2016-04-18T13:43:09.678+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:43:12.819+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 184ms 2016-04-18T13:43:47.661+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:44:02.962+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:44:21.930+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 141ms 2016-04-18T13:44:32.429+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1247ms 2016-04-18T13:44:42.965+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 125ms 2016-04-18T13:44:44.833+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:45:01.640+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:45:39.328+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:45:48.294+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3760, after asserts: 4850, after connections: 6020, after extra_info: 7790, after globalLock: 10760, after locks: 12030, after network: 13430, after opcounters: 13430, after opcountersRepl: 13430, after repl: 28470, after storageEngine: 31630, after tcmalloc: 38940, after wiredTiger: 46580, at end: 57080 } 2016-04-18T13:45:52.469+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 597ms 2016-04-18T13:45:56.043+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:46:01.255+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1383ms 2016-04-18T13:46:04.749+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 126ms 2016-04-18T13:46:25.306+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:46:37.127+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:47:06.229+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 227ms 2016-04-18T13:47:09.086+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:47:14.034+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 667ms 2016-04-18T13:47:20.126+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:47:25.938+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T13:47:59.946+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:48:18.324+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5320, after asserts: 6840, after connections: 7390, after extra_info: 9830, after globalLock: 10920, after locks: 11460, after network: 11460, after opcounters: 11460, after opcountersRepl: 11460, after repl: 32240, after storageEngine: 36850, after tcmalloc: 39280, after wiredTiger: 49070, at end: 57580 } 2016-04-18T13:48:20.948+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:48:34.030+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 354ms 2016-04-18T13:48:42.090+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 214ms 2016-04-18T13:49:00.609+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:49:18.588+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:49:44.400+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 231ms 2016-04-18T13:49:52.811+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 760ms 2016-04-18T13:49:56.355+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:50:15.924+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:50:30.091+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3060, after asserts: 3920, after connections: 4260, after extra_info: 4580, after globalLock: 5170, after locks: 8180, after network: 10870, after opcounters: 12090, after opcountersRepl: 14330, after repl: 27650, after storageEngine: 30980, after tcmalloc: 32730, after wiredTiger: 40400, at end: 55000 } 2016-04-18T13:50:45.490+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:51:02.482+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T13:51:10.120+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 110ms 2016-04-18T13:51:12.520+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:52:06.658+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:52:18.474+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 535ms 2016-04-18T13:52:28.819+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:52:34.037+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3646ms 2016-04-18T13:52:40.774+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 153ms 2016-04-18T13:53:18.840+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:53:31.091+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:53:49.023+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1370, after asserts: 2940, after connections: 3920, after extra_info: 13150, after globalLock: 16430, after locks: 17780, after network: 20080, after opcounters: 20830, after opcountersRepl: 20830, after repl: 44360, after storageEngine: 48090, after tcmalloc: 51280, after wiredTiger: 74060, at end: 82390 } 2016-04-18T13:53:49.022+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 114ms 2016-04-18T13:53:56.920+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 787ms 2016-04-18T13:54:09.980+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:54:10.373+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 131ms 2016-04-18T13:54:29.322+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:55:01.730+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:55:13.811+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 123ms 2016-04-18T13:55:21.264+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:55:25.580+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 517ms 2016-04-18T13:55:34.874+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:56:14.162+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:56:27.537+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 383ms 2016-04-18T13:56:34.308+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 799ms 2016-04-18T13:56:34.512+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:56:38.952+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1420, after asserts: 2280, after connections: 3550, after extra_info: 10940, after globalLock: 15270, after locks: 17590, after network: 19270, after opcounters: 21730, after opcountersRepl: 23340, after repl: 38810, after storageEngine: 41060, after tcmalloc: 44240, after wiredTiger: 53860, at end: 61960 } 2016-04-18T13:56:57.389+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:57:19.198+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:57:36.085+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1177ms 2016-04-18T13:57:56.548+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:58:24.917+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:58:43.686+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 217ms 2016-04-18T13:58:55.468+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 847ms 2016-04-18T13:58:55.969+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:59:20.972+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:59:29.975+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3450, after asserts: 5460, after connections: 7470, after extra_info: 13070, after globalLock: 14340, after locks: 15480, after network: 15850, after opcounters: 16910, after opcountersRepl: 16910, after repl: 38240, after storageEngine: 41950, after tcmalloc: 44890, after wiredTiger: 55520, at end: 73550 } 2016-04-18T14:00:04.902+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:00:10.076+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 108ms 2016-04-18T14:00:15.401+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 378ms 2016-04-18T14:00:22.619+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:00:27.209+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 501ms 2016-04-18T14:00:51.117+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:01:05.267+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T14:01:39.749+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 255ms 2016-04-18T14:01:45.890+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:01:47.632+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 583ms 2016-04-18T14:02:04.327+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:02:03.868+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 433ms 2016-04-18T14:02:09.581+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3390, after asserts: 4790, after connections: 7580, after extra_info: 12090, after globalLock: 13910, after locks: 14220, after network: 17160, after opcounters: 17370, after opcountersRepl: 17480, after repl: 41260, after storageEngine: 44400, after tcmalloc: 51840, after wiredTiger: 55320, at end: 66900 } 2016-04-18T14:02:51.374+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:03:07.107+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:03:14.637+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 199ms 2016-04-18T14:03:24.287+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1181ms 2016-04-18T14:03:36.837+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 882ms 2016-04-18T14:03:41.110+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:03:48.892+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:04:31.926+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:04:43.322+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 110ms 2016-04-18T14:04:48.376+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1524ms 2016-04-18T14:04:50.277+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:05:05.312+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2990, after asserts: 5330, after connections: 6840, after extra_info: 10280, after globalLock: 13040, after locks: 16550, after network: 16800, after opcounters: 16800, after opcountersRepl: 16800, after repl: 39670, after storageEngine: 45570, after tcmalloc: 52500, after wiredTiger: 67780, at end: 79190 } 2016-04-18T14:05:05.312+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T14:05:51.913+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:06:13.315+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:06:20.875+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 229ms 2016-04-18T14:06:34.527+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 222ms 2016-04-18T14:06:37.368+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T14:06:43.623+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 183ms 2016-04-18T14:06:52.317+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:07:32.204+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:07:45.863+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 291ms 2016-04-18T14:07:47.601+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:07:48.872+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2350, after asserts: 3190, after connections: 3930, after extra_info: 10400, after globalLock: 12080, after locks: 13520, after network: 14360, after opcounters: 14360, after opcountersRepl: 14360, after repl: 30090, after storageEngine: 37200, after tcmalloc: 38710, after wiredTiger: 43290, at end: 54180 } 2016-04-18T14:07:57.218+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1049ms 2016-04-18T14:08:03.388+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 327ms 2016-04-18T14:08:41.652+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:09:00.803+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:09:13.526+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 125ms 2016-04-18T14:09:19.949+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 355ms 2016-04-18T14:09:31.657+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 535ms 2016-04-18T14:09:32.582+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T14:09:46.027+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:10:33.839+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:10:38.916+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-18T14:10:48.133+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 534ms 2016-04-18T14:10:52.805+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:10:59.059+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 146ms 2016-04-18T14:11:06.312+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4150, after asserts: 6710, after connections: 7840, after extra_info: 14990, after globalLock: 17420, after locks: 19690, after network: 22780, after opcounters: 23130,