2016-04-12T18:19:32.206+0000 I CONTROL [initandlisten] MongoDB starting : pid=16576 port=27016 dbpath=/var/lib/mongodb-replica/mongodbreplica2 64-bit host=ip-172-31-6-169 2016-04-12T18:19:32.207+0000 I CONTROL [initandlisten] db version v3.2.1 2016-04-12T18:19:32.207+0000 I CONTROL [initandlisten] git version: a14d55980c2cdc565d4704a7e3ad37e4e535c1b2 2016-04-12T18:19:32.207+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014 2016-04-12T18:19:32.207+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-04-12T18:19:32.207+0000 I CONTROL [initandlisten] modules: none 2016-04-12T18:19:32.207+0000 I CONTROL [initandlisten] build environment: 2016-04-12T18:19:32.207+0000 I CONTROL [initandlisten] distmod: ubuntu1404 2016-04-12T18:19:32.207+0000 I CONTROL [initandlisten] distarch: x86_64 2016-04-12T18:19:32.207+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-04-12T18:19:32.207+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb.d/mongodbreplica2.conf", net: { http: { RESTInterfaceEnabled: true, enabled: true }, port: 27016 }, processManagement: { pidFilePath: "/var/run/mongodb-replica/mongodbreplica2.pid" }, replication: { oplogSizeMB: 128, replSet: "mongodbreplica" }, storage: { dbPath: "/var/lib/mongodb-replica/mongodbreplica2", mmapv1: { smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb-replica/mongodbreplica2.log" } } 2016-04-12T18:19:32.534+0000 I - [initandlisten] Detected data files in /var/lib/mongodb-replica/mongodbreplica2 created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2016-04-12T18:19:32.534+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-04-12T18:19:35.467+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-04-12T18:19:35.467+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 127570 records totaling to 2938105140 bytes 2016-04-12T18:19:35.478+0000 I STORAGE [initandlisten] Sampling from the oplog between Apr 8 12:06:39:1 and Apr 12 12:22:26:1 to determine where to place markers for truncation 2016-04-12T18:19:35.478+0000 I STORAGE [initandlisten] Taking 1009 samples and assuming that each section of oplog contains approximately 1264 records totaling to 29111584 bytes 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 12:54:46:2 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 13:49:12:1 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 14:41:57:1 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 15:33:45:3 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 16:25:40:1 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 17:23:08:1 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 18:25:00:1 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 19:19:45:5 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 20:20:47:1 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 21:14:45:4 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 22:09:00:1 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 23:12:39:1 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 00:07:24:1 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 01:02:07:1 2016-04-12T18:19:43.966+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 02:01:45:2 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 02:56:08:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 03:50:36:2 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 04:50:07:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 05:44:39:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 06:44:00:6 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 07:38:36:2 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 08:32:39:3 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 09:32:07:2 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 10:26:34:2 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 11:20:43:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 12:20:36:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 13:15:18:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 14:12:08:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 15:14:45:2 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 16:09:07:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 17:08:12:2 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 18:03:10:2 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 18:57:46:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 19:57:36:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:51:54:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 21:43:45:3 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 22:35:39:2 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 23:30:17:1 2016-04-12T18:19:43.967+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 00:21:56:1 2016-04-12T18:19:43.968+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 01:09:07:1 2016-04-12T18:19:43.968+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 02:01:08:2 2016-04-12T18:19:43.968+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 02:52:46:1 2016-04-12T18:19:43.968+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 03:45:02:2 2016-04-12T18:19:43.969+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 04:39:36:2 2016-04-12T18:19:43.969+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 05:31:42:1 2016-04-12T18:19:43.969+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 06:18:45:1 2016-04-12T18:19:43.969+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 07:10:46:1 2016-04-12T18:19:43.970+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 08:02:47:2 2016-04-12T18:19:43.970+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 08:55:08:2 2016-04-12T18:19:43.970+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 09:49:48:2 2016-04-12T18:19:43.970+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 10:43:00:6 2016-04-12T18:19:43.970+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 11:30:15:1 2016-04-12T18:19:43.970+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 12:22:45:2 2016-04-12T18:19:43.970+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 13:15:09:2 2016-04-12T18:19:43.970+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 14:07:47:1 2016-04-12T18:19:43.971+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 15:02:45:3 2016-04-12T18:19:44.077+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 15:55:10:1 2016-04-12T18:19:44.078+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 16:42:46:1 2016-04-12T18:19:44.079+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 17:44:08:2 2016-04-12T18:19:44.079+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 18:40:45:1 2016-04-12T18:19:44.079+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 19:32:20:2 2016-04-12T18:19:44.079+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 20:26:29:2 2016-04-12T18:19:44.079+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 21:17:46:1 2016-04-12T18:19:44.079+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 22:05:07:2 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 22:56:19:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 23:47:51:2 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 00:39:45:5 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 01:33:46:2 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:25:44:2 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 03:12:22:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 04:03:46:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 04:55:51:3 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 05:47:47:2 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 06:41:53:2 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 07:33:45:6 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 08:20:26:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 09:12:21:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:03:52:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:55:48:2 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 11:49:50:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 12:41:45:2 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 13:29:00:4 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 14:24:50:3 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 15:16:32:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 16:08:46:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 17:04:46:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 17:57:39:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 18:54:45:1 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 19:46:54:2 2016-04-12T18:19:44.081+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 20:56:45:3 2016-04-12T18:19:44.082+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 21:51:50:2 2016-04-12T18:19:44.082+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 22:51:00:3 2016-04-12T18:19:44.082+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 23:42:43:2 2016-04-12T18:19:44.082+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 00:39:56:1 2016-04-12T18:19:44.082+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 01:32:32:1 2016-04-12T18:19:44.082+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 02:25:00:2 2016-04-12T18:19:44.082+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 03:17:07:2 2016-04-12T18:19:44.082+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 04:12:46:1 2016-04-12T18:19:44.082+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:04:48:1 2016-04-12T18:19:44.082+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:52:47:1 2016-04-12T18:19:45.289+0000 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2016-04-12T18:19:45.619+0000 I NETWORK [websvr] admin web console waiting for connections on port 28016 2016-04-12T18:19:45.636+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb-replica/mongodbreplica2/diagnostic.data' 2016-04-12T18:19:45.639+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-04-12T18:19:45.645+0000 I NETWORK [initandlisten] waiting for connections on port 27016 2016-04-12T18:19:45.767+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51000 #1 (1 connection now open) 2016-04-12T18:19:45.791+0000 I NETWORK [conn1] end connection 127.0.0.1:51000 (0 connections now open) 2016-04-12T18:19:45.864+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51003 #2 (1 connection now open) 2016-04-12T18:19:45.865+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "mongodbreplica", version: 2, protocolVersion: 1, members: [ { _id: 0, host: "localhost:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "localhost:27016", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "localhost:27015", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-04-12T18:19:45.865+0000 I REPL [ReplicationExecutor] This node is localhost:27016 in the config 2016-04-12T18:19:45.865+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-04-12T18:19:45.865+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-04-12T18:19:45.963+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-12T18:19:45.963+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-12T18:19:45.963+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-04-12T18:19:45.964+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-12T18:19:45.964+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-04-12T18:19:45.966+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-12T18:19:48.258+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51017 #3 (2 connections now open) 2016-04-12T18:19:48.259+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51018 #4 (3 connections now open) 2016-04-12T18:19:48.260+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51019 #5 (4 connections now open) 2016-04-12T18:19:48.263+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51020 #6 (5 connections now open) 2016-04-12T18:19:48.278+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51021 #7 (6 connections now open) 2016-04-12T18:19:48.290+0000 I NETWORK [conn3] end connection 127.0.0.1:51017 (5 connections now open) 2016-04-12T18:19:48.292+0000 I NETWORK [conn4] end connection 127.0.0.1:51018 (4 connections now open) 2016-04-12T18:19:48.292+0000 I NETWORK [conn5] end connection 127.0.0.1:51019 (3 connections now open) 2016-04-12T18:19:48.292+0000 I NETWORK [conn6] end connection 127.0.0.1:51020 (2 connections now open) 2016-04-12T18:19:48.293+0000 I NETWORK [conn7] end connection 127.0.0.1:51021 (1 connection now open) 2016-04-12T18:19:48.822+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51033 #8 (2 connections now open) 2016-04-12T18:19:48.822+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51034 #9 (3 connections now open) 2016-04-12T18:19:48.840+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51035 #10 (4 connections now open) 2016-04-12T18:19:48.841+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51036 #11 (5 connections now open) 2016-04-12T18:19:48.842+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51037 #12 (6 connections now open) 2016-04-12T18:19:48.868+0000 I NETWORK [conn8] end connection 127.0.0.1:51033 (5 connections now open) 2016-04-12T18:19:48.868+0000 I NETWORK [conn9] end connection 127.0.0.1:51034 (4 connections now open) 2016-04-12T18:19:48.868+0000 I NETWORK [conn10] end connection 127.0.0.1:51035 (3 connections now open) 2016-04-12T18:19:48.869+0000 I NETWORK [conn11] end connection 127.0.0.1:51036 (2 connections now open) 2016-04-12T18:19:48.869+0000 I NETWORK [conn12] end connection 127.0.0.1:51037 (1 connection now open) 2016-04-12T18:19:48.918+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51038 #13 (2 connections now open) 2016-04-12T18:19:50.390+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51051 #14 (3 connections now open) 2016-04-12T18:19:50.391+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51052 #15 (4 connections now open) 2016-04-12T18:19:50.393+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51053 #16 (5 connections now open) 2016-04-12T18:19:50.394+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51054 #17 (6 connections now open) 2016-04-12T18:19:50.456+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51055 #18 (7 connections now open) 2016-04-12T18:19:50.478+0000 I NETWORK [conn14] end connection 127.0.0.1:51051 (6 connections now open) 2016-04-12T18:19:50.478+0000 I NETWORK [conn15] end connection 127.0.0.1:51052 (5 connections now open) 2016-04-12T18:19:50.478+0000 I NETWORK [conn16] end connection 127.0.0.1:51053 (4 connections now open) 2016-04-12T18:19:50.478+0000 I NETWORK [conn17] end connection 127.0.0.1:51054 (3 connections now open) 2016-04-12T18:19:50.479+0000 I NETWORK [conn18] end connection 127.0.0.1:51055 (2 connections now open) 2016-04-12T18:19:51.940+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51056 #19 (3 connections now open) 2016-04-12T18:19:51.941+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51057 #20 (4 connections now open) 2016-04-12T18:19:51.941+0000 I NETWORK [conn19] end connection 127.0.0.1:51056 (3 connections now open) 2016-04-12T18:19:51.943+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51058 #21 (4 connections now open) 2016-04-12T18:19:53.682+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51070 #22 (5 connections now open) 2016-04-12T18:19:53.687+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51071 #23 (6 connections now open) 2016-04-12T18:19:53.688+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51072 #24 (7 connections now open) 2016-04-12T18:19:53.712+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51073 #25 (8 connections now open) 2016-04-12T18:19:53.716+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51074 #26 (9 connections now open) 2016-04-12T18:19:53.750+0000 I NETWORK [conn22] end connection 127.0.0.1:51070 (8 connections now open) 2016-04-12T18:19:53.752+0000 I NETWORK [conn23] end connection 127.0.0.1:51071 (7 connections now open) 2016-04-12T18:19:53.752+0000 I NETWORK [conn24] end connection 127.0.0.1:51072 (6 connections now open) 2016-04-12T18:19:53.752+0000 I NETWORK [conn25] end connection 127.0.0.1:51073 (5 connections now open) 2016-04-12T18:19:53.752+0000 I NETWORK [conn26] end connection 127.0.0.1:51074 (4 connections now open) 2016-04-12T18:19:56.768+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-12T18:19:56.768+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-12T18:19:56.795+0000 I REPL [ReplicationExecutor] dry election run succeeded, running for election 2016-04-12T18:19:56.880+0000 I REPL [ReplicationExecutor] election succeeded, assuming primary role in term 27 2016-04-12T18:19:56.952+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-12T18:19:56.952+0000 I REPL [ReplicationExecutor] transition to PRIMARY 2016-04-12T18:19:56.952+0000 W REPL [ReplicationExecutor] The liveness timeout does not match callback handle, so not resetting it. 2016-04-12T18:19:57.067+0000 I REPL [rsSync] transition to primary complete; database writes are now permitted 2016-04-12T18:19:58.987+0000 I NETWORK [conn20] end connection 127.0.0.1:51057 (3 connections now open) 2016-04-12T18:19:58.990+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51079 #27 (4 connections now open) 2016-04-12T18:19:58.991+0000 I NETWORK [conn27] end connection 127.0.0.1:51079 (3 connections now open) 2016-04-12T18:19:59.032+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51080 #28 (4 connections now open) 2016-04-12T18:19:59.038+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51081 #29 (5 connections now open) 2016-04-12T18:20:00.948+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51093 #30 (6 connections now open) 2016-04-12T18:20:00.950+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51094 #31 (7 connections now open) 2016-04-12T18:20:00.953+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51095 #32 (8 connections now open) 2016-04-12T18:20:00.953+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51096 #33 (9 connections now open) 2016-04-12T18:20:00.954+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51097 #34 (10 connections now open) 2016-04-12T18:20:01.096+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51099 #35 (11 connections now open) 2016-04-12T18:20:01.100+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51103 #36 (12 connections now open) 2016-04-12T18:20:01.148+0000 I NETWORK [conn36] end connection 127.0.0.1:51103 (11 connections now open) 2016-04-12T18:20:01.275+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51106 #37 (12 connections now open) 2016-04-12T18:20:01.402+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51109 #38 (13 connections now open) 2016-04-12T18:20:02.099+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51112 #39 (14 connections now open) 2016-04-12T18:20:02.099+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51113 #40 (15 connections now open) 2016-04-12T18:20:02.100+0000 I NETWORK [conn39] end connection 127.0.0.1:51112 (14 connections now open) 2016-04-12T18:20:02.647+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51125 #41 (15 connections now open) 2016-04-12T18:20:02.647+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51126 #42 (16 connections now open) 2016-04-12T18:20:02.647+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51127 #43 (17 connections now open) 2016-04-12T18:20:02.647+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51128 #44 (18 connections now open) 2016-04-12T18:20:02.647+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51129 #45 (19 connections now open) 2016-04-12T18:20:02.749+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51131 #46 (20 connections now open) 2016-04-12T18:20:02.750+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51135 #47 (21 connections now open) 2016-04-12T18:20:02.776+0000 I NETWORK [conn47] end connection 127.0.0.1:51135 (20 connections now open) 2016-04-12T18:20:02.858+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51138 #48 (21 connections now open) 2016-04-12T18:20:03.532+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51151 #49 (22 connections now open) 2016-04-12T18:20:03.532+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51152 #50 (23 connections now open) 2016-04-12T18:20:03.533+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51153 #51 (24 connections now open) 2016-04-12T18:20:03.534+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51154 #52 (25 connections now open) 2016-04-12T18:20:03.534+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51155 #53 (26 connections now open) 2016-04-12T18:20:03.716+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51157 #54 (27 connections now open) 2016-04-12T18:20:03.716+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51161 #55 (28 connections now open) 2016-04-12T18:20:03.731+0000 I NETWORK [conn55] end connection 127.0.0.1:51161 (27 connections now open) 2016-04-12T18:20:03.782+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51164 #56 (28 connections now open) 2016-04-12T18:20:03.833+0000 I ACCESS [conn37] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:03.885+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51167 #57 (29 connections now open) 2016-04-12T18:20:05.284+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51171 #58 (30 connections now open) 2016-04-12T18:20:06.094+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51185 #59 (31 connections now open) 2016-04-12T18:20:06.101+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51186 #60 (32 connections now open) 2016-04-12T18:20:06.113+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51187 #61 (33 connections now open) 2016-04-12T18:20:06.114+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51188 #62 (34 connections now open) 2016-04-12T18:20:06.115+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51189 #63 (35 connections now open) 2016-04-12T18:20:06.302+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51191 #64 (36 connections now open) 2016-04-12T18:20:06.303+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51195 #65 (37 connections now open) 2016-04-12T18:20:06.401+0000 I NETWORK [conn65] end connection 127.0.0.1:51195 (36 connections now open) 2016-04-12T18:20:06.478+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51198 #66 (37 connections now open) 2016-04-12T18:20:08.605+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51202 #67 (38 connections now open) 2016-04-12T18:20:08.624+0000 I NETWORK [conn67] end connection 127.0.0.1:51202 (37 connections now open) 2016-04-12T18:20:08.701+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51208 #68 (38 connections now open) 2016-04-12T18:20:08.702+0000 I ACCESS [conn56] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:08.779+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51217 #69 (39 connections now open) 2016-04-12T18:20:08.779+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51218 #70 (40 connections now open) 2016-04-12T18:20:08.795+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51219 #71 (41 connections now open) 2016-04-12T18:20:08.795+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51220 #72 (42 connections now open) 2016-04-12T18:20:08.796+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51221 #73 (43 connections now open) 2016-04-12T18:20:08.798+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51223 #74 (44 connections now open) 2016-04-12T18:20:08.919+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51227 #75 (45 connections now open) 2016-04-12T18:20:08.919+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51231 #76 (46 connections now open) 2016-04-12T18:20:08.980+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51234 #77 (47 connections now open) 2016-04-12T18:20:08.981+0000 I REPL [ReplicationExecutor] stepping down from primary, because a new term has begun: 28 2016-04-12T18:20:08.981+0000 I REPL [ReplicationExecutor] stepping down from primary, because a new term has begun: 28 2016-04-12T18:20:08.982+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state PRIMARY 2016-04-12T18:20:08.981+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51235 #78 (48 connections now open) 2016-04-12T18:20:08.982+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51236 #79 (49 connections now open) 2016-04-12T18:20:08.981+0000 I NETWORK [conn76] end connection 127.0.0.1:51231 (46 connections now open) 2016-04-12T18:20:08.982+0000 I REPL [replExecDBWorker-1] transition to SECONDARY 2016-04-12T18:20:08.996+0000 I NETWORK [conn2] end connection 127.0.0.1:51003 (47 connections now open) 2016-04-12T18:20:08.997+0000 I NETWORK [conn29] end connection 127.0.0.1:51081 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn30] end connection 127.0.0.1:51093 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn31] end connection 127.0.0.1:51094 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn32] end connection 127.0.0.1:51095 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn33] end connection 127.0.0.1:51096 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn34] end connection 127.0.0.1:51097 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn35] end connection 127.0.0.1:51099 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn37] end connection 127.0.0.1:51106 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn38] end connection 127.0.0.1:51109 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn40] end connection 127.0.0.1:51113 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn41] end connection 127.0.0.1:51125 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn42] end connection 127.0.0.1:51126 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn43] end connection 127.0.0.1:51127 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn44] end connection 127.0.0.1:51128 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn45] end connection 127.0.0.1:51129 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn46] end connection 127.0.0.1:51131 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn48] end connection 127.0.0.1:51138 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn49] end connection 127.0.0.1:51151 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn50] end connection 127.0.0.1:51152 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn51] end connection 127.0.0.1:51153 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn52] end connection 127.0.0.1:51154 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn53] end connection 127.0.0.1:51155 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn54] end connection 127.0.0.1:51157 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn56] end connection 127.0.0.1:51164 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn57] end connection 127.0.0.1:51167 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn58] end connection 127.0.0.1:51171 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn59] end connection 127.0.0.1:51185 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn60] end connection 127.0.0.1:51186 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn61] end connection 127.0.0.1:51187 (47 connections now open) 2016-04-12T18:20:09.026+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51237 #80 (49 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn63] end connection 127.0.0.1:51189 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn64] end connection 127.0.0.1:51191 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn68] end connection 127.0.0.1:51208 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn69] end connection 127.0.0.1:51217 (47 connections now open) 2016-04-12T18:20:08.998+0000 I NETWORK [conn62] end connection 127.0.0.1:51188 (47 connections now open) 2016-04-12T18:20:09.026+0000 I NETWORK [conn66] end connection 127.0.0.1:51198 (47 connections now open) 2016-04-12T18:20:09.026+0000 I NETWORK [conn72] end connection 127.0.0.1:51220 (47 connections now open) 2016-04-12T18:20:09.026+0000 I NETWORK [conn74] end connection 127.0.0.1:51223 (47 connections now open) 2016-04-12T18:20:09.027+0000 I NETWORK [conn73] end connection 127.0.0.1:51221 (47 connections now open) 2016-04-12T18:20:09.027+0000 I NETWORK [conn71] end connection 127.0.0.1:51219 (47 connections now open) 2016-04-12T18:20:09.027+0000 I NETWORK [conn70] end connection 127.0.0.1:51218 (47 connections now open) 2016-04-12T18:20:09.027+0000 I NETWORK [conn13] end connection 127.0.0.1:51038 (47 connections now open) 2016-04-12T18:20:09.027+0000 I NETWORK [conn75] end connection 127.0.0.1:51227 (47 connections now open) 2016-04-12T18:20:09.044+0000 I NETWORK [conn78] end connection 127.0.0.1:51235 (5 connections now open) 2016-04-12T18:20:09.060+0000 I NETWORK [conn79] end connection 127.0.0.1:51236 (5 connections now open) 2016-04-12T18:20:09.066+0000 I NETWORK [conn77] end connection 127.0.0.1:51234 (3 connections now open) 2016-04-12T18:20:09.226+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51239 #81 (4 connections now open) 2016-04-12T18:20:09.232+0000 I NETWORK [conn28] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:51080] 2016-04-12T18:20:09.242+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-12T18:20:09.247+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-12T18:20:09.249+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-12T18:20:09.250+0000 I NETWORK [conn21] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:51058] 2016-04-12T18:20:09.329+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51247 #82 (3 connections now open) 2016-04-12T18:20:09.786+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51248 #83 (4 connections now open) 2016-04-12T18:20:09.787+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51250 #84 (5 connections now open) 2016-04-12T18:20:09.802+0000 I NETWORK [conn84] end connection 127.0.0.1:51250 (4 connections now open) 2016-04-12T18:20:09.803+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51252 #85 (5 connections now open) 2016-04-12T18:20:09.807+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51253 #86 (6 connections now open) 2016-04-12T18:20:09.834+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51255 #87 (7 connections now open) 2016-04-12T18:20:09.836+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51256 #88 (8 connections now open) 2016-04-12T18:20:09.856+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51257 #89 (9 connections now open) 2016-04-12T18:20:11.043+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51262 #90 (10 connections now open) 2016-04-12T18:20:11.142+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51264 #91 (11 connections now open) 2016-04-12T18:20:11.143+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51268 #92 (12 connections now open) 2016-04-12T18:20:11.145+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51269 #93 (13 connections now open) 2016-04-12T18:20:11.147+0000 I NETWORK [conn93] end connection 127.0.0.1:51269 (12 connections now open) 2016-04-12T18:20:12.179+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51274 #94 (13 connections now open) 2016-04-12T18:20:13.477+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51276 #95 (14 connections now open) 2016-04-12T18:20:13.490+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51277 #96 (15 connections now open) 2016-04-12T18:20:13.490+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51278 #97 (16 connections now open) 2016-04-12T18:20:13.490+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51279 #98 (17 connections now open) 2016-04-12T18:20:13.490+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51280 #99 (18 connections now open) 2016-04-12T18:20:13.493+0000 I ACCESS [conn90] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:13.542+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51281 #100 (19 connections now open) 2016-04-12T18:20:13.676+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51286 #101 (20 connections now open) 2016-04-12T18:20:14.038+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51288 #102 (21 connections now open) 2016-04-12T18:20:14.038+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51290 #103 (22 connections now open) 2016-04-12T18:20:14.039+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51291 #104 (23 connections now open) 2016-04-12T18:20:14.063+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51292 #105 (24 connections now open) 2016-04-12T18:20:14.077+0000 I NETWORK [conn102] end connection 127.0.0.1:51288 (23 connections now open) 2016-04-12T18:20:14.118+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51294 #106 (24 connections now open) 2016-04-12T18:20:14.118+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51295 #107 (25 connections now open) 2016-04-12T18:20:14.121+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51296 #108 (26 connections now open) 2016-04-12T18:20:16.065+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51298 #109 (27 connections now open) 2016-04-12T18:20:16.068+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51299 #110 (28 connections now open) 2016-04-12T18:20:16.110+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51300 #111 (29 connections now open) 2016-04-12T18:20:16.110+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51301 #112 (30 connections now open) 2016-04-12T18:20:16.110+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51302 #113 (31 connections now open) 2016-04-12T18:20:16.110+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51303 #114 (32 connections now open) 2016-04-12T18:20:16.383+0000 I ACCESS [conn81] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:16.399+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51307 #115 (33 connections now open) 2016-04-12T18:20:16.402+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51308 #116 (34 connections now open) 2016-04-12T18:20:16.486+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51310 #117 (35 connections now open) 2016-04-12T18:20:16.486+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51312 #118 (36 connections now open) 2016-04-12T18:20:16.487+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51313 #119 (37 connections now open) 2016-04-12T18:20:16.487+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51314 #120 (38 connections now open) 2016-04-12T18:20:16.487+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51315 #121 (39 connections now open) 2016-04-12T18:20:16.490+0000 I NETWORK [conn117] end connection 127.0.0.1:51310 (38 connections now open) 2016-04-12T18:20:16.541+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51317 #122 (39 connections now open) 2016-04-12T18:20:16.582+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51322 #123 (40 connections now open) 2016-04-12T18:20:16.727+0000 I ACCESS [conn89] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:16.852+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51323 #124 (41 connections now open) 2016-04-12T18:20:16.853+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51324 #125 (42 connections now open) 2016-04-12T18:20:18.433+0000 I ACCESS [conn110] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:18.433+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51325 #126 (43 connections now open) 2016-04-12T18:20:19.238+0000 I ACCESS [conn125] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:20.902+0000 I ACCESS [conn126] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:21.034+0000 I ACCESS [conn100] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:21.052+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51326 #127 (44 connections now open) 2016-04-12T18:20:21.081+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51327 #128 (45 connections now open) 2016-04-12T18:20:21.084+0000 I ACCESS [conn108] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:21.093+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51328 #129 (46 connections now open) 2016-04-12T18:20:21.117+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51329 #130 (47 connections now open) 2016-04-12T18:20:21.123+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51330 #131 (48 connections now open) 2016-04-12T18:20:21.123+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51331 #132 (49 connections now open) 2016-04-12T18:20:23.398+0000 I ACCESS [conn122] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:23.399+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51332 #133 (50 connections now open) 2016-04-12T18:20:23.538+0000 I ACCESS [conn132] Successfully authenticated as principal oplogger on admin 2016-04-12T18:20:24.631+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51333 #134 (51 connections now open) 2016-04-12T18:20:27.336+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51334 #135 (52 connections now open) 2016-04-12T18:20:31.138+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-12T18:24:03.396+0000 I NETWORK [conn128] end connection 127.0.0.1:51327 (51 connections now open) 2016-04-12T18:24:03.396+0000 I NETWORK [conn127] end connection 127.0.0.1:51326 (50 connections now open) 2016-04-12T18:24:03.396+0000 I NETWORK [conn101] end connection 127.0.0.1:51286 (49 connections now open) 2016-04-12T18:24:03.397+0000 I NETWORK [conn100] end connection 127.0.0.1:51281 (48 connections now open) 2016-04-12T18:24:03.397+0000 I NETWORK [conn99] end connection 127.0.0.1:51280 (47 connections now open) 2016-04-12T18:24:03.397+0000 I NETWORK [conn98] end connection 127.0.0.1:51279 (46 connections now open) 2016-04-12T18:24:03.397+0000 I NETWORK [conn97] end connection 127.0.0.1:51278 (45 connections now open) 2016-04-12T18:24:03.398+0000 I NETWORK [conn96] end connection 127.0.0.1:51277 (44 connections now open) 2016-04-12T18:24:03.398+0000 I NETWORK [conn95] end connection 127.0.0.1:51276 (43 connections now open) 2016-04-12T18:24:03.398+0000 I NETWORK [conn90] end connection 127.0.0.1:51262 (42 connections now open) 2016-04-12T18:24:04.953+0000 I NETWORK [conn91] end connection 127.0.0.1:51264 (41 connections now open) 2016-04-12T18:24:04.953+0000 I NETWORK [conn130] end connection 127.0.0.1:51329 (40 connections now open) 2016-04-12T18:24:04.954+0000 I NETWORK [conn129] end connection 127.0.0.1:51328 (39 connections now open) 2016-04-12T18:24:04.954+0000 I NETWORK [conn126] end connection 127.0.0.1:51325 (38 connections now open) 2016-04-12T18:24:04.961+0000 I NETWORK [conn114] end connection 127.0.0.1:51303 (37 connections now open) 2016-04-12T18:24:04.961+0000 I NETWORK [conn113] end connection 127.0.0.1:51302 (36 connections now open) 2016-04-12T18:24:04.961+0000 I NETWORK [conn112] end connection 127.0.0.1:51301 (35 connections now open) 2016-04-12T18:24:04.961+0000 I NETWORK [conn111] end connection 127.0.0.1:51300 (34 connections now open) 2016-04-12T18:24:04.961+0000 I NETWORK [conn110] end connection 127.0.0.1:51299 (33 connections now open) 2016-04-12T18:24:04.961+0000 I NETWORK [conn109] end connection 127.0.0.1:51298 (32 connections now open) 2016-04-12T18:24:07.202+0000 I NETWORK [conn135] end connection 127.0.0.1:51334 (31 connections now open) 2016-04-12T18:24:07.203+0000 I NETWORK [conn132] end connection 127.0.0.1:51331 (30 connections now open) 2016-04-12T18:24:07.203+0000 I NETWORK [conn131] end connection 127.0.0.1:51330 (29 connections now open) 2016-04-12T18:24:07.203+0000 I NETWORK [conn115] end connection 127.0.0.1:51307 (28 connections now open) 2016-04-12T18:24:07.203+0000 I NETWORK [conn108] end connection 127.0.0.1:51296 (27 connections now open) 2016-04-12T18:24:07.203+0000 I NETWORK [conn107] end connection 127.0.0.1:51295 (26 connections now open) 2016-04-12T18:24:07.203+0000 I NETWORK [conn104] end connection 127.0.0.1:51291 (25 connections now open) 2016-04-12T18:24:07.203+0000 I NETWORK [conn103] end connection 127.0.0.1:51290 (24 connections now open) 2016-04-12T18:24:07.203+0000 I NETWORK [conn106] end connection 127.0.0.1:51294 (23 connections now open) 2016-04-12T18:24:07.203+0000 I NETWORK [conn105] end connection 127.0.0.1:51292 (22 connections now open) 2016-04-12T18:24:10.319+0000 I NETWORK [conn134] end connection 127.0.0.1:51333 (21 connections now open) 2016-04-12T18:24:10.319+0000 I NETWORK [conn125] end connection 127.0.0.1:51324 (20 connections now open) 2016-04-12T18:24:10.319+0000 I NETWORK [conn124] end connection 127.0.0.1:51323 (19 connections now open) 2016-04-12T18:24:10.319+0000 I NETWORK [conn94] end connection 127.0.0.1:51274 (18 connections now open) 2016-04-12T18:24:10.320+0000 I NETWORK [conn89] end connection 127.0.0.1:51257 (17 connections now open) 2016-04-12T18:24:10.320+0000 I NETWORK [conn88] end connection 127.0.0.1:51256 (16 connections now open) 2016-04-12T18:24:10.350+0000 I NETWORK [conn87] end connection 127.0.0.1:51255 (16 connections now open) 2016-04-12T18:24:10.350+0000 I NETWORK [conn85] end connection 127.0.0.1:51252 (15 connections now open) 2016-04-12T18:24:10.350+0000 I NETWORK [conn86] end connection 127.0.0.1:51253 (14 connections now open) 2016-04-12T18:24:10.350+0000 I NETWORK [conn83] end connection 127.0.0.1:51248 (13 connections now open) 2016-04-12T18:24:11.576+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51399 #136 (13 connections now open) 2016-04-12T18:24:11.576+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51400 #137 (14 connections now open) 2016-04-12T18:24:11.576+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51401 #138 (15 connections now open) 2016-04-12T18:24:11.576+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51402 #139 (16 connections now open) 2016-04-12T18:24:11.576+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51403 #140 (17 connections now open) 2016-04-12T18:24:11.705+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51407 #141 (18 connections now open) 2016-04-12T18:24:11.705+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51409 #142 (19 connections now open) 2016-04-12T18:24:11.739+0000 I NETWORK [conn142] end connection 127.0.0.1:51409 (18 connections now open) 2016-04-12T18:24:11.786+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51412 #143 (19 connections now open) 2016-04-12T18:24:11.899+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51417 #144 (20 connections now open) 2016-04-12T18:24:14.321+0000 I NETWORK [conn133] end connection 127.0.0.1:51332 (19 connections now open) 2016-04-12T18:24:14.333+0000 I NETWORK [conn123] end connection 127.0.0.1:51322 (18 connections now open) 2016-04-12T18:24:14.334+0000 I NETWORK [conn121] end connection 127.0.0.1:51315 (17 connections now open) 2016-04-12T18:24:14.334+0000 I NETWORK [conn120] end connection 127.0.0.1:51314 (16 connections now open) 2016-04-12T18:24:14.334+0000 I NETWORK [conn118] end connection 127.0.0.1:51312 (15 connections now open) 2016-04-12T18:24:14.334+0000 I NETWORK [conn119] end connection 127.0.0.1:51313 (14 connections now open) 2016-04-12T18:24:14.334+0000 I NETWORK [conn122] end connection 127.0.0.1:51317 (13 connections now open) 2016-04-12T18:24:14.334+0000 I NETWORK [conn116] end connection 127.0.0.1:51308 (12 connections now open) 2016-04-12T18:24:14.335+0000 I NETWORK [conn82] end connection 127.0.0.1:51247 (11 connections now open) 2016-04-12T18:24:14.335+0000 I NETWORK [conn81] end connection 127.0.0.1:51239 (10 connections now open) 2016-04-12T18:24:16.460+0000 I ACCESS [conn143] Successfully authenticated as principal oplogger on admin 2016-04-12T18:24:16.653+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51430 #145 (11 connections now open) 2016-04-12T18:24:16.658+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51431 #146 (12 connections now open) 2016-04-12T18:24:16.659+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51432 #147 (13 connections now open) 2016-04-12T18:24:16.688+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51433 #148 (14 connections now open) 2016-04-12T18:24:16.688+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51434 #149 (15 connections now open) 2016-04-12T18:24:16.797+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51438 #150 (16 connections now open) 2016-04-12T18:24:16.797+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51440 #151 (17 connections now open) 2016-04-12T18:24:16.851+0000 I NETWORK [conn151] end connection 127.0.0.1:51440 (16 connections now open) 2016-04-12T18:24:16.884+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51443 #152 (17 connections now open) 2016-04-12T18:24:18.729+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51446 #153 (18 connections now open) 2016-04-12T18:24:18.732+0000 I NETWORK [conn153] end connection 127.0.0.1:51446 (17 connections now open) 2016-04-12T18:24:18.740+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51449 #154 (18 connections now open) 2016-04-12T18:24:19.013+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51454 #155 (19 connections now open) 2016-04-12T18:24:19.467+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51466 #156 (20 connections now open) 2016-04-12T18:24:19.469+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51467 #157 (21 connections now open) 2016-04-12T18:24:19.469+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51468 #158 (22 connections now open) 2016-04-12T18:24:19.470+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51469 #159 (23 connections now open) 2016-04-12T18:24:19.471+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51470 #160 (24 connections now open) 2016-04-12T18:24:19.728+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51474 #161 (25 connections now open) 2016-04-12T18:24:19.729+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51476 #162 (26 connections now open) 2016-04-12T18:24:19.874+0000 I NETWORK [conn162] end connection 127.0.0.1:51476 (25 connections now open) 2016-04-12T18:24:19.904+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51479 #163 (26 connections now open) 2016-04-12T18:24:20.114+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51484 #164 (27 connections now open) 2016-04-12T18:24:20.848+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51488 #165 (28 connections now open) 2016-04-12T18:24:23.614+0000 I ACCESS [conn152] Successfully authenticated as principal oplogger on admin 2016-04-12T18:24:23.684+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51490 #166 (29 connections now open) 2016-04-12T18:24:23.686+0000 I NETWORK [conn166] end connection 127.0.0.1:51490 (28 connections now open) 2016-04-12T18:24:23.695+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51493 #167 (29 connections now open) 2016-04-12T18:24:23.750+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51498 #168 (30 connections now open) 2016-04-12T18:24:24.249+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51510 #169 (31 connections now open) 2016-04-12T18:24:24.249+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51511 #170 (32 connections now open) 2016-04-12T18:24:24.250+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51512 #171 (33 connections now open) 2016-04-12T18:24:24.250+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51513 #172 (34 connections now open) 2016-04-12T18:24:24.250+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51514 #173 (35 connections now open) 2016-04-12T18:24:24.419+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51518 #174 (36 connections now open) 2016-04-12T18:24:24.419+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51520 #175 (37 connections now open) 2016-04-12T18:24:24.450+0000 I NETWORK [conn175] end connection 127.0.0.1:51520 (36 connections now open) 2016-04-12T18:24:24.506+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51523 #176 (37 connections now open) 2016-04-12T18:24:24.690+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51528 #177 (38 connections now open) 2016-04-12T18:24:25.337+0000 I ACCESS [conn154] Successfully authenticated as principal oplogger on admin 2016-04-12T18:24:26.213+0000 I ACCESS [conn167] Successfully authenticated as principal oplogger on admin 2016-04-12T18:24:26.818+0000 I ACCESS [conn163] Successfully authenticated as principal oplogger on admin 2016-04-12T18:24:26.847+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51530 #178 (39 connections now open) 2016-04-12T18:24:26.864+0000 I NETWORK [conn178] end connection 127.0.0.1:51530 (38 connections now open) 2016-04-12T18:24:26.896+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51533 #179 (39 connections now open) 2016-04-12T18:24:26.952+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51538 #180 (40 connections now open) 2016-04-12T18:24:27.442+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51550 #181 (41 connections now open) 2016-04-12T18:24:27.442+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51551 #182 (42 connections now open) 2016-04-12T18:24:27.442+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51552 #183 (43 connections now open) 2016-04-12T18:24:27.442+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51553 #184 (44 connections now open) 2016-04-12T18:24:27.442+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51554 #185 (45 connections now open) 2016-04-12T18:24:27.503+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51558 #186 (46 connections now open) 2016-04-12T18:24:27.536+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51560 #187 (47 connections now open) 2016-04-12T18:24:27.623+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51563 #188 (48 connections now open) 2016-04-12T18:24:27.624+0000 I NETWORK [conn187] end connection 127.0.0.1:51560 (47 connections now open) 2016-04-12T18:24:27.707+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51568 #189 (48 connections now open) 2016-04-12T18:24:31.275+0000 I ACCESS [conn179] Successfully authenticated as principal oplogger on admin 2016-04-12T18:24:31.865+0000 I ACCESS [conn176] Successfully authenticated as principal oplogger on admin 2016-04-12T18:24:31.914+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51570 #190 (49 connections now open) 2016-04-12T18:24:31.932+0000 I NETWORK [conn190] end connection 127.0.0.1:51570 (48 connections now open) 2016-04-12T18:24:32.055+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51573 #191 (49 connections now open) 2016-04-12T18:24:34.058+0000 I ACCESS [conn188] Successfully authenticated as principal oplogger on admin 2016-04-12T18:24:34.171+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51576 #192 (50 connections now open) 2016-04-12T18:24:34.175+0000 I NETWORK [conn192] end connection 127.0.0.1:51576 (49 connections now open) 2016-04-12T18:24:34.246+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51579 #193 (50 connections now open) 2016-04-12T18:24:34.345+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51584 #194 (51 connections now open) 2016-04-12T18:24:34.609+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51588 #195 (52 connections now open) 2016-04-12T18:24:38.418+0000 I ACCESS [conn191] Successfully authenticated as principal oplogger on admin 2016-04-12T18:24:39.204+0000 I ACCESS [conn193] Successfully authenticated as principal oplogger on admin 2016-04-12T18:29:45.092+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 28, timestamp: Apr 12 18:29:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 28, timestamp: Apr 12 18:29:45:5) 2016-04-12T18:29:45.092+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-12T18:29:45.093+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-12T18:29:45.093+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T18:29:48.696+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T18:31:42.853+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 28, timestamp: Apr 12 18:31:09:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 28, timestamp: Apr 12 18:31:42:1) 2016-04-12T18:31:42.853+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-12T18:31:42.853+0000 W REPL [ReplicationExecutor] The liveness timeout does not match callback handle, so not resetting it. 2016-04-12T18:31:47.864+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-12T18:31:47.865+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-12T18:35:31.687+0000 I NETWORK [conn165] end connection 127.0.0.1:51488 (51 connections now open) 2016-04-12T18:35:31.688+0000 I NETWORK [conn154] end connection 127.0.0.1:51449 (50 connections now open) 2016-04-12T18:35:31.688+0000 I NETWORK [conn144] end connection 127.0.0.1:51417 (49 connections now open) 2016-04-12T18:35:31.688+0000 I NETWORK [conn143] end connection 127.0.0.1:51412 (48 connections now open) 2016-04-12T18:35:31.689+0000 I NETWORK [conn141] end connection 127.0.0.1:51407 (47 connections now open) 2016-04-12T18:35:31.689+0000 I NETWORK [conn140] end connection 127.0.0.1:51403 (46 connections now open) 2016-04-12T18:35:31.689+0000 I NETWORK [conn139] end connection 127.0.0.1:51402 (45 connections now open) 2016-04-12T18:35:31.689+0000 I NETWORK [conn138] end connection 127.0.0.1:51401 (44 connections now open) 2016-04-12T18:35:31.689+0000 I NETWORK [conn137] end connection 127.0.0.1:51400 (43 connections now open) 2016-04-12T18:35:31.689+0000 I NETWORK [conn136] end connection 127.0.0.1:51399 (42 connections now open) 2016-04-12T18:35:32.480+0000 I NETWORK [conn168] end connection 127.0.0.1:51498 (41 connections now open) 2016-04-12T18:35:32.480+0000 I NETWORK [conn167] end connection 127.0.0.1:51493 (40 connections now open) 2016-04-12T18:35:32.480+0000 I NETWORK [conn155] end connection 127.0.0.1:51454 (39 connections now open) 2016-04-12T18:35:32.480+0000 I NETWORK [conn152] end connection 127.0.0.1:51443 (38 connections now open) 2016-04-12T18:35:32.481+0000 I NETWORK [conn150] end connection 127.0.0.1:51438 (37 connections now open) 2016-04-12T18:35:32.481+0000 I NETWORK [conn149] end connection 127.0.0.1:51434 (36 connections now open) 2016-04-12T18:35:32.481+0000 I NETWORK [conn148] end connection 127.0.0.1:51433 (35 connections now open) 2016-04-12T18:35:32.481+0000 I NETWORK [conn147] end connection 127.0.0.1:51432 (34 connections now open) 2016-04-12T18:35:32.482+0000 I NETWORK [conn146] end connection 127.0.0.1:51431 (33 connections now open) 2016-04-12T18:35:32.482+0000 I NETWORK [conn145] end connection 127.0.0.1:51430 (32 connections now open) 2016-04-12T18:35:33.257+0000 I NETWORK [conn180] end connection 127.0.0.1:51538 (31 connections now open) 2016-04-12T18:35:33.266+0000 I NETWORK [conn179] end connection 127.0.0.1:51533 (30 connections now open) 2016-04-12T18:35:33.266+0000 I NETWORK [conn164] end connection 127.0.0.1:51484 (29 connections now open) 2016-04-12T18:35:33.267+0000 I NETWORK [conn163] end connection 127.0.0.1:51479 (28 connections now open) 2016-04-12T18:35:33.267+0000 I NETWORK [conn161] end connection 127.0.0.1:51474 (27 connections now open) 2016-04-12T18:35:33.267+0000 I NETWORK [conn160] end connection 127.0.0.1:51470 (26 connections now open) 2016-04-12T18:35:33.267+0000 I NETWORK [conn159] end connection 127.0.0.1:51469 (25 connections now open) 2016-04-12T18:35:33.267+0000 I NETWORK [conn158] end connection 127.0.0.1:51468 (24 connections now open) 2016-04-12T18:35:33.267+0000 I NETWORK [conn157] end connection 127.0.0.1:51467 (23 connections now open) 2016-04-12T18:35:33.268+0000 I NETWORK [conn156] end connection 127.0.0.1:51466 (22 connections now open) 2016-04-12T18:35:34.033+0000 I NETWORK [conn195] end connection 127.0.0.1:51588 (21 connections now open) 2016-04-12T18:35:34.034+0000 I NETWORK [conn191] end connection 127.0.0.1:51573 (21 connections now open) 2016-04-12T18:35:34.034+0000 I NETWORK [conn177] end connection 127.0.0.1:51528 (21 connections now open) 2016-04-12T18:35:34.035+0000 I NETWORK [conn176] end connection 127.0.0.1:51523 (21 connections now open) 2016-04-12T18:35:34.035+0000 I NETWORK [conn174] end connection 127.0.0.1:51518 (21 connections now open) 2016-04-12T18:35:34.035+0000 I NETWORK [conn173] end connection 127.0.0.1:51514 (21 connections now open) 2016-04-12T18:35:34.035+0000 I NETWORK [conn172] end connection 127.0.0.1:51513 (21 connections now open) 2016-04-12T18:35:34.035+0000 I NETWORK [conn171] end connection 127.0.0.1:51512 (21 connections now open) 2016-04-12T18:35:34.035+0000 I NETWORK [conn170] end connection 127.0.0.1:51511 (21 connections now open) 2016-04-12T18:35:34.035+0000 I NETWORK [conn169] end connection 127.0.0.1:51510 (21 connections now open) 2016-04-12T18:35:34.836+0000 I NETWORK [conn194] end connection 127.0.0.1:51584 (11 connections now open) 2016-04-12T18:35:34.836+0000 I NETWORK [conn193] end connection 127.0.0.1:51579 (10 connections now open) 2016-04-12T18:35:34.836+0000 I NETWORK [conn189] end connection 127.0.0.1:51568 (9 connections now open) 2016-04-12T18:35:34.836+0000 I NETWORK [conn188] end connection 127.0.0.1:51563 (8 connections now open) 2016-04-12T18:35:34.836+0000 I NETWORK [conn186] end connection 127.0.0.1:51558 (7 connections now open) 2016-04-12T18:35:34.837+0000 I NETWORK [conn185] end connection 127.0.0.1:51554 (6 connections now open) 2016-04-12T18:35:34.837+0000 I NETWORK [conn184] end connection 127.0.0.1:51553 (5 connections now open) 2016-04-12T18:35:34.837+0000 I NETWORK [conn183] end connection 127.0.0.1:51552 (4 connections now open) 2016-04-12T18:35:34.837+0000 I NETWORK [conn182] end connection 127.0.0.1:51551 (3 connections now open) 2016-04-12T18:35:34.837+0000 I NETWORK [conn181] end connection 127.0.0.1:51550 (2 connections now open) 2016-04-12T18:35:44.197+0000 I CONTROL [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends 2016-04-12T18:35:44.197+0000 I FTDC [signalProcessingThread] Shutting down full-time diagnostic data capture 2016-04-12T18:35:44.203+0000 I REPL [signalProcessingThread] Stopping replication applier threads 2016-04-12T18:35:44.281+0000 W EXECUTOR [rsBackgroundSync] killCursors command task failed: CallbackCanceled Callback canceled 2016-04-12T18:35:45.240+0000 I CONTROL [signalProcessingThread] now exiting 2016-04-12T18:35:45.240+0000 I NETWORK [signalProcessingThread] shutdown: going to close listening sockets... 2016-04-12T18:35:45.240+0000 I NETWORK [signalProcessingThread] closing listening socket: 6 2016-04-12T18:35:45.240+0000 I NETWORK [signalProcessingThread] closing listening socket: 7 2016-04-12T18:35:45.240+0000 I NETWORK [signalProcessingThread] closing listening socket: 8 2016-04-12T18:35:45.241+0000 I NETWORK [signalProcessingThread] removing socket file: /tmp/mongodb-27016.sock 2016-04-12T18:35:45.241+0000 I NETWORK [signalProcessingThread] shutdown: going to flush diaglog... 2016-04-12T18:35:45.241+0000 I NETWORK [signalProcessingThread] shutdown: going to close sockets... 2016-04-12T18:35:45.241+0000 I STORAGE [signalProcessingThread] WiredTigerKVEngine shutting down 2016-04-12T18:35:45.241+0000 I NETWORK [conn92] end connection 127.0.0.1:51268 (1 connection now open) 2016-04-12T18:35:45.241+0000 I NETWORK [conn80] end connection 127.0.0.1:51237 (1 connection now open) 2016-04-12T18:35:45.273+0000 I STORAGE [signalProcessingThread] shutdown: removing fs lock... 2016-04-12T18:35:45.273+0000 I CONTROL [signalProcessingThread] dbexit: rc: 0 2016-04-12T18:35:49.907+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] MongoDB starting : pid=17820 port=27016 dbpath=/var/lib/mongodb-replica/mongodbreplica2 64-bit host=ip-172-31-6-169 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] db version v3.2.1 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] git version: a14d55980c2cdc565d4704a7e3ad37e4e535c1b2 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] modules: none 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] build environment: 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] distmod: ubuntu1404 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] distarch: x86_64 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-04-12T18:35:49.913+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb.d/mongodbreplica2.conf", net: { http: { RESTInterfaceEnabled: true, enabled: true }, port: 27016 }, processManagement: { pidFilePath: "/var/run/mongodb-replica/mongodbreplica2.pid" }, replication: { oplogSizeMB: 128, replSet: "mongodbreplica" }, storage: { dbPath: "/var/lib/mongodb-replica/mongodbreplica2", mmapv1: { smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb-replica/mongodbreplica2.log" } } 2016-04-12T18:35:50.010+0000 I - [initandlisten] Detected data files in /var/lib/mongodb-replica/mongodbreplica2 created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2016-04-12T18:35:50.010+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-04-12T18:35:51.112+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-04-12T18:35:51.112+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 127182 records totaling to 2916795086 bytes 2016-04-12T18:35:51.113+0000 I STORAGE [initandlisten] Sampling from the oplog between Apr 8 12:54:47:1 and Apr 12 18:35:09:2 to determine where to place markers for truncation 2016-04-12T18:35:51.113+0000 I STORAGE [initandlisten] Taking 1002 samples and assuming that each section of oplog contains approximately 1269 records totaling to 29103276 bytes 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 13:49:12:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 14:47:11:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 15:43:07:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 16:39:36:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 17:45:46:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 18:15:56:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 19:14:45:5 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 20:12:13:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 21:09:09:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 22:05:09:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 23:05:08:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 23:36:08:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 00:32:38:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 01:28:45:6 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 02:25:45:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 03:22:07:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 04:18:38:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 04:48:34:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 05:44:40:5 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 06:40:45:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 07:38:00:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 08:34:02:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 09:30:08:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 10:00:07:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 10:56:41:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 11:52:46:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 12:50:02:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 13:46:08:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 14:47:46:5 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 15:17:37:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 16:14:20:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 17:11:00:6 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 18:07:40:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 19:03:44:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:03:50:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:33:45:7 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 21:32:45:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 22:31:41:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 23:31:44:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 00:31:00:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 01:29:49:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 02:29:40:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 03:28:45:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 04:28:19:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 05:27:35:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 06:27:36:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 06:57:38:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 07:56:16:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 08:56:45:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 09:56:45:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 10:56:45:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 11:56:14:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 12:56:19:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 13:56:13:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 14:56:21:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 15:53:38:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 16:23:39:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 17:23:20:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 18:30:45:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 19:26:47:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 20:23:00:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 21:19:07:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 21:48:22:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 22:44:12:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 23:40:45:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 00:37:00:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 01:32:46:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:29:02:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:58:08:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 03:54:18:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 04:50:46:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 05:47:06:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 06:43:41:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 07:39:35:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 08:09:07:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 09:05:39:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:01:08:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:57:38:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 11:53:39:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 12:49:46:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 13:19:45:4 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 14:19:58:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 15:16:00:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 16:13:02:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 17:10:46:4 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 18:07:53:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 18:46:03:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 19:44:29:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 20:58:45:3 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 21:59:06:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 22:59:20:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 23:55:50:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 00:34:54:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 01:32:45:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 02:29:41:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 03:26:31:1 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 04:24:09:2 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:20:45:5 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:50:45:5 2016-04-12T18:35:53.181+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 18:27:50:3 2016-04-12T18:35:53.455+0000 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2016-04-12T18:35:53.483+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb-replica/mongodbreplica2/diagnostic.data' 2016-04-12T18:35:53.483+0000 I NETWORK [initandlisten] waiting for connections on port 27016 2016-04-12T18:35:53.483+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-04-12T18:35:53.484+0000 I NETWORK [websvr] admin web console waiting for connections on port 28016 2016-04-12T18:35:53.485+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "mongodbreplica", version: 2, protocolVersion: 1, members: [ { _id: 0, host: "localhost:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "localhost:27016", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "localhost:27015", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-04-12T18:35:53.485+0000 I REPL [ReplicationExecutor] This node is localhost:27016 in the config 2016-04-12T18:35:53.485+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-04-12T18:35:53.485+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-04-12T18:35:53.486+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-12T18:35:53.486+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-12T18:35:53.486+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-12T18:35:53.499+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-04-12T18:35:53.499+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-04-12T18:35:53.500+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-12T18:35:58.384+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51726 #1 (1 connection now open) 2016-04-12T18:35:58.410+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51728 #2 (2 connections now open) 2016-04-12T18:36:03.717+0000 I NETWORK [conn1] end connection 127.0.0.1:51726 (1 connection now open) 2016-04-12T18:36:03.717+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51733 #3 (2 connections now open) 2016-04-12T18:36:03.717+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51734 #4 (3 connections now open) 2016-04-12T18:36:04.835+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-12T18:36:04.835+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-12T18:36:04.835+0000 I REPL [ReplicationExecutor] VoteRequester: Got no vote from localhost:27017 because: candidate's term is lower than mine, resp:{ term: 29, voteGranted: false, reason: "candidate's term is lower than mine", ok: 1.0 } 2016-04-12T18:36:04.835+0000 I REPL [ReplicationExecutor] not running for primary, we have been superceded already 2016-04-12T18:36:08.486+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state PRIMARY 2016-04-12T18:36:08.501+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-12T18:36:08.502+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-12T18:36:08.502+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-12T18:37:57.031+0000 I CONTROL [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends 2016-04-12T18:37:57.031+0000 I FTDC [signalProcessingThread] Shutting down full-time diagnostic data capture 2016-04-12T18:37:57.053+0000 I REPL [signalProcessingThread] Stopping replication applier threads 2016-04-12T18:37:58.447+0000 I NETWORK [conn4] end connection 127.0.0.1:51734 (2 connections now open) 2016-04-12T18:37:58.448+0000 I NETWORK [conn3] end connection 127.0.0.1:51733 (1 connection now open) 2016-04-12T18:37:58.511+0000 I NETWORK [conn2] end connection 127.0.0.1:51728 (0 connections now open) 2016-04-12T18:37:58.524+0000 I CONTROL [signalProcessingThread] now exiting 2016-04-12T18:37:58.524+0000 I NETWORK [signalProcessingThread] shutdown: going to close listening sockets... 2016-04-12T18:37:58.524+0000 I NETWORK [signalProcessingThread] closing listening socket: 6 2016-04-12T18:37:58.524+0000 I NETWORK [signalProcessingThread] closing listening socket: 7 2016-04-12T18:37:58.524+0000 I NETWORK [signalProcessingThread] closing listening socket: 8 2016-04-12T18:37:58.524+0000 I NETWORK [signalProcessingThread] removing socket file: /tmp/mongodb-27016.sock 2016-04-12T18:37:58.524+0000 I NETWORK [signalProcessingThread] shutdown: going to flush diaglog... 2016-04-12T18:37:58.524+0000 I NETWORK [signalProcessingThread] shutdown: going to close sockets... 2016-04-12T18:37:58.524+0000 I STORAGE [signalProcessingThread] WiredTigerKVEngine shutting down 2016-04-12T18:37:58.545+0000 I STORAGE [signalProcessingThread] shutdown: removing fs lock... 2016-04-12T18:37:58.545+0000 I CONTROL [signalProcessingThread] dbexit: rc: 0 2016-04-12T18:39:17.536+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] MongoDB starting : pid=18110 port=27016 dbpath=/var/lib/mongodb-replica/mongodbreplica2 64-bit host=ip-172-31-6-169 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] db version v3.2.1 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] git version: a14d55980c2cdc565d4704a7e3ad37e4e535c1b2 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] modules: none 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] build environment: 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] distmod: ubuntu1404 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] distarch: x86_64 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-04-12T18:39:17.582+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb.d/mongodbreplica2.conf", net: { http: { RESTInterfaceEnabled: true, enabled: true }, port: 27016 }, processManagement: { pidFilePath: "/var/run/mongodb-replica/mongodbreplica2.pid" }, replication: { oplogSizeMB: 128, replSet: "mongodbreplica" }, storage: { dbPath: "/var/lib/mongodb-replica/mongodbreplica2", mmapv1: { smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb-replica/mongodbreplica2.log" } } 2016-04-12T18:39:17.674+0000 I - [initandlisten] Detected data files in /var/lib/mongodb-replica/mongodbreplica2 created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2016-04-12T18:39:17.674+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-04-12T18:39:18.879+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-04-12T18:39:18.879+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 127183 records totaling to 2916795180 bytes 2016-04-12T18:39:18.879+0000 I STORAGE [initandlisten] Sampling from the oplog between Apr 8 12:54:47:1 and Apr 12 18:36:04:1 to determine where to place markers for truncation 2016-04-12T18:39:18.879+0000 I STORAGE [initandlisten] Taking 1002 samples and assuming that each section of oplog contains approximately 1269 records totaling to 29103049 bytes 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 13:49:12:2 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 14:49:50:3 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 15:49:01:1 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 16:51:32:2 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 17:57:49:1 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 18:59:47:1 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 20:00:46:1 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 21:00:36:1 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 21:29:39:2 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 22:29:00:1 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 23:32:46:2 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 00:32:39:2 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 01:32:09:2 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 02:31:16:1 2016-04-12T18:39:19.776+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 03:30:51:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 04:30:39:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 05:30:01:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 06:28:45:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 07:28:42:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 07:58:37:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 08:57:08:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 09:56:46:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 10:53:45:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 11:50:06:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 12:46:45:4 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 13:43:45:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 14:15:45:3 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 15:14:45:3 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 16:11:37:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 17:07:38:3 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 18:04:21:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 19:01:11:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 19:31:10:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:27:44:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 21:23:43:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 22:19:46:3 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 23:16:16:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 00:13:07:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 00:42:31:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 01:39:07:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 02:35:09:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 03:31:40:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 04:28:45:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 05:25:00:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 05:54:14:3 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 06:51:40:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 07:47:36:2 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 08:44:14:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 09:41:37:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 10:38:13:1 2016-04-12T18:39:19.786+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 11:08:45:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 12:05:36:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 13:02:15:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 13:59:38:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 14:56:20:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 15:53:38:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 16:23:38:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 17:23:19:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 18:30:17:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 19:27:00:3 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 20:22:45:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 21:19:07:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 21:48:21:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 22:44:45:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 23:40:37:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 00:37:00:6 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 01:32:45:4 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:29:00:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:58:08:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 03:53:48:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 04:51:02:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 05:47:06:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 06:43:41:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 07:39:35:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 08:09:07:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 09:05:39:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:01:09:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:57:37:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 11:53:40:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 12:49:46:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 13:19:44:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 14:19:58:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 15:15:59:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 16:13:00:6 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 17:10:46:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 18:07:52:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 18:46:04:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 19:44:29:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 20:59:12:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 21:59:06:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 22:59:21:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 23:56:00:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 00:34:54:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 01:33:01:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 02:29:41:2 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 03:26:31:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 04:24:09:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:20:45:1 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:50:43:3 2016-04-12T18:39:19.787+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 18:27:50:2 2016-04-12T18:39:19.960+0000 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2016-04-12T18:39:19.997+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb-replica/mongodbreplica2/diagnostic.data' 2016-04-12T18:39:19.997+0000 I NETWORK [initandlisten] waiting for connections on port 27016 2016-04-12T18:39:19.997+0000 I NETWORK [websvr] admin web console waiting for connections on port 28016 2016-04-12T18:39:19.997+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-04-12T18:39:19.999+0000 W NETWORK [ReplicationExecutor] Failed to connect to 127.0.0.1:27017, reason: errno:111 Connection refused 2016-04-12T18:39:20.011+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "mongodbreplica", version: 2, protocolVersion: 1, members: [ { _id: 0, host: "localhost:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "localhost:27016", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "localhost:27015", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-04-12T18:39:20.011+0000 I REPL [ReplicationExecutor] This node is localhost:27016 in the config 2016-04-12T18:39:20.011+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-04-12T18:39:20.011+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-04-12T18:39:20.012+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:20.012+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-12T18:39:20.013+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-12T18:39:20.013+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:20.013+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-04-12T18:39:20.013+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:20.014+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-04-12T18:39:20.730+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51772 #1 (1 connection now open) 2016-04-12T18:39:20.730+0000 I NETWORK [conn1] end connection 127.0.0.1:51772 (0 connections now open) 2016-04-12T18:39:20.731+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51774 #2 (1 connection now open) 2016-04-12T18:39:24.740+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51782 #3 (2 connections now open) 2016-04-12T18:39:25.014+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-12T18:39:25.014+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-12T18:39:31.788+0000 I NETWORK [conn2] end connection 127.0.0.1:51774 (1 connection now open) 2016-04-12T18:39:35.016+0000 I ASIO [ReplicationExecutor] dropping unhealthy pooled connection to localhost:27017 2016-04-12T18:39:35.016+0000 I ASIO [ReplicationExecutor] after drop, pool was empty, going to spawn some connections 2016-04-12T18:39:35.016+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:35.016+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:35.016+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state PRIMARY 2016-04-12T18:39:35.017+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:35.018+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-12T18:39:35.019+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-12T18:39:35.019+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T18:39:40.017+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:40.017+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:40.017+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:42.017+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:42.018+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:42.019+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:44.019+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:44.019+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:44.019+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:46.019+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:46.019+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:46.019+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:48.019+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:48.020+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:48.020+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:50.021+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:50.021+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:50.021+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:52.021+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:52.021+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:52.022+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:54.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:54.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:54.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:56.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:56.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:56.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:58.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:58.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:39:58.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:40:00.024+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:40:00.024+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:40:00.024+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:40:02.024+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:40:02.024+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:40:02.024+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:40:04.025+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:40:04.025+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:40:04.025+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:40:05.015+0000 I CONTROL [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends 2016-04-12T18:40:05.015+0000 I FTDC [signalProcessingThread] Shutting down full-time diagnostic data capture 2016-04-12T18:40:05.017+0000 I REPL [signalProcessingThread] Stopping replication applier threads 2016-04-12T18:40:05.045+0000 W EXECUTOR [rsBackgroundSync] killCursors command task failed: CallbackCanceled Callback canceled 2016-04-12T18:40:06.029+0000 I CONTROL [signalProcessingThread] now exiting 2016-04-12T18:40:06.029+0000 I NETWORK [signalProcessingThread] shutdown: going to close listening sockets... 2016-04-12T18:40:06.029+0000 I NETWORK [signalProcessingThread] closing listening socket: 6 2016-04-12T18:40:06.029+0000 I NETWORK [signalProcessingThread] closing listening socket: 7 2016-04-12T18:40:06.029+0000 I NETWORK [signalProcessingThread] closing listening socket: 8 2016-04-12T18:40:06.029+0000 I NETWORK [signalProcessingThread] removing socket file: /tmp/mongodb-27016.sock 2016-04-12T18:40:06.029+0000 I NETWORK [signalProcessingThread] shutdown: going to flush diaglog... 2016-04-12T18:40:06.029+0000 I NETWORK [signalProcessingThread] shutdown: going to close sockets... 2016-04-12T18:40:06.029+0000 I STORAGE [signalProcessingThread] WiredTigerKVEngine shutting down 2016-04-12T18:40:06.029+0000 I NETWORK [conn3] end connection 127.0.0.1:51782 (0 connections now open) 2016-04-12T18:40:06.101+0000 I STORAGE [signalProcessingThread] shutdown: removing fs lock... 2016-04-12T18:40:06.101+0000 I CONTROL [signalProcessingThread] dbexit: rc: 0 2016-04-12T18:40:15.070+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-04-12T18:40:15.123+0000 I CONTROL [initandlisten] MongoDB starting : pid=18398 port=27016 dbpath=/var/lib/mongodb-replica/mongodbreplica2 64-bit host=ip-172-31-6-169 2016-04-12T18:40:15.123+0000 I CONTROL [initandlisten] db version v3.2.1 2016-04-12T18:40:15.123+0000 I CONTROL [initandlisten] git version: a14d55980c2cdc565d4704a7e3ad37e4e535c1b2 2016-04-12T18:40:15.123+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014 2016-04-12T18:40:15.123+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-04-12T18:40:15.123+0000 I CONTROL [initandlisten] modules: none 2016-04-12T18:40:15.123+0000 I CONTROL [initandlisten] build environment: 2016-04-12T18:40:15.124+0000 I CONTROL [initandlisten] distmod: ubuntu1404 2016-04-12T18:40:15.124+0000 I CONTROL [initandlisten] distarch: x86_64 2016-04-12T18:40:15.124+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-04-12T18:40:15.124+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb.d/mongodbreplica2.conf", net: { http: { RESTInterfaceEnabled: true, enabled: true }, port: 27016 }, processManagement: { pidFilePath: "/var/run/mongodb-replica/mongodbreplica2.pid" }, replication: { oplogSizeMB: 128, replSet: "mongodbreplica" }, storage: { dbPath: "/var/lib/mongodb-replica/mongodbreplica2", mmapv1: { smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb-replica/mongodbreplica2.log" } } 2016-04-12T18:40:15.239+0000 I - [initandlisten] Detected data files in /var/lib/mongodb-replica/mongodbreplica2 created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2016-04-12T18:40:15.239+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-04-12T18:40:16.476+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-04-12T18:40:16.476+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 127184 records totaling to 2916795274 bytes 2016-04-12T18:40:16.477+0000 I STORAGE [initandlisten] Sampling from the oplog between Apr 8 12:54:47:1 and Apr 12 18:39:30:2 to determine where to place markers for truncation 2016-04-12T18:40:16.477+0000 I STORAGE [initandlisten] Taking 1002 samples and assuming that each section of oplog contains approximately 1269 records totaling to 29102821 bytes 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 13:49:12:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 14:47:11:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 15:43:07:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 16:39:36:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 17:45:46:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 18:15:56:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 19:14:45:5 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 20:12:13:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 21:09:09:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 22:05:09:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 23:05:08:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 23:36:08:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 00:32:38:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 01:28:45:6 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 02:25:45:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 03:22:07:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 04:18:38:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 04:48:34:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 05:44:40:5 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 06:40:45:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 07:38:00:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 08:34:02:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 09:30:08:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 10:00:07:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 10:56:41:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 11:52:46:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 12:50:02:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 13:46:08:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 14:47:46:5 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 15:17:37:3 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 16:14:20:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 17:11:00:6 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 18:07:40:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 19:03:44:3 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:03:50:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:33:45:7 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 21:32:45:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 22:31:41:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 23:31:44:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 00:31:00:3 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 01:29:49:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 02:29:40:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 03:28:45:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 04:28:19:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 05:27:35:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 06:27:36:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 06:57:38:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 07:56:16:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 08:56:45:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 09:56:45:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 10:56:45:1 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 11:56:14:2 2016-04-12T18:40:17.444+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 12:56:19:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 13:56:13:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 14:56:21:3 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 15:53:38:3 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 16:23:39:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 17:23:20:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 18:30:45:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 19:26:47:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 20:23:00:3 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 21:19:07:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 21:48:22:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 22:44:12:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 23:40:45:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 00:37:00:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 01:32:46:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:29:02:3 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:58:08:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 03:54:18:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 04:50:46:3 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 05:47:06:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 06:43:41:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 07:39:35:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 08:09:07:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 09:05:39:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:01:08:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:57:38:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 11:53:39:3 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 12:49:46:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 13:19:45:4 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 14:19:58:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 15:16:00:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 16:13:02:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 17:10:46:4 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 18:07:53:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 18:46:03:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 19:44:29:3 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 20:58:45:3 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 21:59:06:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 22:59:20:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 23:55:50:1 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 00:34:54:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 01:32:45:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 02:29:41:2 2016-04-12T18:40:17.446+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 03:26:31:1 2016-04-12T18:40:17.447+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 04:24:09:2 2016-04-12T18:40:17.447+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:20:45:5 2016-04-12T18:40:17.447+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:50:45:5 2016-04-12T18:40:17.447+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 18:27:50:3 2016-04-12T18:40:17.863+0000 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2016-04-12T18:40:17.887+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb-replica/mongodbreplica2/diagnostic.data' 2016-04-12T18:40:17.887+0000 I NETWORK [initandlisten] waiting for connections on port 27016 2016-04-12T18:40:17.887+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-04-12T18:40:17.896+0000 I NETWORK [websvr] admin web console waiting for connections on port 28016 2016-04-12T18:40:17.897+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "mongodbreplica", version: 2, protocolVersion: 1, members: [ { _id: 0, host: "localhost:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "localhost:27016", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "localhost:27015", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-04-12T18:40:17.897+0000 I REPL [ReplicationExecutor] This node is localhost:27016 in the config 2016-04-12T18:40:17.897+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-04-12T18:40:17.897+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-04-12T18:40:17.898+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-12T18:40:17.898+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-12T18:40:17.898+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-04-12T18:40:17.899+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-04-12T18:40:17.899+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-12T18:40:17.899+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-12T18:40:22.663+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51903 #1 (1 connection now open) 2016-04-12T18:40:22.751+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51905 #2 (2 connections now open) 2016-04-12T18:40:32.901+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state PRIMARY 2016-04-12T18:40:33.901+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-12T18:40:33.901+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-12T18:40:33.902+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T18:40:38.769+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51914 #3 (3 connections now open) 2016-04-12T18:40:38.770+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-12T18:40:38.770+0000 W REPL [ReplicationExecutor] The liveness timeout does not match callback handle, so not resetting it. 2016-04-12T18:40:38.771+0000 I ASIO [ReplicationExecutor] dropping unhealthy pooled connection to localhost:27015 2016-04-12T18:40:38.771+0000 I ASIO [ReplicationExecutor] after drop, pool was empty, going to spawn some connections 2016-04-12T18:40:38.771+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-12T18:40:38.771+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state PRIMARY 2016-04-12T18:40:38.771+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-12T18:40:38.771+0000 I NETWORK [conn1] end connection 127.0.0.1:51903 (2 connections now open) 2016-04-12T18:40:44.772+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-12T18:40:44.773+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-12T18:40:44.773+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T18:40:55.795+0000 I CONTROL [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends 2016-04-12T18:40:55.795+0000 I FTDC [signalProcessingThread] Shutting down full-time diagnostic data capture 2016-04-12T18:40:55.797+0000 I REPL [signalProcessingThread] Stopping replication applier threads 2016-04-12T18:40:57.790+0000 I CONTROL [signalProcessingThread] now exiting 2016-04-12T18:40:57.790+0000 I NETWORK [signalProcessingThread] shutdown: going to close listening sockets... 2016-04-12T18:40:57.790+0000 I NETWORK [signalProcessingThread] closing listening socket: 6 2016-04-12T18:40:57.790+0000 I NETWORK [signalProcessingThread] closing listening socket: 7 2016-04-12T18:40:57.790+0000 I NETWORK [signalProcessingThread] closing listening socket: 8 2016-04-12T18:40:57.790+0000 I NETWORK [signalProcessingThread] removing socket file: /tmp/mongodb-27016.sock 2016-04-12T18:40:57.790+0000 I NETWORK [signalProcessingThread] shutdown: going to flush diaglog... 2016-04-12T18:40:57.790+0000 I NETWORK [signalProcessingThread] shutdown: going to close sockets... 2016-04-12T18:40:57.790+0000 I STORAGE [signalProcessingThread] WiredTigerKVEngine shutting down 2016-04-12T18:40:57.791+0000 I NETWORK [conn2] end connection 127.0.0.1:51905 (1 connection now open) 2016-04-12T18:40:57.791+0000 I NETWORK [conn3] end connection 127.0.0.1:51914 (1 connection now open) 2016-04-12T18:40:57.916+0000 I STORAGE [signalProcessingThread] shutdown: removing fs lock... 2016-04-12T18:40:57.916+0000 I CONTROL [signalProcessingThread] dbexit: rc: 0 2016-04-12T18:42:04.041+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] MongoDB starting : pid=1098 port=27016 dbpath=/var/lib/mongodb-replica/mongodbreplica2 64-bit host=ip-172-31-6-169 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] db version v3.2.1 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] git version: a14d55980c2cdc565d4704a7e3ad37e4e535c1b2 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] modules: none 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] build environment: 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] distmod: ubuntu1404 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] distarch: x86_64 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-04-12T18:42:04.151+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb.d/mongodbreplica2.conf", net: { http: { RESTInterfaceEnabled: true, enabled: true }, port: 27016 }, processManagement: { pidFilePath: "/var/run/mongodb-replica/mongodbreplica2.pid" }, replication: { oplogSizeMB: 128, replSet: "mongodbreplica" }, storage: { dbPath: "/var/lib/mongodb-replica/mongodbreplica2", mmapv1: { smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb-replica/mongodbreplica2.log" } } 2016-04-12T18:42:04.375+0000 I - [initandlisten] Detected data files in /var/lib/mongodb-replica/mongodbreplica2 created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2016-04-12T18:42:04.375+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-04-12T18:42:05.826+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-04-12T18:42:05.826+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 127186 records totaling to 2916795462 bytes 2016-04-12T18:42:05.827+0000 I STORAGE [initandlisten] Sampling from the oplog between Apr 8 12:54:47:1 and Apr 12 18:40:39:1 to determine where to place markers for truncation 2016-04-12T18:42:05.828+0000 I STORAGE [initandlisten] Taking 1002 samples and assuming that each section of oplog contains approximately 1269 records totaling to 29102365 bytes 2016-04-12T18:42:07.712+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 13:52:46:5 2016-04-12T18:42:07.712+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 14:26:32:1 2016-04-12T18:42:07.712+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 15:25:08:1 2016-04-12T18:42:07.712+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 16:24:21:1 2016-04-12T18:42:07.712+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 17:33:38:3 2016-04-12T18:42:07.712+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 18:35:43:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 19:34:26:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 20:35:14:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 21:34:00:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 22:33:00:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 23:36:44:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 00:08:46:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 01:05:27:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 02:01:19:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 02:56:49:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 03:52:45:3 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 04:48:45:3 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 05:21:09:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 06:16:46:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 07:14:01:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 08:08:45:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 09:04:46:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 10:00:44:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 10:32:42:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 11:29:12:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 12:25:16:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 13:21:15:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 14:21:04:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 15:18:45:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 15:51:02:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 16:47:07:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 17:43:08:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 18:39:08:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 19:35:38:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:31:45:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 21:03:44:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 21:59:38:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 22:55:10:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 23:51:46:3 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 00:47:07:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 01:43:08:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 02:15:08:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 03:11:08:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 04:07:09:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 05:03:07:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 05:59:06:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 06:55:36:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 07:27:11:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 08:23:36:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 09:19:47:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 10:16:45:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 11:13:07:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 12:09:37:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 12:41:46:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 13:38:22:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 14:35:08:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 15:31:40:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 16:27:46:3 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 17:29:45:4 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 18:09:46:4 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 19:05:45:6 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 20:01:53:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 20:57:09:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 21:53:00:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 22:48:45:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 23:20:13:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 00:15:55:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 01:11:43:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:07:45:3 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 03:03:01:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 03:57:47:3 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 04:30:34:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 05:25:45:7 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 06:21:55:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 07:17:43:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 08:13:47:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 09:09:08:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 09:41:06:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:37:06:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 11:32:30:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 12:28:25:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 13:23:52:2 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 14:23:58:1 2016-04-12T18:42:07.713+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 14:55:49:1 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 15:51:41:4 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 16:48:45:4 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 17:46:33:1 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 18:52:45:5 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 19:48:46:1 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 20:30:16:1 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 21:37:53:2 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 22:41:43:1 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 23:40:45:2 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 00:50:03:2 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 01:49:47:2 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 02:49:45:1 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 03:48:26:2 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 04:48:50:2 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:48:41:1 2016-04-12T18:42:07.722+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 06:20:44:1 2016-04-12T18:42:07.989+0000 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2016-04-12T18:42:08.070+0000 I NETWORK [websvr] admin web console waiting for connections on port 28016 2016-04-12T18:42:08.075+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb-replica/mongodbreplica2/diagnostic.data' 2016-04-12T18:42:08.075+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-04-12T18:42:08.077+0000 I NETWORK [initandlisten] waiting for connections on port 27016 2016-04-12T18:42:08.077+0000 W NETWORK [ReplicationExecutor] Failed to connect to 127.0.0.1:27017, reason: errno:111 Connection refused 2016-04-12T18:42:08.078+0000 W NETWORK [ReplicationExecutor] Failed to connect to 127.0.0.1:27015, reason: errno:111 Connection refused 2016-04-12T18:42:08.078+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "mongodbreplica", version: 2, protocolVersion: 1, members: [ { _id: 0, host: "localhost:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "localhost:27016", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "localhost:27015", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-04-12T18:42:08.078+0000 I REPL [ReplicationExecutor] This node is localhost:27016 in the config 2016-04-12T18:42:08.078+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-04-12T18:42:08.078+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-04-12T18:42:08.089+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-04-12T18:42:08.092+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-04-12T18:42:08.093+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:42:08.093+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable Connection refused 2016-04-12T18:42:08.093+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:42:08.093+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable Connection refused 2016-04-12T18:42:08.110+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable Connection refused 2016-04-12T18:42:08.110+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable Connection refused 2016-04-12T18:42:08.247+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44336 #1 (1 connection now open) 2016-04-12T18:42:08.249+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44338 #2 (2 connections now open) 2016-04-12T18:42:08.264+0000 I NETWORK [conn1] end connection 127.0.0.1:44336 (1 connection now open) 2016-04-12T18:42:08.361+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44343 #3 (2 connections now open) 2016-04-12T18:42:08.361+0000 I NETWORK [conn3] end connection 127.0.0.1:44343 (1 connection now open) 2016-04-12T18:42:08.362+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44345 #4 (2 connections now open) 2016-04-12T18:42:13.094+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-12T18:42:13.094+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-12T18:42:13.111+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-12T18:42:13.111+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-12T18:42:23.094+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state PRIMARY 2016-04-12T18:42:24.094+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-12T18:42:24.095+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-12T18:42:24.096+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-12T18:43:36.412+0000 I CONTROL [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends 2016-04-12T18:43:36.412+0000 I FTDC [signalProcessingThread] Shutting down full-time diagnostic data capture 2016-04-12T18:43:36.429+0000 I REPL [signalProcessingThread] Stopping replication applier threads 2016-04-12T18:43:38.312+0000 I CONTROL [signalProcessingThread] now exiting 2016-04-12T18:43:38.312+0000 I NETWORK [signalProcessingThread] shutdown: going to close listening sockets... 2016-04-12T18:43:38.312+0000 I NETWORK [signalProcessingThread] closing listening socket: 6 2016-04-12T18:43:38.312+0000 I NETWORK [signalProcessingThread] closing listening socket: 7 2016-04-12T18:43:38.312+0000 I NETWORK [signalProcessingThread] closing listening socket: 8 2016-04-12T18:43:38.312+0000 I NETWORK [signalProcessingThread] removing socket file: /tmp/mongodb-27016.sock 2016-04-12T18:43:38.312+0000 I NETWORK [signalProcessingThread] shutdown: going to flush diaglog... 2016-04-12T18:43:38.312+0000 I NETWORK [signalProcessingThread] shutdown: going to close sockets... 2016-04-12T18:43:38.312+0000 I STORAGE [signalProcessingThread] WiredTigerKVEngine shutting down 2016-04-12T18:43:38.312+0000 I NETWORK [conn2] end connection 127.0.0.1:44338 (1 connection now open) 2016-04-12T18:43:38.313+0000 I NETWORK [conn4] end connection 127.0.0.1:44345 (1 connection now open) 2016-04-12T18:43:38.417+0000 I STORAGE [signalProcessingThread] shutdown: removing fs lock... 2016-04-12T18:43:38.418+0000 I CONTROL [signalProcessingThread] dbexit: rc: 0 2016-04-12T18:43:42.426+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-04-12T18:43:42.432+0000 I CONTROL [initandlisten] MongoDB starting : pid=1950 port=27016 dbpath=/var/lib/mongodb-replica/mongodbreplica2 64-bit host=ip-172-31-6-169 2016-04-12T18:43:42.433+0000 I CONTROL [initandlisten] db version v3.2.4 2016-04-12T18:43:42.433+0000 I CONTROL [initandlisten] git version: e2ee9ffcf9f5a94fad76802e28cc978718bb7a30 2016-04-12T18:43:42.433+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014 2016-04-12T18:43:42.433+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-04-12T18:43:42.433+0000 I CONTROL [initandlisten] modules: none 2016-04-12T18:43:42.433+0000 I CONTROL [initandlisten] build environment: 2016-04-12T18:43:42.433+0000 I CONTROL [initandlisten] distmod: ubuntu1404 2016-04-12T18:43:42.433+0000 I CONTROL [initandlisten] distarch: x86_64 2016-04-12T18:43:42.433+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-04-12T18:43:42.433+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb.d/mongodbreplica2.conf", net: { http: { RESTInterfaceEnabled: true, enabled: true }, port: 27016 }, processManagement: { pidFilePath: "/var/run/mongodb-replica/mongodbreplica2.pid" }, replication: { oplogSizeMB: 128, replSet: "mongodbreplica" }, storage: { dbPath: "/var/lib/mongodb-replica/mongodbreplica2", mmapv1: { smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb-replica/mongodbreplica2.log" } } 2016-04-12T18:43:42.525+0000 I - [initandlisten] Detected data files in /var/lib/mongodb-replica/mongodbreplica2 created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2016-04-12T18:43:42.525+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-04-12T18:43:44.325+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-04-12T18:43:44.334+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 127187 records totaling to 2916795556 bytes 2016-04-12T18:43:44.335+0000 I STORAGE [initandlisten] Sampling from the oplog between Apr 8 12:54:47:1 and Apr 12 18:42:19:1 to determine where to place markers for truncation 2016-04-12T18:43:44.335+0000 I STORAGE [initandlisten] Taking 1002 samples and assuming that each section of oplog contains approximately 1269 records totaling to 29102137 bytes 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 13:26:34:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 14:25:47:3 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 15:25:07:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 16:23:46:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 17:33:37:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 18:35:09:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 19:33:47:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 20:35:13:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 21:33:53:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 22:32:15:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 8 23:36:40:3 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 00:08:40:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 01:08:37:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 02:07:17:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 03:06:40:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 04:06:08:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 05:04:47:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 06:03:46:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 07:03:14:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 08:02:38:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 09:01:11:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 09:33:45:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 10:30:01:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 11:26:00:3 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 12:22:08:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 13:18:06:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 14:17:46:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 14:51:09:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 15:47:39:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 16:43:36:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 17:39:37:3 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 18:35:43:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 19:31:46:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:04:45:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:59:46:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 21:55:45:5 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 22:51:43:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 23:47:41:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 00:43:42:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 01:15:47:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 02:11:46:3 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 03:07:41:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 04:03:44:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 04:59:42:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 05:55:38:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 06:27:43:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 07:24:07:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 08:19:45:5 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 09:16:45:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 10:13:07:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 11:09:41:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 11:41:45:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 12:38:45:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 13:35:07:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 14:31:42:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 15:27:48:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 16:24:17:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 16:57:08:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 18:07:08:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 19:02:45:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 19:57:50:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 20:53:45:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 21:49:40:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 22:21:42:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 23:17:08:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 00:12:27:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 01:07:59:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:03:42:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:59:08:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 03:31:08:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 04:27:09:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 05:23:00:5 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 06:18:24:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 07:14:21:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 08:09:41:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 08:41:44:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 09:37:47:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:33:38:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 11:29:12:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 12:25:01:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 13:21:00:4 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 13:53:00:3 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 14:52:33:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 15:48:31:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 16:44:45:5 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 17:42:46:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 18:47:46:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 19:21:08:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 20:26:02:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 21:35:00:4 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 22:35:02:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 23:30:44:2 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 00:36:44:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 01:09:48:3 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 02:05:46:4 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 03:01:47:4 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 03:57:46:1 2016-04-12T18:43:46.403+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 04:55:25:1 2016-04-12T18:43:46.404+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:52:01:1 2016-04-12T18:43:46.404+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 06:24:07:2 2016-04-12T18:43:46.529+0000 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2016-04-12T18:43:46.553+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb-replica/mongodbreplica2/diagnostic.data' 2016-04-12T18:43:46.554+0000 I NETWORK [initandlisten] waiting for connections on port 27016 2016-04-12T18:43:46.554+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-04-12T18:43:46.554+0000 I NETWORK [websvr] admin web console waiting for connections on port 28016 2016-04-12T18:43:46.564+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "mongodbreplica", version: 2, protocolVersion: 1, members: [ { _id: 0, host: "localhost:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "localhost:27016", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "localhost:27015", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-04-12T18:43:46.564+0000 I REPL [ReplicationExecutor] This node is localhost:27016 in the config 2016-04-12T18:43:46.564+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-04-12T18:43:46.564+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-04-12T18:43:46.564+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-12T18:43:46.565+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-12T18:43:46.565+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-04-12T18:43:46.565+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-04-12T18:43:46.566+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-12T18:43:46.566+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-12T18:43:50.322+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44379 #1 (1 connection now open) 2016-04-12T18:43:51.377+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44381 #2 (2 connections now open) 2016-04-12T18:43:56.566+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state PRIMARY 2016-04-12T18:44:01.567+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-12T18:44:01.568+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-12T18:44:01.569+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T18:45:31.580+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T18:45:45.739+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44405 #3 (3 connections now open) 2016-04-12T18:45:45.739+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44406 #4 (4 connections now open) 2016-04-12T18:45:45.739+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44407 #5 (5 connections now open) 2016-04-12T18:45:45.739+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44408 #6 (6 connections now open) 2016-04-12T18:45:45.739+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44409 #7 (7 connections now open) 2016-04-12T18:45:45.870+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44413 #8 (8 connections now open) 2016-04-12T18:45:45.871+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44415 #9 (9 connections now open) 2016-04-12T18:45:45.902+0000 I NETWORK [conn9] end connection 127.0.0.1:44415 (8 connections now open) 2016-04-12T18:45:45.966+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44418 #10 (9 connections now open) 2016-04-12T18:45:46.071+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44423 #11 (10 connections now open) 2016-04-12T18:45:49.307+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44435 #12 (11 connections now open) 2016-04-12T18:45:49.307+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44436 #13 (12 connections now open) 2016-04-12T18:45:49.322+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44437 #14 (13 connections now open) 2016-04-12T18:45:49.322+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44438 #15 (14 connections now open) 2016-04-12T18:45:49.324+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44439 #16 (15 connections now open) 2016-04-12T18:45:49.510+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44443 #17 (16 connections now open) 2016-04-12T18:45:49.510+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44445 #18 (17 connections now open) 2016-04-12T18:45:49.524+0000 I NETWORK [conn18] end connection 127.0.0.1:44445 (16 connections now open) 2016-04-12T18:45:49.545+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44448 #19 (17 connections now open) 2016-04-12T18:45:49.612+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44453 #20 (18 connections now open) 2016-04-12T18:45:52.736+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44465 #21 (19 connections now open) 2016-04-12T18:45:52.736+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44466 #22 (20 connections now open) 2016-04-12T18:45:52.736+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44467 #23 (21 connections now open) 2016-04-12T18:45:52.736+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44468 #24 (22 connections now open) 2016-04-12T18:45:52.736+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44469 #25 (23 connections now open) 2016-04-12T18:45:52.888+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44473 #26 (24 connections now open) 2016-04-12T18:45:52.888+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44475 #27 (25 connections now open) 2016-04-12T18:45:52.905+0000 I NETWORK [conn27] end connection 127.0.0.1:44475 (24 connections now open) 2016-04-12T18:45:52.974+0000 I ACCESS [conn10] Successfully authenticated as principal oplogger on admin 2016-04-12T18:45:52.991+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44478 #28 (25 connections now open) 2016-04-12T18:45:53.021+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44481 #29 (26 connections now open) 2016-04-12T18:45:53.025+0000 I NETWORK [conn29] end connection 127.0.0.1:44481 (25 connections now open) 2016-04-12T18:45:53.054+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44484 #30 (26 connections now open) 2016-04-12T18:45:53.101+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44489 #31 (27 connections now open) 2016-04-12T18:45:55.233+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44493 #32 (28 connections now open) 2016-04-12T18:45:56.525+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44505 #33 (29 connections now open) 2016-04-12T18:45:56.525+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44506 #34 (30 connections now open) 2016-04-12T18:45:56.525+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44507 #35 (31 connections now open) 2016-04-12T18:45:56.525+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44508 #36 (32 connections now open) 2016-04-12T18:45:56.525+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44509 #37 (33 connections now open) 2016-04-12T18:45:56.757+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44513 #38 (34 connections now open) 2016-04-12T18:45:56.757+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44515 #39 (35 connections now open) 2016-04-12T18:45:56.760+0000 I NETWORK [conn39] end connection 127.0.0.1:44515 (34 connections now open) 2016-04-12T18:45:56.781+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44518 #40 (35 connections now open) 2016-04-12T18:45:56.809+0000 I ACCESS [conn19] Successfully authenticated as principal oplogger on admin 2016-04-12T18:45:56.856+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44521 #41 (36 connections now open) 2016-04-12T18:45:56.861+0000 I NETWORK [conn41] end connection 127.0.0.1:44521 (35 connections now open) 2016-04-12T18:45:56.871+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44526 #42 (36 connections now open) 2016-04-12T18:45:56.908+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44528 #43 (37 connections now open) 2016-04-12T18:45:58.770+0000 I ACCESS [conn40] Successfully authenticated as principal oplogger on admin 2016-04-12T18:45:59.432+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44533 #44 (38 connections now open) 2016-04-12T18:46:00.223+0000 I ACCESS [conn30] Successfully authenticated as principal oplogger on admin 2016-04-12T18:46:00.226+0000 I ACCESS [conn28] Successfully authenticated as principal oplogger on admin 2016-04-12T18:46:00.373+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44535 #45 (39 connections now open) 2016-04-12T18:46:00.423+0000 I NETWORK [conn45] end connection 127.0.0.1:44535 (38 connections now open) 2016-04-12T18:46:00.460+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44538 #46 (39 connections now open) 2016-04-12T18:46:00.509+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44543 #47 (40 connections now open) 2016-04-12T18:46:01.199+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44555 #48 (41 connections now open) 2016-04-12T18:46:01.200+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44556 #49 (42 connections now open) 2016-04-12T18:46:01.202+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44557 #50 (43 connections now open) 2016-04-12T18:46:01.203+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44558 #51 (44 connections now open) 2016-04-12T18:46:01.216+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44559 #52 (45 connections now open) 2016-04-12T18:46:01.315+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44563 #53 (46 connections now open) 2016-04-12T18:46:01.316+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44565 #54 (47 connections now open) 2016-04-12T18:46:01.354+0000 I NETWORK [conn54] end connection 127.0.0.1:44565 (46 connections now open) 2016-04-12T18:46:01.439+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44568 #55 (47 connections now open) 2016-04-12T18:46:01.534+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44573 #56 (48 connections now open) 2016-04-12T18:46:04.118+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44575 #57 (49 connections now open) 2016-04-12T18:46:04.134+0000 I NETWORK [conn57] end connection 127.0.0.1:44575 (48 connections now open) 2016-04-12T18:46:04.239+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44578 #58 (49 connections now open) 2016-04-12T18:46:04.323+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44583 #59 (50 connections now open) 2016-04-12T18:46:04.484+0000 I ACCESS [conn43] Successfully authenticated as principal oplogger on admin 2016-04-12T18:46:05.131+0000 I ACCESS [conn46] Successfully authenticated as principal oplogger on admin 2016-04-12T18:46:08.848+0000 I ACCESS [conn55] Successfully authenticated as principal oplogger on admin 2016-04-12T18:46:08.914+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44585 #60 (51 connections now open) 2016-04-12T18:46:08.919+0000 I NETWORK [conn60] end connection 127.0.0.1:44585 (50 connections now open) 2016-04-12T18:46:08.980+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44588 #61 (51 connections now open) 2016-04-12T18:46:09.062+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44593 #62 (52 connections now open) 2016-04-12T18:46:11.089+0000 I ACCESS [conn58] Successfully authenticated as principal oplogger on admin 2016-04-12T18:46:12.923+0000 I ACCESS [conn61] Successfully authenticated as principal oplogger on admin 2016-04-12T18:49:45.882+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-12T18:49:50.892+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-12T18:49:50.892+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-12T18:49:50.893+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-12T18:51:00.102+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-12T18:58:42.099+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 12 18:57:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 12 18:58:41:2) 2016-04-12T18:58:42.112+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-12T18:58:48.114+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-12T18:58:48.114+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-12T18:58:48.115+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T18:59:45.097+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T19:48:45.075+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 12 19:48:09:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 34, timestamp: Apr 12 19:48:45:5) 2016-04-12T19:48:45.075+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-12T19:48:51.088+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-12T19:48:51.090+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-12T19:49:50.029+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-12T19:49:50.031+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-12T19:49:50.032+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-12T19:51:46.934+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-12T20:14:23.634+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45128 #63 (53 connections now open) 2016-04-12T20:14:23.644+0000 I NETWORK [conn63] end connection 127.0.0.1:45128 (52 connections now open) 2016-04-12T20:14:23.645+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45129 #64 (53 connections now open) 2016-04-12T20:14:23.646+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45130 #65 (54 connections now open) 2016-04-12T20:27:32.660+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45170 #66 (55 connections now open) 2016-04-12T20:35:45.055+0000 I NETWORK [conn65] end connection 127.0.0.1:45130 (54 connections now open) 2016-04-12T20:40:45.042+0000 I NETWORK [conn64] end connection 127.0.0.1:45129 (53 connections now open) 2016-04-12T20:40:45.042+0000 I NETWORK [conn66] end connection 127.0.0.1:45170 (52 connections now open) 2016-04-12T20:58:30.432+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 12 20:57:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 12 20:58:29:1) 2016-04-12T20:58:30.432+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-12T20:58:31.432+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-12T20:58:31.433+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-12T20:58:31.434+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T21:02:45.084+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-12T22:01:24.493+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 12 22:00:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 34, timestamp: Apr 12 22:01:24:1) 2016-04-12T22:01:24.493+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-12T22:01:49.498+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-12T22:01:49.499+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-12T22:28:45.042+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 12 22:28:12:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 34, timestamp: Apr 12 22:28:45:2) 2016-04-12T22:28:45.042+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-12T22:28:46.042+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T00:32:50.040+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T00:32:50.043+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T00:32:50.043+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T00:36:04.426+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T01:23:25.024+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46509 #67 (53 connections now open) 2016-04-13T01:23:25.025+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46510 #68 (54 connections now open) 2016-04-13T01:23:25.025+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46511 #69 (55 connections now open) 2016-04-13T01:23:25.025+0000 I NETWORK [conn67] end connection 127.0.0.1:46509 (54 connections now open) 2016-04-13T01:31:00.084+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46543 #70 (55 connections now open) 2016-04-13T02:28:45.037+0000 I NETWORK [conn69] end connection 127.0.0.1:46511 (54 connections now open) 2016-04-13T02:33:45.041+0000 I NETWORK [conn68] end connection 127.0.0.1:46510 (53 connections now open) 2016-04-13T02:33:45.042+0000 I NETWORK [conn70] end connection 127.0.0.1:46543 (52 connections now open) 2016-04-13T03:47:31.512+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47444 #71 (53 connections now open) 2016-04-13T03:47:31.513+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47445 #72 (54 connections now open) 2016-04-13T03:47:31.513+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47446 #73 (55 connections now open) 2016-04-13T03:47:31.513+0000 I NETWORK [conn71] end connection 127.0.0.1:47444 (54 connections now open) 2016-04-13T03:47:45.066+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47447 #74 (55 connections now open) 2016-04-13T04:18:43.022+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47667 #75 (56 connections now open) 2016-04-13T04:18:43.023+0000 I NETWORK [conn73] end connection 127.0.0.1:47446 (55 connections now open) 2016-04-13T04:18:43.023+0000 I NETWORK [conn2] end connection 127.0.0.1:44381 (54 connections now open) 2016-04-13T04:19:49.991+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47677 #76 (55 connections now open) 2016-04-13T04:19:49.991+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47678 #77 (56 connections now open) 2016-04-13T04:19:49.992+0000 I NETWORK [conn76] end connection 127.0.0.1:47677 (55 connections now open) 2016-04-13T04:47:35.762+0000 I NETWORK [conn77] end connection 127.0.0.1:47678 (54 connections now open) 2016-04-13T04:47:40.762+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47875 #78 (55 connections now open) 2016-04-13T04:47:40.763+0000 I NETWORK [conn78] end connection 127.0.0.1:47875 (54 connections now open) 2016-04-13T04:47:40.764+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47876 #79 (55 connections now open) 2016-04-13T04:53:30.850+0000 I NETWORK [conn79] end connection 127.0.0.1:47876 (54 connections now open) 2016-04-13T04:53:31.851+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47919 #80 (55 connections now open) 2016-04-13T04:53:31.852+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47920 #81 (56 connections now open) 2016-04-13T04:53:31.852+0000 I NETWORK [conn80] end connection 127.0.0.1:47919 (55 connections now open) 2016-04-13T05:28:51.471+0000 I NETWORK [conn81] end connection 127.0.0.1:47920 (54 connections now open) 2016-04-13T05:28:51.474+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48170 #82 (55 connections now open) 2016-04-13T05:28:51.475+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48171 #83 (56 connections now open) 2016-04-13T05:28:51.477+0000 I NETWORK [conn82] end connection 127.0.0.1:48170 (55 connections now open) 2016-04-13T05:35:42.508+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 05:34:59:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 05:35:42:1) 2016-04-13T05:35:42.508+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T05:35:47.524+0000 I NETWORK [conn83] end connection 127.0.0.1:48171 (54 connections now open) 2016-04-13T05:35:47.526+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T05:35:47.526+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T05:40:47.523+0000 I NETWORK [conn74] end connection 127.0.0.1:47447 (53 connections now open) 2016-04-13T05:40:47.523+0000 I NETWORK [conn72] end connection 127.0.0.1:47445 (52 connections now open) 2016-04-13T05:50:26.822+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 05:49:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 05:50:26:1) 2016-04-13T05:50:26.822+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T05:50:31.832+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T05:50:31.834+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T05:50:31.834+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T05:54:50.082+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T06:12:25.219+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 06:11:48:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 34, timestamp: Apr 13 06:12:25:1) 2016-04-13T06:12:25.219+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T06:12:31.220+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T06:12:31.221+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T06:17:41.322+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T06:17:46.327+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T06:17:46.332+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T06:17:46.332+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T06:21:00.085+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T06:26:29.533+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 06:25:49:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 06:26:29:1) 2016-04-13T06:26:29.545+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T06:26:34.547+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T06:26:34.548+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T06:26:34.549+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T06:27:48.513+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T06:27:48.515+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T06:39:41.762+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 06:39:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 06:39:41:4) 2016-04-13T06:39:41.762+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T06:39:46.775+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T06:39:46.777+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T06:39:46.778+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T06:40:27.242+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 06:39:50:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 34, timestamp: Apr 13 06:40:26:2) 2016-04-13T06:40:27.242+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T06:40:32.243+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T06:40:32.244+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T06:43:02.532+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T06:49:41.564+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 06:49:08:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 34, timestamp: Apr 13 06:49:41:4) 2016-04-13T06:49:41.564+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T06:49:41.566+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T06:49:41.567+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T06:53:08.084+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T06:57:47.183+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48828 #84 (53 connections now open) 2016-04-13T06:57:47.183+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48829 #85 (54 connections now open) 2016-04-13T06:57:47.183+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48830 #86 (55 connections now open) 2016-04-13T06:57:47.183+0000 I NETWORK [conn84] end connection 127.0.0.1:48828 (54 connections now open) 2016-04-13T06:57:50.607+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48831 #87 (55 connections now open) 2016-04-13T08:03:45.262+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 08:03:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 08:03:45:5) 2016-04-13T08:03:45.262+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T08:03:50.263+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T08:03:50.264+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T08:03:50.268+0000 I NETWORK [conn86] end connection 127.0.0.1:48830 (54 connections now open) 2016-04-13T08:04:35.197+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 08:03:53:3) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 08:04:34:1) 2016-04-13T08:04:35.197+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T08:04:45.200+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T08:04:45.201+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T08:04:45.202+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T08:05:47.281+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T08:08:50.267+0000 I NETWORK [conn87] end connection 127.0.0.1:48831 (53 connections now open) 2016-04-13T08:08:50.267+0000 I NETWORK [conn85] end connection 127.0.0.1:48829 (52 connections now open) 2016-04-13T10:04:33.074+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T10:04:33.078+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T10:04:33.078+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T10:05:09.066+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T10:37:50.130+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50389 #88 (53 connections now open) 2016-04-13T10:37:50.131+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50390 #89 (54 connections now open) 2016-04-13T10:37:50.131+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50391 #90 (55 connections now open) 2016-04-13T10:37:50.131+0000 I NETWORK [conn88] end connection 127.0.0.1:50389 (54 connections now open) 2016-04-13T10:39:47.439+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50403 #91 (55 connections now open) 2016-04-13T11:38:28.347+0000 I NETWORK [conn90] end connection 127.0.0.1:50391 (54 connections now open) 2016-04-13T11:38:34.348+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50816 #92 (55 connections now open) 2016-04-13T11:38:34.348+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50817 #93 (56 connections now open) 2016-04-13T11:38:34.349+0000 I NETWORK [conn92] end connection 127.0.0.1:50816 (55 connections now open) 2016-04-13T11:53:42.849+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 11:53:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 11:53:41:2) 2016-04-13T11:53:42.849+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T11:53:42.862+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-13T11:53:43.849+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T11:53:43.850+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T12:08:29.863+0000 I NETWORK [conn93] end connection 127.0.0.1:50817 (54 connections now open) 2016-04-13T12:08:30.890+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51031 #94 (55 connections now open) 2016-04-13T12:08:30.890+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51032 #95 (56 connections now open) 2016-04-13T12:08:30.893+0000 I NETWORK [conn94] end connection 127.0.0.1:51031 (55 connections now open) 2016-04-13T12:11:36.475+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 12:11:00:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 12:11:36:1) 2016-04-13T12:11:36.475+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T12:11:36.505+0000 I NETWORK [conn95] end connection 127.0.0.1:51032 (54 connections now open) 2016-04-13T12:11:42.476+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T12:11:42.477+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T12:16:36.505+0000 I NETWORK [conn89] end connection 127.0.0.1:50390 (53 connections now open) 2016-04-13T12:16:36.506+0000 I NETWORK [conn91] end connection 127.0.0.1:50403 (52 connections now open) 2016-04-13T12:21:24.714+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 12:20:51:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 12:21:24:1) 2016-04-13T12:21:24.715+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T12:21:29.750+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T12:21:29.750+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T12:21:29.751+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T12:21:45.064+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T12:36:45.980+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T12:36:45.980+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T12:36:45.981+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T12:38:52.318+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T13:01:27.797+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 13:00:54:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 13:01:27:1) 2016-04-13T13:01:27.797+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T13:01:33.801+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T13:01:33.802+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T13:01:33.803+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T13:05:00.059+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T13:32:30.598+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 13:31:55:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 34, timestamp: Apr 13 13:32:29:2) 2016-04-13T13:32:30.598+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T13:32:45.601+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T13:32:45.601+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T13:39:42.702+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 13:39:08:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 34, timestamp: Apr 13 13:39:41:2) 2016-04-13T13:39:42.702+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T13:39:48.704+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T13:39:48.704+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T14:09:18.794+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T14:09:24.806+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T14:09:24.807+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T14:09:24.807+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T14:14:10.160+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T15:11:39.819+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 15:10:59:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 15:11:39:1) 2016-04-13T15:11:39.819+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T15:11:45.821+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T15:11:45.823+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T15:11:45.823+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T15:12:57.491+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T15:14:45.871+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T15:14:50.876+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T15:14:50.877+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T15:38:42.340+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 34, timestamp: Apr 13 15:38:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 34, timestamp: Apr 13 15:38:42:1) 2016-04-13T15:38:42.340+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T15:38:47.346+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T15:38:47.346+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T15:38:47.347+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T15:40:01.210+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T16:23:55.946+0000 I CONTROL [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends 2016-04-13T16:23:55.946+0000 I FTDC [signalProcessingThread] Shutting down full-time diagnostic data capture 2016-04-13T16:23:55.978+0000 I REPL [signalProcessingThread] Stopping replication applier threads 2016-04-13T16:23:56.442+0000 I STORAGE [conn32] got request after shutdown() 2016-04-13T16:23:56.442+0000 I STORAGE [conn47] got request after shutdown() 2016-04-13T16:23:56.543+0000 I STORAGE [conn31] got request after shutdown() 2016-04-13T16:23:57.144+0000 I CONTROL [signalProcessingThread] now exiting 2016-04-13T16:23:57.144+0000 I NETWORK [signalProcessingThread] shutdown: going to close listening sockets... 2016-04-13T16:23:57.144+0000 I NETWORK [signalProcessingThread] closing listening socket: 6 2016-04-13T16:23:57.144+0000 I NETWORK [signalProcessingThread] closing listening socket: 7 2016-04-13T16:23:57.144+0000 I NETWORK [signalProcessingThread] closing listening socket: 8 2016-04-13T16:23:57.144+0000 I NETWORK [signalProcessingThread] removing socket file: /tmp/mongodb-27016.sock 2016-04-13T16:23:57.144+0000 I NETWORK [signalProcessingThread] shutdown: going to flush diaglog... 2016-04-13T16:23:57.144+0000 I NETWORK [signalProcessingThread] shutdown: going to close sockets... 2016-04-13T16:23:57.144+0000 I STORAGE [signalProcessingThread] WiredTigerKVEngine shutting down 2016-04-13T16:23:57.145+0000 I NETWORK [conn1] end connection 127.0.0.1:44379 (48 connections now open) 2016-04-13T16:23:57.145+0000 I NETWORK [conn3] end connection 127.0.0.1:44405 (48 connections now open) 2016-04-13T16:23:57.145+0000 I NETWORK [conn4] end connection 127.0.0.1:44406 (48 connections now open) 2016-04-13T16:23:57.154+0000 I NETWORK [conn5] end connection 127.0.0.1:44407 (48 connections now open) 2016-04-13T16:23:57.154+0000 I NETWORK [conn6] end connection 127.0.0.1:44408 (48 connections now open) 2016-04-13T16:23:57.154+0000 I NETWORK [conn7] end connection 127.0.0.1:44409 (48 connections now open) 2016-04-13T16:23:57.154+0000 I NETWORK [conn8] end connection 127.0.0.1:44413 (48 connections now open) 2016-04-13T16:23:57.154+0000 I NETWORK [conn10] end connection 127.0.0.1:44418 (48 connections now open) 2016-04-13T16:23:57.154+0000 I NETWORK [conn11] end connection 127.0.0.1:44423 (48 connections now open) 2016-04-13T16:23:57.156+0000 I NETWORK [conn12] end connection 127.0.0.1:44435 (48 connections now open) 2016-04-13T16:23:57.156+0000 I NETWORK [conn13] end connection 127.0.0.1:44436 (48 connections now open) 2016-04-13T16:23:57.156+0000 I NETWORK [conn14] end connection 127.0.0.1:44437 (48 connections now open) 2016-04-13T16:23:57.156+0000 I NETWORK [conn15] end connection 127.0.0.1:44438 (48 connections now open) 2016-04-13T16:23:57.156+0000 I NETWORK [conn16] end connection 127.0.0.1:44439 (48 connections now open) 2016-04-13T16:23:57.156+0000 I NETWORK [conn17] end connection 127.0.0.1:44443 (48 connections now open) 2016-04-13T16:23:57.156+0000 I NETWORK [conn19] end connection 127.0.0.1:44448 (48 connections now open) 2016-04-13T16:23:57.157+0000 I NETWORK [conn20] end connection 127.0.0.1:44453 (48 connections now open) 2016-04-13T16:23:57.157+0000 I NETWORK [conn49] end connection 127.0.0.1:44556 (48 connections now open) 2016-04-13T16:23:57.157+0000 I NETWORK [conn48] end connection 127.0.0.1:44555 (48 connections now open) 2016-04-13T16:23:57.157+0000 I NETWORK [conn50] end connection 127.0.0.1:44557 (48 connections now open) 2016-04-13T16:23:57.158+0000 I NETWORK [conn51] end connection 127.0.0.1:44558 (48 connections now open) 2016-04-13T16:23:57.158+0000 I NETWORK [conn52] end connection 127.0.0.1:44559 (48 connections now open) 2016-04-13T16:23:57.158+0000 I NETWORK [conn46] end connection 127.0.0.1:44538 (48 connections now open) 2016-04-13T16:23:57.159+0000 I NETWORK [conn22] end connection 127.0.0.1:44466 (48 connections now open) 2016-04-13T16:23:57.159+0000 I NETWORK [conn21] end connection 127.0.0.1:44465 (48 connections now open) 2016-04-13T16:23:57.159+0000 I NETWORK [conn23] end connection 127.0.0.1:44467 (48 connections now open) 2016-04-13T16:23:57.159+0000 I NETWORK [conn24] end connection 127.0.0.1:44468 (48 connections now open) 2016-04-13T16:23:57.159+0000 I NETWORK [conn25] end connection 127.0.0.1:44469 (48 connections now open) 2016-04-13T16:23:57.161+0000 I NETWORK [conn44] end connection 127.0.0.1:44533 (48 connections now open) 2016-04-13T16:23:57.161+0000 I NETWORK [conn40] end connection 127.0.0.1:44518 (48 connections now open) 2016-04-13T16:23:57.161+0000 I NETWORK [conn42] end connection 127.0.0.1:44526 (48 connections now open) 2016-04-13T16:23:57.162+0000 I NETWORK [conn43] end connection 127.0.0.1:44528 (48 connections now open) 2016-04-13T16:23:57.182+0000 I NETWORK [conn38] end connection 127.0.0.1:44513 (48 connections now open) 2016-04-13T16:23:57.182+0000 I NETWORK [conn34] end connection 127.0.0.1:44506 (48 connections now open) 2016-04-13T16:23:57.182+0000 I NETWORK [conn37] end connection 127.0.0.1:44509 (48 connections now open) 2016-04-13T16:23:57.182+0000 I NETWORK [conn36] end connection 127.0.0.1:44508 (48 connections now open) 2016-04-13T16:23:57.182+0000 I NETWORK [conn28] end connection 127.0.0.1:44478 (48 connections now open) 2016-04-13T16:23:57.182+0000 I NETWORK [conn35] end connection 127.0.0.1:44507 (48 connections now open) 2016-04-13T16:23:57.182+0000 I NETWORK [conn75] end connection 127.0.0.1:47667 (48 connections now open) 2016-04-13T16:23:57.183+0000 I NETWORK [conn62] end connection 127.0.0.1:44593 (48 connections now open) 2016-04-13T16:23:57.183+0000 I NETWORK [conn33] end connection 127.0.0.1:44505 (48 connections now open) 2016-04-13T16:23:57.183+0000 I NETWORK [conn53] end connection 127.0.0.1:44563 (48 connections now open) 2016-04-13T16:23:57.183+0000 I NETWORK [conn59] end connection 127.0.0.1:44583 (48 connections now open) 2016-04-13T16:23:57.183+0000 I NETWORK [conn61] end connection 127.0.0.1:44588 (48 connections now open) 2016-04-13T16:23:57.183+0000 I NETWORK [conn58] end connection 127.0.0.1:44578 (48 connections now open) 2016-04-13T16:23:57.183+0000 I NETWORK [conn56] end connection 127.0.0.1:44573 (48 connections now open) 2016-04-13T16:23:57.184+0000 I NETWORK [conn55] end connection 127.0.0.1:44568 (48 connections now open) 2016-04-13T16:23:57.184+0000 I NETWORK [conn26] end connection 127.0.0.1:44473 (48 connections now open) 2016-04-13T16:23:57.184+0000 I NETWORK [conn30] end connection 127.0.0.1:44484 (48 connections now open) 2016-04-13T16:23:57.427+0000 I STORAGE [signalProcessingThread] shutdown: removing fs lock... 2016-04-13T16:23:57.427+0000 I CONTROL [signalProcessingThread] dbexit: rc: 0 2016-04-13T16:26:47.097+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] MongoDB starting : pid=1087 port=27016 dbpath=/var/lib/mongodb-replica/mongodbreplica2 64-bit host=ip-172-31-6-169 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] db version v3.2.4 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] git version: e2ee9ffcf9f5a94fad76802e28cc978718bb7a30 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] modules: none 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] build environment: 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] distmod: ubuntu1404 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] distarch: x86_64 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-04-13T16:26:47.165+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb.d/mongodbreplica2.conf", net: { http: { RESTInterfaceEnabled: true, enabled: true }, port: 27016 }, processManagement: { pidFilePath: "/var/run/mongodb-replica/mongodbreplica2.pid" }, replication: { oplogSizeMB: 128, replSet: "mongodbreplica" }, storage: { dbPath: "/var/lib/mongodb-replica/mongodbreplica2", mmapv1: { smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb-replica/mongodbreplica2.log" } } 2016-04-13T16:26:47.516+0000 I - [initandlisten] Detected data files in /var/lib/mongodb-replica/mongodbreplica2 created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2016-04-13T16:26:47.517+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-04-13T16:26:49.253+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-04-13T16:26:49.253+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 126147 records totaling to 2918549203 bytes 2016-04-13T16:26:49.254+0000 I STORAGE [initandlisten] Sampling from the oplog between Apr 9 09:01:12:1 and Apr 13 16:23:45:5 to determine where to place markers for truncation 2016-04-13T16:26:49.254+0000 I STORAGE [initandlisten] Taking 1002 samples and assuming that each section of oplog contains approximately 1258 records totaling to 29105209 bytes 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 09:57:13:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 10:24:38:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 11:22:01:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 12:18:46:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 13:16:06:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 14:16:00:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 15:15:40:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 15:42:45:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 16:39:37:3 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 17:37:02:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 18:33:45:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 19:31:09:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:27:53:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 20:55:09:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 21:51:45:4 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 22:49:07:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 9 23:45:45:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 00:42:32:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 01:39:43:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 02:06:28:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 03:03:39:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 04:00:09:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 04:57:39:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 05:54:14:4 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 06:51:46:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 07:18:49:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 08:15:45:5 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 09:15:49:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 10:16:14:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 11:17:02:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 12:17:08:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 13:17:37:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 14:15:00:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 15:11:47:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 15:39:40:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 16:37:09:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 17:43:45:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 18:45:08:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 19:41:44:3 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 20:38:28:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 21:05:43:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 22:01:45:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 22:58:12:2 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 10 23:55:08:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 00:51:52:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 01:47:58:3 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 02:15:39:1 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 03:11:44:3 2016-04-13T16:26:51.701+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 04:08:27:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 05:05:35:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 06:01:45:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 06:58:33:5 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 07:25:44:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 08:22:32:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 09:19:44:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 10:15:46:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 11:12:45:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 12:09:06:2 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 12:36:26:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 13:33:10:3 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 14:33:50:3 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 15:31:01:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 16:28:02:3 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 17:27:46:2 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 17:54:31:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 19:01:44:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 19:58:50:2 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 21:15:09:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 22:14:45:4 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 23:14:50:1 2016-04-13T16:26:51.702+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 11 23:42:08:2 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 00:49:01:2 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 01:46:45:4 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 02:43:49:2 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 03:41:50:1 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 04:39:45:4 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:06:55:1 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 06:04:42:1 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 18:54:45:4 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 20:06:13:1 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 21:59:45:2 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 23:31:53:2 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 00:09:10:1 2016-04-13T16:26:51.705+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 01:25:01:2 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 02:32:44:3 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 03:30:08:1 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 04:26:54:2 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 05:24:42:1 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 05:52:25:1 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 06:49:41:1 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 07:47:08:2 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 08:43:47:1 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 09:41:00:6 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 10:37:49:1 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 11:05:00:6 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 12:01:52:1 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 12:59:24:1 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 13:58:01:1 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 15:12:48:2 2016-04-13T16:26:51.706+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 16:13:35:1 2016-04-13T16:26:51.959+0000 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2016-04-13T16:26:52.034+0000 I NETWORK [websvr] admin web console waiting for connections on port 28016 2016-04-13T16:26:52.047+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb-replica/mongodbreplica2/diagnostic.data' 2016-04-13T16:26:52.047+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-04-13T16:26:52.050+0000 I NETWORK [initandlisten] waiting for connections on port 27016 2016-04-13T16:26:52.051+0000 W NETWORK [ReplicationExecutor] Failed to connect to 127.0.0.1:27017, reason: errno:111 Connection refused 2016-04-13T16:26:52.062+0000 W NETWORK [ReplicationExecutor] Failed to connect to 127.0.0.1:27015, reason: errno:111 Connection refused 2016-04-13T16:26:52.063+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "mongodbreplica", version: 2, protocolVersion: 1, members: [ { _id: 0, host: "localhost:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "localhost:27016", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "localhost:27015", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-04-13T16:26:52.063+0000 I REPL [ReplicationExecutor] This node is localhost:27016 in the config 2016-04-13T16:26:52.063+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-04-13T16:26:52.063+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-04-13T16:26:52.063+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable: Connection refused 2016-04-13T16:26:52.064+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: Connection refused 2016-04-13T16:26:52.064+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable: Connection refused 2016-04-13T16:26:52.064+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: Connection refused 2016-04-13T16:26:52.064+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable: Connection refused 2016-04-13T16:26:52.064+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: Connection refused 2016-04-13T16:26:52.064+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-04-13T16:26:52.066+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-04-13T16:26:52.365+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37920 #1 (1 connection now open) 2016-04-13T16:26:52.367+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37922 #2 (2 connections now open) 2016-04-13T16:26:52.385+0000 I NETWORK [conn1] end connection 127.0.0.1:37920 (1 connection now open) 2016-04-13T16:26:53.473+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37925 #3 (2 connections now open) 2016-04-13T16:26:53.473+0000 I NETWORK [conn3] end connection 127.0.0.1:37925 (1 connection now open) 2016-04-13T16:26:53.483+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37927 #4 (2 connections now open) 2016-04-13T16:26:57.064+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-13T16:26:57.065+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-13T16:26:57.065+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-13T16:26:57.065+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-13T16:27:02.509+0000 I NETWORK [conn2] end connection 127.0.0.1:37922 (1 connection now open) 2016-04-13T16:27:02.510+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37932 #5 (2 connections now open) 2016-04-13T16:27:07.066+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state PRIMARY 2016-04-13T16:27:07.066+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-13T16:27:07.067+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-13T16:27:07.068+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-13T16:27:13.488+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37939 #6 (3 connections now open) 2016-04-13T16:27:13.489+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37940 #7 (4 connections now open) 2016-04-13T16:27:13.489+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37942 #8 (5 connections now open) 2016-04-13T16:27:13.489+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-13T16:27:13.489+0000 I ASIO [ReplicationExecutor] dropping unhealthy pooled connection to localhost:27015 2016-04-13T16:27:13.489+0000 I ASIO [ReplicationExecutor] after drop, pool was empty, going to spawn some connections 2016-04-13T16:27:13.489+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-13T16:27:13.489+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state PRIMARY 2016-04-13T16:27:13.490+0000 I NETWORK [conn4] end connection 127.0.0.1:37927 (4 connections now open) 2016-04-13T16:27:13.490+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-13T16:27:18.490+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-13T16:27:18.492+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-13T16:27:18.492+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-13T16:36:03.539+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-14T20:27:51.982+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38316 #9 (5 connections now open) 2016-04-14T20:27:51.983+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38317 #10 (6 connections now open) 2016-04-14T20:27:51.983+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38318 #11 (7 connections now open) 2016-04-14T20:27:51.983+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38319 #12 (8 connections now open) 2016-04-14T20:27:51.983+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38320 #13 (9 connections now open) 2016-04-14T20:27:52.060+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38324 #14 (10 connections now open) 2016-04-14T20:27:52.061+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38326 #15 (11 connections now open) 2016-04-14T20:27:52.111+0000 I NETWORK [conn15] end connection 127.0.0.1:38326 (10 connections now open) 2016-04-14T20:27:52.198+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38329 #16 (11 connections now open) 2016-04-14T20:27:52.277+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38334 #17 (12 connections now open) 2016-04-14T20:27:54.703+0000 I ACCESS [conn16] Successfully authenticated as principal oplogger on admin 2016-04-14T20:27:54.976+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38346 #18 (13 connections now open) 2016-04-14T20:27:54.976+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38347 #19 (14 connections now open) 2016-04-14T20:27:54.976+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38348 #20 (15 connections now open) 2016-04-14T20:27:54.976+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38349 #21 (16 connections now open) 2016-04-14T20:27:54.979+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38350 #22 (17 connections now open) 2016-04-14T20:27:55.071+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38354 #23 (18 connections now open) 2016-04-14T20:27:55.085+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38356 #24 (19 connections now open) 2016-04-14T20:27:55.170+0000 I NETWORK [conn24] end connection 127.0.0.1:38356 (18 connections now open) 2016-04-14T20:27:55.273+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38359 #25 (19 connections now open) 2016-04-14T20:27:55.346+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38364 #26 (20 connections now open) 2016-04-14T20:27:59.361+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38376 #27 (21 connections now open) 2016-04-14T20:27:59.362+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38377 #28 (22 connections now open) 2016-04-14T20:27:59.363+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38378 #29 (23 connections now open) 2016-04-14T20:27:59.376+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38379 #30 (24 connections now open) 2016-04-14T20:27:59.379+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38380 #31 (25 connections now open) 2016-04-14T20:27:59.582+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38384 #32 (26 connections now open) 2016-04-14T20:27:59.583+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38386 #33 (27 connections now open) 2016-04-14T20:27:59.586+0000 I NETWORK [conn33] end connection 127.0.0.1:38386 (26 connections now open) 2016-04-14T20:27:59.635+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38389 #34 (27 connections now open) 2016-04-14T20:27:59.771+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38394 #35 (28 connections now open) 2016-04-14T20:28:00.089+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38396 #36 (29 connections now open) 2016-04-14T20:28:00.120+0000 I NETWORK [conn36] end connection 127.0.0.1:38396 (28 connections now open) 2016-04-14T20:28:00.187+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38399 #37 (29 connections now open) 2016-04-14T20:28:00.222+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38404 #38 (30 connections now open) 2016-04-14T20:28:02.294+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38416 #39 (31 connections now open) 2016-04-14T20:28:02.295+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38417 #40 (32 connections now open) 2016-04-14T20:28:02.295+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38418 #41 (33 connections now open) 2016-04-14T20:28:02.296+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38419 #42 (34 connections now open) 2016-04-14T20:28:02.296+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38420 #43 (35 connections now open) 2016-04-14T20:28:02.440+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38424 #44 (36 connections now open) 2016-04-14T20:28:02.441+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38426 #45 (37 connections now open) 2016-04-14T20:28:02.484+0000 I NETWORK [conn45] end connection 127.0.0.1:38426 (36 connections now open) 2016-04-14T20:28:02.529+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38429 #46 (37 connections now open) 2016-04-14T20:28:02.598+0000 I ACCESS [conn25] Successfully authenticated as principal oplogger on admin 2016-04-14T20:28:02.629+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38434 #47 (38 connections now open) 2016-04-14T20:28:02.694+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38436 #48 (39 connections now open) 2016-04-14T20:28:02.713+0000 I NETWORK [conn48] end connection 127.0.0.1:38436 (38 connections now open) 2016-04-14T20:28:02.731+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38439 #49 (39 connections now open) 2016-04-14T20:28:02.775+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38444 #50 (40 connections now open) 2016-04-14T20:28:04.744+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38456 #51 (41 connections now open) 2016-04-14T20:28:04.744+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38457 #52 (42 connections now open) 2016-04-14T20:28:04.744+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38458 #53 (43 connections now open) 2016-04-14T20:28:04.744+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38459 #54 (44 connections now open) 2016-04-14T20:28:04.744+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38460 #55 (45 connections now open) 2016-04-14T20:28:04.815+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38464 #56 (46 connections now open) 2016-04-14T20:28:04.819+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38466 #57 (47 connections now open) 2016-04-14T20:28:04.912+0000 I NETWORK [conn57] end connection 127.0.0.1:38466 (46 connections now open) 2016-04-14T20:28:04.931+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38469 #58 (47 connections now open) 2016-04-14T20:28:06.087+0000 I ACCESS [conn34] Successfully authenticated as principal oplogger on admin 2016-04-14T20:28:06.158+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38472 #59 (48 connections now open) 2016-04-14T20:28:06.176+0000 I NETWORK [conn59] end connection 127.0.0.1:38472 (47 connections now open) 2016-04-14T20:28:06.225+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38475 #60 (48 connections now open) 2016-04-14T20:28:07.123+0000 I ACCESS [conn37] Successfully authenticated as principal oplogger on admin 2016-04-14T20:28:07.218+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38480 #61 (49 connections now open) 2016-04-14T20:28:07.263+0000 I ACCESS [conn49] Successfully authenticated as principal oplogger on admin 2016-04-14T20:28:08.624+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38484 #62 (50 connections now open) 2016-04-14T20:28:09.548+0000 I ACCESS [conn58] Successfully authenticated as principal oplogger on admin 2016-04-14T20:28:10.332+0000 I ACCESS [conn46] Successfully authenticated as principal oplogger on admin 2016-04-14T20:28:10.369+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38490 #63 (51 connections now open) 2016-04-14T20:28:10.386+0000 I NETWORK [conn63] end connection 127.0.0.1:38490 (50 connections now open) 2016-04-14T20:28:10.438+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38493 #64 (51 connections now open) 2016-04-14T20:28:12.098+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38496 #65 (52 connections now open) 2016-04-14T20:28:12.102+0000 I NETWORK [conn65] end connection 127.0.0.1:38496 (51 connections now open) 2016-04-14T20:28:12.122+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38499 #66 (52 connections now open) 2016-04-14T20:28:12.831+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38504 #67 (53 connections now open) 2016-04-14T20:28:13.073+0000 I ACCESS [conn60] Successfully authenticated as principal oplogger on admin 2016-04-14T20:28:14.467+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38508 #68 (54 connections now open) 2016-04-14T20:28:14.944+0000 I ACCESS [conn64] Successfully authenticated as principal oplogger on admin 2016-04-14T20:28:18.619+0000 I ACCESS [conn66] Successfully authenticated as principal oplogger on admin 2016-04-14T20:34:45.243+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 14 20:33:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 14 20:34:45:5) 2016-04-14T20:34:45.243+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-14T20:34:50.254+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-14T20:34:50.259+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-14T20:34:50.260+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-14T20:38:57.051+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-14T20:57:22.589+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-14T20:57:22.590+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-14T20:57:22.591+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-14T21:02:04.779+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-14T21:14:32.861+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38686 #69 (55 connections now open) 2016-04-14T21:14:32.862+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38687 #70 (56 connections now open) 2016-04-14T21:14:32.862+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38688 #71 (57 connections now open) 2016-04-14T21:14:32.862+0000 I NETWORK [conn69] end connection 127.0.0.1:38686 (56 connections now open) 2016-04-14T21:16:37.850+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 14 21:15:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 14 21:16:37:2) 2016-04-14T21:16:37.850+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-14T21:16:37.882+0000 I NETWORK [conn71] end connection 127.0.0.1:38688 (55 connections now open) 2016-04-14T21:16:42.851+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-14T21:16:42.852+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-14T21:16:42.874+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38702 #72 (56 connections now open) 2016-04-14T21:16:42.875+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38703 #73 (57 connections now open) 2016-04-14T21:16:42.877+0000 I NETWORK [conn72] end connection 127.0.0.1:38702 (56 connections now open) 2016-04-14T21:17:45.304+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38707 #74 (57 connections now open) 2016-04-14T22:24:22.907+0000 I NETWORK [conn73] end connection 127.0.0.1:38703 (56 connections now open) 2016-04-14T22:24:27.923+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38932 #75 (57 connections now open) 2016-04-14T22:24:27.923+0000 I NETWORK [conn75] end connection 127.0.0.1:38932 (56 connections now open) 2016-04-14T22:24:27.927+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38933 #76 (57 connections now open) 2016-04-14T22:32:50.058+0000 I NETWORK [conn76] end connection 127.0.0.1:38933 (56 connections now open) 2016-04-14T22:33:25.084+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38965 #77 (57 connections now open) 2016-04-14T22:33:25.085+0000 I NETWORK [conn77] end connection 127.0.0.1:38965 (56 connections now open) 2016-04-14T22:33:25.085+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38966 #78 (57 connections now open) 2016-04-14T23:27:45.021+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39247 #79 (58 connections now open) 2016-04-14T23:27:45.021+0000 I NETWORK [conn5] end connection 127.0.0.1:37932 (57 connections now open) 2016-04-14T23:27:45.022+0000 I NETWORK [conn78] end connection 127.0.0.1:38966 (56 connections now open) 2016-04-14T23:27:46.021+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39248 #80 (57 connections now open) 2016-04-14T23:27:46.021+0000 I NETWORK [conn80] end connection 127.0.0.1:39248 (56 connections now open) 2016-04-14T23:27:46.022+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39249 #81 (57 connections now open) 2016-04-15T00:31:45.050+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 00:31:10:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 00:31:45:2) 2016-04-15T00:31:45.050+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T00:31:50.057+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T00:31:50.067+0000 I NETWORK [conn81] end connection 127.0.0.1:39249 (56 connections now open) 2016-04-15T00:31:50.068+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T00:32:45.070+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 00:31:59:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 00:32:45:5) 2016-04-15T00:32:45.070+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T00:32:50.071+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T00:32:50.071+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T00:32:50.072+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T00:36:07.883+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T00:36:50.052+0000 I NETWORK [conn74] end connection 127.0.0.1:38707 (55 connections now open) 2016-04-15T00:36:50.052+0000 I NETWORK [conn70] end connection 127.0.0.1:38687 (54 connections now open) 2016-04-15T01:02:33.508+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 01:01:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 15 01:02:32:2) 2016-04-15T01:02:33.509+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T01:02:48.512+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T01:02:48.512+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T01:35:22.051+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T01:35:22.055+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-15T01:35:27.077+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T01:35:27.078+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T01:54:18.324+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T01:54:18.325+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-15T01:54:23.324+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T01:54:23.325+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T01:54:23.325+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-15T02:07:19.748+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 02:06:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 02:07:19:1) 2016-04-15T02:07:19.748+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T02:07:24.768+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T02:07:24.769+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T02:07:24.770+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T02:11:36.518+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T03:20:45.040+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 03:19:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 15 03:20:45:4) 2016-04-15T03:20:45.040+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T03:20:45.041+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T03:20:45.042+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-15T03:28:06.125+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-15T05:50:48.029+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41159 #82 (55 connections now open) 2016-04-15T05:50:48.031+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41160 #83 (56 connections now open) 2016-04-15T05:50:48.031+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41161 #84 (57 connections now open) 2016-04-15T05:50:48.031+0000 I NETWORK [conn82] end connection 127.0.0.1:41159 (56 connections now open) 2016-04-15T05:53:50.329+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41183 #85 (57 connections now open) 2016-04-15T06:04:39.820+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 06:04:00:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 06:04:39:a) 2016-04-15T06:04:39.820+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T06:04:44.823+0000 I NETWORK [conn84] end connection 127.0.0.1:41161 (56 connections now open) 2016-04-15T06:04:45.821+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T06:04:45.822+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T06:09:44.856+0000 I NETWORK [conn85] end connection 127.0.0.1:41183 (55 connections now open) 2016-04-15T06:09:44.856+0000 I NETWORK [conn83] end connection 127.0.0.1:41160 (55 connections now open) 2016-04-15T06:54:31.275+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41620 #86 (55 connections now open) 2016-04-15T06:54:31.277+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41621 #87 (56 connections now open) 2016-04-15T06:54:31.277+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41622 #88 (57 connections now open) 2016-04-15T06:54:31.277+0000 I NETWORK [conn86] end connection 127.0.0.1:41620 (56 connections now open) 2016-04-15T06:55:42.786+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 06:55:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 06:55:42:4) 2016-04-15T06:55:42.786+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T06:55:47.788+0000 I NETWORK [conn88] end connection 127.0.0.1:41622 (55 connections now open) 2016-04-15T06:55:48.787+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T06:55:48.787+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T07:00:47.787+0000 I NETWORK [conn87] end connection 127.0.0.1:41621 (54 connections now open) 2016-04-15T07:45:41.263+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41990 #89 (55 connections now open) 2016-04-15T07:45:41.265+0000 I NETWORK [conn89] end connection 127.0.0.1:41990 (54 connections now open) 2016-04-15T07:45:41.265+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41991 #90 (55 connections now open) 2016-04-15T07:45:41.269+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41992 #91 (56 connections now open) 2016-04-15T07:48:50.062+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42016 #92 (57 connections now open) 2016-04-15T07:54:33.439+0000 I NETWORK [conn91] end connection 127.0.0.1:41992 (56 connections now open) 2016-04-15T07:54:48.444+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42063 #93 (57 connections now open) 2016-04-15T07:54:48.444+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42064 #94 (58 connections now open) 2016-04-15T07:54:48.445+0000 I NETWORK [conn93] end connection 127.0.0.1:42063 (57 connections now open) 2016-04-15T08:14:30.533+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 08:13:56:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 08:14:30:1) 2016-04-15T08:14:30.533+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T08:14:30.556+0000 I NETWORK [conn94] end connection 127.0.0.1:42064 (56 connections now open) 2016-04-15T08:14:35.536+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T08:14:35.538+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T08:15:46.231+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 08:15:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 08:15:45:5) 2016-04-15T08:15:46.231+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T08:15:51.232+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T08:15:51.233+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T08:15:51.233+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T08:16:38.158+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 08:15:56:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 15 08:16:36:2) 2016-04-15T08:16:38.158+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T08:16:48.159+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T08:16:48.160+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T08:18:32.067+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T08:19:30.556+0000 I NETWORK [conn90] end connection 127.0.0.1:41991 (55 connections now open) 2016-04-15T08:19:30.556+0000 I NETWORK [conn92] end connection 127.0.0.1:42016 (54 connections now open) 2016-04-15T08:33:45.519+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 08:33:08:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 15 08:33:45:5) 2016-04-15T08:33:45.519+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T08:33:45.525+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-15T08:33:51.520+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T08:33:51.521+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T09:41:46.852+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 09:41:07:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 15 09:41:46:2) 2016-04-15T09:41:46.852+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T09:41:51.859+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T09:41:51.860+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T09:56:25.144+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 09:55:50:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 15 09:56:25:1) 2016-04-15T09:56:25.147+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T09:56:25.149+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-15T09:56:30.147+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T09:56:30.148+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T09:56:30.150+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-15T10:01:48.397+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-15T10:06:38.642+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 10:05:59:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 10:06:38:1) 2016-04-15T10:06:38.642+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T10:06:44.643+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T10:06:44.644+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T10:16:36.840+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 10:16:02:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 10:16:36:1) 2016-04-15T10:16:36.840+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T10:16:41.844+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T10:16:41.846+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T10:16:41.846+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T10:16:41.849+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T10:16:41.850+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T10:16:42.120+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43088 #95 (55 connections now open) 2016-04-15T10:16:42.121+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43089 #96 (56 connections now open) 2016-04-15T10:16:42.121+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43090 #97 (57 connections now open) 2016-04-15T10:16:42.121+0000 I NETWORK [conn95] end connection 127.0.0.1:43088 (56 connections now open) 2016-04-15T10:17:00.649+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43093 #98 (57 connections now open) 2016-04-15T10:26:33.025+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 10:25:57:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 10:26:31:2) 2016-04-15T10:26:33.025+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T10:26:38.025+0000 I NETWORK [conn97] end connection 127.0.0.1:43090 (56 connections now open) 2016-04-15T10:26:49.028+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T10:26:49.029+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T10:31:33.028+0000 I NETWORK [conn98] end connection 127.0.0.1:43093 (55 connections now open) 2016-04-15T10:31:33.028+0000 I NETWORK [conn96] end connection 127.0.0.1:43089 (54 connections now open) 2016-04-15T11:23:45.040+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43560 #99 (55 connections now open) 2016-04-15T11:23:45.043+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43561 #100 (56 connections now open) 2016-04-15T11:23:45.043+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43562 #101 (57 connections now open) 2016-04-15T11:23:45.043+0000 I NETWORK [conn99] end connection 127.0.0.1:43560 (56 connections now open) 2016-04-15T11:24:46.107+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43572 #102 (57 connections now open) 2016-04-15T11:33:36.250+0000 I NETWORK [conn101] end connection 127.0.0.1:43562 (56 connections now open) 2016-04-15T11:33:46.252+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43634 #103 (57 connections now open) 2016-04-15T11:33:46.252+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43635 #104 (58 connections now open) 2016-04-15T11:33:46.255+0000 I NETWORK [conn103] end connection 127.0.0.1:43634 (57 connections now open) 2016-04-15T11:35:33.285+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43650 #105 (58 connections now open) 2016-04-15T11:35:33.286+0000 I NETWORK [conn79] end connection 127.0.0.1:39247 (57 connections now open) 2016-04-15T11:35:33.286+0000 I NETWORK [conn104] end connection 127.0.0.1:43635 (56 connections now open) 2016-04-15T11:40:33.286+0000 I NETWORK [conn102] end connection 127.0.0.1:43572 (55 connections now open) 2016-04-15T11:40:33.286+0000 I NETWORK [conn100] end connection 127.0.0.1:43561 (54 connections now open) 2016-04-15T11:41:48.230+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43699 #106 (55 connections now open) 2016-04-15T11:41:48.231+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43700 #107 (56 connections now open) 2016-04-15T11:41:48.231+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43701 #108 (57 connections now open) 2016-04-15T11:41:48.231+0000 I NETWORK [conn106] end connection 127.0.0.1:43699 (56 connections now open) 2016-04-15T11:42:48.553+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43709 #109 (57 connections now open) 2016-04-15T12:28:49.138+0000 I NETWORK [conn108] end connection 127.0.0.1:43701 (56 connections now open) 2016-04-15T12:28:49.146+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44036 #110 (57 connections now open) 2016-04-15T12:28:49.146+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44037 #111 (58 connections now open) 2016-04-15T12:28:49.147+0000 I NETWORK [conn110] end connection 127.0.0.1:44036 (57 connections now open) 2016-04-15T13:33:36.673+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 13:33:00:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 13:33:36:1) 2016-04-15T13:33:36.673+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T13:33:41.664+0000 I NETWORK [conn111] end connection 127.0.0.1:44037 (56 connections now open) 2016-04-15T13:33:41.687+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T13:33:41.688+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T13:38:36.674+0000 I NETWORK [conn107] end connection 127.0.0.1:43700 (55 connections now open) 2016-04-15T13:38:36.674+0000 I NETWORK [conn109] end connection 127.0.0.1:43709 (54 connections now open) 2016-04-15T13:40:46.816+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 13:40:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 13:40:45:7) 2016-04-15T13:40:46.816+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T13:40:52.817+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T13:40:52.818+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T15:45:45.059+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 15:45:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 15:45:45:2) 2016-04-15T15:45:45.060+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T15:45:50.061+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T15:45:50.062+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T15:48:44.222+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 15:48:02:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 15:48:43:1) 2016-04-15T15:48:44.222+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T15:48:49.226+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T15:48:49.227+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T15:48:49.228+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T15:49:00.091+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T16:35:45.065+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 16:35:04:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 15 16:35:45:4) 2016-04-15T16:35:45.065+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T16:35:45.066+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T16:35:45.066+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-15T16:35:45.096+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-15T16:39:45.030+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45478 #112 (55 connections now open) 2016-04-15T16:39:45.031+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45479 #113 (56 connections now open) 2016-04-15T16:39:45.031+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45480 #114 (57 connections now open) 2016-04-15T16:39:45.031+0000 I NETWORK [conn112] end connection 127.0.0.1:45478 (56 connections now open) 2016-04-15T16:40:59.187+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45492 #115 (57 connections now open) 2016-04-15T17:29:44.140+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 17:29:05:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 17:29:43:1) 2016-04-15T17:29:44.140+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T17:29:44.162+0000 I NETWORK [conn114] end connection 127.0.0.1:45480 (56 connections now open) 2016-04-15T17:29:50.141+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T17:29:50.142+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T17:34:44.160+0000 I NETWORK [conn113] end connection 127.0.0.1:45479 (55 connections now open) 2016-04-15T17:34:44.160+0000 I NETWORK [conn115] end connection 127.0.0.1:45492 (54 connections now open) 2016-04-15T18:18:45.041+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 18:18:00:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 18:18:45:1) 2016-04-15T18:18:45.042+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T18:18:46.042+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T18:34:33.330+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46232 #116 (55 connections now open) 2016-04-15T18:34:33.331+0000 I NETWORK [conn116] end connection 127.0.0.1:46232 (54 connections now open) 2016-04-15T18:34:33.331+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46233 #117 (55 connections now open) 2016-04-15T18:34:33.334+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46234 #118 (56 connections now open) 2016-04-15T18:42:14.281+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46266 #119 (57 connections now open) 2016-04-15T19:15:45.022+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 19:14:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 19:15:45:1) 2016-04-15T19:15:45.023+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T19:15:50.013+0000 I NETWORK [conn118] end connection 127.0.0.1:46234 (56 connections now open) 2016-04-15T19:15:50.024+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T19:15:50.025+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T19:17:45.076+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 19:17:14:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 19:17:45:4) 2016-04-15T19:17:45.076+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T19:17:45.080+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-15T19:18:20.083+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T19:18:20.083+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T19:18:20.084+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T19:20:45.028+0000 I NETWORK [conn119] end connection 127.0.0.1:46266 (55 connections now open) 2016-04-15T19:20:45.029+0000 I NETWORK [conn117] end connection 127.0.0.1:46233 (54 connections now open) 2016-04-15T19:38:18.803+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-15T22:25:44.088+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 22:25:09:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 15 22:25:44:1) 2016-04-15T22:25:44.088+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T22:25:49.110+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T22:25:49.111+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T22:46:24.473+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 22:45:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 15 22:46:24:1) 2016-04-15T22:46:24.473+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T22:46:24.481+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-15T22:46:29.478+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T22:46:29.480+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T22:46:29.480+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-15T22:48:38.114+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 15 22:47:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 15 22:48:36:2) 2016-04-15T22:48:38.114+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T22:48:39.114+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-15T22:48:39.115+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-15T23:18:45.065+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-15T23:18:46.065+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-15T23:18:46.069+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-15T23:18:46.069+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-15T23:36:02.542+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T00:21:18.937+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 00:20:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 00:21:18:1) 2016-04-16T00:21:18.937+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T00:21:24.939+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T00:21:24.939+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T00:21:24.940+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T00:22:49.229+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T00:27:45.072+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 00:27:07:1) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 16 00:27:45:5) 2016-04-16T00:27:45.072+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T00:27:45.074+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T00:27:45.074+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T00:30:31.107+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47857 #120 (55 connections now open) 2016-04-16T00:30:31.109+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47858 #121 (56 connections now open) 2016-04-16T00:30:31.109+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47859 #122 (57 connections now open) 2016-04-16T00:30:31.109+0000 I NETWORK [conn120] end connection 127.0.0.1:47857 (56 connections now open) 2016-04-16T00:32:45.059+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47863 #123 (57 connections now open) 2016-04-16T00:32:45.072+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T00:50:30.495+0000 I NETWORK [conn122] end connection 127.0.0.1:47859 (56 connections now open) 2016-04-16T00:50:35.521+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47949 #124 (57 connections now open) 2016-04-16T00:50:35.522+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47950 #125 (58 connections now open) 2016-04-16T00:50:35.522+0000 I NETWORK [conn124] end connection 127.0.0.1:47949 (57 connections now open) 2016-04-16T01:59:28.727+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 01:58:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 01:59:28:1) 2016-04-16T01:59:28.727+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T01:59:28.730+0000 I NETWORK [conn125] end connection 127.0.0.1:47950 (56 connections now open) 2016-04-16T01:59:33.729+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T01:59:33.731+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T02:04:28.731+0000 I NETWORK [conn123] end connection 127.0.0.1:47863 (55 connections now open) 2016-04-16T02:04:28.731+0000 I NETWORK [conn121] end connection 127.0.0.1:47858 (54 connections now open) 2016-04-16T02:20:45.064+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 02:20:14:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 02:20:45:5) 2016-04-16T02:20:45.064+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T02:20:45.065+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T02:20:45.065+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T02:38:32.412+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T02:38:37.417+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T02:38:37.417+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T02:38:37.418+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T02:39:01.201+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T03:29:17.319+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 03:28:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 03:29:16:1) 2016-04-16T03:29:17.319+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T03:29:23.320+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T03:29:23.321+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T03:29:23.322+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T03:37:00.021+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T04:24:34.501+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T04:24:39.518+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T04:24:39.518+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T04:59:43.046+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T04:59:48.051+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T04:59:48.052+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T04:59:48.054+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T05:00:45.073+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T05:01:15.075+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49171 #126 (55 connections now open) 2016-04-16T05:01:15.076+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49172 #127 (56 connections now open) 2016-04-16T05:01:15.077+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49173 #128 (57 connections now open) 2016-04-16T05:01:15.076+0000 I NETWORK [conn126] end connection 127.0.0.1:49171 (54 connections now open) 2016-04-16T05:06:45.081+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49192 #129 (57 connections now open) 2016-04-16T05:14:22.324+0000 I NETWORK [conn128] end connection 127.0.0.1:49173 (56 connections now open) 2016-04-16T05:14:28.313+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49232 #130 (57 connections now open) 2016-04-16T05:14:28.314+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49233 #131 (58 connections now open) 2016-04-16T05:14:28.314+0000 I NETWORK [conn130] end connection 127.0.0.1:49232 (57 connections now open) 2016-04-16T06:58:45.076+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 06:58:08:3) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 06:58:45:4) 2016-04-16T06:58:45.080+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T06:58:50.083+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T06:58:50.088+0000 I NETWORK [conn131] end connection 127.0.0.1:49233 (56 connections now open) 2016-04-16T06:58:50.089+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T06:58:50.100+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49715 #132 (57 connections now open) 2016-04-16T06:58:50.101+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49716 #133 (58 connections now open) 2016-04-16T06:58:50.104+0000 I NETWORK [conn132] end connection 127.0.0.1:49715 (57 connections now open) 2016-04-16T07:21:43.684+0000 I NETWORK [conn133] end connection 127.0.0.1:49716 (56 connections now open) 2016-04-16T07:21:49.685+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49874 #134 (57 connections now open) 2016-04-16T07:21:49.685+0000 I NETWORK [conn134] end connection 127.0.0.1:49874 (56 connections now open) 2016-04-16T07:21:49.689+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49875 #135 (57 connections now open) 2016-04-16T07:25:39.566+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 07:24:56:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 07:25:39:c) 2016-04-16T07:25:39.566+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T07:25:44.569+0000 I NETWORK [conn135] end connection 127.0.0.1:49875 (56 connections now open) 2016-04-16T07:25:49.568+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T07:25:49.570+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T07:25:50.572+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49906 #136 (57 connections now open) 2016-04-16T07:25:50.573+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49907 #137 (58 connections now open) 2016-04-16T07:25:50.573+0000 I NETWORK [conn136] end connection 127.0.0.1:49906 (57 connections now open) 2016-04-16T08:52:38.335+0000 I NETWORK [conn137] end connection 127.0.0.1:49907 (56 connections now open) 2016-04-16T08:52:43.345+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50510 #138 (57 connections now open) 2016-04-16T08:52:43.345+0000 I NETWORK [conn138] end connection 127.0.0.1:50510 (56 connections now open) 2016-04-16T08:52:43.347+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50511 #139 (57 connections now open) 2016-04-16T08:53:46.089+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 08:53:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 08:53:45:5) 2016-04-16T08:53:46.090+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T08:53:51.093+0000 I NETWORK [conn139] end connection 127.0.0.1:50511 (56 connections now open) 2016-04-16T08:53:51.123+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T08:53:51.124+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T08:58:51.092+0000 I NETWORK [conn127] end connection 127.0.0.1:49172 (55 connections now open) 2016-04-16T08:58:51.092+0000 I NETWORK [conn129] end connection 127.0.0.1:49192 (54 connections now open) 2016-04-16T09:05:52.631+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50613 #140 (55 connections now open) 2016-04-16T09:05:52.631+0000 I NETWORK [conn140] end connection 127.0.0.1:50613 (54 connections now open) 2016-04-16T09:05:52.632+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50614 #141 (55 connections now open) 2016-04-16T09:05:52.634+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50615 #142 (56 connections now open) 2016-04-16T09:09:08.680+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50637 #143 (57 connections now open) 2016-04-16T09:23:44.601+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 09:23:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 09:23:44:1) 2016-04-16T09:23:44.601+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T09:23:49.602+0000 I NETWORK [conn142] end connection 127.0.0.1:50615 (56 connections now open) 2016-04-16T09:23:50.602+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T09:23:50.603+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T09:28:49.602+0000 I NETWORK [conn143] end connection 127.0.0.1:50637 (55 connections now open) 2016-04-16T09:28:49.602+0000 I NETWORK [conn141] end connection 127.0.0.1:50614 (54 connections now open) 2016-04-16T10:15:45.675+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 10:15:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 10:15:45:5) 2016-04-16T10:15:45.675+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T10:15:45.690+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-16T10:15:50.678+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T10:15:50.679+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T10:15:50.679+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T10:17:08.785+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T10:18:33.410+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 10:17:55:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 16 10:18:32:1) 2016-04-16T10:18:33.410+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T10:18:48.417+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T10:18:48.417+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T13:01:46.250+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T13:01:46.252+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T13:01:46.252+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T13:02:02.573+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T13:21:45.046+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 13:21:09:1) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 13:21:45:2) 2016-04-16T13:21:45.046+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T13:21:45.049+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-16T13:21:46.046+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T14:11:45.070+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 14:11:14:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 14:11:45:2) 2016-04-16T14:11:45.070+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T14:12:25.091+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T14:12:25.093+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T14:12:25.094+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T14:17:01.046+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T15:05:44.597+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T15:05:49.605+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T15:05:49.620+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T15:05:49.621+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T15:14:45.070+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T15:23:43.179+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 15:23:03:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 15:23:42:1) 2016-04-16T15:23:43.179+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T15:23:48.180+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T15:23:48.181+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T15:23:48.182+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T15:25:45.079+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T15:32:45.056+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T15:32:50.059+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T15:32:50.059+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T15:32:50.060+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T15:34:46.199+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T17:23:45.054+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 17:23:09:1) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 17:23:45:4) 2016-04-16T17:23:45.054+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T17:23:45.055+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T17:23:45.057+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T17:25:45.043+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 17:25:09:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 16 17:25:45:3) 2016-04-16T17:25:45.044+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T17:25:46.044+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T17:25:46.044+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T17:27:50.066+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54010 #144 (55 connections now open) 2016-04-16T17:27:50.067+0000 I NETWORK [conn144] end connection 127.0.0.1:54010 (54 connections now open) 2016-04-16T17:27:50.068+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54011 #145 (55 connections now open) 2016-04-16T17:27:50.068+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54012 #146 (56 connections now open) 2016-04-16T17:31:02.406+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54035 #147 (57 connections now open) 2016-04-16T18:00:46.559+0000 I NETWORK [conn146] end connection 127.0.0.1:54012 (56 connections now open) 2016-04-16T18:00:46.602+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54242 #148 (57 connections now open) 2016-04-16T18:00:46.604+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54243 #149 (58 connections now open) 2016-04-16T18:00:46.606+0000 I NETWORK [conn148] end connection 127.0.0.1:54242 (57 connections now open) 2016-04-16T18:10:46.128+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 18:10:00:3) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 18:10:45:5) 2016-04-16T18:10:46.129+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T18:10:46.134+0000 I NETWORK [conn149] end connection 127.0.0.1:54243 (56 connections now open) 2016-04-16T18:10:52.132+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T18:10:52.132+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T18:15:46.135+0000 I NETWORK [conn145] end connection 127.0.0.1:54011 (55 connections now open) 2016-04-16T18:15:46.135+0000 I NETWORK [conn147] end connection 127.0.0.1:54035 (54 connections now open) 2016-04-16T18:26:40.423+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54432 #150 (55 connections now open) 2016-04-16T18:26:40.423+0000 I NETWORK [conn150] end connection 127.0.0.1:54432 (54 connections now open) 2016-04-16T18:26:40.424+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54433 #151 (55 connections now open) 2016-04-16T18:26:40.426+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54434 #152 (56 connections now open) 2016-04-16T18:29:01.149+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54451 #153 (57 connections now open) 2016-04-16T19:01:50.071+0000 I NETWORK [conn152] end connection 127.0.0.1:54434 (56 connections now open) 2016-04-16T19:01:50.075+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54685 #154 (57 connections now open) 2016-04-16T19:01:50.076+0000 I NETWORK [conn154] end connection 127.0.0.1:54685 (56 connections now open) 2016-04-16T19:01:50.079+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54686 #155 (57 connections now open) 2016-04-16T20:48:45.055+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 20:48:10:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 20:48:45:2) 2016-04-16T20:48:45.055+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T20:48:46.056+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T20:48:46.057+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T21:01:50.032+0000 I NETWORK [conn155] end connection 127.0.0.1:54686 (56 connections now open) 2016-04-16T21:01:51.033+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:55378 #156 (57 connections now open) 2016-04-16T21:01:51.034+0000 I NETWORK [conn156] end connection 127.0.0.1:55378 (56 connections now open) 2016-04-16T21:01:51.037+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:55379 #157 (57 connections now open) 2016-04-16T21:11:40.496+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 21:11:02:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 21:11:40:2) 2016-04-16T21:11:40.508+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T21:11:45.494+0000 I NETWORK [conn157] end connection 127.0.0.1:55379 (56 connections now open) 2016-04-16T21:11:46.509+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T21:11:46.510+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T21:15:34.613+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 21:14:58:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 21:15:34:1) 2016-04-16T21:15:34.613+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T21:15:34.629+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-16T21:15:40.616+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T21:15:40.617+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T21:16:40.510+0000 I NETWORK [conn151] end connection 127.0.0.1:54433 (55 connections now open) 2016-04-16T21:16:40.510+0000 I NETWORK [conn153] end connection 127.0.0.1:54451 (55 connections now open) 2016-04-16T22:08:23.477+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 22:07:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 22:08:23:1) 2016-04-16T22:08:23.477+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T22:08:28.478+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T22:08:28.479+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T22:08:28.480+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T22:09:39.212+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 22:08:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 16 22:09:38:1) 2016-04-16T22:09:39.212+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T22:09:49.214+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T22:09:49.215+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T22:14:45.049+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T22:38:31.909+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T22:38:37.910+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T22:38:37.910+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T22:38:37.911+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T22:38:45.072+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T23:14:46.457+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 23:14:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 16 23:14:46:1) 2016-04-16T23:14:46.457+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T23:14:51.470+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T23:14:51.471+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T23:14:51.472+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T23:16:02.392+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-16T23:21:40.580+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 16 23:21:03:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 16 23:21:40:1) 2016-04-16T23:21:40.580+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-16T23:21:45.593+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-16T23:21:45.596+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-16T23:21:45.598+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-16T23:21:45.600+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T23:21:45.600+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-16T23:21:45.884+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56209 #158 (55 connections now open) 2016-04-16T23:21:45.884+0000 I NETWORK [conn158] end connection 127.0.0.1:56209 (54 connections now open) 2016-04-16T23:21:45.885+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56210 #159 (55 connections now open) 2016-04-16T23:21:45.886+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56211 #160 (56 connections now open) 2016-04-16T23:22:02.532+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-16T23:22:07.811+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56217 #161 (57 connections now open) 2016-04-16T23:30:45.043+0000 I NETWORK [conn160] end connection 127.0.0.1:56211 (56 connections now open) 2016-04-16T23:35:45.055+0000 I NETWORK [conn159] end connection 127.0.0.1:56210 (55 connections now open) 2016-04-16T23:35:45.055+0000 I NETWORK [conn161] end connection 127.0.0.1:56217 (54 connections now open) 2016-04-17T01:22:46.053+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57022 #162 (55 connections now open) 2016-04-17T01:22:46.055+0000 I NETWORK [conn162] end connection 127.0.0.1:57022 (54 connections now open) 2016-04-17T01:22:46.055+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57023 #163 (55 connections now open) 2016-04-17T01:22:46.056+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57024 #164 (56 connections now open) 2016-04-17T01:35:00.173+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57082 #165 (57 connections now open) 2016-04-17T01:40:45.064+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 01:40:08:4) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 01:40:45:5) 2016-04-17T01:40:45.064+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T01:40:55.063+0000 I NETWORK [conn164] end connection 127.0.0.1:57024 (56 connections now open) 2016-04-17T01:41:05.098+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T01:41:05.099+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T01:45:50.066+0000 I NETWORK [conn163] end connection 127.0.0.1:57023 (55 connections now open) 2016-04-17T01:45:50.066+0000 I NETWORK [conn165] end connection 127.0.0.1:57082 (54 connections now open) 2016-04-17T02:16:45.933+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57334 #166 (55 connections now open) 2016-04-17T02:16:45.935+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57335 #167 (56 connections now open) 2016-04-17T02:16:45.935+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57336 #168 (57 connections now open) 2016-04-17T02:16:45.935+0000 I NETWORK [conn166] end connection 127.0.0.1:57334 (56 connections now open) 2016-04-17T02:18:02.612+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57345 #169 (57 connections now open) 2016-04-17T02:22:45.052+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57373 #170 (58 connections now open) 2016-04-17T02:22:45.053+0000 I NETWORK [conn105] end connection 127.0.0.1:43650 (57 connections now open) 2016-04-17T02:22:45.053+0000 I NETWORK [conn168] end connection 127.0.0.1:57336 (57 connections now open) 2016-04-17T02:22:46.034+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57374 #171 (57 connections now open) 2016-04-17T02:22:46.035+0000 I NETWORK [conn171] end connection 127.0.0.1:57374 (56 connections now open) 2016-04-17T02:22:46.035+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57375 #172 (57 connections now open) 2016-04-17T02:37:45.035+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 02:37:06:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 02:37:45:2) 2016-04-17T02:37:45.035+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T02:37:50.039+0000 I NETWORK [conn172] end connection 127.0.0.1:57375 (56 connections now open) 2016-04-17T02:37:51.036+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T02:37:51.037+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T02:42:50.036+0000 I NETWORK [conn169] end connection 127.0.0.1:57345 (55 connections now open) 2016-04-17T02:42:50.036+0000 I NETWORK [conn167] end connection 127.0.0.1:57335 (54 connections now open) 2016-04-17T05:50:45.062+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 05:50:07:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 05:50:45:2) 2016-04-17T05:50:45.062+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T05:50:50.064+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T05:50:50.066+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T05:51:35.046+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 05:50:55:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 05:51:33:2) 2016-04-17T05:51:35.047+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T05:51:46.054+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-17T05:51:46.055+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-17T05:51:46.055+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-17T05:54:46.023+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T05:54:52.024+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-17T05:54:52.024+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-17T05:56:45.041+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-17T06:35:41.816+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T06:35:41.825+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T06:35:41.828+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-17T06:35:42.835+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59141 #173 (55 connections now open) 2016-04-17T06:35:42.835+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59142 #174 (56 connections now open) 2016-04-17T06:35:42.835+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59143 #175 (57 connections now open) 2016-04-17T06:35:42.836+0000 I NETWORK [conn173] end connection 127.0.0.1:59141 (56 connections now open) 2016-04-17T06:39:01.663+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-17T06:40:49.055+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59180 #176 (57 connections now open) 2016-04-17T06:43:36.946+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 06:42:56:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 06:43:36:1) 2016-04-17T06:43:36.946+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T06:43:41.948+0000 I NETWORK [conn175] end connection 127.0.0.1:59143 (56 connections now open) 2016-04-17T06:43:42.947+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T06:43:42.948+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T06:46:45.071+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 06:46:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 06:46:45:3) 2016-04-17T06:46:45.071+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T06:46:50.073+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T06:46:50.074+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T06:48:41.947+0000 I NETWORK [conn176] end connection 127.0.0.1:59180 (55 connections now open) 2016-04-17T06:48:41.947+0000 I NETWORK [conn174] end connection 127.0.0.1:59142 (54 connections now open) 2016-04-17T06:59:43.318+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 06:58:57:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 06:59:43:1) 2016-04-17T06:59:43.318+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T06:59:48.319+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T06:59:48.321+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T07:15:39.664+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 07:14:58:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 07:15:39:a) 2016-04-17T07:15:39.665+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T07:15:40.665+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T07:15:40.666+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T07:33:45.032+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 07:33:12:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 07:33:45:2) 2016-04-17T07:33:45.033+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T07:33:50.033+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-17T07:33:50.035+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-17T07:33:50.035+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-17T07:33:56.051+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-17T07:34:42.654+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 07:34:02:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 17 07:34:41:2) 2016-04-17T07:34:42.654+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T07:34:47.664+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-17T07:34:47.665+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-17T07:40:46.783+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 07:40:02:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 17 07:40:46:1) 2016-04-17T07:40:46.783+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T07:40:51.790+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-17T07:40:51.791+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-17T07:53:45.049+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 07:53:08:3) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 36, timestamp: Apr 17 07:53:45:2) 2016-04-17T07:53:45.050+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T07:53:46.050+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T07:53:46.051+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T07:53:46.052+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-17T08:04:39.492+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59788 #177 (55 connections now open) 2016-04-17T08:04:39.494+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59789 #178 (56 connections now open) 2016-04-17T08:04:39.494+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59790 #179 (57 connections now open) 2016-04-17T08:04:39.494+0000 I NETWORK [conn177] end connection 127.0.0.1:59788 (56 connections now open) 2016-04-17T08:06:44.062+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-17T08:07:47.065+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59813 #180 (57 connections now open) 2016-04-17T08:08:39.612+0000 I NETWORK [conn179] end connection 127.0.0.1:59790 (56 connections now open) 2016-04-17T08:08:44.614+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59821 #181 (57 connections now open) 2016-04-17T08:08:44.615+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59822 #182 (58 connections now open) 2016-04-17T08:08:44.616+0000 I NETWORK [conn181] end connection 127.0.0.1:59821 (57 connections now open) 2016-04-17T08:22:35.771+0000 I NETWORK [conn182] end connection 127.0.0.1:59822 (56 connections now open) 2016-04-17T08:22:45.771+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59921 #183 (57 connections now open) 2016-04-17T08:22:45.772+0000 I NETWORK [conn183] end connection 127.0.0.1:59921 (56 connections now open) 2016-04-17T08:22:45.773+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59922 #184 (57 connections now open) 2016-04-17T08:36:46.079+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60021 #185 (58 connections now open) 2016-04-17T08:36:46.083+0000 I NETWORK [conn185] end connection 127.0.0.1:60021 (57 connections now open) 2016-04-17T08:45:45.045+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 08:45:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 08:45:45:2) 2016-04-17T08:45:45.046+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T08:45:50.047+0000 I NETWORK [conn184] end connection 127.0.0.1:59922 (56 connections now open) 2016-04-17T08:45:50.055+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T08:45:50.055+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T08:50:50.047+0000 I NETWORK [conn180] end connection 127.0.0.1:59813 (55 connections now open) 2016-04-17T08:50:50.047+0000 I NETWORK [conn178] end connection 127.0.0.1:59789 (54 connections now open) 2016-04-17T09:08:43.454+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 09:08:04:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 09:08:43:2) 2016-04-17T09:08:43.454+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T09:08:49.455+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-17T09:08:49.457+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-17T09:08:49.458+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-17T09:09:55.530+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-17T09:24:45.944+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T09:24:45.945+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T09:24:45.945+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-17T09:27:45.048+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60394 #186 (55 connections now open) 2016-04-17T09:27:45.050+0000 I NETWORK [conn186] end connection 127.0.0.1:60394 (54 connections now open) 2016-04-17T09:27:45.050+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60395 #187 (55 connections now open) 2016-04-17T09:27:45.051+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60396 #188 (56 connections now open) 2016-04-17T09:27:59.718+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-17T09:33:49.829+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60442 #189 (57 connections now open) 2016-04-17T09:42:42.036+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 09:41:58:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 09:42:41:1) 2016-04-17T09:42:42.036+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T09:42:42.075+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-17T09:42:47.039+0000 I NETWORK [conn188] end connection 127.0.0.1:60396 (56 connections now open) 2016-04-17T09:42:48.038+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T09:42:48.039+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T09:47:47.037+0000 I NETWORK [conn187] end connection 127.0.0.1:60395 (55 connections now open) 2016-04-17T09:47:47.038+0000 I NETWORK [conn189] end connection 127.0.0.1:60442 (54 connections now open) 2016-04-17T09:52:40.467+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60581 #190 (55 connections now open) 2016-04-17T09:52:40.467+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60582 #191 (56 connections now open) 2016-04-17T09:52:40.467+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60583 #192 (57 connections now open) 2016-04-17T09:52:40.467+0000 I NETWORK [conn190] end connection 127.0.0.1:60581 (56 connections now open) 2016-04-17T09:53:01.214+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60587 #193 (57 connections now open) 2016-04-17T10:30:37.227+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 10:29:58:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 10:30:36:1) 2016-04-17T10:30:37.227+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T10:30:37.264+0000 I NETWORK [conn192] end connection 127.0.0.1:60583 (56 connections now open) 2016-04-17T10:30:43.230+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T10:30:43.232+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T10:35:37.262+0000 I NETWORK [conn191] end connection 127.0.0.1:60582 (55 connections now open) 2016-04-17T10:35:37.262+0000 I NETWORK [conn193] end connection 127.0.0.1:60587 (54 connections now open) 2016-04-17T10:40:43.478+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60927 #194 (55 connections now open) 2016-04-17T10:40:43.479+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60928 #195 (56 connections now open) 2016-04-17T10:40:43.479+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60929 #196 (57 connections now open) 2016-04-17T10:40:43.479+0000 I NETWORK [conn194] end connection 127.0.0.1:60927 (56 connections now open) 2016-04-17T10:42:38.220+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60944 #197 (57 connections now open) 2016-04-17T11:16:46.096+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 11:16:07:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 11:16:45:5) 2016-04-17T11:16:46.097+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T11:16:46.128+0000 I NETWORK [conn196] end connection 127.0.0.1:60929 (56 connections now open) 2016-04-17T11:16:52.098+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T11:16:52.099+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T11:21:46.128+0000 I NETWORK [conn197] end connection 127.0.0.1:60944 (55 connections now open) 2016-04-17T11:21:46.128+0000 I NETWORK [conn195] end connection 127.0.0.1:60928 (54 connections now open) 2016-04-17T11:46:37.031+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 11:45:58:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 11:46:36:1) 2016-04-17T11:46:37.032+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T11:46:43.038+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T11:46:43.039+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T12:24:42.792+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33422 #198 (55 connections now open) 2016-04-17T12:24:42.793+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33423 #199 (56 connections now open) 2016-04-17T12:24:42.793+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33424 #200 (57 connections now open) 2016-04-17T12:24:42.794+0000 I NETWORK [conn198] end connection 127.0.0.1:33422 (56 connections now open) 2016-04-17T12:27:02.674+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33443 #201 (57 connections now open) 2016-04-17T12:46:36.230+0000 I NETWORK [conn200] end connection 127.0.0.1:33424 (56 connections now open) 2016-04-17T12:46:46.232+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33580 #202 (57 connections now open) 2016-04-17T12:46:46.234+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33581 #203 (58 connections now open) 2016-04-17T12:46:46.235+0000 I NETWORK [conn202] end connection 127.0.0.1:33580 (57 connections now open) 2016-04-17T13:30:45.044+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 13:30:04:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 13:30:45:2) 2016-04-17T13:30:45.044+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T13:30:45.048+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-17T13:30:46.044+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T13:46:36.625+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 13:45:56:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 13:46:36:1) 2016-04-17T13:46:36.626+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T13:46:36.630+0000 I NETWORK [conn203] end connection 127.0.0.1:33581 (56 connections now open) 2016-04-17T13:46:42.627+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T13:46:42.628+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T13:51:36.631+0000 I NETWORK [conn199] end connection 127.0.0.1:33423 (55 connections now open) 2016-04-17T13:51:36.631+0000 I NETWORK [conn201] end connection 127.0.0.1:33443 (54 connections now open) 2016-04-17T14:11:41.620+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34149 #204 (55 connections now open) 2016-04-17T14:11:41.621+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34150 #205 (56 connections now open) 2016-04-17T14:11:41.621+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34151 #206 (57 connections now open) 2016-04-17T14:11:41.622+0000 I NETWORK [conn204] end connection 127.0.0.1:34149 (56 connections now open) 2016-04-17T14:11:49.160+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34155 #207 (57 connections now open) 2016-04-17T14:14:31.159+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 14:13:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 14:14:31:1) 2016-04-17T14:14:31.159+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T14:14:36.139+0000 I NETWORK [conn206] end connection 127.0.0.1:34151 (56 connections now open) 2016-04-17T14:14:36.174+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T14:14:36.175+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T14:19:31.176+0000 I NETWORK [conn207] end connection 127.0.0.1:34155 (55 connections now open) 2016-04-17T14:19:31.177+0000 I NETWORK [conn205] end connection 127.0.0.1:34150 (54 connections now open) 2016-04-17T14:21:22.254+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 14:20:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 14:21:22:1) 2016-04-17T14:21:22.255+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T14:21:27.256+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T14:21:27.257+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T17:03:45.116+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 17:03:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 17:03:45:2) 2016-04-17T17:03:45.116+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T17:03:50.119+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T17:03:50.120+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T17:03:51.049+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35199 #208 (55 connections now open) 2016-04-17T17:03:51.049+0000 I NETWORK [conn208] end connection 127.0.0.1:35199 (54 connections now open) 2016-04-17T17:03:51.049+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35200 #209 (55 connections now open) 2016-04-17T17:03:51.053+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35201 #210 (56 connections now open) 2016-04-17T17:05:59.588+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35218 #211 (57 connections now open) 2016-04-17T17:17:41.287+0000 I NETWORK [conn210] end connection 127.0.0.1:35201 (56 connections now open) 2016-04-17T17:17:47.288+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35292 #212 (57 connections now open) 2016-04-17T17:17:47.288+0000 I NETWORK [conn212] end connection 127.0.0.1:35292 (56 connections now open) 2016-04-17T17:17:47.290+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35293 #213 (57 connections now open) 2016-04-17T18:27:36.701+0000 I NETWORK [conn213] end connection 127.0.0.1:35293 (56 connections now open) 2016-04-17T18:27:41.714+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35784 #214 (57 connections now open) 2016-04-17T18:27:41.715+0000 I NETWORK [conn214] end connection 127.0.0.1:35784 (56 connections now open) 2016-04-17T18:27:41.715+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35785 #215 (57 connections now open) 2016-04-17T18:44:50.041+0000 I NETWORK [conn215] end connection 127.0.0.1:35785 (56 connections now open) 2016-04-17T18:44:50.049+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35908 #216 (57 connections now open) 2016-04-17T18:44:50.049+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35909 #217 (58 connections now open) 2016-04-17T18:44:50.050+0000 I NETWORK [conn216] end connection 127.0.0.1:35908 (57 connections now open) 2016-04-17T18:48:45.054+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 18:48:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 18:48:45:2) 2016-04-17T18:48:45.054+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T18:48:46.055+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T18:48:46.057+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T18:48:46.058+0000 I NETWORK [conn217] end connection 127.0.0.1:35909 (56 connections now open) 2016-04-17T18:53:45.057+0000 I NETWORK [conn211] end connection 127.0.0.1:35218 (55 connections now open) 2016-04-17T18:53:45.066+0000 I NETWORK [conn209] end connection 127.0.0.1:35200 (55 connections now open) 2016-04-17T19:43:46.097+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 19:43:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 19:43:45:5) 2016-04-17T19:43:46.099+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T19:43:51.102+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-17T19:43:51.103+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-17T19:43:51.104+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-17T19:50:55.385+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-17T20:25:19.650+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T20:25:25.653+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-17T20:25:25.654+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-17T20:25:25.656+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-17T20:29:37.572+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-17T21:43:47.252+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36996 #218 (55 connections now open) 2016-04-17T21:43:47.253+0000 I NETWORK [conn218] end connection 127.0.0.1:36996 (54 connections now open) 2016-04-17T21:43:47.253+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36997 #219 (55 connections now open) 2016-04-17T21:43:47.255+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36998 #220 (56 connections now open) 2016-04-17T21:44:46.018+0000 I NETWORK [conn220] end connection 127.0.0.1:36998 (55 connections now open) 2016-04-17T21:44:51.019+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37010 #221 (56 connections now open) 2016-04-17T21:44:51.019+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37011 #222 (57 connections now open) 2016-04-17T21:44:51.020+0000 I NETWORK [conn221] end connection 127.0.0.1:37010 (56 connections now open) 2016-04-17T21:45:35.741+0000 I NETWORK [conn222] end connection 127.0.0.1:37011 (55 connections now open) 2016-04-17T21:45:45.742+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37015 #223 (56 connections now open) 2016-04-17T21:45:45.743+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37016 #224 (57 connections now open) 2016-04-17T21:45:45.743+0000 I NETWORK [conn223] end connection 127.0.0.1:37015 (56 connections now open) 2016-04-17T21:46:00.060+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37017 #225 (57 connections now open) 2016-04-17T21:48:45.057+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 36, timestamp: Apr 17 21:48:08:3) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 36, timestamp: Apr 17 21:48:45:2) 2016-04-17T21:48:45.058+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T21:48:46.062+0000 I NETWORK [conn224] end connection 127.0.0.1:37016 (56 connections now open) 2016-04-17T21:48:50.062+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-17T21:48:50.063+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-17T21:48:50.064+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-17T21:53:45.063+0000 I NETWORK [conn219] end connection 127.0.0.1:36997 (55 connections now open) 2016-04-17T21:53:45.063+0000 I NETWORK [conn225] end connection 127.0.0.1:37017 (54 connections now open) 2016-04-17T21:54:02.386+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-17T22:41:42.983+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-17T22:41:47.995+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-17T22:41:47.999+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-18T00:42:50.069+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-18T00:43:05.113+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-18T00:43:05.118+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-18T00:43:05.135+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-18T00:44:57.886+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-18T01:38:55.079+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38541 #226 (55 connections now open) 2016-04-18T01:38:55.086+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38542 #227 (56 connections now open) 2016-04-18T01:38:55.086+0000 I NETWORK [conn226] end connection 127.0.0.1:38541 (55 connections now open) 2016-04-18T01:38:55.102+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38543 #228 (56 connections now open) 2016-04-18T01:38:57.967+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38547 #229 (57 connections now open) 2016-04-18T01:48:21.263+0000 I NETWORK [conn227] end connection 127.0.0.1:38542 (56 connections now open) 2016-04-18T01:48:21.275+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38594 #230 (57 connections now open) 2016-04-18T01:48:21.276+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38595 #231 (58 connections now open) 2016-04-18T01:48:21.276+0000 I NETWORK [conn230] end connection 127.0.0.1:38594 (57 connections now open) 2016-04-18T02:16:04.370+0000 I COMMAND [conn61] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 289ms 2016-04-18T02:16:04.370+0000 I COMMAND [conn68] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 289ms 2016-04-18T02:16:04.370+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 289ms 2016-04-18T02:16:04.370+0000 I COMMAND [conn67] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 289ms 2016-04-18T02:16:04.370+0000 I COMMAND [conn50] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 289ms 2016-04-18T02:16:04.370+0000 I COMMAND [conn47] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 289ms 2016-04-18T02:16:04.370+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 289ms 2016-04-18T02:16:04.370+0000 I COMMAND [conn35] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 289ms 2016-04-18T02:16:04.370+0000 I COMMAND [conn62] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 289ms 2016-04-18T02:16:04.370+0000 I COMMAND [conn32] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 289ms 2016-04-18T02:16:04.372+0000 I COMMAND [conn7] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 36 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:425 locks:{} protocol:op_command 729ms 2016-04-18T02:16:04.372+0000 I COMMAND [conn170] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 36 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:425 locks:{} protocol:op_command 729ms 2016-04-18T02:16:08.098+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 780, after connections: 1270, after extra_info: 1730, after globalLock: 1970, after locks: 2050, after network: 2140, after opcounters: 2140, after opcountersRepl: 2140, after repl: 2760, after storageEngine: 2850, after tcmalloc: 3230, after wiredTiger: 4070, at end: 5960 } 2016-04-18T02:16:09.698+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-18T02:16:11.507+0000 I COMMAND [conn231] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1460564823000|1, t: 35 }, appliedOpTime: { ts: Timestamp 1460564823000|1, t: 35 }, memberId: 0, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1460945758000|2, t: 36 }, appliedOpTime: { ts: Timestamp 1460945758000|2, t: 36 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1460945758000|1, t: 36 }, appliedOpTime: { ts: Timestamp 1460945758000|1, t: 36 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 1035ms 2016-04-18T02:16:12.632+0000 I COMMAND [conn229] command local.oplog.rs command: getMore { getMore: 28435136938, collection: "oplog.rs", maxTimeMS: 5000, term: 36, lastKnownCommittedOpTime: { ts: Timestamp 1460945758000|1, t: 36 } } cursorid:28435136938 keyUpdates:0 writeConflicts:0 numYields:1 nreturned:0 reslen:292 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } protocol:op_command 11062ms 2016-04-18T02:16:13.699+0000 I COMMAND [conn170] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 36 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:394 locks:{} protocol:op_command 1560ms 2016-04-18T02:16:13.988+0000 I COMMAND [conn6] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 36 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:394 locks:{} protocol:op_command 1560ms 2016-04-18T02:16:14.671+0000 I NETWORK [conn229] end connection 127.0.0.1:38547 (56 connections now open) 2016-04-18T02:16:15.622+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38773 #232 (58 connections now open) 2016-04-18T02:16:17.979+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-18T02:16:18.177+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-18T02:16:19.167+0000 I NETWORK [conn170] end connection 127.0.0.1:57373 (56 connections now open) 2016-04-18T02:16:19.167+0000 I NETWORK [conn231] end connection 127.0.0.1:38595 (56 connections now open) 2016-04-18T02:16:19.178+0000 I COMMAND [conn232] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 1302ms 2016-04-18T02:16:19.263+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:16:20.406+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-18T02:16:22.359+0000 I COMMAND [conn6] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 36 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3404ms 2016-04-18T02:16:22.365+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38775 #233 (56 connections now open) 2016-04-18T02:16:24.131+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: HostUnreachable: End of file 2016-04-18T02:16:25.514+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 190, after asserts: 290, after connections: 480, after extra_info: 1160, after globalLock: 1160, after locks: 1160, after network: 1160, after opcounters: 1160, after opcountersRepl: 1160, after repl: 4490, after storageEngine: 4495, after tcmalloc: 4905, after wiredTiger: 6675, at end: 7405 } 2016-04-18T02:16:26.009+0000 I COMMAND [conn23] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 591ms 2016-04-18T02:16:26.009+0000 I COMMAND [conn26] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 591ms 2016-04-18T02:16:26.009+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 591ms 2016-04-18T02:16:26.009+0000 I COMMAND [conn44] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 591ms 2016-04-18T02:16:26.108+0000 I COMMAND [conn232] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 36, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1460945758000|1, t: 36 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 2706ms 2016-04-18T02:16:26.108+0000 I COMMAND [conn32] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1776ms 2016-04-18T02:16:26.108+0000 I COMMAND [conn62] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1776ms 2016-04-18T02:16:26.108+0000 I COMMAND [conn35] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1776ms 2016-04-18T02:16:26.116+0000 I COMMAND [conn233] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1973ms 2016-04-18T02:16:28.509+0000 I COMMAND [conn232] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 36 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 406ms 2016-04-18T02:16:28.509+0000 I COMMAND [conn6] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 36 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2120ms 2016-04-18T02:16:28.509+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-18T02:16:30.157+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-18T02:16:30.639+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-18T02:16:31.543+0000 I NETWORK [conn232] end connection 127.0.0.1:38773 (55 connections now open) 2016-04-18T02:16:31.979+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-18T02:16:31.979+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:16:36.367+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-18T02:16:37.262+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 210, after asserts: 310, after connections: 490, after extra_info: 1180, after globalLock: 1280, after locks: 1290, after network: 1380, after opcounters: 1380, after opcountersRepl: 1380, after repl: 2510, after storageEngine: 2690, after tcmalloc: 2980, after wiredTiger: 4100, at end: 5110 } 2016-04-18T02:16:37.783+0000 I COMMAND [conn7] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 36 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1017ms 2016-04-18T02:16:39.259+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-18T02:16:39.768+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-18T02:16:39.905+0000 I COMMAND [conn56] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 105ms 2016-04-18T02:16:40.148+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 693ms 2016-04-18T02:16:40.148+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 693ms 2016-04-18T02:16:40.182+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:16:40.218+0000 I COMMAND [conn6] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 36, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1460945758000|2, t: 36 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 4819ms 2016-04-18T02:16:40.230+0000 I REPL [ReplicationExecutor] dry election run succeeded, running for election 2016-04-18T02:16:40.231+0000 I REPL [ReplicationExecutor] election succeeded, assuming primary role in term 37 2016-04-18T02:16:40.231+0000 I REPL [ReplicationExecutor] transition to PRIMARY 2016-04-18T02:16:40.234+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-18T02:16:40.234+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-18T02:16:43.438+0000 I REPL [rsSync] transition to primary complete; database writes are now permitted 2016-04-18T02:16:43.577+0000 I COMMAND [conn6] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 37 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:416 locks:{} protocol:op_command 335ms 2016-04-18T02:16:46.526+0000 I COMMAND [conn50] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 197ms 2016-04-18T02:16:46.526+0000 I COMMAND [conn26] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 197ms 2016-04-18T02:16:46.526+0000 I COMMAND [conn47] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 197ms 2016-04-18T02:16:46.526+0000 I COMMAND [conn44] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 197ms 2016-04-18T02:16:46.526+0000 I COMMAND [conn23] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 197ms 2016-04-18T02:16:46.526+0000 I COMMAND [conn67] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 197ms 2016-04-18T02:16:48.525+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38789 #234 (56 connections now open) 2016-04-18T02:16:48.526+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38790 #235 (57 connections now open) 2016-04-18T02:16:49.954+0000 I COMMAND [conn61] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 589ms 2016-04-18T02:16:54.597+0000 I COMMAND [conn233] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 37, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1460945758000|2, t: 36 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 537ms 2016-04-18T02:16:54.597+0000 I COMMAND [conn6] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 37 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:416 locks:{} protocol:op_command 1826ms 2016-04-18T02:16:56.311+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 490, after connections: 810, after extra_info: 1830, after globalLock: 2300, after locks: 2450, after network: 2450, after opcounters: 2450, after opcountersRepl: 2450, after repl: 2820, after storageEngine: 3330, after tcmalloc: 4280, after wiredTiger: 5310, at end: 6990 } 2016-04-18T02:16:57.890+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:17:01.201+0000 I COMMAND [conn234] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1378ms 2016-04-18T02:17:01.201+0000 I COMMAND [conn235] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1378ms 2016-04-18T02:17:10.506+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-18T02:17:13.024+0000 I COMMAND [conn26] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 950ms 2016-04-18T02:17:13.024+0000 I COMMAND [conn47] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 949ms 2016-04-18T02:17:13.024+0000 I COMMAND [conn50] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 949ms 2016-04-18T02:17:13.024+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 949ms 2016-04-18T02:17:13.024+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 950ms 2016-04-18T02:17:13.025+0000 I COMMAND [conn23] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 949ms 2016-04-18T02:17:13.024+0000 I COMMAND [conn67] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 949ms 2016-04-18T02:17:13.024+0000 I COMMAND [conn44] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 949ms 2016-04-18T02:17:14.847+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 870, after connections: 880, after extra_info: 1350, after globalLock: 1670, after locks: 1750, after network: 1760, after opcounters: 1760, after opcountersRepl: 1760, after repl: 2520, after storageEngine: 2800, after tcmalloc: 3080, after wiredTiger: 4680, at end: 6880 } 2016-04-18T02:17:15.433+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 635ms 2016-04-18T02:17:25.836+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-18T02:17:36.259+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 730, after connections: 830, after extra_info: 1550, after globalLock: 1910, after locks: 2110, after network: 2250, after opcounters: 2250, after opcountersRepl: 2250, after repl: 3070, after storageEngine: 3600, after tcmalloc: 4080, after wiredTiger: 4170, at end: 6450 } 2016-04-18T02:17:36.994+0000 I COMMAND [conn26] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1567ms 2016-04-18T02:17:36.994+0000 I COMMAND [conn50] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1567ms 2016-04-18T02:17:40.913+0000 I COMMAND [conn23] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2341ms 2016-04-18T02:17:40.913+0000 I COMMAND [conn47] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2341ms 2016-04-18T02:17:41.531+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:17:49.024+0000 I COMMAND [conn67] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1778ms 2016-04-18T02:17:55.535+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:17:55.681+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 770, after connections: 1760, after extra_info: 2820, after globalLock: 3090, after locks: 3350, after network: 3440, after opcounters: 3440, after opcountersRepl: 3440, after repl: 4270, after storageEngine: 4470, after tcmalloc: 4480, after wiredTiger: 5060, at end: 6820 } 2016-04-18T02:17:58.854+0000 I COMMAND [conn44] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3148ms 2016-04-18T02:18:10.401+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:18:13.597+0000 I COMMAND [conn56] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 427ms 2016-04-18T02:18:13.597+0000 I COMMAND [conn61] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 427ms 2016-04-18T02:18:13.597+0000 I COMMAND [conn68] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 426ms 2016-04-18T02:18:14.232+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 260, after asserts: 550, after connections: 910, after extra_info: 1690, after globalLock: 2180, after locks: 2440, after network: 2730, after opcounters: 2730, after opcountersRepl: 2730, after repl: 5100, after storageEngine: 5420, after tcmalloc: 6180, after wiredTiger: 6820, at end: 7440 } 2016-04-18T02:18:22.796+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:18:36.254+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 500, after asserts: 780, after connections: 1380, after extra_info: 2250, after globalLock: 2770, after locks: 3360, after network: 3850, after opcounters: 4230, after opcountersRepl: 4700, after repl: 5940, after storageEngine: 6480, after tcmalloc: 7320, after wiredTiger: 8600, at end: 10580 } 2016-04-18T02:18:36.853+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:18:51.243+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:19:01.578+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 370, after asserts: 720, after connections: 810, after extra_info: 1340, after globalLock: 1740, after locks: 1840, after network: 1980, after opcounters: 1980, after opcountersRepl: 1980, after repl: 2750, after storageEngine: 3110, after tcmalloc: 4300, after wiredTiger: 6320, at end: 7680 } 2016-04-18T02:19:04.348+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:19:18.704+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:19:26.359+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 690, after connections: 890, after extra_info: 1470, after globalLock: 1950, after locks: 2300, after network: 2490, after opcounters: 2770, after opcountersRepl: 2770, after repl: 6060, after storageEngine: 6340, after tcmalloc: 6750, after wiredTiger: 8020, at end: 10110 } 2016-04-18T02:19:35.006+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:19:46.397+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 870, after connections: 1050, after extra_info: 2010, after globalLock: 2280, after locks: 2370, after network: 2370, after opcounters: 2370, after opcountersRepl: 2370, after repl: 2700, after storageEngine: 2800, after tcmalloc: 3290, after wiredTiger: 4710, at end: 5760 } 2016-04-18T02:19:48.192+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:19:55.448+0000 I NETWORK [conn235] end connection 127.0.0.1:38790 (56 connections now open) 2016-04-18T02:19:55.448+0000 I NETWORK [conn234] end connection 127.0.0.1:38789 (56 connections now open) 2016-04-18T02:19:55.771+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 194ms 2016-04-18T02:20:03.612+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:20:06.605+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 610, after connections: 610, after extra_info: 800, after globalLock: 800, after locks: 810, after network: 810, after opcounters: 900, after opcountersRepl: 900, after repl: 2520, after storageEngine: 2960, after tcmalloc: 3580, after wiredTiger: 4820, at end: 5850 } 2016-04-18T02:20:08.458+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38799 #236 (56 connections now open) 2016-04-18T02:20:09.932+0000 I COMMAND [conn50] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1446ms 2016-04-18T02:20:09.932+0000 I COMMAND [conn23] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1446ms 2016-04-18T02:20:09.932+0000 I COMMAND [conn26] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1446ms 2016-04-18T02:20:10.575+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38800 #237 (57 connections now open) 2016-04-18T02:20:11.106+0000 I COMMAND [conn44] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 579ms 2016-04-18T02:20:11.106+0000 I COMMAND [conn47] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 579ms 2016-04-18T02:20:11.106+0000 I COMMAND [conn67] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 579ms 2016-04-18T02:20:11.599+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38801 #238 (58 connections now open) 2016-04-18T02:20:12.721+0000 I COMMAND [conn68] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1719ms 2016-04-18T02:20:12.721+0000 I COMMAND [conn61] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1719ms 2016-04-18T02:20:12.721+0000 I COMMAND [conn56] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1719ms 2016-04-18T02:20:15.260+0000 I COMMAND [conn236] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1722ms 2016-04-18T02:20:16.442+0000 I COMMAND [conn237] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1589ms 2016-04-18T02:20:17.420+0000 I COMMAND [conn238] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1782ms 2016-04-18T02:20:17.598+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:20:25.498+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 550, after connections: 640, after extra_info: 1550, after globalLock: 1810, after locks: 1990, after network: 2080, after opcounters: 2080, after opcountersRepl: 2080, after repl: 5740, after storageEngine: 6100, after tcmalloc: 6800, after wiredTiger: 8050, at end: 10460 } 2016-04-18T02:20:31.731+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:20:40.703+0000 I NETWORK [conn236] end connection 127.0.0.1:38799 (57 connections now open) 2016-04-18T02:20:40.703+0000 I NETWORK [conn237] end connection 127.0.0.1:38800 (57 connections now open) 2016-04-18T02:20:42.730+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 530, after asserts: 540, after connections: 620, after extra_info: 1170, after globalLock: 1480, after locks: 1790, after network: 1980, after opcounters: 1980, after opcountersRepl: 1980, after repl: 2800, after storageEngine: 2910, after tcmalloc: 3730, after wiredTiger: 4140, at end: 5490 } 2016-04-18T02:20:43.367+0000 I COMMAND [conn44] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2124ms 2016-04-18T02:20:43.367+0000 I COMMAND [conn67] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2124ms 2016-04-18T02:20:43.367+0000 I COMMAND [conn47] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2124ms 2016-04-18T02:20:44.226+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:20:58.860+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 181ms 2016-04-18T02:20:59.454+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:21:02.716+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 630, after connections: 630, after extra_info: 1210, after globalLock: 1580, after locks: 1680, after network: 1770, after opcounters: 1770, after opcountersRepl: 1770, after repl: 2710, after storageEngine: 3240, after tcmalloc: 3770, after wiredTiger: 5310, at end: 7680 } 2016-04-18T02:21:13.037+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:21:14.513+0000 I NETWORK [conn228] end connection 127.0.0.1:38543 (55 connections now open) 2016-04-18T02:21:19.545+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 370, after asserts: 590, after connections: 720, after extra_info: 830, after globalLock: 920, after locks: 920, after network: 920, after opcounters: 920, after opcountersRepl: 920, after repl: 2300, after storageEngine: 2690, after tcmalloc: 2980, after wiredTiger: 3830, at end: 5280 } 2016-04-18T02:21:25.637+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:21:32.417+0000 I COMMAND [conn56] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 453ms 2016-04-18T02:21:32.417+0000 I COMMAND [conn26] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 453ms 2016-04-18T02:21:32.417+0000 I COMMAND [conn61] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 452ms 2016-04-18T02:21:32.417+0000 I COMMAND [conn68] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 453ms 2016-04-18T02:21:32.417+0000 I COMMAND [conn23] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 453ms 2016-04-18T02:21:32.417+0000 I COMMAND [conn50] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 453ms 2016-04-18T02:21:33.608+0000 I NETWORK [conn238] end connection 127.0.0.1:38801 (54 connections now open) 2016-04-18T02:21:38.928+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 350, after asserts: 530, after connections: 620, after extra_info: 1520, after globalLock: 2360, after locks: 3120, after network: 3350, after opcounters: 3450, after opcountersRepl: 3450, after repl: 5150, after storageEngine: 5630, after tcmalloc: 5960, after wiredTiger: 6000, at end: 6770 } 2016-04-18T02:21:39.399+0000 I COMMAND [conn44] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 183ms 2016-04-18T02:21:39.399+0000 I COMMAND [conn67] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 183ms 2016-04-18T02:21:39.399+0000 I COMMAND [conn47] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 183ms 2016-04-18T02:21:40.225+0000 I COMMAND [conn50] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 922ms 2016-04-18T02:21:40.225+0000 I COMMAND [conn68] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 922ms 2016-04-18T02:21:40.225+0000 I COMMAND [conn56] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 922ms 2016-04-18T02:21:40.225+0000 I COMMAND [conn61] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 922ms 2016-04-18T02:21:40.225+0000 I COMMAND [conn23] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 922ms 2016-04-18T02:21:40.225+0000 I COMMAND [conn26] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 922ms 2016-04-18T02:21:40.672+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:21:50.640+0000 I COMMAND [conn44] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1508ms 2016-04-18T02:21:50.640+0000 I COMMAND [conn47] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1508ms 2016-04-18T02:21:50.640+0000 I COMMAND [conn67] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1508ms 2016-04-18T02:21:53.305+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 450, after connections: 530, after extra_info: 1070, after globalLock: 1480, after locks: 1580, after network: 1580, after opcounters: 1580, after opcountersRepl: 1580, after repl: 2320, after storageEngine: 2590, after tcmalloc: 2810, after wiredTiger: 4040, at end: 4940 } 2016-04-18T02:21:54.776+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:21:57.167+0000 I COMMAND [conn50] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 986ms 2016-04-18T02:21:57.167+0000 I COMMAND [conn23] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 986ms 2016-04-18T02:21:58.649+0000 I NETWORK [conn233] end connection 127.0.0.1:38775 (53 connections now open) 2016-04-18T02:21:59.279+0000 I COMMAND [conn26] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 803ms 2016-04-18T02:22:00.902+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 183ms 2016-04-18T02:22:08.292+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:22:13.139+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 420, after asserts: 620, after connections: 990, after extra_info: 1600, after globalLock: 1920, after locks: 2180, after network: 2480, after opcounters: 2480, after opcountersRepl: 2480, after repl: 3620, after storageEngine: 4020, after tcmalloc: 4420, after wiredTiger: 5370, at end: 5870 } 2016-04-18T02:22:14.763+0000 I COMMAND [conn67] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 194ms 2016-04-18T02:22:14.763+0000 I COMMAND [conn68] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 194ms 2016-04-18T02:22:14.763+0000 I COMMAND [conn56] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 194ms 2016-04-18T02:22:14.763+0000 I COMMAND [conn47] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 194ms 2016-04-18T02:22:14.763+0000 I COMMAND [conn44] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 194ms 2016-04-18T02:22:14.763+0000 I COMMAND [conn61] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 194ms 2016-04-18T02:22:15.873+0000 I COMMAND [conn26] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1310ms 2016-04-18T02:22:15.873+0000 I COMMAND [conn23] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1310ms 2016-04-18T02:22:15.873+0000 I COMMAND [conn50] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1310ms 2016-04-18T02:22:21.064+0000 I COMMAND [conn47] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1325ms 2016-04-18T02:22:21.064+0000 I COMMAND [conn68] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1325ms 2016-04-18T02:22:21.064+0000 I COMMAND [conn56] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1325ms 2016-04-18T02:22:21.064+0000 I COMMAND [conn61] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1325ms 2016-04-18T02:22:21.064+0000 I COMMAND [conn44] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1325ms 2016-04-18T02:22:21.064+0000 I COMMAND [conn67] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1325ms 2016-04-18T02:22:22.099+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:22:28.399+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 290, after extra_info: 1150, after globalLock: 1280, after locks: 1380, after network: 1380, after opcounters: 1380, after opcountersRepl: 1380, after repl: 2600, after storageEngine: 2870, after tcmalloc: 3720, after wiredTiger: 4570, at end: 5690 } 2016-04-18T02:22:35.991+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:22:40.688+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 670, after connections: 880, after extra_info: 1070, after globalLock: 1070, after locks: 1070, after network: 1070, after opcounters: 1070, after opcountersRepl: 1070, after repl: 1080, after storageEngine: 1080, after tcmalloc: 1080, after wiredTiger: 1970, at end: 4190 } 2016-04-18T02:22:49.540+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:22:59.968+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 500, after asserts: 720, after connections: 960, after extra_info: 1720, after globalLock: 1990, after locks: 2040, after network: 2130, after opcounters: 2130, after opcountersRepl: 2130, after repl: 2970, after storageEngine: 3370, after tcmalloc: 3890, after wiredTiger: 5120, at end: 7280 } 2016-04-18T02:23:02.489+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:23:03.266+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 189ms 2016-04-18T02:23:14.064+0000 I COMMAND [conn50] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 944ms 2016-04-18T02:23:17.185+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:23:19.802+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 100, after asserts: 110, after connections: 180, after extra_info: 1070, after globalLock: 1500, after locks: 1510, after network: 1640, after opcounters: 1780, after opcountersRepl: 1780, after repl: 3450, after storageEngine: 3720, after tcmalloc: 4130, after wiredTiger: 5000, at end: 6870 } 2016-04-18T02:23:24.732+0000 I COMMAND [conn26] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 552ms 2016-04-18T02:23:31.603+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:23:33.604+0000 I COMMAND [conn23] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 559ms 2016-04-18T02:23:37.290+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 670, after asserts: 870, after connections: 970, after extra_info: 1650, after globalLock: 1840, after locks: 1930, after network: 2010, after opcounters: 2010, after opcountersRepl: 2010, after repl: 3070, after storageEngine: 3530, after tcmalloc: 4200, after wiredTiger: 4320, at end: 5940 } 2016-04-18T02:23:45.628+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:23:59.838+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 930, after asserts: 1220, after connections: 1590, after extra_info: 2800, after globalLock: 3090, after locks: 3090, after network: 3190, after opcounters: 3190, after opcountersRepl: 3190, after repl: 4030, after storageEngine: 4310, after tcmalloc: 4780, after wiredTiger: 5840, at end: 7540 } 2016-04-18T02:23:59.961+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:24:15.357+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:24:18.684+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:24:23.966+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 490, after connections: 770, after extra_info: 1570, after globalLock: 1750, after locks: 1850, after network: 1940, after opcounters: 1940, after opcountersRepl: 1940, after repl: 3950, after storageEngine: 4350, after tcmalloc: 5690, after wiredTiger: 6760, at end: 8600 } 2016-04-18T02:24:32.412+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:24:35.449+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:24:46.154+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 540, after connections: 1060, after extra_info: 1810, after globalLock: 2170, after locks: 2270, after network: 2360, after opcounters: 2360, after opcountersRepl: 2360, after repl: 2950, after storageEngine: 3400, after tcmalloc: 4070, after wiredTiger: 4830, at end: 6930 } 2016-04-18T02:24:51.784+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:25:05.382+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:25:07.703+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 530, after asserts: 800, after connections: 990, after extra_info: 1580, after globalLock: 2070, after locks: 2350, after network: 2440, after opcounters: 2440, after opcountersRepl: 2440, after repl: 3290, after storageEngine: 4020, after tcmalloc: 4370, after wiredTiger: 5950, at end: 7530 } 2016-04-18T02:25:19.833+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:25:32.193+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 500, after connections: 590, after extra_info: 1420, after globalLock: 1980, after locks: 2350, after network: 2730, after opcounters: 3160, after opcountersRepl: 3170, after repl: 3880, after storageEngine: 4330, after tcmalloc: 4960, after wiredTiger: 6600, at end: 8760 } 2016-04-18T02:25:33.969+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:25:51.319+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:25:55.871+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 350, after asserts: 530, after connections: 880, after extra_info: 1690, after globalLock: 1960, after locks: 2140, after network: 2140, after opcounters: 2140, after opcountersRepl: 2140, after repl: 3310, after storageEngine: 3760, after tcmalloc: 4130, after wiredTiger: 5440, at end: 7850 } 2016-04-18T02:26:05.430+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 182ms 2016-04-18T02:26:06.530+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:26:18.980+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 550, after asserts: 910, after connections: 1210, after extra_info: 2000, after globalLock: 2190, after locks: 2290, after network: 2370, after opcounters: 2370, after opcountersRepl: 2370, after repl: 3320, after storageEngine: 4040, after tcmalloc: 4930, after wiredTiger: 6080, at end: 7400 } 2016-04-18T02:26:20.972+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:26:35.587+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:26:42.475+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 550, after connections: 680, after extra_info: 1080, after globalLock: 1440, after locks: 1910, after network: 2100, after opcounters: 2270, after opcountersRepl: 2270, after repl: 5080, after storageEngine: 5610, after tcmalloc: 5990, after wiredTiger: 7410, at end: 9320 } 2016-04-18T02:26:49.586+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:26:53.408+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:27:04.085+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:27:06.942+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 176ms 2016-04-18T02:27:07.039+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 590, after connections: 690, after extra_info: 1360, after globalLock: 1870, after locks: 2090, after network: 2270, after opcounters: 2460, after opcountersRepl: 2460, after repl: 3530, after storageEngine: 4090, after tcmalloc: 4550, after wiredTiger: 6280, at end: 8280 } 2016-04-18T02:27:08.493+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:27:10.009+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:27:19.406+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:27:24.516+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:27:31.149+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 440, after connections: 610, after extra_info: 1420, after globalLock: 1740, after locks: 1840, after network: 1920, after opcounters: 1920, after opcountersRepl: 1920, after repl: 2940, after storageEngine: 3570, after tcmalloc: 4140, after wiredTiger: 5920, at end: 7440 } 2016-04-18T02:27:35.359+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:27:37.402+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:27:38.367+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:27:50.658+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:27:50.750+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 670, after asserts: 880, after connections: 980, after extra_info: 1500, after globalLock: 1810, after locks: 2170, after network: 2380, after opcounters: 2390, after opcountersRepl: 2390, after repl: 3230, after storageEngine: 3630, after tcmalloc: 4200, after wiredTiger: 5560, at end: 7910 } 2016-04-18T02:27:53.556+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:28:09.771+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:28:15.443+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 370, after asserts: 470, after connections: 470, after extra_info: 1200, after globalLock: 1690, after locks: 2080, after network: 2180, after opcounters: 2180, after opcountersRepl: 2180, after repl: 4710, after storageEngine: 4970, after tcmalloc: 5070, after wiredTiger: 6170, at end: 7590 } 2016-04-18T02:28:22.815+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:28:25.329+0000 I COMMAND [conn26] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1733ms 2016-04-18T02:28:25.329+0000 I COMMAND [conn50] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1733ms 2016-04-18T02:28:25.329+0000 I COMMAND [conn23] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1732ms 2016-04-18T02:28:33.504+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 250, after asserts: 550, after connections: 840, after extra_info: 1450, after globalLock: 1860, after locks: 2160, after network: 2260, after opcounters: 2260, after opcountersRepl: 2260, after repl: 3880, after storageEngine: 4420, after tcmalloc: 5300, after wiredTiger: 6990, at end: 9940 } 2016-04-18T02:28:43.343+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:28:59.674+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:29:04.793+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 230, after asserts: 420, after connections: 520, after extra_info: 1070, after globalLock: 1700, after locks: 2240, after network: 2460, after opcounters: 2870, after opcountersRepl: 3280, after repl: 5300, after storageEngine: 5840, after tcmalloc: 6540, after wiredTiger: 8200, at end: 10390 } 2016-04-18T02:29:07.106+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2130ms 2016-04-18T02:29:09.212+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 178ms 2016-04-18T02:29:15.420+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:29:15.427+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1933ms 2016-04-18T02:29:21.925+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1318ms 2016-04-18T02:29:29.046+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:29:30.642+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 820, after connections: 1000, after extra_info: 1820, after globalLock: 2240, after locks: 2650, after network: 3090, after opcounters: 3100, after opcountersRepl: 3100, after repl: 3990, after storageEngine: 4760, after tcmalloc: 5600, after wiredTiger: 7400, at end: 9800 } 2016-04-18T02:29:31.003+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:29:45.815+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:29:46.440+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:29:51.220+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:29:59.752+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:30:01.115+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 420, after asserts: 690, after connections: 1090, after extra_info: 2030, after globalLock: 2540, after locks: 3000, after network: 3390, after opcounters: 3590, after opcountersRepl: 3590, after repl: 7070, after storageEngine: 7580, after tcmalloc: 8360, after wiredTiger: 10580, at end: 12940 } 2016-04-18T02:30:06.794+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:30:10.803+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 215ms 2016-04-18T02:30:13.080+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 214ms 2016-04-18T02:30:14.206+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:30:22.215+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:30:28.702+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:30:32.553+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 880, after asserts: 1230, after connections: 1600, after extra_info: 2840, after globalLock: 3150, after locks: 3240, after network: 3330, after opcounters: 3330, after opcountersRepl: 3330, after repl: 7660, after storageEngine: 8170, after tcmalloc: 8680, after wiredTiger: 10880, at end: 13450 } 2016-04-18T02:30:35.082+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:30:38.625+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:30:43.875+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:30:53.088+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:30:54.805+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 460, after asserts: 730, after connections: 830, after extra_info: 1620, after globalLock: 1830, after locks: 2220, after network: 2400, after opcounters: 2400, after opcountersRepl: 2400, after repl: 3140, after storageEngine: 3840, after tcmalloc: 4910, after wiredTiger: 6220, at end: 7330 } 2016-04-18T02:31:00.114+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:31:02.830+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:31:08.430+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:31:14.399+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:31:19.898+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 800, after connections: 1070, after extra_info: 1760, after globalLock: 2030, after locks: 2480, after network: 2570, after opcounters: 2570, after opcountersRepl: 2570, after repl: 4260, after storageEngine: 4660, after tcmalloc: 5560, after wiredTiger: 7030, at end: 9550 } 2016-04-18T02:31:22.955+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:31:29.796+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:31:33.825+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:31:40.123+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:31:44.011+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:31:47.338+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 520, after asserts: 810, after connections: 910, after extra_info: 2010, after globalLock: 2480, after locks: 2880, after network: 3150, after opcounters: 3150, after opcountersRepl: 3150, after repl: 4950, after storageEngine: 5290, after tcmalloc: 5680, after wiredTiger: 7170, at end: 9190 } 2016-04-18T02:31:55.822+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:31:58.509+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:32:08.578+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:32:13.475+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 600, after asserts: 970, after connections: 1460, after extra_info: 2720, after globalLock: 3030, after locks: 3220, after network: 3310, after opcounters: 3310, after opcountersRepl: 3310, after repl: 4570, after storageEngine: 5050, after tcmalloc: 5320, after wiredTiger: 6680, at end: 8080 } 2016-04-18T02:32:13.930+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:32:15.248+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 119ms 2016-04-18T02:32:16.798+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:32:31.077+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:32:34.493+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:32:38.605+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:32:44.683+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 910, after connections: 1270, after extra_info: 2330, after globalLock: 2730, after locks: 3120, after network: 3480, after opcounters: 3660, after opcountersRepl: 3660, after repl: 7850, after storageEngine: 8270, after tcmalloc: 8820, after wiredTiger: 11220, at end: 13160 } 2016-04-18T02:32:51.444+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:32:53.906+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:33:06.106+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 600, after connections: 1000, after extra_info: 1630, after globalLock: 2020, after locks: 2340, after network: 2460, after opcounters: 2460, after opcountersRepl: 2460, after repl: 3020, after storageEngine: 3390, after tcmalloc: 4120, after wiredTiger: 5460, at end: 7190 } 2016-04-18T02:33:06.602+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:33:08.209+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:33:11.066+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:33:16.634+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 109ms 2016-04-18T02:33:23.422+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:33:26.204+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:33:26.716+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 650, after connections: 1120, after extra_info: 2320, after globalLock: 2770, after locks: 3210, after network: 3340, after opcounters: 3340, after opcountersRepl: 3340, after repl: 4250, after storageEngine: 4730, after tcmalloc: 5100, after wiredTiger: 5810, at end: 7800 } 2016-04-18T02:33:40.294+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:33:47.574+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 560, after connections: 830, after extra_info: 1770, after globalLock: 2490, after locks: 2770, after network: 3120, after opcounters: 3220, after opcountersRepl: 3220, after repl: 5430, after storageEngine: 5870, after tcmalloc: 6010, after wiredTiger: 7040, at end: 9000 } 2016-04-18T02:33:55.754+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:34:08.908+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 530, after asserts: 730, after connections: 920, after extra_info: 1440, after globalLock: 1670, after locks: 1770, after network: 1770, after opcounters: 1770, after opcountersRepl: 1770, after repl: 2990, after storageEngine: 3570, after tcmalloc: 4680, after wiredTiger: 6950, at end: 8550 } 2016-04-18T02:34:10.589+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:34:25.164+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:34:33.191+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 510, after connections: 880, after extra_info: 2070, after globalLock: 2340, after locks: 2640, after network: 2720, after opcounters: 2720, after opcountersRepl: 2720, after repl: 4680, after storageEngine: 5420, after tcmalloc: 5860, after wiredTiger: 7880, at end: 8900 } 2016-04-18T02:34:38.751+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:34:53.017+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 580, after connections: 750, after extra_info: 1330, after globalLock: 1520, after locks: 1700, after network: 1790, after opcounters: 1790, after opcountersRepl: 1790, after repl: 2850, after storageEngine: 3030, after tcmalloc: 3220, after wiredTiger: 4590, at end: 6220 } 2016-04-18T02:34:54.695+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:35:10.694+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:35:14.516+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 310, after asserts: 600, after connections: 1050, after extra_info: 1740, after globalLock: 1950, after locks: 2260, after network: 2440, after opcounters: 2440, after opcountersRepl: 2440, after repl: 3610, after storageEngine: 3960, after tcmalloc: 4620, after wiredTiger: 5370, at end: 7750 } 2016-04-18T02:35:23.803+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:35:32.532+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 390, after connections: 510, after extra_info: 1270, after globalLock: 1550, after locks: 1850, after network: 1950, after opcounters: 1960, after opcountersRepl: 1960, after repl: 3040, after storageEngine: 3220, after tcmalloc: 3690, after wiredTiger: 4900, at end: 5840 } 2016-04-18T02:35:37.683+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:35:52.086+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:35:54.005+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 600, after asserts: 870, after connections: 1090, after extra_info: 1940, after globalLock: 2150, after locks: 2260, after network: 2340, after opcounters: 2340, after opcountersRepl: 2340, after repl: 3160, after storageEngine: 3340, after tcmalloc: 3830, after wiredTiger: 6750, at end: 8280 } 2016-04-18T02:36:05.019+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:36:16.877+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 750, after connections: 1010, after extra_info: 1880, after globalLock: 2440, after locks: 2720, after network: 2820, after opcounters: 2820, after opcountersRepl: 2820, after repl: 3790, after storageEngine: 4130, after tcmalloc: 4470, after wiredTiger: 6880, at end: 7990 } 2016-04-18T02:36:18.375+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 174ms 2016-04-18T02:36:18.930+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:36:34.473+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:36:38.352+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 220, after asserts: 490, after connections: 710, after extra_info: 1700, after globalLock: 1970, after locks: 2150, after network: 2150, after opcounters: 2150, after opcountersRepl: 2150, after repl: 3880, after storageEngine: 4060, after tcmalloc: 4580, after wiredTiger: 5750, at end: 7490 } 2016-04-18T02:36:50.516+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:36:56.864+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 670, after connections: 760, after extra_info: 1490, after globalLock: 1700, after locks: 1700, after network: 1710, after opcounters: 1710, after opcountersRepl: 1710, after repl: 4070, after storageEngine: 4450, after tcmalloc: 4930, after wiredTiger: 6160, at end: 7351 } 2016-04-18T02:36:56.866+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38826 #239 (54 connections now open) 2016-04-18T02:37:04.663+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:37:14.370+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 590, after connections: 590, after extra_info: 1340, after globalLock: 1820, after locks: 1920, after network: 1920, after opcounters: 1920, after opcountersRepl: 1920, after repl: 1930, after storageEngine: 1930, after tcmalloc: 1930, after wiredTiger: 2720, at end: 4250 } 2016-04-18T02:37:19.663+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:37:33.342+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 230, after asserts: 520, after connections: 990, after extra_info: 1660, after globalLock: 2030, after locks: 2220, after network: 2490, after opcounters: 2490, after opcountersRepl: 2490, after repl: 4430, after storageEngine: 4960, after tcmalloc: 5780, after wiredTiger: 7720, at end: 9730 } 2016-04-18T02:37:34.222+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:37:48.007+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:37:55.977+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 370, after asserts: 460, after connections: 550, after extra_info: 1100, after globalLock: 1630, after locks: 1980, after network: 2160, after opcounters: 2160, after opcountersRepl: 2160, after repl: 3880, after storageEngine: 4260, after tcmalloc: 4550, after wiredTiger: 5960, at end: 8040 } 2016-04-18T02:38:03.314+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:38:19.308+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:38:19.580+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 550, after connections: 1000, after extra_info: 1840, after globalLock: 2100, after locks: 2180, after network: 2290, after opcounters: 2640, after opcountersRepl: 2640, after repl: 3610, after storageEngine: 4240, after tcmalloc: 5140, after wiredTiger: 6680, at end: 7930 } 2016-04-18T02:38:35.816+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:38:41.511+0000 I NETWORK [conn239] end connection 127.0.0.1:38826 (53 connections now open) 2016-04-18T02:38:45.344+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 590, after connections: 890, after extra_info: 1740, after globalLock: 2120, after locks: 2320, after network: 2320, after opcounters: 2320, after opcountersRepl: 2320, after repl: 3790, after storageEngine: 4200, after tcmalloc: 5030, after wiredTiger: 7090, at end: 9210 } 2016-04-18T02:38:52.546+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:38:58.703+0000 I COMMAND [conn44] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 1122ms 2016-04-18T02:39:07.411+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:39:11.092+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:39:12.109+0000 I COMMAND [conn47] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 1108ms 2016-04-18T02:39:19.564+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 660, after asserts: 840, after connections: 960, after extra_info: 2000, after globalLock: 2460, after locks: 3140, after network: 3530, after opcounters: 3700, after opcountersRepl: 3700, after repl: 10190, after storageEngine: 10510, after tcmalloc: 11380, after wiredTiger: 12980, at end: 15160 } 2016-04-18T02:39:26.051+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:39:27.443+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:39:28.942+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:39:29.600+0000 I COMMAND [conn67] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 901ms 2016-04-18T02:39:42.890+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:39:45.716+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:39:46.132+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 600, after asserts: 850, after connections: 940, after extra_info: 1610, after globalLock: 2030, after locks: 2180, after network: 2360, after opcounters: 2360, after opcountersRepl: 2360, after repl: 3400, after storageEngine: 4020, after tcmalloc: 4700, after wiredTiger: 6440, at end: 9620 } 2016-04-18T02:40:01.101+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:40:01.421+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:40:04.200+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:40:14.064+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:40:14.072+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 750, after asserts: 1070, after connections: 1270, after extra_info: 2710, after globalLock: 3080, after locks: 3170, after network: 3270, after opcounters: 3270, after opcountersRepl: 3270, after repl: 5450, after storageEngine: 5990, after tcmalloc: 6520, after wiredTiger: 8220, at end: 11790 } 2016-04-18T02:40:19.989+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:40:20.749+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 211ms 2016-04-18T02:40:24.580+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 764ms 2016-04-18T02:40:34.358+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:40:37.753+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 660, after connections: 1520, after extra_info: 3160, after globalLock: 3260, after locks: 3260, after network: 3340, after opcounters: 3520, after opcountersRepl: 3520, after repl: 4810, after storageEngine: 5090, after tcmalloc: 6060, after wiredTiger: 7170, at end: 8790 } 2016-04-18T02:40:48.141+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:41:01.044+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:41:04.783+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 640, after asserts: 910, after connections: 1360, after extra_info: 2330, after globalLock: 3060, after locks: 3070, after network: 3160, after opcounters: 3260, after opcountersRepl: 3260, after repl: 4890, after storageEngine: 5180, after tcmalloc: 6160, after wiredTiger: 9490, at end: 11320 } 2016-04-18T02:41:15.848+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:41:22.623+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 174ms 2016-04-18T02:41:26.226+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:41:29.985+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:41:33.765+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 530, after asserts: 750, after connections: 920, after extra_info: 1670, after globalLock: 2070, after locks: 2710, after network: 3070, after opcounters: 3360, after opcountersRepl: 3710, after repl: 8550, after storageEngine: 8970, after tcmalloc: 9510, after wiredTiger: 10670, at end: 11880 } 2016-04-18T02:41:40.849+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:41:43.539+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T02:41:46.539+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:41:53.618+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 750, after asserts: 1100, after connections: 1410, after extra_info: 2580, after globalLock: 3160, after locks: 3170, after network: 3260, after opcounters: 3260, after opcountersRepl: 3260, after repl: 5400, after storageEngine: 5840, after tcmalloc: 6120, after wiredTiger: 8210, at end: 9310 } 2016-04-18T02:41:59.557+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:41:59.648+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 941ms 2016-04-18T02:42:01.738+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:42:04.938+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:42:10.997+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:42:13.273+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 360, after connections: 360, after extra_info: 1140, after globalLock: 1510, after locks: 1790, after network: 1880, after opcounters: 1880, after opcountersRepl: 1880, after repl: 2610, after storageEngine: 2920, after tcmalloc: 3190, after wiredTiger: 5720, at end: 7590 } 2016-04-18T02:42:15.067+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 666ms 2016-04-18T02:42:18.784+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:42:24.616+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 180ms 2016-04-18T02:42:32.140+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:42:35.672+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 660, after connections: 960, after extra_info: 1910, after globalLock: 2210, after locks: 2300, after network: 2470, after opcounters: 2470, after opcountersRepl: 2470, after repl: 3510, after storageEngine: 3740, after tcmalloc: 4190, after wiredTiger: 5450, at end: 7270 } 2016-04-18T02:42:46.592+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:42:54.378+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 360, after asserts: 570, after connections: 660, after extra_info: 1250, after globalLock: 1420, after locks: 1420, after network: 1520, after opcounters: 1790, after opcountersRepl: 1790, after repl: 2400, after storageEngine: 2930, after tcmalloc: 3600, after wiredTiger: 4620, at end: 5330 } 2016-04-18T02:43:00.625+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:43:14.534+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:43:15.844+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 670, after connections: 800, after extra_info: 1400, after globalLock: 1820, after locks: 2080, after network: 2440, after opcounters: 2710, after opcountersRepl: 2800, after repl: 3540, after storageEngine: 3900, after tcmalloc: 4570, after wiredTiger: 5530, at end: 7420 } 2016-04-18T02:43:28.944+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:43:36.645+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 190, after asserts: 460, after connections: 930, after extra_info: 1760, after globalLock: 2160, after locks: 2690, after network: 3050, after opcounters: 3260, after opcountersRepl: 3260, after repl: 5670, after storageEngine: 6260, after tcmalloc: 7010, after wiredTiger: 8010, at end: 10050 } 2016-04-18T02:43:45.984+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:43:59.064+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 650, after connections: 940, after extra_info: 1700, after globalLock: 2160, after locks: 2370, after network: 2560, after opcounters: 2560, after opcountersRepl: 2560, after repl: 3850, after storageEngine: 4350, after tcmalloc: 4950, after wiredTiger: 6660, at end: 8750 } 2016-04-18T02:43:59.642+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:44:13.470+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:44:19.554+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 640, after connections: 950, after extra_info: 1600, after globalLock: 1880, after locks: 2150, after network: 2250, after opcounters: 2250, after opcountersRepl: 2250, after repl: 5480, after storageEngine: 6140, after tcmalloc: 6330, after wiredTiger: 6610, at end: 8370 } 2016-04-18T02:44:26.038+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 122ms 2016-04-18T02:44:28.096+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 183ms 2016-04-18T02:44:29.432+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:44:40.218+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 760, after connections: 970, after extra_info: 2010, after globalLock: 2490, after locks: 2950, after network: 3210, after opcounters: 3390, after opcountersRepl: 3480, after repl: 4340, after storageEngine: 5010, after tcmalloc: 5380, after wiredTiger: 6580, at end: 7570 } 2016-04-18T02:44:44.064+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:44:55.113+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3249ms 2016-04-18T02:44:57.727+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:44:58.561+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 770, after asserts: 780, after connections: 780, after extra_info: 1270, after globalLock: 1550, after locks: 1730, after network: 1830, after opcounters: 1830, after opcountersRepl: 1830, after repl: 2910, after storageEngine: 3690, after tcmalloc: 4300, after wiredTiger: 6080, at end: 7990 } 2016-04-18T02:45:04.187+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:45:04.876+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3777ms 2016-04-18T02:45:11.562+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:45:12.480+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1840ms 2016-04-18T02:45:17.541+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:45:18.923+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 880, after connections: 980, after extra_info: 1610, after globalLock: 1790, after locks: 1970, after network: 2050, after opcounters: 2050, after opcountersRepl: 2050, after repl: 3300, after storageEngine: 3790, after tcmalloc: 4510, after wiredTiger: 5740, at end: 7350 } 2016-04-18T02:45:20.268+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T02:45:25.470+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:45:34.652+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:45:36.207+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:45:39.872+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:45:41.773+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 750, after connections: 1260, after extra_info: 2080, after globalLock: 2560, after locks: 2740, after network: 2830, after opcounters: 2830, after opcountersRepl: 2830, after repl: 3750, after storageEngine: 4220, after tcmalloc: 4700, after wiredTiger: 5660, at end: 7420 } 2016-04-18T02:45:48.726+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:45:52.560+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:46:01.925+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:46:02.725+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 350, after asserts: 670, after connections: 850, after extra_info: 1170, after globalLock: 1530, after locks: 2070, after network: 2250, after opcounters: 2260, after opcountersRepl: 2260, after repl: 3160, after storageEngine: 3610, after tcmalloc: 4560, after wiredTiger: 6580, at end: 8000 } 2016-04-18T02:46:05.217+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T02:46:08.953+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:46:21.595+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:46:24.914+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:46:24.921+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:46:33.681+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 800, after asserts: 1070, after connections: 1320, after extra_info: 2100, after globalLock: 2650, after locks: 2820, after network: 2820, after opcounters: 2820, after opcountersRepl: 2820, after repl: 8110, after storageEngine: 8740, after tcmalloc: 9130, after wiredTiger: 11310, at end: 13790 } 2016-04-18T02:46:39.544+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:46:42.077+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:46:56.760+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:46:57.576+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 660, after asserts: 760, after connections: 1340, after extra_info: 2060, after globalLock: 2570, after locks: 3240, after network: 3420, after opcounters: 3420, after opcountersRepl: 3420, after repl: 4360, after storageEngine: 4760, after tcmalloc: 5440, after wiredTiger: 7460, at end: 9220 } 2016-04-18T02:47:10.864+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:47:14.109+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:47:22.120+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 670, after asserts: 890, after connections: 1000, after extra_info: 1430, after globalLock: 1710, after locks: 1930, after network: 2020, after opcounters: 2020, after opcountersRepl: 2020, after repl: 4750, after storageEngine: 5340, after tcmalloc: 5880, after wiredTiger: 7410, at end: 8030 } 2016-04-18T02:47:27.959+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:47:30.515+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:47:31.038+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:47:45.446+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:47:45.534+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 560, after asserts: 770, after connections: 1120, after extra_info: 2050, after globalLock: 2430, after locks: 2790, after network: 2970, after opcounters: 2970, after opcountersRepl: 2970, after repl: 4180, after storageEngine: 4800, after tcmalloc: 5290, after wiredTiger: 7080, at end: 8810 } 2016-04-18T02:47:48.459+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:48:05.916+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:48:11.867+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 790, after asserts: 980, after connections: 1100, after extra_info: 1930, after globalLock: 2420, after locks: 2940, after network: 3030, after opcounters: 3030, after opcountersRepl: 3030, after repl: 5230, after storageEngine: 5590, after tcmalloc: 6040, after wiredTiger: 7070, at end: 8250 } 2016-04-18T02:48:20.979+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:48:30.863+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 192ms 2016-04-18T02:48:34.948+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:48:37.107+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 470, after connections: 840, after extra_info: 1450, after globalLock: 1830, after locks: 2200, after network: 2290, after opcounters: 2290, after opcountersRepl: 2290, after repl: 3680, after storageEngine: 3820, after tcmalloc: 4260, after wiredTiger: 5660, at end: 7740 } 2016-04-18T02:48:49.142+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:48:53.567+0000 I COMMAND [conn67] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3296ms 2016-04-18T02:48:53.567+0000 I COMMAND [conn44] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3296ms 2016-04-18T02:48:53.567+0000 I COMMAND [conn47] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3296ms 2016-04-18T02:49:00.017+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 530, after asserts: 790, after connections: 1150, after extra_info: 1830, after globalLock: 2060, after locks: 2150, after network: 2150, after opcounters: 2150, after opcountersRepl: 2150, after repl: 3990, after storageEngine: 4390, after tcmalloc: 4870, after wiredTiger: 6910, at end: 9660 } 2016-04-18T02:49:05.535+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:49:08.535+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:49:21.606+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 200, after asserts: 660, after connections: 1190, after extra_info: 3020, after globalLock: 3340, after locks: 3520, after network: 3520, after opcounters: 3520, after opcountersRepl: 3520, after repl: 4350, after storageEngine: 4970, after tcmalloc: 5460, after wiredTiger: 5790, at end: 7570 } 2016-04-18T02:49:22.162+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:49:23.185+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:49:25.494+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:49:28.947+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 952ms 2016-04-18T02:49:38.174+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:49:40.744+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:49:48.586+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 470, after connections: 560, after extra_info: 650, after globalLock: 1370, after locks: 1940, after network: 2320, after opcounters: 2540, after opcountersRepl: 2540, after repl: 8620, after storageEngine: 8990, after tcmalloc: 9340, after wiredTiger: 10790, at end: 12660 } 2016-04-18T02:49:55.891+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:50:10.700+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:50:11.090+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 600, after asserts: 800, after connections: 1130, after extra_info: 1670, after globalLock: 2140, after locks: 2690, after network: 2960, after opcounters: 3130, after opcountersRepl: 3130, after repl: 3990, after storageEngine: 4440, after tcmalloc: 5240, after wiredTiger: 6590, at end: 7670 } 2016-04-18T02:50:24.625+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:50:34.546+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 460, after asserts: 570, after connections: 660, after extra_info: 1330, after globalLock: 1840, after locks: 2140, after network: 2230, after opcounters: 2230, after opcountersRepl: 2230, after repl: 4010, after storageEngine: 4570, after tcmalloc: 5060, after wiredTiger: 7030, at end: 9580 } 2016-04-18T02:50:40.178+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:50:56.623+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:50:57.746+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 370, after asserts: 540, after connections: 830, after extra_info: 1810, after globalLock: 2280, after locks: 2380, after network: 2390, after opcounters: 2390, after opcountersRepl: 2390, after repl: 3490, after storageEngine: 3880, after tcmalloc: 4830, after wiredTiger: 6190, at end: 7570 } 2016-04-18T02:50:59.382+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:51:12.721+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:51:15.632+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:51:17.306+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:51:21.153+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 758ms 2016-04-18T02:51:24.337+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 410, after connections: 510, after extra_info: 1580, after globalLock: 1980, after locks: 2170, after network: 2250, after opcounters: 2250, after opcountersRepl: 2250, after repl: 3640, after storageEngine: 4100, after tcmalloc: 4730, after wiredTiger: 7130, at end: 9000 } 2016-04-18T02:51:27.588+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 1028ms 2016-04-18T02:51:28.957+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:51:32.472+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:51:33.512+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 305ms 2016-04-18T02:51:46.753+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:51:49.230+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 450, after connections: 530, after extra_info: 900, after globalLock: 1290, after locks: 2130, after network: 2490, after opcounters: 2890, after opcountersRepl: 3070, after repl: 4070, after storageEngine: 4600, after tcmalloc: 5500, after wiredTiger: 7700, at end: 10500 } 2016-04-18T02:51:49.778+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:51:50.562+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:52:04.092+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:52:05.391+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2095ms 2016-04-18T02:52:07.582+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:52:08.738+0000 I COMMAND [conn50] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 765ms 2016-04-18T02:52:17.405+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 580, after asserts: 850, after connections: 1030, after extra_info: 1900, after globalLock: 2260, after locks: 2450, after network: 2450, after opcounters: 2450, after opcountersRepl: 2450, after repl: 6190, after storageEngine: 6740, after tcmalloc: 7310, after wiredTiger: 9260, at end: 11090 } 2016-04-18T02:52:18.315+0000 I COMMAND [conn26] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 333ms 2016-04-18T02:52:19.543+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2078ms 2016-04-18T02:52:23.144+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:52:26.299+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:52:26.598+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:52:28.920+0000 I COMMAND [conn23] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 809ms 2016-04-18T02:52:36.785+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2950ms 2016-04-18T02:52:38.463+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:52:40.430+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 750, after asserts: 940, after connections: 1390, after extra_info: 2210, after globalLock: 2580, after locks: 2670, after network: 2670, after opcounters: 2670, after opcountersRepl: 2670, after repl: 4470, after storageEngine: 5030, after tcmalloc: 5740, after wiredTiger: 6720, at end: 8580 } 2016-04-18T02:52:40.859+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:52:59.007+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:53:03.409+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:53:13.141+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 640, after connections: 820, after extra_info: 1100, after globalLock: 1200, after locks: 1280, after network: 1370, after opcounters: 1370, after opcountersRepl: 1370, after repl: 8040, after storageEngine: 8750, after tcmalloc: 9630, after wiredTiger: 11670, at end: 13570 } 2016-04-18T02:53:18.483+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:53:20.634+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:53:24.330+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:53:35.944+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:53:37.297+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 820, after connections: 1210, after extra_info: 2030, after globalLock: 2430, after locks: 3180, after network: 3450, after opcounters: 3830, after opcountersRepl: 3840, after repl: 4790, after storageEngine: 5360, after tcmalloc: 6030, after wiredTiger: 7240, at end: 9260 } 2016-04-18T02:53:39.249+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:53:52.495+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:53:56.676+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:53:59.048+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:54:05.542+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 630, after connections: 1200, after extra_info: 2170, after globalLock: 2700, after locks: 3070, after network: 3340, after opcounters: 3640, after opcountersRepl: 3640, after repl: 5000, after storageEngine: 5540, after tcmalloc: 6300, after wiredTiger: 8050, at end: 10000 } 2016-04-18T02:54:05.924+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:54:07.459+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38846 #240 (54 connections now open) 2016-04-18T02:54:09.597+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38847 #241 (55 connections now open) 2016-04-18T02:54:13.672+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:54:19.146+0000 I COMMAND [conn241] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2217ms 2016-04-18T02:54:19.964+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:54:22.019+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:54:25.498+0000 I COMMAND [conn240] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1717ms 2016-04-18T02:54:27.572+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:54:29.249+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 330, after asserts: 760, after connections: 1340, after extra_info: 2510, after globalLock: 2860, after locks: 3230, after network: 3540, after opcounters: 3640, after opcountersRepl: 3640, after repl: 5020, after storageEngine: 5590, after tcmalloc: 6070, after wiredTiger: 7930, at end: 10420 } 2016-04-18T02:54:33.464+0000 I COMMAND [conn50] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2740ms 2016-04-18T02:54:34.203+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:54:41.451+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:54:47.616+0000 I COMMAND [conn26] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2645ms 2016-04-18T02:54:48.594+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:54:52.161+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:54:52.690+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 490, after connections: 850, after extra_info: 1920, after globalLock: 2370, after locks: 2620, after network: 2630, after opcounters: 2630, after opcountersRepl: 2630, after repl: 3440, after storageEngine: 3970, after tcmalloc: 4620, after wiredTiger: 6920, at end: 8560 } 2016-04-18T02:54:58.079+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:55:04.357+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:55:10.425+0000 I COMMAND [conn23] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 4771ms 2016-04-18T02:55:13.175+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:55:19.888+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 420, after asserts: 860, after connections: 1050, after extra_info: 1320, after globalLock: 1580, after locks: 1670, after network: 1760, after opcounters: 1760, after opcountersRepl: 1760, after repl: 5410, after storageEngine: 5820, after tcmalloc: 6540, after wiredTiger: 7590, at end: 8770 } 2016-04-18T02:55:19.977+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:55:22.788+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:55:27.096+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:55:33.617+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:55:34.091+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 722ms 2016-04-18T02:55:35.661+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 173ms 2016-04-18T02:55:41.587+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:55:43.232+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 500, after asserts: 810, after connections: 940, after extra_info: 1960, after globalLock: 2320, after locks: 2510, after network: 2600, after opcounters: 2600, after opcountersRepl: 2600, after repl: 3880, after storageEngine: 4140, after tcmalloc: 4860, after wiredTiger: 6430, at end: 7480 } 2016-04-18T02:55:54.984+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:56:08.286+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 360, after asserts: 630, after connections: 1160, after extra_info: 1880, after globalLock: 2190, after locks: 2190, after network: 2280, after opcounters: 2280, after opcountersRepl: 2280, after repl: 3660, after storageEngine: 4290, after tcmalloc: 5070, after wiredTiger: 6330, at end: 8010 } 2016-04-18T02:56:11.222+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:56:16.354+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:56:31.782+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 700, after connections: 900, after extra_info: 1780, after globalLock: 2280, after locks: 2640, after network: 2910, after opcounters: 2910, after opcountersRepl: 2910, after repl: 4190, after storageEngine: 4570, after tcmalloc: 5040, after wiredTiger: 6500, at end: 8190 } 2016-04-18T02:56:31.962+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:56:34.668+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:56:34.868+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:56:37.765+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 124ms 2016-04-18T02:56:49.474+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:56:53.995+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 865ms 2016-04-18T02:56:54.146+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T02:57:02.396+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 760, after connections: 1050, after extra_info: 2380, after globalLock: 2820, after locks: 3150, after network: 3160, after opcounters: 3160, after opcountersRepl: 3160, after repl: 5920, after storageEngine: 6510, after tcmalloc: 7420, after wiredTiger: 8580, at end: 10490 } 2016-04-18T02:57:03.300+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 700ms 2016-04-18T02:57:04.377+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:57:17.622+0000 I NETWORK [conn240] end connection 127.0.0.1:38846 (54 connections now open) 2016-04-18T02:57:21.027+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:57:23.563+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:57:33.192+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 460, after asserts: 700, after connections: 980, after extra_info: 1820, after globalLock: 2380, after locks: 2900, after network: 3210, after opcounters: 3220, after opcountersRepl: 3220, after repl: 7200, after storageEngine: 7890, after tcmalloc: 8730, after wiredTiger: 10140, at end: 12540 } 2016-04-18T02:57:39.727+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:57:39.826+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 219ms 2016-04-18T02:57:42.526+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:57:44.891+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:57:58.546+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:57:59.625+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 970, after connections: 1350, after extra_info: 2160, after globalLock: 2540, after locks: 2630, after network: 2720, after opcounters: 2720, after opcountersRepl: 2720, after repl: 3940, after storageEngine: 4510, after tcmalloc: 5340, after wiredTiger: 6820, at end: 9000 } 2016-04-18T02:58:02.568+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:58:17.677+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:58:21.546+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:58:25.188+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:58:31.794+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 830, after asserts: 1190, after connections: 1970, after extra_info: 2990, after globalLock: 3170, after locks: 3270, after network: 3360, after opcounters: 3360, after opcountersRepl: 3360, after repl: 7610, after storageEngine: 8220, after tcmalloc: 8950, after wiredTiger: 11100, at end: 13600 } 2016-04-18T02:58:36.241+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:58:41.228+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:58:42.818+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 212ms 2016-04-18T02:58:51.919+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:58:56.084+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:58:58.964+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:59:01.103+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 680, after asserts: 1060, after connections: 1290, after extra_info: 1950, after globalLock: 2430, after locks: 2980, after network: 3160, after opcounters: 3340, after opcountersRepl: 3340, after repl: 5000, after storageEngine: 5320, after tcmalloc: 6170, after wiredTiger: 7430, at end: 10030 } 2016-04-18T02:59:06.676+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:59:13.182+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:59:21.015+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:59:23.629+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 740, after asserts: 1000, after connections: 1390, after extra_info: 1810, after globalLock: 2260, after locks: 2540, after network: 2640, after opcounters: 2640, after opcountersRepl: 2640, after repl: 3840, after storageEngine: 4020, after tcmalloc: 4550, after wiredTiger: 6220, at end: 7920 } 2016-04-18T02:59:24.331+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:59:31.490+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:59:36.140+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T02:59:44.006+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T02:59:47.229+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 530, after asserts: 820, after connections: 1350, after extra_info: 2290, after globalLock: 2900, after locks: 3530, after network: 3790, after opcounters: 3800, after opcountersRepl: 3800, after repl: 5350, after storageEngine: 5350, after tcmalloc: 5440, after wiredTiger: 6780, at end: 7970 } 2016-04-18T02:59:47.913+0000 I NETWORK [conn241] end connection 127.0.0.1:38847 (53 connections now open) 2016-04-18T02:59:48.691+0000 I COMMAND [conn67] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 989ms 2016-04-18T02:59:48.691+0000 I COMMAND [conn47] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 989ms 2016-04-18T02:59:48.691+0000 I COMMAND [conn44] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 989ms 2016-04-18T02:59:49.494+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T02:59:54.139+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T02:59:58.477+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:00:06.861+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3340ms 2016-04-18T03:00:08.040+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:00:11.732+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:00:16.111+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 460, after asserts: 900, after connections: 1450, after extra_info: 2570, after globalLock: 3010, after locks: 3110, after network: 3290, after opcounters: 3290, after opcountersRepl: 3290, after repl: 6110, after storageEngine: 6790, after tcmalloc: 7380, after wiredTiger: 8690, at end: 10760 } 2016-04-18T03:00:17.089+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:00:21.548+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3544ms 2016-04-18T03:00:24.772+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:00:32.466+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:00:34.919+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1461ms 2016-04-18T03:00:37.751+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:00:41.445+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 680, after asserts: 940, after connections: 1070, after extra_info: 1800, after globalLock: 2200, after locks: 2370, after network: 2460, after opcounters: 2460, after opcountersRepl: 2460, after repl: 3720, after storageEngine: 4620, after tcmalloc: 5470, after wiredTiger: 7050, at end: 8850 } 2016-04-18T03:00:41.590+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T03:00:45.155+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 181ms 2016-04-18T03:00:47.378+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:00:55.160+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:00:58.176+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:01:02.965+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:01:08.445+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 960, after connections: 1150, after extra_info: 1890, after globalLock: 2490, after locks: 2800, after network: 3270, after opcounters: 3550, after opcountersRepl: 3960, after repl: 5970, after storageEngine: 6780, after tcmalloc: 7790, after wiredTiger: 9520, at end: 11870 } 2016-04-18T03:01:09.000+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:01:17.514+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:01:23.998+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:01:26.978+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:01:31.817+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:01:33.965+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 800, after connections: 1350, after extra_info: 2540, after globalLock: 2820, after locks: 3090, after network: 3270, after opcounters: 3480, after opcountersRepl: 3480, after repl: 4880, after storageEngine: 5330, after tcmalloc: 6260, after wiredTiger: 8230, at end: 9960 } 2016-04-18T03:01:38.151+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:01:46.690+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:01:54.489+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:02:01.795+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:02:01.979+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:02:04.119+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 680, after connections: 1190, after extra_info: 2170, after globalLock: 2880, after locks: 3480, after network: 3860, after opcounters: 4060, after opcountersRepl: 4060, after repl: 7260, after storageEngine: 8010, after tcmalloc: 8670, after wiredTiger: 10740, at end: 12160 } 2016-04-18T03:02:10.802+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:02:15.456+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:02:25.531+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 260, after asserts: 480, after connections: 660, after extra_info: 1850, after globalLock: 2220, after locks: 2310, after network: 2310, after opcounters: 2310, after opcountersRepl: 2310, after repl: 3220, after storageEngine: 3680, after tcmalloc: 3880, after wiredTiger: 4500, at end: 6190 } 2016-04-18T03:02:25.621+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:02:25.624+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:02:30.797+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:02:40.345+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:02:43.828+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:02:47.404+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 370, after asserts: 720, after connections: 1040, after extra_info: 2020, after globalLock: 2480, after locks: 2680, after network: 2680, after opcounters: 2680, after opcountersRepl: 2680, after repl: 4860, after storageEngine: 5660, after tcmalloc: 5980, after wiredTiger: 6610, at end: 8760 } 2016-04-18T03:02:56.940+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:03:10.158+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:03:12.669+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 710, after asserts: 890, after connections: 1240, after extra_info: 2150, after globalLock: 2520, after locks: 2970, after network: 3500, after opcounters: 3640, after opcountersRepl: 3640, after repl: 4830, after storageEngine: 5270, after tcmalloc: 5810, after wiredTiger: 7560, at end: 9540 } 2016-04-18T03:03:13.127+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:03:27.434+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:03:30.298+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:03:31.616+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:03:38.152+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 190, after asserts: 370, after connections: 480, after extra_info: 1170, after globalLock: 1670, after locks: 2020, after network: 2410, after opcounters: 2580, after opcountersRepl: 2580, after repl: 4790, after storageEngine: 5340, after tcmalloc: 5620, after wiredTiger: 7060, at end: 8950 } 2016-04-18T03:03:41.825+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:03:46.335+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:03:47.499+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 175ms 2016-04-18T03:03:54.990+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 527ms 2016-04-18T03:03:58.820+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:04:00.521+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 560, after connections: 820, after extra_info: 1230, after globalLock: 1350, after locks: 1440, after network: 1440, after opcounters: 1440, after opcountersRepl: 1440, after repl: 2390, after storageEngine: 2960, after tcmalloc: 3200, after wiredTiger: 4360, at end: 6430 } 2016-04-18T03:04:11.847+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:04:19.413+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 480, after connections: 490, after extra_info: 1050, after globalLock: 1440, after locks: 1560, after network: 1560, after opcounters: 1560, after opcountersRepl: 1560, after repl: 4020, after storageEngine: 4290, after tcmalloc: 4860, after wiredTiger: 6350, at end: 8030 } 2016-04-18T03:04:28.604+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:04:32.519+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 790, after connections: 990, after extra_info: 1830, after globalLock: 2030, after locks: 2220, after network: 2310, after opcounters: 2310, after opcountersRepl: 2310, after repl: 5340, after storageEngine: 5900, after tcmalloc: 6410, after wiredTiger: 6430, at end: 6520 } 2016-04-18T03:04:38.358+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:04:42.252+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:04:52.253+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:04:52.793+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:04:54.501+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 810, after connections: 1170, after extra_info: 2130, after globalLock: 2510, after locks: 2600, after network: 2600, after opcounters: 2600, after opcountersRepl: 2600, after repl: 3410, after storageEngine: 3840, after tcmalloc: 4470, after wiredTiger: 6590, at end: 8250 } 2016-04-18T03:04:56.323+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:04:59.269+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 795ms 2016-04-18T03:05:06.287+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:05:10.144+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 579ms 2016-04-18T03:05:10.370+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:05:18.098+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 620, after connections: 710, after extra_info: 1040, after globalLock: 1040, after locks: 1140, after network: 1140, after opcounters: 1140, after opcountersRepl: 1140, after repl: 3380, after storageEngine: 4110, after tcmalloc: 4900, after wiredTiger: 6040, at end: 8200 } 2016-04-18T03:05:24.803+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:05:31.561+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:05:36.204+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3582ms 2016-04-18T03:05:38.223+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:05:40.325+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 520, after asserts: 520, after connections: 520, after extra_info: 1220, after globalLock: 1320, after locks: 1320, after network: 1400, after opcounters: 1400, after opcountersRepl: 1400, after repl: 3780, after storageEngine: 4320, after tcmalloc: 4950, after wiredTiger: 6590, at end: 8830 } 2016-04-18T03:05:46.779+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:05:48.122+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 179ms 2016-04-18T03:05:50.775+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:05:50.775+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1939ms 2016-04-18T03:05:52.659+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:05:59.507+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:06:01.648+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 710, after connections: 990, after extra_info: 1620, after globalLock: 1710, after locks: 1800, after network: 1880, after opcounters: 1880, after opcountersRepl: 1880, after repl: 2760, after storageEngine: 3600, after tcmalloc: 4230, after wiredTiger: 5600, at end: 7130 } 2016-04-18T03:06:03.162+0000 I COMMAND [conn50] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 573ms 2016-04-18T03:06:06.362+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:06:06.363+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2378ms 2016-04-18T03:06:08.726+0000 I COMMAND [conn26] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 769ms 2016-04-18T03:06:17.897+0000 I COMMAND [conn23] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 564ms 2016-04-18T03:06:20.807+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:06:23.003+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 550, after asserts: 730, after connections: 730, after extra_info: 1440, after globalLock: 1700, after locks: 1890, after network: 2250, after opcounters: 2340, after opcountersRepl: 2340, after repl: 2430, after storageEngine: 2430, after tcmalloc: 2670, after wiredTiger: 4220, at end: 6010 } 2016-04-18T03:06:36.490+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:06:39.166+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:06:41.460+0000 I COMMAND [conn44] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3854ms 2016-04-18T03:06:41.459+0000 I COMMAND [conn67] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3854ms 2016-04-18T03:06:41.460+0000 I COMMAND [conn47] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3854ms 2016-04-18T03:06:46.582+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 860, after connections: 1550, after extra_info: 2110, after globalLock: 2310, after locks: 2790, after network: 2920, after opcounters: 2920, after opcountersRepl: 2920, after repl: 3110, after storageEngine: 3580, after tcmalloc: 4200, after wiredTiger: 6290, at end: 8580 } 2016-04-18T03:06:51.749+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:06:54.067+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:06:54.433+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:07:03.660+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:07:06.886+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 780, after connections: 1010, after extra_info: 1490, after globalLock: 1680, after locks: 1680, after network: 1780, after opcounters: 1780, after opcountersRepl: 1780, after repl: 2960, after storageEngine: 3320, after tcmalloc: 3810, after wiredTiger: 5790, at end: 8040 } 2016-04-18T03:07:07.009+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:07:21.019+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38869 #242 (54 connections now open) 2016-04-18T03:07:22.257+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:07:29.175+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 740, after connections: 752, after extra_info: 752, after globalLock: 752, after locks: 752, after network: 752, after opcounters: 752, after opcountersRepl: 752, after repl: 2832, after storageEngine: 3222, after tcmalloc: 3332, after wiredTiger: 4872, at end: 6562 } 2016-04-18T03:07:35.295+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:07:48.620+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 800, after connections: 1170, after extra_info: 1750, after globalLock: 1850, after locks: 1950, after network: 2080, after opcounters: 2080, after opcountersRepl: 2080, after repl: 3040, after storageEngine: 3460, after tcmalloc: 4230, after wiredTiger: 5810, at end: 7570 } 2016-04-18T03:07:52.336+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:08:08.200+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:08:15.655+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 460, after asserts: 560, after connections: 660, after extra_info: 1450, after globalLock: 1920, after locks: 2370, after network: 2380, after opcounters: 2380, after opcountersRepl: 2380, after repl: 4640, after storageEngine: 4980, after tcmalloc: 5560, after wiredTiger: 6820, at end: 8950 } 2016-04-18T03:08:22.760+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:08:25.324+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:08:37.126+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 560, after asserts: 850, after connections: 1050, after extra_info: 1540, after globalLock: 1910, after locks: 2000, after network: 2090, after opcounters: 2090, after opcountersRepl: 2090, after repl: 3620, after storageEngine: 4070, after tcmalloc: 4450, after wiredTiger: 6010, at end: 7160 } 2016-04-18T03:08:38.953+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:08:42.319+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T03:08:44.293+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:08:44.295+0000 I NETWORK [conn242] end connection 127.0.0.1:38869 (53 connections now open) 2016-04-18T03:08:56.785+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 220, after asserts: 490, after connections: 670, after extra_info: 1400, after globalLock: 1770, after locks: 1780, after network: 1780, after opcounters: 1780, after opcountersRepl: 1780, after repl: 3120, after storageEngine: 3780, after tcmalloc: 4500, after wiredTiger: 5880, at end: 6630 } 2016-04-18T03:08:56.908+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:08:58.575+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:09:03.100+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:09:11.398+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:09:17.116+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:09:19.476+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 670, after asserts: 850, after connections: 1110, after extra_info: 1760, after globalLock: 2050, after locks: 2320, after network: 2720, after opcounters: 3230, after opcountersRepl: 3490, after repl: 4760, after storageEngine: 5310, after tcmalloc: 6100, after wiredTiger: 7560, at end: 9590 } 2016-04-18T03:09:25.652+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:09:31.829+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:09:38.642+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 730, after connections: 900, after extra_info: 1540, after globalLock: 1890, after locks: 2020, after network: 2110, after opcounters: 2110, after opcountersRepl: 2110, after repl: 3340, after storageEngine: 3540, after tcmalloc: 3890, after wiredTiger: 4550, at end: 5870 } 2016-04-18T03:09:39.577+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:09:41.303+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:09:45.622+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:09:53.147+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:09:58.866+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:10:00.451+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 610, after asserts: 960, after connections: 1160, after extra_info: 1820, after globalLock: 2090, after locks: 2380, after network: 2640, after opcounters: 2740, after opcountersRepl: 2740, after repl: 4080, after storageEngine: 4600, after tcmalloc: 5000, after wiredTiger: 6130, at end: 8460 } 2016-04-18T03:10:12.123+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:10:16.586+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:10:19.915+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 690, after asserts: 880, after connections: 980, after extra_info: 1450, after globalLock: 1720, after locks: 1810, after network: 1900, after opcounters: 1900, after opcountersRepl: 1900, after repl: 2610, after storageEngine: 2790, after tcmalloc: 3650, after wiredTiger: 4440, at end: 5450 } 2016-04-18T03:10:24.134+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 575ms 2016-04-18T03:10:26.473+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:10:29.848+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:10:31.517+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:10:41.383+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:10:41.562+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 830, after connections: 1090, after extra_info: 1970, after globalLock: 2600, after locks: 3070, after network: 3340, after opcounters: 3340, after opcountersRepl: 3340, after repl: 4720, after storageEngine: 4830, after tcmalloc: 4830, after wiredTiger: 5710, at end: 7680 } 2016-04-18T03:10:43.562+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:11:02.905+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:11:06.395+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 760, after connections: 960, after extra_info: 1600, after globalLock: 1910, after locks: 2130, after network: 2220, after opcounters: 2220, after opcountersRepl: 2220, after repl: 4050, after storageEngine: 4420, after tcmalloc: 5260, after wiredTiger: 6670, at end: 7830 } 2016-04-18T03:11:17.193+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:11:28.318+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 630, after connections: 940, after extra_info: 1400, after globalLock: 1600, after locks: 1700, after network: 1830, after opcounters: 1830, after opcountersRepl: 1830, after repl: 3260, after storageEngine: 3560, after tcmalloc: 4010, after wiredTiger: 5920, at end: 7720 } 2016-04-18T03:11:31.274+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:11:45.123+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 1208ms 2016-04-18T03:11:47.582+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:11:52.571+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 260, after asserts: 530, after connections: 820, after extra_info: 1450, after globalLock: 1810, after locks: 1980, after network: 2150, after opcounters: 2150, after opcountersRepl: 2150, after repl: 3240, after storageEngine: 3670, after tcmalloc: 4040, after wiredTiger: 5610, at end: 7980 } 2016-04-18T03:11:59.576+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 541ms 2016-04-18T03:12:01.428+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:12:14.056+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 640, after asserts: 920, after connections: 1000, after extra_info: 1750, after globalLock: 2210, after locks: 2570, after network: 2960, after opcounters: 3330, after opcountersRepl: 3410, after repl: 4460, after storageEngine: 4910, after tcmalloc: 5520, after wiredTiger: 6870, at end: 8190 } 2016-04-18T03:12:17.518+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:12:22.469+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:12:37.163+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:12:39.464+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:12:39.857+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:12:40.263+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 730, after connections: 960, after extra_info: 1680, after globalLock: 2130, after locks: 2310, after network: 2610, after opcounters: 2700, after opcountersRepl: 2700, after repl: 4340, after storageEngine: 4840, after tcmalloc: 5620, after wiredTiger: 7260, at end: 9270 } 2016-04-18T03:12:50.691+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 119ms 2016-04-18T03:12:53.625+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:12:56.816+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:13:10.391+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 770, after connections: 910, after extra_info: 1870, after globalLock: 2330, after locks: 2510, after network: 2970, after opcounters: 3470, after opcountersRepl: 3830, after repl: 8350, after storageEngine: 8930, after tcmalloc: 9870, after wiredTiger: 11520, at end: 13180 } 2016-04-18T03:13:12.826+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:13:14.876+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:13:30.411+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:13:34.643+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:13:34.643+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:13:43.152+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 520, after asserts: 880, after connections: 1250, after extra_info: 2230, after globalLock: 2430, after locks: 2890, after network: 3170, after opcounters: 3400, after opcountersRepl: 3750, after repl: 8660, after storageEngine: 9220, after tcmalloc: 10130, after wiredTiger: 11270, at end: 13300 } 2016-04-18T03:13:49.180+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:13:52.544+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:14:06.160+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 620, after asserts: 890, after connections: 1460, after extra_info: 2600, after globalLock: 2790, after locks: 2890, after network: 3030, after opcounters: 3030, after opcountersRepl: 3030, after repl: 3600, after storageEngine: 4090, after tcmalloc: 4940, after wiredTiger: 6200, at end: 8010 } 2016-04-18T03:14:08.941+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:14:22.275+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:14:25.242+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:14:32.594+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 840, after connections: 1160, after extra_info: 1550, after globalLock: 1910, after locks: 2400, after network: 2630, after opcounters: 2720, after opcountersRepl: 2720, after repl: 6810, after storageEngine: 7250, after tcmalloc: 7940, after wiredTiger: 9400, at end: 10680 } 2016-04-18T03:14:39.196+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:14:40.729+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:14:41.490+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:14:53.205+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 106ms 2016-04-18T03:14:54.286+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:14:54.555+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 680, after connections: 990, after extra_info: 1520, after globalLock: 1980, after locks: 2510, after network: 2600, after opcounters: 2600, after opcountersRepl: 2600, after repl: 3600, after storageEngine: 3880, after tcmalloc: 4250, after wiredTiger: 5460, at end: 7730 } 2016-04-18T03:14:56.850+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:15:13.723+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:15:21.888+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 470, after connections: 600, after extra_info: 970, after globalLock: 1210, after locks: 1520, after network: 1890, after opcounters: 1900, after opcountersRepl: 1900, after repl: 5470, after storageEngine: 5780, after tcmalloc: 6320, after wiredTiger: 7870, at end: 9580 } 2016-04-18T03:15:28.794+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:15:42.867+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:15:45.087+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 640, after connections: 820, after extra_info: 1280, after globalLock: 1620, after locks: 2070, after network: 2450, after opcounters: 2740, after opcountersRepl: 2750, after repl: 3140, after storageEngine: 3650, after tcmalloc: 4570, after wiredTiger: 5880, at end: 8150 } 2016-04-18T03:15:49.043+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2096ms 2016-04-18T03:15:54.931+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 191ms 2016-04-18T03:15:57.333+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 170ms 2016-04-18T03:16:00.059+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:16:08.665+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 690, after connections: 1150, after extra_info: 1530, after globalLock: 1810, after locks: 1890, after network: 1990, after opcounters: 2090, after opcountersRepl: 2090, after repl: 4370, after storageEngine: 4710, after tcmalloc: 4890, after wiredTiger: 5330, at end: 6970 } 2016-04-18T03:16:15.671+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1959ms 2016-04-18T03:16:15.675+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:16:26.016+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:16:29.286+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:16:35.423+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 270, after asserts: 530, after connections: 720, after extra_info: 1190, after globalLock: 1720, after locks: 1920, after network: 1920, after opcounters: 1920, after opcountersRepl: 1920, after repl: 4100, after storageEngine: 5010, after tcmalloc: 6240, after wiredTiger: 8380, at end: 9760 } 2016-04-18T03:16:40.300+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:16:41.947+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:16:43.308+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 4070ms 2016-04-18T03:16:46.928+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:16:53.680+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:16:58.895+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 104ms 2016-04-18T03:17:01.158+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:17:01.919+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 680, after asserts: 920, after connections: 1100, after extra_info: 1580, after globalLock: 1910, after locks: 2090, after network: 2090, after opcounters: 2090, after opcountersRepl: 2090, after repl: 6200, after storageEngine: 6560, after tcmalloc: 7440, after wiredTiger: 9050, at end: 11060 } 2016-04-18T03:17:14.985+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:17:29.287+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:17:30.134+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 690, after asserts: 880, after connections: 1300, after extra_info: 2190, after globalLock: 2460, after locks: 3020, after network: 3390, after opcounters: 3570, after opcountersRepl: 3570, after repl: 5780, after storageEngine: 6440, after tcmalloc: 6880, after wiredTiger: 8270, at end: 10600 } 2016-04-18T03:17:37.280+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:17:42.873+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:17:52.063+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:17:53.855+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 590, after asserts: 870, after connections: 1180, after extra_info: 2160, after globalLock: 2340, after locks: 2440, after network: 2530, after opcounters: 2530, after opcountersRepl: 2530, after repl: 3860, after storageEngine: 4230, after tcmalloc: 4940, after wiredTiger: 7670, at end: 9180 } 2016-04-18T03:17:55.471+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:18:00.784+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 172ms 2016-04-18T03:18:01.208+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:18:06.344+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:18:15.265+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:18:19.806+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 770, after connections: 1240, after extra_info: 1860, after globalLock: 1990, after locks: 2210, after network: 2210, after opcounters: 2210, after opcountersRepl: 2210, after repl: 3440, after storageEngine: 3970, after tcmalloc: 4910, after wiredTiger: 6630, at end: 8710 } 2016-04-18T03:18:28.555+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:18:42.202+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 570, after connections: 570, after extra_info: 860, after globalLock: 1040, after locks: 1400, after network: 1520, after opcounters: 1520, after opcountersRepl: 1520, after repl: 2770, after storageEngine: 3210, after tcmalloc: 3830, after wiredTiger: 6990, at end: 9250 } 2016-04-18T03:18:43.734+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:18:46.732+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:19:00.522+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:19:03.601+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:19:03.693+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:19:10.838+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 500, after asserts: 680, after connections: 950, after extra_info: 1690, after globalLock: 2110, after locks: 2440, after network: 2640, after opcounters: 2740, after opcountersRepl: 2740, after repl: 7670, after storageEngine: 8190, after tcmalloc: 8780, after wiredTiger: 10250, at end: 11680 } 2016-04-18T03:19:17.954+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:19:20.246+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:19:35.272+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 270, after asserts: 540, after connections: 550, after extra_info: 1040, after globalLock: 1340, after locks: 1530, after network: 1890, after opcounters: 2400, after opcountersRepl: 2580, after repl: 3600, after storageEngine: 4200, after tcmalloc: 5170, after wiredTiger: 7100, at end: 9200 } 2016-04-18T03:19:35.571+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:19:53.183+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:20:01.015+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 780, after connections: 790, after extra_info: 1460, after globalLock: 1770, after locks: 1990, after network: 2000, after opcounters: 2000, after opcountersRepl: 2000, after repl: 3010, after storageEngine: 3460, after tcmalloc: 3640, after wiredTiger: 5110, at end: 7150 } 2016-04-18T03:20:02.730+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 130ms 2016-04-18T03:20:06.421+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:20:21.373+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:20:24.148+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 740, after asserts: 940, after connections: 1350, after extra_info: 2120, after globalLock: 2700, after locks: 3170, after network: 3180, after opcounters: 3180, after opcountersRepl: 3180, after repl: 5120, after storageEngine: 5530, after tcmalloc: 6220, after wiredTiger: 7530, at end: 9400 } 2016-04-18T03:20:35.629+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:20:48.816+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 660, after asserts: 890, after connections: 1060, after extra_info: 1330, after globalLock: 1800, after locks: 2250, after network: 2340, after opcounters: 2340, after opcountersRepl: 2340, after repl: 3590, after storageEngine: 4000, after tcmalloc: 4410, after wiredTiger: 6270, at end: 8030 } 2016-04-18T03:20:49.966+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:21:05.229+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:21:13.019+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 330, after asserts: 520, after connections: 750, after extra_info: 1280, after globalLock: 1770, after locks: 1790, after network: 1790, after opcounters: 1790, after opcountersRepl: 1790, after repl: 4760, after storageEngine: 5130, after tcmalloc: 5680, after wiredTiger: 7800, at end: 9250 } 2016-04-18T03:21:18.513+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:21:29.240+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 560, after connections: 950, after extra_info: 1720, after globalLock: 1900, after locks: 2120, after network: 2310, after opcounters: 2310, after opcountersRepl: 2310, after repl: 3030, after storageEngine: 3240, after tcmalloc: 3620, after wiredTiger: 4710, at end: 6310 } 2016-04-18T03:21:34.519+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:21:48.303+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 510, after connections: 600, after extra_info: 800, after globalLock: 1010, after locks: 1250, after network: 1250, after opcounters: 1250, after opcountersRepl: 1250, after repl: 2150, after storageEngine: 2550, after tcmalloc: 3600, after wiredTiger: 4680, at end: 6610 } 2016-04-18T03:21:48.998+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:22:04.935+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:22:06.280+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 520, after connections: 870, after extra_info: 1450, after globalLock: 1770, after locks: 1770, after network: 1770, after opcounters: 1770, after opcountersRepl: 1770, after repl: 3200, after storageEngine: 3600, after tcmalloc: 4380, after wiredTiger: 6280, at end: 7770 } 2016-04-18T03:22:07.290+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:22:17.972+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:22:24.239+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:22:26.257+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:22:27.839+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 860, after connections: 960, after extra_info: 2020, after globalLock: 2410, after locks: 2590, after network: 2680, after opcounters: 2680, after opcountersRepl: 2680, after repl: 3790, after storageEngine: 4350, after tcmalloc: 4570, after wiredTiger: 5890, at end: 7370 } 2016-04-18T03:22:32.020+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:22:35.782+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:22:42.014+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 420, after asserts: 700, after connections: 910, after extra_info: 1520, after globalLock: 1960, after locks: 2070, after network: 2160, after opcounters: 2160, after opcountersRepl: 2160, after repl: 2960, after storageEngine: 2960, after tcmalloc: 3610, after wiredTiger: 4550, at end: 5810 } 2016-04-18T03:22:46.603+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:23:00.939+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:23:03.609+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 590, after connections: 680, after extra_info: 1100, after globalLock: 1390, after locks: 1590, after network: 1890, after opcounters: 2090, after opcountersRepl: 2290, after repl: 3670, after storageEngine: 4360, after tcmalloc: 4640, after wiredTiger: 6600, at end: 8060 } 2016-04-18T03:23:05.057+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 103ms 2016-04-18T03:23:14.036+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:23:24.368+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 490, after connections: 690, after extra_info: 1470, after globalLock: 1840, after locks: 1950, after network: 1950, after opcounters: 1950, after opcountersRepl: 1950, after repl: 2820, after storageEngine: 3210, after tcmalloc: 3760, after wiredTiger: 7420, at end: 8290 } 2016-04-18T03:23:27.919+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:23:43.584+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:23:47.573+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 550, after asserts: 730, after connections: 830, after extra_info: 1680, after globalLock: 1860, after locks: 2220, after network: 2400, after opcounters: 2680, after opcountersRepl: 2760, after repl: 4060, after storageEngine: 4250, after tcmalloc: 4740, after wiredTiger: 6170, at end: 7290 } 2016-04-18T03:23:57.686+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:24:05.949+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 170, after asserts: 170, after connections: 510, after extra_info: 1320, after globalLock: 1500, after locks: 1700, after network: 1950, after opcounters: 1970, after opcountersRepl: 1970, after repl: 3090, after storageEngine: 3420, after tcmalloc: 4460, after wiredTiger: 5990, at end: 7410 } 2016-04-18T03:24:10.654+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:24:24.828+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 770, after connections: 1310, after extra_info: 2140, after globalLock: 2490, after locks: 2670, after network: 2750, after opcounters: 2750, after opcountersRepl: 2750, after repl: 3710, after storageEngine: 4030, after tcmalloc: 4530, after wiredTiger: 5400, at end: 7040 } 2016-04-18T03:24:25.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:24:42.685+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:24:49.775+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 590, after asserts: 870, after connections: 1070, after extra_info: 1650, after globalLock: 2020, after locks: 2640, after network: 2820, after opcounters: 3140, after opcountersRepl: 3590, after repl: 4460, after storageEngine: 4570, after tcmalloc: 5170, after wiredTiger: 7740, at end: 9490 } 2016-04-18T03:24:55.539+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:25:08.296+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:25:09.403+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 630, after asserts: 930, after connections: 1030, after extra_info: 1800, after globalLock: 2000, after locks: 2210, after network: 2480, after opcounters: 2580, after opcountersRepl: 2710, after repl: 3630, after storageEngine: 3980, after tcmalloc: 4440, after wiredTiger: 6140, at end: 7620 } 2016-04-18T03:25:22.061+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:25:30.213+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 670, after connections: 870, after extra_info: 1360, after globalLock: 1630, after locks: 1960, after network: 2320, after opcounters: 2700, after opcountersRepl: 2710, after repl: 4500, after storageEngine: 4810, after tcmalloc: 5570, after wiredTiger: 7440, at end: 8900 } 2016-04-18T03:25:36.422+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:25:45.543+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 310, after asserts: 410, after connections: 510, after extra_info: 1140, after globalLock: 1400, after locks: 1600, after network: 1870, after opcounters: 1960, after opcountersRepl: 1960, after repl: 2460, after storageEngine: 2850, after tcmalloc: 3110, after wiredTiger: 4960, at end: 5370 } 2016-04-18T03:25:49.981+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 788ms 2016-04-18T03:25:50.347+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:26:01.063+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 590, after connections: 970, after extra_info: 1250, after globalLock: 1730, after locks: 2160, after network: 2330, after opcounters: 2330, after opcountersRepl: 2330, after repl: 2440, after storageEngine: 2440, after tcmalloc: 2910, after wiredTiger: 4980, at end: 5230 } 2016-04-18T03:26:04.418+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:26:07.412+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 197ms 2016-04-18T03:26:19.032+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:26:21.857+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 350, after asserts: 620, after connections: 900, after extra_info: 1600, after globalLock: 1960, after locks: 2110, after network: 2200, after opcounters: 2200, after opcountersRepl: 2200, after repl: 4130, after storageEngine: 4650, after tcmalloc: 5240, after wiredTiger: 6590, at end: 8530 } 2016-04-18T03:26:32.392+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:26:45.230+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 550, after asserts: 740, after connections: 1210, after extra_info: 1940, after globalLock: 2430, after locks: 2820, after network: 2940, after opcounters: 2940, after opcountersRepl: 2940, after repl: 3850, after storageEngine: 4420, after tcmalloc: 5330, after wiredTiger: 7340, at end: 10680 } 2016-04-18T03:26:46.358+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:27:01.032+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:27:09.587+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 420, after asserts: 810, after connections: 1090, after extra_info: 2230, after globalLock: 2520, after locks: 2780, after network: 2970, after opcounters: 3050, after opcountersRepl: 3050, after repl: 4850, after storageEngine: 5450, after tcmalloc: 6670, after wiredTiger: 8300, at end: 11000 } 2016-04-18T03:27:14.454+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:27:27.598+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:27:31.351+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 350, after asserts: 540, after connections: 1100, after extra_info: 1660, after globalLock: 1920, after locks: 2010, after network: 2100, after opcounters: 2100, after opcountersRepl: 2100, after repl: 3280, after storageEngine: 3670, after tcmalloc: 4240, after wiredTiger: 5300, at end: 7050 } 2016-04-18T03:27:32.028+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:27:40.386+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:27:47.799+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:27:47.977+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:27:52.217+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 360, after asserts: 540, after connections: 670, after extra_info: 1110, after globalLock: 1560, after locks: 1740, after network: 1820, after opcounters: 1820, after opcountersRepl: 1820, after repl: 3230, after storageEngine: 3610, after tcmalloc: 4090, after wiredTiger: 5460, at end: 7330 } 2016-04-18T03:27:53.501+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:28:01.292+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:28:06.910+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:28:09.990+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 180, after asserts: 390, after connections: 480, after extra_info: 580, after globalLock: 580, after locks: 580, after network: 580, after opcounters: 580, after opcountersRepl: 580, after repl: 1330, after storageEngine: 1790, after tcmalloc: 2460, after wiredTiger: 3700, at end: 5710 } 2016-04-18T03:28:18.789+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 913ms 2016-04-18T03:28:19.530+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:28:29.200+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 270, after asserts: 310, after connections: 480, after extra_info: 580, after globalLock: 1010, after locks: 1600, after network: 1700, after opcounters: 1700, after opcountersRepl: 1700, after repl: 3070, after storageEngine: 3180, after tcmalloc: 3650, after wiredTiger: 4960, at end: 6700 } 2016-04-18T03:28:33.711+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:28:35.597+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 790ms 2016-04-18T03:28:48.550+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:28:48.828+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 130, after asserts: 240, after connections: 330, after extra_info: 900, after globalLock: 1360, after locks: 1800, after network: 1980, after opcounters: 1980, after opcountersRepl: 1980, after repl: 3640, after storageEngine: 4030, after tcmalloc: 4710, after wiredTiger: 5740, at end: 7600 } 2016-04-18T03:29:02.085+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:29:07.895+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 530, after connections: 710, after extra_info: 1430, after globalLock: 1790, after locks: 2090, after network: 2180, after opcounters: 2180, after opcountersRepl: 2180, after repl: 2940, after storageEngine: 3260, after tcmalloc: 3810, after wiredTiger: 5040, at end: 6250 } 2016-04-18T03:29:09.495+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 125ms 2016-04-18T03:29:15.181+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:29:28.249+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 350, after asserts: 640, after connections: 970, after extra_info: 1490, after globalLock: 1810, after locks: 1910, after network: 2000, after opcounters: 2000, after opcountersRepl: 2000, after repl: 3160, after storageEngine: 3370, after tcmalloc: 4130, after wiredTiger: 5630, at end: 7460 } 2016-04-18T03:29:29.887+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:29:44.546+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:29:47.476+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:29:50.825+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 650, after connections: 1060, after extra_info: 1800, after globalLock: 2110, after locks: 2310, after network: 2380, after opcounters: 2380, after opcountersRepl: 2380, after repl: 5520, after storageEngine: 5870, after tcmalloc: 6270, after wiredTiger: 7450, at end: 8600 } 2016-04-18T03:29:58.809+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:30:01.480+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T03:30:03.716+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:30:09.463+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 490, after connections: 580, after extra_info: 1420, after globalLock: 1820, after locks: 2120, after network: 2220, after opcounters: 2220, after opcountersRepl: 2220, after repl: 3900, after storageEngine: 4160, after tcmalloc: 4600, after wiredTiger: 6000, at end: 6750 } 2016-04-18T03:30:16.546+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:30:18.993+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T03:30:20.916+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:30:26.017+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 950, after connections: 1420, after extra_info: 1900, after globalLock: 2270, after locks: 2560, after network: 2660, after opcounters: 2660, after opcountersRepl: 2660, after repl: 3840, after storageEngine: 4100, after tcmalloc: 4560, after wiredTiger: 4990, at end: 6070 } 2016-04-18T03:30:34.119+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:30:36.681+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:30:36.975+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:30:45.280+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 340, after asserts: 530, after connections: 900, after extra_info: 1850, after globalLock: 2210, after locks: 2680, after network: 2870, after opcounters: 3190, after opcountersRepl: 3370, after repl: 4350, after storageEngine: 4830, after tcmalloc: 5220, after wiredTiger: 6280, at end: 7920 } 2016-04-18T03:30:47.987+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:30:51.896+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:31:05.531+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:31:06.215+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 510, after connections: 670, after extra_info: 1270, after globalLock: 1360, after locks: 1440, after network: 1440, after opcounters: 1440, after opcountersRepl: 1440, after repl: 2360, after storageEngine: 2680, after tcmalloc: 2760, after wiredTiger: 4320, at end: 6180 } 2016-04-18T03:31:21.134+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:31:30.721+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 460, after connections: 990, after extra_info: 1670, after globalLock: 2080, after locks: 2320, after network: 2530, after opcounters: 2540, after opcountersRepl: 2540, after repl: 5170, after storageEngine: 5410, after tcmalloc: 5890, after wiredTiger: 7620, at end: 9330 } 2016-04-18T03:31:36.689+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:31:50.205+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:31:53.192+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 270, after asserts: 620, after connections: 930, after extra_info: 1510, after globalLock: 1870, after locks: 2080, after network: 2170, after opcounters: 2170, after opcountersRepl: 2170, after repl: 2700, after storageEngine: 3050, after tcmalloc: 3440, after wiredTiger: 4920, at end: 6980 } 2016-04-18T03:32:05.159+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:32:17.703+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 560, after asserts: 660, after connections: 1090, after extra_info: 1720, after globalLock: 1900, after locks: 2080, after network: 2180, after opcounters: 2180, after opcountersRepl: 2180, after repl: 3380, after storageEngine: 3960, after tcmalloc: 4750, after wiredTiger: 6140, at end: 8890 } 2016-04-18T03:32:19.592+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2170ms 2016-04-18T03:32:20.671+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:32:27.189+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:32:40.652+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:32:42.306+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:32:42.306+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 720, after connections: 810, after extra_info: 1610, after globalLock: 1870, after locks: 1870, after network: 1870, after opcounters: 1870, after opcountersRepl: 1870, after repl: 3440, after storageEngine: 3760, after tcmalloc: 4030, after wiredTiger: 5630, at end: 7180 } 2016-04-18T03:32:42.313+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:32:49.936+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2795ms 2016-04-18T03:32:58.143+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:33:00.950+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:33:10.792+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 222ms 2016-04-18T03:33:10.879+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 530, after asserts: 800, after connections: 1190, after extra_info: 2340, after globalLock: 2630, after locks: 2750, after network: 2840, after opcounters: 2840, after opcountersRepl: 2840, after repl: 6330, after storageEngine: 6700, after tcmalloc: 7430, after wiredTiger: 9510, at end: 12280 } 2016-04-18T03:33:12.562+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2451ms 2016-04-18T03:33:14.261+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:33:17.626+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:33:31.664+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:33:33.788+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:33:35.860+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 800, after connections: 1080, after extra_info: 2260, after globalLock: 2460, after locks: 2670, after network: 2760, after opcounters: 2760, after opcountersRepl: 2760, after repl: 4510, after storageEngine: 5010, after tcmalloc: 5920, after wiredTiger: 7210, at end: 8860 } 2016-04-18T03:33:37.523+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:33:44.791+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:33:51.746+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:33:58.755+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:34:02.331+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:34:02.961+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 680, after connections: 1180, after extra_info: 2060, after globalLock: 2430, after locks: 2530, after network: 2540, after opcounters: 2540, after opcountersRepl: 2540, after repl: 3600, after storageEngine: 4020, after tcmalloc: 4620, after wiredTiger: 6410, at end: 7710 } 2016-04-18T03:34:08.933+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:34:12.038+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:34:12.139+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 288ms 2016-04-18T03:34:25.221+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 650, after connections: 830, after extra_info: 1750, after globalLock: 2100, after locks: 2100, after network: 2190, after opcounters: 2190, after opcountersRepl: 2190, after repl: 3400, after storageEngine: 3880, after tcmalloc: 4430, after wiredTiger: 5520, at end: 6930 } 2016-04-18T03:34:25.807+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:34:27.980+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:34:30.075+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:34:42.894+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:34:45.776+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:34:49.706+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 420, after asserts: 790, after connections: 1340, after extra_info: 2250, after globalLock: 2880, after locks: 3170, after network: 3350, after opcounters: 3350, after opcountersRepl: 3350, after repl: 6780, after storageEngine: 6980, after tcmalloc: 7190, after wiredTiger: 7700, at end: 9970 } 2016-04-18T03:35:00.157+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:35:03.045+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:35:04.399+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:35:13.498+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 176ms 2016-04-18T03:35:14.211+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 700, after connections: 1070, after extra_info: 2020, after globalLock: 2320, after locks: 2760, after network: 2940, after opcounters: 2940, after opcountersRepl: 2940, after repl: 4280, after storageEngine: 4750, after tcmalloc: 5200, after wiredTiger: 7510, at end: 10070 } 2016-04-18T03:35:17.587+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:35:21.630+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:35:37.297+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:35:40.022+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 490, after connections: 580, after extra_info: 1270, after globalLock: 1450, after locks: 1640, after network: 1640, after opcounters: 1640, after opcountersRepl: 1640, after repl: 2790, after storageEngine: 3280, after tcmalloc: 3760, after wiredTiger: 5450, at end: 7290 } 2016-04-18T03:35:50.933+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:36:01.251+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 460, after asserts: 470, after connections: 470, after extra_info: 1250, after globalLock: 1540, after locks: 1810, after network: 2070, after opcounters: 2080, after opcountersRepl: 2080, after repl: 3410, after storageEngine: 3860, after tcmalloc: 4720, after wiredTiger: 6290, at end: 7820 } 2016-04-18T03:36:07.480+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:36:14.847+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 181ms 2016-04-18T03:36:20.711+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:36:24.464+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 350, after asserts: 550, after connections: 840, after extra_info: 1680, after globalLock: 2050, after locks: 2250, after network: 2250, after opcounters: 2250, after opcountersRepl: 2250, after repl: 3650, after storageEngine: 4100, after tcmalloc: 4830, after wiredTiger: 5580, at end: 7690 } 2016-04-18T03:36:34.208+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:36:36.804+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:36:48.347+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 730, after asserts: 1180, after connections: 1830, after extra_info: 3000, after globalLock: 3660, after locks: 3970, after network: 4240, after opcounters: 4340, after opcountersRepl: 4340, after repl: 5760, after storageEngine: 6210, after tcmalloc: 7230, after wiredTiger: 8360, at end: 10400 } 2016-04-18T03:36:50.852+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:36:51.844+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:36:54.582+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:37:02.793+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:37:07.837+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:37:09.724+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 590, after asserts: 820, after connections: 910, after extra_info: 1500, after globalLock: 1780, after locks: 1980, after network: 2060, after opcounters: 2060, after opcountersRepl: 2060, after repl: 5220, after storageEngine: 5380, after tcmalloc: 5870, after wiredTiger: 6510, at end: 8010 } 2016-04-18T03:37:21.502+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:37:30.460+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 630, after connections: 1070, after extra_info: 1780, after globalLock: 2200, after locks: 2730, after network: 2890, after opcounters: 3210, after opcountersRepl: 3210, after repl: 4120, after storageEngine: 4480, after tcmalloc: 5210, after wiredTiger: 5950, at end: 6730 } 2016-04-18T03:37:35.413+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:37:48.605+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:37:52.245+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 420, after asserts: 590, after connections: 870, after extra_info: 1620, after globalLock: 1810, after locks: 1910, after network: 1910, after opcounters: 1910, after opcountersRepl: 1910, after repl: 3240, after storageEngine: 3810, after tcmalloc: 4510, after wiredTiger: 6400, at end: 7890 } 2016-04-18T03:38:03.327+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:38:06.768+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:38:13.843+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 500, after asserts: 770, after connections: 1130, after extra_info: 2060, after globalLock: 2510, after locks: 2990, after network: 3180, after opcounters: 3180, after opcountersRepl: 3180, after repl: 3980, after storageEngine: 4080, after tcmalloc: 4500, after wiredTiger: 5090, at end: 7100 } 2016-04-18T03:38:20.748+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:38:22.721+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:38:23.645+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:38:35.213+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:38:35.969+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 480, after connections: 490, after extra_info: 930, after globalLock: 1320, after locks: 1590, after network: 1860, after opcounters: 1960, after opcountersRepl: 2080, after repl: 2950, after storageEngine: 3320, after tcmalloc: 3720, after wiredTiger: 5170, at end: 6970 } 2016-04-18T03:38:35.974+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:38:36.496+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38893 #243 (54 connections now open) 2016-04-18T03:38:40.515+0000 I COMMAND [conn26] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1447ms 2016-04-18T03:38:40.515+0000 I COMMAND [conn50] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1447ms 2016-04-18T03:38:40.515+0000 I COMMAND [conn23] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1447ms 2016-04-18T03:38:42.475+0000 I COMMAND [conn243] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1519ms 2016-04-18T03:38:50.161+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:38:51.290+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 530, after connections: 530, after extra_info: 1130, after globalLock: 1530, after locks: 1810, after network: 2080, after opcounters: 2430, after opcountersRepl: 2430, after repl: 3740, after storageEngine: 3930, after tcmalloc: 4040, after wiredTiger: 5100, at end: 6990 } 2016-04-18T03:39:03.155+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:39:16.963+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 760, after connections: 1320, after extra_info: 2130, after globalLock: 2430, after locks: 2780, after network: 3060, after opcounters: 3340, after opcountersRepl: 3430, after repl: 5690, after storageEngine: 6090, after tcmalloc: 6270, after wiredTiger: 8760, at end: 11500 } 2016-04-18T03:39:23.193+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:39:39.202+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:39:41.798+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 430, after asserts: 740, after connections: 1060, after extra_info: 1790, after globalLock: 2470, after locks: 2870, after network: 2970, after opcounters: 2970, after opcountersRepl: 2970, after repl: 4770, after storageEngine: 5120, after tcmalloc: 5560, after wiredTiger: 7210, at end: 8660 } 2016-04-18T03:39:53.565+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:40:02.575+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 580, after asserts: 850, after connections: 1250, after extra_info: 1840, after globalLock: 2400, after locks: 2790, after network: 2980, after opcounters: 3070, after opcountersRepl: 3070, after repl: 4350, after storageEngine: 4760, after tcmalloc: 5450, after wiredTiger: 6970, at end: 8620 } 2016-04-18T03:40:08.093+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:40:23.820+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:40:26.735+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 810, after connections: 1070, after extra_info: 2180, after globalLock: 2370, after locks: 2450, after network: 2630, after opcounters: 2720, after opcountersRepl: 2720, after repl: 3890, after storageEngine: 3990, after tcmalloc: 4240, after wiredTiger: 5780, at end: 7150 } 2016-04-18T03:40:39.288+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:40:42.352+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:40:46.163+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 800ms 2016-04-18T03:40:53.321+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 640, after asserts: 1030, after connections: 1390, after extra_info: 2380, after globalLock: 2740, after locks: 3050, after network: 3490, after opcounters: 3910, after opcountersRepl: 4010, after repl: 4860, after storageEngine: 5430, after tcmalloc: 6270, after wiredTiger: 7800, at end: 9370 } 2016-04-18T03:40:55.906+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:40:57.972+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:40:58.419+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:41:13.403+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:41:15.693+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:41:20.901+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 300, after connections: 300, after extra_info: 950, after globalLock: 1440, after locks: 2050, after network: 2150, after opcounters: 2150, after opcountersRepl: 2150, after repl: 4390, after storageEngine: 4970, after tcmalloc: 5830, after wiredTiger: 7310, at end: 9160 } 2016-04-18T03:41:29.679+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:41:32.267+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:41:34.703+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:41:41.826+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:41:43.420+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 740, after connections: 1010, after extra_info: 1690, after globalLock: 2240, after locks: 2590, after network: 2790, after opcounters: 2790, after opcountersRepl: 2790, after repl: 3560, after storageEngine: 3750, after tcmalloc: 4310, after wiredTiger: 5960, at end: 7900 } 2016-04-18T03:41:45.716+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:42:00.763+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:42:09.649+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 560, after asserts: 570, after connections: 620, after extra_info: 1600, after globalLock: 1810, after locks: 2180, after network: 2290, after opcounters: 2290, after opcountersRepl: 2290, after repl: 4260, after storageEngine: 4700, after tcmalloc: 4830, after wiredTiger: 7970, at end: 9740 } 2016-04-18T03:42:15.605+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:42:17.010+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 135ms 2016-04-18T03:42:30.237+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:42:33.039+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 600, after connections: 790, after extra_info: 1550, after globalLock: 1860, after locks: 2140, after network: 2490, after opcounters: 2580, after opcountersRepl: 2580, after repl: 3660, after storageEngine: 4030, after tcmalloc: 4400, after wiredTiger: 6070, at end: 8440 } 2016-04-18T03:42:45.136+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:42:52.257+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 650, after connections: 930, after extra_info: 1660, after globalLock: 2140, after locks: 2410, after network: 2540, after opcounters: 2540, after opcountersRepl: 2540, after repl: 3540, after storageEngine: 4110, after tcmalloc: 4650, after wiredTiger: 6060, at end: 8250 } 2016-04-18T03:42:59.781+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:43:11.093+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 720, after connections: 1100, after extra_info: 1590, after globalLock: 2110, after locks: 2600, after network: 2710, after opcounters: 2710, after opcountersRepl: 2710, after repl: 3720, after storageEngine: 4080, after tcmalloc: 4430, after wiredTiger: 6940, at end: 8330 } 2016-04-18T03:43:14.524+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:43:27.662+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 750, after connections: 1130, after extra_info: 1890, after globalLock: 2160, after locks: 2430, after network: 2700, after opcounters: 2790, after opcountersRepl: 2790, after repl: 3450, after storageEngine: 3880, after tcmalloc: 4360, after wiredTiger: 4650, at end: 5780 } 2016-04-18T03:43:27.855+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:43:41.622+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:43:46.368+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 550, after connections: 560, after extra_info: 910, after globalLock: 1090, after locks: 1090, after network: 1100, after opcounters: 1100, after opcountersRepl: 1100, after repl: 2010, after storageEngine: 2610, after tcmalloc: 3160, after wiredTiger: 4590, at end: 6060 } 2016-04-18T03:43:54.844+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:44:03.712+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 360, after asserts: 490, after connections: 620, after extra_info: 1340, after globalLock: 1490, after locks: 1500, after network: 1500, after opcounters: 1500, after opcountersRepl: 1500, after repl: 2420, after storageEngine: 2730, after tcmalloc: 3190, after wiredTiger: 4860, at end: 5750 } 2016-04-18T03:44:08.946+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:44:18.896+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 172ms 2016-04-18T03:44:22.015+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 580, after connections: 770, after extra_info: 1300, after globalLock: 1510, after locks: 1630, after network: 1810, after opcounters: 1810, after opcountersRepl: 1810, after repl: 2430, after storageEngine: 2690, after tcmalloc: 3300, after wiredTiger: 4800, at end: 7060 } 2016-04-18T03:44:23.164+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:44:38.029+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:44:41.432+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 740, after connections: 1020, after extra_info: 1320, after globalLock: 1600, after locks: 1950, after network: 2230, after opcounters: 2330, after opcountersRepl: 2330, after repl: 3390, after storageEngine: 3670, after tcmalloc: 4220, after wiredTiger: 5370, at end: 7750 } 2016-04-18T03:44:42.758+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 532ms 2016-04-18T03:44:51.686+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:45:00.506+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 567ms 2016-04-18T03:45:03.883+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 510, after connections: 680, after extra_info: 1160, after globalLock: 1500, after locks: 1610, after network: 1700, after opcounters: 1700, after opcountersRepl: 1700, after repl: 2380, after storageEngine: 3130, after tcmalloc: 3860, after wiredTiger: 5670, at end: 6860 } 2016-04-18T03:45:04.065+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:45:19.141+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:45:20.670+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 106ms 2016-04-18T03:45:20.890+0000 I NETWORK [conn243] end connection 127.0.0.1:38893 (53 connections now open) 2016-04-18T03:45:22.965+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 360, after asserts: 560, after connections: 660, after extra_info: 1110, after globalLock: 1660, after locks: 1670, after network: 1760, after opcounters: 1850, after opcountersRepl: 1850, after repl: 2590, after storageEngine: 2990, after tcmalloc: 3880, after wiredTiger: 5800, at end: 6990 } 2016-04-18T03:45:32.819+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:45:40.549+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 500, after asserts: 670, after connections: 1010, after extra_info: 1640, after globalLock: 1830, after locks: 1960, after network: 1960, after opcounters: 1960, after opcountersRepl: 1960, after repl: 3410, after storageEngine: 3670, after tcmalloc: 3910, after wiredTiger: 5050, at end: 6630 } 2016-04-18T03:45:46.702+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:45:58.511+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 370, after connections: 730, after extra_info: 1720, after globalLock: 1920, after locks: 2110, after network: 2120, after opcounters: 2120, after opcountersRepl: 2120, after repl: 2980, after storageEngine: 3280, after tcmalloc: 4150, after wiredTiger: 6240, at end: 8350 } 2016-04-18T03:45:58.964+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:46:15.782+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:46:21.752+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 106ms 2016-04-18T03:46:24.152+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 570, after connections: 580, after extra_info: 1440, after globalLock: 1880, after locks: 1890, after network: 1980, after opcounters: 1980, after opcountersRepl: 1980, after repl: 5080, after storageEngine: 5520, after tcmalloc: 5970, after wiredTiger: 7750, at end: 9980 } 2016-04-18T03:46:30.668+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:46:44.982+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 580, after connections: 1030, after extra_info: 1870, after globalLock: 2070, after locks: 2420, after network: 2640, after opcounters: 2640, after opcountersRepl: 2640, after repl: 3680, after storageEngine: 4140, after tcmalloc: 5100, after wiredTiger: 6620, at end: 8070 } 2016-04-18T03:46:45.068+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:47:03.394+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:47:05.184+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 670, after connections: 1120, after extra_info: 1730, after globalLock: 2280, after locks: 2590, after network: 2810, after opcounters: 2900, after opcountersRepl: 2900, after repl: 4160, after storageEngine: 4660, after tcmalloc: 5290, after wiredTiger: 7050, at end: 8850 } 2016-04-18T03:47:18.959+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:47:24.434+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 670, after asserts: 940, after connections: 1120, after extra_info: 2010, after globalLock: 2280, after locks: 2460, after network: 2640, after opcounters: 2640, after opcountersRepl: 2640, after repl: 4370, after storageEngine: 4650, after tcmalloc: 4830, after wiredTiger: 5460, at end: 6800 } 2016-04-18T03:47:33.876+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:47:47.580+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 750, after asserts: 1060, after connections: 1600, after extra_info: 2440, after globalLock: 3020, after locks: 3280, after network: 3380, after opcounters: 3380, after opcountersRepl: 3380, after repl: 4030, after storageEngine: 4550, after tcmalloc: 5290, after wiredTiger: 6650, at end: 8400 } 2016-04-18T03:47:48.126+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:47:51.228+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:48:04.036+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:48:07.026+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:48:11.088+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:48:13.178+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 680, after connections: 980, after extra_info: 1520, after globalLock: 1890, after locks: 1890, after network: 1890, after opcounters: 1890, after opcountersRepl: 1890, after repl: 4210, after storageEngine: 4710, after tcmalloc: 5200, after wiredTiger: 7740, at end: 10180 } 2016-04-18T03:48:17.591+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:48:24.823+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:48:29.988+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 450, after connections: 800, after extra_info: 1180, after globalLock: 1490, after locks: 1580, after network: 1580, after opcounters: 1580, after opcountersRepl: 1580, after repl: 3130, after storageEngine: 3490, after tcmalloc: 3790, after wiredTiger: 3920, at end: 4750 } 2016-04-18T03:48:29.988+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:48:34.872+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T03:48:38.443+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:48:39.141+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2940ms 2016-04-18T03:48:39.141+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2940ms 2016-04-18T03:48:46.272+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1769ms 2016-04-18T03:48:48.648+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:48:48.865+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:48:52.379+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:48:54.428+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 750, after connections: 1100, after extra_info: 1930, after globalLock: 2210, after locks: 2410, after network: 2500, after opcounters: 2500, after opcountersRepl: 2500, after repl: 3510, after storageEngine: 4100, after tcmalloc: 4820, after wiredTiger: 7580, at end: 9770 } 2016-04-18T03:49:03.098+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:49:06.821+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:49:18.052+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:49:19.043+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 560, after asserts: 930, after connections: 1320, after extra_info: 1850, after globalLock: 2450, after locks: 2820, after network: 3140, after opcounters: 3280, after opcountersRepl: 3280, after repl: 4440, after storageEngine: 4910, after tcmalloc: 6100, after wiredTiger: 7530, at end: 8930 } 2016-04-18T03:49:20.657+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:49:21.106+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:49:32.653+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:49:35.591+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:49:41.116+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 970, after connections: 1200, after extra_info: 2230, after globalLock: 2420, after locks: 2680, after network: 2860, after opcounters: 2860, after opcountersRepl: 2860, after repl: 5930, after storageEngine: 6290, after tcmalloc: 6470, after wiredTiger: 7680, at end: 9780 } 2016-04-18T03:49:50.030+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:49:51.728+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:49:54.188+0000 I COMMAND [conn47] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 726ms 2016-04-18T03:50:04.126+0000 I COMMAND [conn67] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 690ms 2016-04-18T03:50:05.999+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 660, after asserts: 1020, after connections: 1510, after extra_info: 2550, after globalLock: 2950, after locks: 3130, after network: 3130, after opcounters: 3130, after opcountersRepl: 3130, after repl: 4510, after storageEngine: 5050, after tcmalloc: 5750, after wiredTiger: 7050, at end: 9530 } 2016-04-18T03:50:06.214+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:50:08.019+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:50:12.680+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:50:13.085+0000 I COMMAND [conn44] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 640ms 2016-04-18T03:50:21.555+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 831ms 2016-04-18T03:50:21.555+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:50:24.001+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 180ms 2016-04-18T03:50:27.774+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:50:33.292+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 940, after connections: 1490, after extra_info: 2310, after globalLock: 2650, after locks: 3280, after network: 3910, after opcounters: 4080, after opcountersRepl: 4080, after repl: 4900, after storageEngine: 5510, after tcmalloc: 6270, after wiredTiger: 7750, at end: 10600 } 2016-04-18T03:50:35.939+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:50:39.093+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:50:43.279+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:50:51.044+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:50:57.364+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:50:58.810+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 680, after asserts: 1020, after connections: 1310, after extra_info: 2430, after globalLock: 2700, after locks: 2720, after network: 2790, after opcounters: 2790, after opcountersRepl: 2790, after repl: 4230, after storageEngine: 4790, after tcmalloc: 5400, after wiredTiger: 6490, at end: 9030 } 2016-04-18T03:51:12.845+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:51:23.891+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 780, after connections: 870, after extra_info: 1430, after globalLock: 1930, after locks: 2570, after network: 2890, after opcounters: 2980, after opcountersRepl: 2980, after repl: 4150, after storageEngine: 4570, after tcmalloc: 5640, after wiredTiger: 6570, at end: 8480 } 2016-04-18T03:51:26.545+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 289ms 2016-04-18T03:51:26.813+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:51:28.577+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 281ms 2016-04-18T03:51:31.217+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:51:42.724+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:51:42.995+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 465ms 2016-04-18T03:51:46.445+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:51:48.474+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 560, after asserts: 940, after connections: 1430, after extra_info: 2460, after globalLock: 2560, after locks: 2560, after network: 2560, after opcounters: 2560, after opcountersRepl: 2560, after repl: 3870, after storageEngine: 4150, after tcmalloc: 5620, after wiredTiger: 7000, at end: 9710 } 2016-04-18T03:51:50.674+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:51:56.364+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:51:59.635+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:52:13.974+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:52:16.170+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:52:16.470+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 590, after connections: 890, after extra_info: 1820, after globalLock: 2100, after locks: 2550, after network: 2910, after opcounters: 2910, after opcountersRepl: 2910, after repl: 4340, after storageEngine: 4580, after tcmalloc: 5100, after wiredTiger: 6960, at end: 9890 } 2016-04-18T03:52:17.609+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:52:30.122+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 169ms 2016-04-18T03:52:30.231+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:52:33.771+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:52:45.449+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 750, after asserts: 1270, after connections: 2100, after extra_info: 3450, after globalLock: 3850, after locks: 4370, after network: 4570, after opcounters: 4970, after opcountersRepl: 5580, after repl: 7050, after storageEngine: 7400, after tcmalloc: 8180, after wiredTiger: 9450, at end: 11340 } 2016-04-18T03:52:48.719+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:52:51.558+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:52:52.984+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:52:57.070+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 7115ms 2016-04-18T03:53:08.388+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:53:12.046+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 590, after asserts: 960, after connections: 1300, after extra_info: 2080, after globalLock: 2280, after locks: 2390, after network: 2480, after opcounters: 2480, after opcountersRepl: 2480, after repl: 3310, after storageEngine: 3800, after tcmalloc: 4700, after wiredTiger: 6620, at end: 9600 } 2016-04-18T03:53:12.243+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:53:18.186+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 9982ms 2016-04-18T03:53:27.891+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:53:31.742+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:53:36.799+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:53:40.023+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 560, after asserts: 830, after connections: 1450, after extra_info: 2580, after globalLock: 2900, after locks: 3280, after network: 3740, after opcounters: 3830, after opcountersRepl: 3830, after repl: 7000, after storageEngine: 7400, after tcmalloc: 7830, after wiredTiger: 9410, at end: 11290 } 2016-04-18T03:53:42.293+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:53:48.759+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:53:59.445+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:54:02.929+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:54:07.588+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:54:07.858+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 370, after asserts: 750, after connections: 1380, after extra_info: 2370, after globalLock: 2690, after locks: 2780, after network: 2970, after opcounters: 3070, after opcountersRepl: 3070, after repl: 6630, after storageEngine: 6990, after tcmalloc: 7270, after wiredTiger: 8950, at end: 11860 } 2016-04-18T03:54:13.996+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:54:19.065+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:54:28.414+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 850, after connections: 1130, after extra_info: 1530, after globalLock: 1830, after locks: 2110, after network: 2280, after opcounters: 2280, after opcountersRepl: 2280, after repl: 3370, after storageEngine: 3760, after tcmalloc: 4060, after wiredTiger: 5220, at end: 6520 } 2016-04-18T03:54:28.614+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:54:33.971+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:54:36.311+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:54:44.817+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:54:48.261+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:54:57.570+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 870, after connections: 1260, after extra_info: 2170, after globalLock: 2990, after locks: 3260, after network: 3690, after opcounters: 4170, after opcountersRepl: 4170, after repl: 9400, after storageEngine: 9970, after tcmalloc: 10760, after wiredTiger: 12310, at end: 14220 } 2016-04-18T03:55:02.369+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:55:04.239+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:55:06.105+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:55:18.436+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:55:19.549+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:55:19.766+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 780, after connections: 1040, after extra_info: 1500, after globalLock: 1940, after locks: 2210, after network: 2420, after opcounters: 2420, after opcountersRepl: 2420, after repl: 3910, after storageEngine: 4440, after tcmalloc: 5480, after wiredTiger: 6880, at end: 8640 } 2016-04-18T03:55:23.158+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 640ms 2016-04-18T03:55:31.884+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 180ms 2016-04-18T03:55:32.902+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:55:36.162+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:55:42.878+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 770, after asserts: 960, after connections: 1220, after extra_info: 2160, after globalLock: 2520, after locks: 2690, after network: 2790, after opcounters: 3060, after opcountersRepl: 3060, after repl: 6870, after storageEngine: 7340, after tcmalloc: 7790, after wiredTiger: 8770, at end: 9860 } 2016-04-18T03:55:47.885+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:55:47.896+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:55:51.484+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:56:01.594+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:56:03.408+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 840, after connections: 1200, after extra_info: 2090, after globalLock: 2270, after locks: 2270, after network: 2380, after opcounters: 2590, after opcountersRepl: 2590, after repl: 3670, after storageEngine: 4140, after tcmalloc: 4990, after wiredTiger: 6620, at end: 8160 } 2016-04-18T03:56:04.802+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:56:19.664+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:56:26.807+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 570, after connections: 740, after extra_info: 1130, after globalLock: 1410, after locks: 1670, after network: 2060, after opcounters: 2160, after opcountersRepl: 2160, after repl: 3270, after storageEngine: 3950, after tcmalloc: 5000, after wiredTiger: 5840, at end: 7730 } 2016-04-18T03:56:31.786+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:56:46.781+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2260ms 2016-04-18T03:56:48.563+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:56:49.411+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 500, after asserts: 1070, after connections: 1170, after extra_info: 2300, after globalLock: 2740, after locks: 3140, after network: 3450, after opcounters: 3530, after opcountersRepl: 3530, after repl: 4390, after storageEngine: 4930, after tcmalloc: 5680, after wiredTiger: 7180, at end: 8990 } 2016-04-18T03:57:04.238+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:57:06.397+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:57:16.635+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 580, after asserts: 970, after connections: 1330, after extra_info: 2410, after globalLock: 2680, after locks: 3510, after network: 3610, after opcounters: 3610, after opcountersRepl: 3610, after repl: 7430, after storageEngine: 7790, after tcmalloc: 8440, after wiredTiger: 10480, at end: 12980 } 2016-04-18T03:57:21.056+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:57:24.825+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:57:25.295+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:57:33.884+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 104ms 2016-04-18T03:57:36.623+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-18T03:57:39.920+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 670, after connections: 960, after extra_info: 1740, after globalLock: 2320, after locks: 2330, after network: 2430, after opcounters: 2610, after opcountersRepl: 2610, after repl: 4060, after storageEngine: 4320, after tcmalloc: 4840, after wiredTiger: 6180, at end: 7730 } 2016-04-18T03:57:39.923+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:57:53.998+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:58:01.638+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 780, after connections: 1060, after extra_info: 1370, after globalLock: 1740, after locks: 2090, after network: 2180, after opcounters: 2180, after opcountersRepl: 2180, after repl: 2280, after storageEngine: 2640, after tcmalloc: 3330, after wiredTiger: 5340, at end: 6760 } 2016-04-18T03:58:07.683+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:58:23.013+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:58:25.813+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 860, after asserts: 1150, after connections: 1430, after extra_info: 2440, after globalLock: 2910, after locks: 3480, after network: 3920, after opcounters: 4250, after opcountersRepl: 4520, after repl: 5880, after storageEngine: 6070, after tcmalloc: 6570, after wiredTiger: 8050, at end: 10040 } 2016-04-18T03:58:26.438+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:58:35.932+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 264ms 2016-04-18T03:58:40.894+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:58:44.589+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:58:46.490+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:58:53.243+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 800, after connections: 1070, after extra_info: 2150, after globalLock: 2440, after locks: 2530, after network: 2610, after opcounters: 2610, after opcountersRepl: 2610, after repl: 4710, after storageEngine: 5370, after tcmalloc: 5690, after wiredTiger: 7250, at end: 9070 } 2016-04-18T03:59:00.141+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:59:02.766+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:59:12.465+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 750, after asserts: 1070, after connections: 1470, after extra_info: 2250, after globalLock: 2820, after locks: 3240, after network: 3660, after opcounters: 3750, after opcountersRepl: 3750, after repl: 4910, after storageEngine: 5640, after tcmalloc: 6220, after wiredTiger: 7750, at end: 8930 } 2016-04-18T03:59:16.870+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:59:20.770+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T03:59:23.743+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:59:36.999+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 730, after connections: 1000, after extra_info: 1860, after globalLock: 2250, after locks: 2600, after network: 2960, after opcounters: 3140, after opcountersRepl: 3410, after repl: 5190, after storageEngine: 5460, after tcmalloc: 5850, after wiredTiger: 7680, at end: 9710 } 2016-04-18T03:59:37.633+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:59:38.130+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 549ms 2016-04-18T03:59:38.514+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T03:59:40.360+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T03:59:54.679+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T03:59:57.953+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:00:05.192+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 860, after asserts: 1150, after connections: 1500, after extra_info: 2190, after globalLock: 2800, after locks: 3220, after network: 3400, after opcounters: 3400, after opcountersRepl: 3400, after repl: 7500, after storageEngine: 8140, after tcmalloc: 8620, after wiredTiger: 9860, at end: 10880 } 2016-04-18T04:00:11.898+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:00:13.878+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:00:15.505+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:00:32.943+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:00:37.383+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:00:41.229+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 298ms 2016-04-18T04:00:46.274+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 730, after asserts: 1070, after connections: 1440, after extra_info: 2790, after globalLock: 2970, after locks: 3320, after network: 3500, after opcounters: 3500, after opcountersRepl: 3500, after repl: 5000, after storageEngine: 6030, after tcmalloc: 11070, after wiredTiger: 16080, at end: 23490 } 2016-04-18T04:00:54.508+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:01:07.464+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:01:35.326+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:01:40.852+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:01:42.659+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T04:01:46.823+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1124ms 2016-04-18T04:01:53.213+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:01:54.673+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 275ms 2016-04-18T04:02:18.849+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:02:38.261+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1110, after asserts: 3460, after connections: 4600, after extra_info: 14410, after globalLock: 16150, after locks: 16360, after network: 16360, after opcounters: 16360, after opcountersRepl: 16360, after repl: 28620, after storageEngine: 30010, after tcmalloc: 33990, after wiredTiger: 42340, at end: 61440 } 2016-04-18T04:02:38.261+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:02:56.473+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 241ms 2016-04-18T04:02:57.302+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:03:05.864+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 774ms 2016-04-18T04:03:08.336+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:03:31.905+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:03:34.690+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:03:40.221+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:03:53.541+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1580, after asserts: 2260, after connections: 2570, after extra_info: 5930, after globalLock: 7310, after locks: 7310, after network: 7450, after opcounters: 7450, after opcountersRepl: 7450, after repl: 10790, after storageEngine: 11190, after tcmalloc: 14360, after wiredTiger: 14630, at end: 18440 } 2016-04-18T04:03:53.574+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:04:00.586+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:04:15.029+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 456ms 2016-04-18T04:04:17.828+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:04:20.456+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:04:20.525+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1790ms 2016-04-18T04:04:33.605+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:04:38.169+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:04:51.368+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:04:51.968+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:05:04.307+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T04:05:06.955+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 260, after asserts: 2140, after connections: 2530, after extra_info: 3270, after globalLock: 3270, after locks: 3270, after network: 3270, after opcounters: 3270, after opcountersRepl: 3270, after repl: 8110, after storageEngine: 8660, after tcmalloc: 8780, after wiredTiger: 11480, at end: 22690 } 2016-04-18T04:05:14.324+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:05:23.541+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 995ms 2016-04-18T04:05:24.025+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:05:37.938+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:05:43.608+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:05:55.923+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:06:08.447+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1630, after asserts: 3330, after connections: 3730, after extra_info: 4670, after globalLock: 4670, after locks: 4670, after network: 4670, after opcounters: 4670, after opcountersRepl: 4670, after repl: 4880, after storageEngine: 6840, after tcmalloc: 8990, after wiredTiger: 13690, at end: 25490 } 2016-04-18T04:06:08.186+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T04:06:24.250+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:06:25.384+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 821ms 2016-04-18T04:06:46.489+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:06:58.011+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:07:22.012+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:07:28.251+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 729ms 2016-04-18T04:07:29.869+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 107ms 2016-04-18T04:07:29.884+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:07:40.853+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:07:53.359+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T04:08:05.535+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1190, after asserts: 1700, after connections: 1880, after extra_info: 6240, after globalLock: 7480, after locks: 9560, after network: 13200, after opcounters: 14240, after opcountersRepl: 18120, after repl: 35580, after storageEngine: 36280, after tcmalloc: 36350, after wiredTiger: 43200, at end: 55390 } 2016-04-18T04:08:13.162+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:08:34.282+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 287ms 2016-04-18T04:08:39.738+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:08:47.052+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:09:03.506+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:09:11.847+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:09:11.991+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:09:19.274+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1260, after asserts: 2390, after connections: 4080, after extra_info: 5560, after globalLock: 5740, after locks: 5740, after network: 5740, after opcounters: 5740, after opcountersRepl: 5740, after repl: 9410, after storageEngine: 12090, after tcmalloc: 14800, after wiredTiger: 19120, at end: 23640 } 2016-04-18T04:09:38.550+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:09:41.424+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 295ms 2016-04-18T04:09:58.571+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:10:20.768+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:10:31.743+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:10:42.217+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:10:44.673+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 372ms 2016-04-18T04:10:53.201+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1451ms 2016-04-18T04:10:58.096+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T04:11:09.736+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3330, after asserts: 5490, after connections: 8430, after extra_info: 10690, after globalLock: 11870, after locks: 12050, after network: 12050, after opcounters: 12050, after opcountersRepl: 12050, after repl: 28140, after storageEngine: 29420, after tcmalloc: 31290, after wiredTiger: 37960, at end: 45870 } 2016-04-18T04:11:09.834+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:11:33.754+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:11:42.012+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:11:55.270+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 131ms 2016-04-18T04:12:04.867+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1950ms 2016-04-18T04:12:05.222+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:12:18.628+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:12:36.283+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:13:01.618+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:13:15.723+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 178ms 2016-04-18T04:13:25.842+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:13:32.312+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 251ms 2016-04-18T04:13:32.313+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2650, after asserts: 5460, after connections: 5840, after extra_info: 10620, after globalLock: 12470, after locks: 19630, after network: 19950, after opcounters: 19950, after opcountersRepl: 19950, after repl: 35670, after storageEngine: 37230, after tcmalloc: 45650, after wiredTiger: 65820, at end: 85110 } 2016-04-18T04:13:39.348+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 176ms 2016-04-18T04:13:59.876+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:14:12.644+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:14:42.996+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:14:46.314+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 510ms 2016-04-18T04:14:59.893+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:15:01.367+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:15:17.985+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:15:32.361+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:15:34.836+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3770, after asserts: 4830, after connections: 5250, after extra_info: 9530, after globalLock: 10290, after locks: 10290, after network: 10370, after opcounters: 10370, after opcountersRepl: 10370, after repl: 20610, after storageEngine: 25180, after tcmalloc: 32250, after wiredTiger: 38240, at end: 48210 } 2016-04-18T04:15:51.791+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 127ms 2016-04-18T04:15:59.386+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1191ms 2016-04-18T04:16:08.162+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 290ms 2016-04-18T04:16:15.882+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:16:28.504+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:16:56.985+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:17:07.165+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:17:17.606+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 524ms 2016-04-18T04:17:19.090+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:17:32.438+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:17:40.732+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 422ms 2016-04-18T04:17:56.609+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 212ms 2016-04-18T04:18:15.122+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4090, after asserts: 4690, after connections: 5020, after extra_info: 8080, after globalLock: 11840, after locks: 16220, after network: 16510, after opcounters: 16510, after opcountersRepl: 16510, after repl: 30360, after storageEngine: 33070, after tcmalloc: 37210, after wiredTiger: 51730, at end: 81610 } 2016-04-18T04:18:18.677+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:18:32.570+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:19:08.769+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 763ms 2016-04-18T04:19:14.806+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:19:18.216+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 614ms 2016-04-18T04:19:26.483+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 137ms 2016-04-18T04:19:32.549+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:19:55.842+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:20:08.004+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:20:34.891+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2206ms 2016-04-18T04:20:44.494+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 280ms 2016-04-18T04:20:54.482+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1460, after asserts: 2240, after connections: 2770, after extra_info: 8290, after globalLock: 9910, after locks: 10700, after network: 11090, after opcounters: 11090, after opcountersRepl: 11090, after repl: 37600, after storageEngine: 43900, after tcmalloc: 48370, after wiredTiger: 54000, at end: 60730 } 2016-04-18T04:20:57.332+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:20:57.783+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:21:17.223+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:21:47.844+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 318ms 2016-04-18T04:21:58.683+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 945ms 2016-04-18T04:22:28.759+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:22:46.665+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:23:14.991+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 342ms 2016-04-18T04:23:25.675+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 348ms 2016-04-18T04:23:32.753+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:23:34.581+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 446ms 2016-04-18T04:23:47.074+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:23:54.011+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1970, after asserts: 5310, after connections: 9880, after extra_info: 15160, after globalLock: 17140, after locks: 20300, after network: 21530, after opcounters: 21530, after opcountersRepl: 21530, after repl: 33870, after storageEngine: 36100, after tcmalloc: 38700, after wiredTiger: 55670, at end: 57630 } 2016-04-18T04:24:12.413+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:24:25.127+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:24:34.846+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:24:38.673+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 539ms 2016-04-18T04:24:44.868+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T04:25:01.609+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:25:18.624+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:25:48.401+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:25:50.321+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2570, after asserts: 3570, after connections: 4130, after extra_info: 13010, after globalLock: 14040, after locks: 14820, after network: 15300, after opcounters: 15300, after opcountersRepl: 15300, after repl: 28800, after storageEngine: 31000, after tcmalloc: 34000, after wiredTiger: 40760, at end: 48990 } 2016-04-18T04:26:00.382+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 331ms 2016-04-18T04:26:00.818+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:26:01.261+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 301ms 2016-04-18T04:26:16.296+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 2098ms 2016-04-18T04:26:30.990+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:26:47.596+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:26:58.736+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:27:03.114+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 264ms 2016-04-18T04:27:04.323+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 108ms 2016-04-18T04:27:22.379+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:27:34.109+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:28:11.371+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 572ms 2016-04-18T04:28:23.461+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 165ms 2016-04-18T04:28:25.622+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:28:27.619+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 215ms 2016-04-18T04:28:35.808+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:28:38.368+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 610, after asserts: 2160, after connections: 4230, after extra_info: 8990, after globalLock: 13140, after locks: 13750, after network: 13750, after opcounters: 13750, after opcountersRepl: 13750, after repl: 43800, after storageEngine: 47370, after tcmalloc: 53880, after wiredTiger: 61950, at end: 77510 } 2016-04-18T04:29:04.820+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:29:18.749+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:29:33.490+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:29:38.227+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 402ms 2016-04-18T04:29:42.924+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:30:14.464+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:30:35.775+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:30:45.872+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 509ms 2016-04-18T04:30:49.405+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 971ms 2016-04-18T04:31:00.897+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 145ms 2016-04-18T04:31:11.750+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1820, after asserts: 2630, after connections: 3580, after extra_info: 8900, after globalLock: 11230, after locks: 11930, after network: 12440, after opcounters: 13430, after opcountersRepl: 13430, after repl: 35770, after storageEngine: 39740, after tcmalloc: 43810, after wiredTiger: 55380, at end: 69600 } 2016-04-18T04:31:15.960+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:31:30.643+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:32:08.467+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:32:10.448+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 485ms 2016-04-18T04:32:21.132+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1367ms 2016-04-18T04:32:25.856+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:32:26.195+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 445ms 2016-04-18T04:32:32.725+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:33:02.122+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:33:13.184+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:33:34.225+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 656ms 2016-04-18T04:33:38.676+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3100, after asserts: 3200, after connections: 3460, after extra_info: 12960, after globalLock: 14270, after locks: 14990, after network: 15190, after opcounters: 15190, after opcountersRepl: 15190, after repl: 30930, after storageEngine: 33500, after tcmalloc: 35740, after wiredTiger: 45190, at end: 50410 } 2016-04-18T04:33:40.024+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 673ms 2016-04-18T04:33:41.681+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:33:51.120+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:34:08.902+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:34:19.597+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:34:19.596+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:34:43.855+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1181ms 2016-04-18T04:34:48.948+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:34:53.892+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 573ms 2016-04-18T04:34:57.968+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:35:35.345+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:35:38.975+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2310, after asserts: 2590, after connections: 2740, after extra_info: 6020, after globalLock: 7070, after locks: 8990, after network: 9320, after opcounters: 9730, after opcountersRepl: 10920, after repl: 36900, after storageEngine: 41330, after tcmalloc: 41830, after wiredTiger: 49870, at end: 56500 } 2016-04-18T04:35:47.077+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:36:21.130+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:36:34.351+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:36:34.812+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:37:02.270+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:37:02.181+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 113ms 2016-04-18T04:37:08.112+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1557ms 2016-04-18T04:37:13.541+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:37:17.465+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-04-18T04:37:23.222+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 990, after asserts: 2100, after connections: 3610, after extra_info: 9370, after globalLock: 11510, after locks: 13680, after network: 16960, after opcounters: 17250, after opcountersRepl: 17250, after repl: 21660, after storageEngine: 24320, after tcmalloc: 26450, after wiredTiger: 36060, at end: 41800 } 2016-04-18T04:37:48.124+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:38:00.059+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:38:20.903+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 219ms 2016-04-18T04:38:25.930+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:38:28.382+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 657ms 2016-04-18T04:38:30.215+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 755ms 2016-04-18T04:38:34.189+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:38:39.734+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:39:14.047+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:39:22.554+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:39:33.559+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4180, after asserts: 8020, after connections: 10260, after extra_info: 14180, after globalLock: 16020, after locks: 16020, after network: 16190, after opcounters: 16190, after opcountersRepl: 16190, after repl: 27440, after storageEngine: 30040, after tcmalloc: 38090, after wiredTiger: 46270, at end: 57720 } 2016-04-18T04:39:42.624+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T04:39:48.721+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:39:52.145+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1023ms 2016-04-18T04:40:10.666+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:40:45.010+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:40:57.957+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 302ms 2016-04-18T04:40:58.104+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:41:03.124+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:41:31.431+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:41:39.288+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:41:56.703+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4320, after asserts: 6190, after connections: 8560, after extra_info: 12070, after globalLock: 13530, after locks: 14250, after network: 14250, after opcounters: 14250, after opcountersRepl: 14250, after repl: 32850, after storageEngine: 36210, after tcmalloc: 43270, after wiredTiger: 48880, at end: 66590 } 2016-04-18T04:42:00.716+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 257ms 2016-04-18T04:42:05.286+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1167ms 2016-04-18T04:42:11.921+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:42:13.875+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 249ms 2016-04-18T04:42:53.022+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:43:22.565+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 167ms 2016-04-18T04:43:24.121+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:43:29.513+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 462ms 2016-04-18T04:43:36.156+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 168ms 2016-04-18T04:43:46.645+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:43:57.638+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T04:44:17.339+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1730, after asserts: 4500, after connections: 5850, after extra_info: 7960, after globalLock: 8140, after locks: 8140, after network: 8140, after opcounters: 8140, after opcountersRepl: 8140, after repl: 11580, after storageEngine: 15560, after tcmalloc: 18170, after wiredTiger: 28130, at end: 46020 } 2016-04-18T04:44:29.486+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:44:44.321+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 332ms 2016-04-18T04:44:56.357+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 562ms 2016-04-18T04:44:56.096+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:45:05.044+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T04:45:23.695+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:45:59.143+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:46:13.771+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 243ms 2016-04-18T04:46:18.013+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:46:22.651+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:46:24.888+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1350ms 2016-04-18T04:46:52.464+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:47:10.184+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:47:16.283+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2130, after asserts: 4290, after connections: 6520, after extra_info: 9570, after globalLock: 12790, after locks: 15490, after network: 15740, after opcounters: 15740, after opcountersRepl: 15740, after repl: 40090, after storageEngine: 47630, after tcmalloc: 56850, after wiredTiger: 63800, at end: 72990 } 2016-04-18T04:47:30.415+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 235ms 2016-04-18T04:47:44.999+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 348ms 2016-04-18T04:47:56.753+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:48:01.272+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 161ms 2016-04-18T04:48:11.375+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:48:58.924+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:49:07.109+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 217ms 2016-04-18T04:49:11.334+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:49:20.604+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1933ms 2016-04-18T04:49:27.405+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:49:36.757+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 149ms 2016-04-18T04:49:53.531+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T04:50:01.516+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2520, after asserts: 4320, after connections: 6370, after extra_info: 9500, after globalLock: 10600, after locks: 11010, after network: 11280, after opcounters: 11280, after opcountersRepl: 11280, after repl: 29760, after storageEngine: 36640, after tcmalloc: 39740, after wiredTiger: 47220, at end: 58680 } 2016-04-18T04:50:13.681+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:50:45.127+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2366ms 2016-04-18T04:50:53.025+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 156ms 2016-04-18T04:50:53.712+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:51:04.604+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:51:39.438+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:51:55.848+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 145ms 2016-04-18T04:51:56.872+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:51:57.111+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:52:07.995+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 635ms 2016-04-18T04:52:17.618+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 167ms 2016-04-18T04:52:31.317+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:52:50.250+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:53:01.907+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2490, after asserts: 3280, after connections: 3570, after extra_info: 9560, after globalLock: 12730, after locks: 15160, after network: 16450, after opcounters: 19940, after opcountersRepl: 20410, after repl: 42170, after storageEngine: 44590, after tcmalloc: 50570, after wiredTiger: 59740, at end: 66590 } 2016-04-18T04:53:26.417+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:53:30.420+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 806ms 2016-04-18T04:53:39.656+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:54:15.942+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:54:31.799+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 231ms 2016-04-18T04:54:35.454+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:54:35.665+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 208ms 2016-04-18T04:54:46.668+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:55:07.093+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T04:55:23.154+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3250, after asserts: 3510, after connections: 4690, after extra_info: 10770, after globalLock: 11510, after locks: 11530, after network: 11960, after opcounters: 14820, after opcountersRepl: 14940, after repl: 36550, after storageEngine: 38500, after tcmalloc: 45170, after wiredTiger: 54440, at end: 69210 } 2016-04-18T04:55:28.536+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:55:37.543+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 290ms 2016-04-18T04:55:39.535+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 878ms 2016-04-18T04:55:41.191+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:55:42.324+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T04:55:49.773+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:56:23.262+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:56:41.068+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:56:44.543+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 213ms 2016-04-18T04:56:54.275+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:57:08.152+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T04:57:19.591+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1300, after asserts: 3700, after connections: 4650, after extra_info: 11180, after globalLock: 14230, after locks: 15930, after network: 18320, after opcounters: 18320, after opcountersRepl: 18320, after repl: 26870, after storageEngine: 29210, after tcmalloc: 30930, after wiredTiger: 37280, at end: 47930 } 2016-04-18T04:57:22.207+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:57:47.031+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 115ms 2016-04-18T04:57:50.470+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1435ms 2016-04-18T04:57:50.576+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:57:51.323+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 224ms 2016-04-18T04:58:03.843+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:58:04.390+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:58:11.517+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:58:27.104+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T04:58:40.758+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:58:53.772+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 252ms 2016-04-18T04:58:55.089+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:59:03.498+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2400, after asserts: 4080, after connections: 6550, after extra_info: 9700, after globalLock: 12370, after locks: 15040, after network: 17160, after opcounters: 17780, after opcountersRepl: 17780, after repl: 26170, after storageEngine: 30290, after tcmalloc: 33870, after wiredTiger: 38750, at end: 46760 } 2016-04-18T04:59:03.595+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:59:25.657+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:59:36.120+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T04:59:40.097+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T04:59:58.773+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 120ms 2016-04-18T05:00:07.213+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 839ms 2016-04-18T05:00:07.218+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:00:16.955+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:00:26.904+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:00:48.440+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 530, after asserts: 530, after connections: 2260, after extra_info: 5470, after globalLock: 7530, after locks: 9080, after network: 10090, after opcounters: 10450, after opcountersRepl: 10450, after repl: 23060, after storageEngine: 27550, after tcmalloc: 33450, after wiredTiger: 41780, at end: 52210 } 2016-04-18T05:00:51.530+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:00:56.301+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:01:13.482+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 466ms 2016-04-18T05:01:19.554+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:01:20.200+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 138ms 2016-04-18T05:01:20.348+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:01:30.427+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:01:40.628+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:02:01.970+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:02:13.890+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:02:14.182+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:02:14.364+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2300, after asserts: 2740, after connections: 2860, after extra_info: 4360, after globalLock: 5900, after locks: 6640, after network: 7420, after opcounters: 9030, after opcountersRepl: 9380, after repl: 16130, after storageEngine: 20130, after tcmalloc: 25040, after wiredTiger: 25220, at end: 31940 } 2016-04-18T05:02:22.991+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 157ms 2016-04-18T05:02:30.674+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 540ms 2016-04-18T05:02:44.181+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:02:48.032+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:03:13.858+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:03:27.127+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:03:45.702+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 117ms 2016-04-18T05:03:51.069+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:03:53.654+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 608ms 2016-04-18T05:04:01.048+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 230ms 2016-04-18T05:04:04.862+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:04:09.935+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4400, after asserts: 6780, after connections: 10020, after extra_info: 13220, after globalLock: 13530, after locks: 13530, after network: 13530, after opcounters: 13530, after opcountersRepl: 13530, after repl: 20310, after storageEngine: 21980, after tcmalloc: 27040, after wiredTiger: 37530, at end: 45900 } 2016-04-18T05:04:11.753+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 28025ms 2016-04-18T05:04:20.726+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:04:38.974+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T05:04:46.072+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:05:06.295+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 600ms 2016-04-18T05:05:17.986+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 817ms 2016-04-18T05:05:28.766+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:05:38.564+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:06:11.636+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:06:19.949+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 116ms 2016-04-18T05:06:25.319+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1534ms 2016-04-18T05:06:27.399+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2640, after asserts: 3520, after connections: 8110, after extra_info: 12970, after globalLock: 14430, after locks: 15140, after network: 15850, after opcounters: 16580, after opcountersRepl: 16580, after repl: 39730, after storageEngine: 41960, after tcmalloc: 47190, after wiredTiger: 49870, at end: 69020 } 2016-04-18T05:06:27.605+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:06:27.990+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:06:50.456+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:07:08.208+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:07:28.560+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 204ms 2016-04-18T05:07:39.917+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 883ms 2016-04-18T05:07:48.496+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:07:52.474+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1066ms 2016-04-18T05:08:04.752+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:08:17.495+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2050, after asserts: 2630, after connections: 4520, after extra_info: 8140, after globalLock: 8340, after locks: 8560, after network: 8620, after opcounters: 8620, after opcountersRepl: 8620, after repl: 30550, after storageEngine: 37070, after tcmalloc: 42590, after wiredTiger: 44550, at end: 57780 } 2016-04-18T05:08:19.459+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:08:31.042+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 21634ms 2016-04-18T05:08:45.515+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:09:00.040+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:09:00.303+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 182ms 2016-04-18T05:09:08.705+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1598ms 2016-04-18T05:09:26.902+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:09:32.641+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:09:47.018+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:10:10.422+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T05:10:20.093+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 284ms 2016-04-18T05:10:22.976+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:10:24.122+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 812ms 2016-04-18T05:10:29.480+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3410, after asserts: 5660, after connections: 8840, after extra_info: 11730, after globalLock: 15020, after locks: 19180, after network: 21040, after opcounters: 21410, after opcountersRepl: 21410, after repl: 36750, after storageEngine: 39600, after tcmalloc: 42550, after wiredTiger: 51120, at end: 57040 } 2016-04-18T05:10:35.036+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:11:02.912+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:11:16.511+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:11:24.835+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 116ms 2016-04-18T05:11:30.323+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 848ms 2016-04-18T05:11:39.944+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 227ms 2016-04-18T05:11:49.388+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:11:58.498+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:11:58.498+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:12:24.386+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:12:24.519+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:12:30.689+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5800, after asserts: 6440, after connections: 6730, after extra_info: 11040, after globalLock: 11950, after locks: 12020, after network: 12120, after opcounters: 12120, after opcountersRepl: 12120, after repl: 33230, after storageEngine: 35850, after tcmalloc: 37600, after wiredTiger: 43880, at end: 51480 } 2016-04-18T05:12:41.811+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 204ms 2016-04-18T05:12:46.534+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 105ms 2016-04-18T05:12:51.490+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:13:02.576+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:13:34.194+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:13:47.973+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 229ms 2016-04-18T05:13:47.973+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:13:51.183+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:14:00.156+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3353ms 2016-04-18T05:14:28.328+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:14:37.404+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2880, after asserts: 3890, after connections: 4650, after extra_info: 9010, after globalLock: 11600, after locks: 16480, after network: 19290, after opcounters: 19690, after opcountersRepl: 19690, after repl: 36770, after storageEngine: 37540, after tcmalloc: 44310, after wiredTiger: 55190, at end: 61910 } 2016-04-18T05:14:41.051+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:15:00.283+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:15:05.175+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1556ms 2016-04-18T05:15:16.695+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1984ms 2016-04-18T05:15:21.251+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:15:29.449+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:15:58.201+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:16:11.072+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:16:14.260+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:16:20.499+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1890, after asserts: 1890, after connections: 3920, after extra_info: 5860, after globalLock: 5950, after locks: 5950, after network: 5950, after opcounters: 5950, after opcountersRepl: 5950, after repl: 12190, after storageEngine: 14950, after tcmalloc: 18710, after wiredTiger: 24750, at end: 28930 } 2016-04-18T05:16:24.100+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 239ms 2016-04-18T05:16:27.800+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1451ms 2016-04-18T05:16:35.153+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 146ms 2016-04-18T05:16:39.995+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:16:50.310+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:17:27.574+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:17:38.436+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:17:40.967+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 183ms 2016-04-18T05:17:49.170+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 282ms 2016-04-18T05:17:56.476+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 130ms 2016-04-18T05:18:15.561+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:18:29.583+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1710, after asserts: 3450, after connections: 7440, after extra_info: 17140, after globalLock: 18560, after locks: 18890, after network: 19010, after opcounters: 19010, after opcountersRepl: 19010, after repl: 44490, after storageEngine: 49590, after tcmalloc: 51940, after wiredTiger: 65380, at end: 75730 } 2016-04-18T05:18:37.002+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:18:42.215+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:18:59.860+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 154ms 2016-04-18T05:19:06.902+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1811ms 2016-04-18T05:19:16.132+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:19:34.374+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:20:09.618+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:20:16.870+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 167ms 2016-04-18T05:20:24.906+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1907ms 2016-04-18T05:20:30.158+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:20:38.673+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 107ms 2016-04-18T05:21:15.713+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:21:35.743+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:21:36.214+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:21:53.150+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4260, after asserts: 7620, after connections: 11440, after extra_info: 17910, after globalLock: 22510, after locks: 24820, after network: 24950, after opcounters: 24950, after opcountersRepl: 24950, after repl: 65750, after storageEngine: 70600, after tcmalloc: 78090, after wiredTiger: 97480, at end: 112700 } 2016-04-18T05:21:53.150+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 259ms 2016-04-18T05:22:06.752+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:22:15.785+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 467ms 2016-04-18T05:22:42.521+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:23:19.147+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 141ms 2016-04-18T05:23:20.437+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:23:23.898+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1168ms 2016-04-18T05:23:40.975+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 185ms 2016-04-18T05:23:41.831+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:24:15.355+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:24:42.414+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:25:01.666+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 158ms 2016-04-18T05:25:11.754+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 836ms 2016-04-18T05:25:17.992+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:25:18.456+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:25:36.059+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6940, after asserts: 8120, after connections: 9110, after extra_info: 17490, after globalLock: 26010, after locks: 29730, after network: 31020, after opcounters: 32060, after opcountersRepl: 32060, after repl: 58530, after storageEngine: 66640, after tcmalloc: 69530, after wiredTiger: 76870, at end: 87530 } 2016-04-18T05:25:39.343+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:26:20.128+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-04-18T05:26:28.992+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1133ms 2016-04-18T05:26:41.010+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:27:04.032+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:27:22.117+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:27:34.739+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 433ms 2016-04-18T05:27:48.240+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 188ms 2016-04-18T05:27:52.479+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 120ms 2016-04-18T05:27:57.066+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:28:11.797+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:28:27.716+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:28:51.597+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T05:28:54.343+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 131ms 2016-04-18T05:29:04.552+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 390ms 2016-04-18T05:29:05.456+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3100, after asserts: 5080, after connections: 8340, after extra_info: 21300, after globalLock: 23260, after locks: 24820, after network: 24920, after opcounters: 24920, after opcountersRepl: 24920, after repl: 56550, after storageEngine: 61130, after tcmalloc: 66870, after wiredTiger: 75480, at end: 92510 } 2016-04-18T05:29:05.542+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:29:09.685+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1464ms 2016-04-18T05:29:48.183+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:30:13.337+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:30:26.449+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-04-18T05:30:26.982+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 151ms 2016-04-18T05:30:43.404+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:31:09.806+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T05:31:30.094+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 531ms 2016-04-18T05:31:33.478+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:31:34.209+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 325ms 2016-04-18T05:32:01.344+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:32:20.432+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1150, after asserts: 4460, after connections: 5780, after extra_info: 14080, after globalLock: 16830, after locks: 18460, after network: 18980, after opcounters: 23810, after opcountersRepl: 28570, after repl: 60500, after storageEngine: 63940, after tcmalloc: 71630, after wiredTiger: 83800, at end: 100900 } 2016-04-18T05:32:20.871+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:32:38.263+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 108ms 2016-04-18T05:32:45.855+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 739ms 2016-04-18T05:33:03.984+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:33:26.631+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:33:29.070+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:33:47.073+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T05:33:51.606+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 184ms 2016-04-18T05:33:59.094+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:33:59.390+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 383ms 2016-04-18T05:34:06.193+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 165ms 2016-04-18T05:34:31.635+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3270, after asserts: 4790, after connections: 6920, after extra_info: 12830, after globalLock: 13580, after locks: 14000, after network: 14190, after opcounters: 16060, after opcountersRepl: 16530, after repl: 20840, after storageEngine: 24320, after tcmalloc: 28980, after wiredTiger: 43070, at end: 54910 } 2016-04-18T05:34:34.065+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:34:40.172+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:35:17.508+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:35:19.663+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 117ms 2016-04-18T05:35:27.117+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:35:39.281+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:35:54.876+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:36:13.830+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:36:25.976+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:36:25.682+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 120ms 2016-04-18T05:36:33.583+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1890, after asserts: 2280, after connections: 2610, after extra_info: 7560, after globalLock: 8570, after locks: 8570, after network: 9990, after opcounters: 11080, after opcountersRepl: 11470, after repl: 22530, after storageEngine: 24550, after tcmalloc: 27080, after wiredTiger: 32970, at end: 41170 } 2016-04-18T05:36:35.589+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1450ms 2016-04-18T05:36:42.813+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 137ms 2016-04-18T05:36:46.404+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:37:01.268+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:37:27.156+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:37:37.458+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:37:47.174+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 144ms 2016-04-18T05:38:00.599+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 553ms 2016-04-18T05:38:08.000+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 196ms 2016-04-18T05:38:12.926+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:38:32.352+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:38:49.175+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1660, after asserts: 4860, after connections: 5560, after extra_info: 10860, after globalLock: 14300, after locks: 16050, after network: 16270, after opcounters: 16270, after opcountersRepl: 16270, after repl: 24500, after storageEngine: 26750, after tcmalloc: 32990, after wiredTiger: 51640, at end: 65630 } 2016-04-18T05:38:52.632+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T05:39:13.868+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 256ms 2016-04-18T05:39:25.651+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 317ms 2016-04-18T05:39:28.661+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:39:49.974+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:40:28.592+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 105ms 2016-04-18T05:40:32.171+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:40:40.610+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 487ms 2016-04-18T05:40:54.110+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 131ms 2016-04-18T05:41:08.300+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:41:22.261+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:41:45.882+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2980, after asserts: 4690, after connections: 6450, after extra_info: 14310, after globalLock: 16150, after locks: 17290, after network: 17680, after opcounters: 17680, after opcountersRepl: 17680, after repl: 46570, after storageEngine: 51060, after tcmalloc: 53030, after wiredTiger: 70320, at end: 82190 } 2016-04-18T05:41:46.906+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T05:42:01.388+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 473ms 2016-04-18T05:42:14.155+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 269ms 2016-04-18T05:42:16.398+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:43:00.775+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:43:18.003+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 477ms 2016-04-18T05:43:27.254+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:43:31.757+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 664ms 2016-04-18T05:43:53.197+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 189ms 2016-04-18T05:44:11.284+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:44:29.491+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:44:54.748+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:45:05.872+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:45:06.044+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2770, after asserts: 3830, after connections: 7930, after extra_info: 15620, after globalLock: 17750, after locks: 19890, after network: 20860, after opcounters: 20860, after opcountersRepl: 20860, after repl: 39310, after storageEngine: 42080, after tcmalloc: 52190, after wiredTiger: 65770, at end: 83290 } 2016-04-18T05:45:06.776+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 186ms 2016-04-18T05:45:09.099+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:45:14.045+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 901ms 2016-04-18T05:45:27.734+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 130ms 2016-04-18T05:45:44.492+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:46:02.950+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:46:37.523+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 164ms 2016-04-18T05:46:50.734+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:46:51.846+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1229ms 2016-04-18T05:47:11.869+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 484ms 2016-04-18T05:47:20.182+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:47:28.403+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:47:46.540+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4250, after asserts: 6310, after connections: 7620, after extra_info: 15740, after globalLock: 24790, after locks: 29380, after network: 29750, after opcounters: 29900, after opcountersRepl: 29900, after repl: 37570, after storageEngine: 42000, after tcmalloc: 43150, after wiredTiger: 61700, at end: 70710 } 2016-04-18T05:48:15.565+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:48:21.344+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:48:22.407+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 305ms 2016-04-18T05:48:27.803+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2876ms 2016-04-18T05:48:29.199+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:48:33.552+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T05:49:03.202+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:49:21.899+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:49:44.591+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-04-18T05:49:51.379+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:49:54.348+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 460ms 2016-04-18T05:50:06.274+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T05:50:11.845+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:50:13.144+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1160, after asserts: 4210, after connections: 4630, after extra_info: 9900, after globalLock: 12080, after locks: 14410, after network: 16590, after opcounters: 17530, after opcountersRepl: 17530, after repl: 23560, after storageEngine: 25540, after tcmalloc: 29480, after wiredTiger: 39500, at end: 57550 } 2016-04-18T05:51:04.941+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:51:16.139+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 198ms 2016-04-18T05:51:21.561+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:51:21.629+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:51:28.891+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 315ms 2016-04-18T05:51:40.759+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-04-18T05:51:50.690+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 4195ms 2016-04-18T05:52:15.159+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:52:30.282+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2950, after asserts: 4020, after connections: 5300, after extra_info: 7910, after globalLock: 10410, after locks: 11850, after network: 12130, after opcounters: 12130, after opcountersRepl: 12130, after repl: 15540, after storageEngine: 18350, after tcmalloc: 22480, after wiredTiger: 28050, at end: 36810 } 2016-04-18T05:52:30.400+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:52:58.389+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:52:58.130+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1159ms 2016-04-18T05:53:22.190+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:53:45.777+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:54:08.163+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 265ms 2016-04-18T05:54:19.386+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1589ms 2016-04-18T05:54:20.608+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:54:27.292+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 116ms 2016-04-18T05:54:36.470+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T05:54:52.220+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:54:59.089+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5180, after asserts: 7660, after connections: 10040, after extra_info: 12800, after globalLock: 14200, after locks: 18950, after network: 21150, after opcounters: 21840, after opcountersRepl: 21840, after repl: 29530, after storageEngine: 35840, after tcmalloc: 40260, after wiredTiger: 49740, at end: 65360 } 2016-04-18T05:55:29.013+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 158ms 2016-04-18T05:55:32.254+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:55:42.804+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 116ms 2016-04-18T05:55:47.115+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:55:50.369+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T05:56:22.888+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:56:30.956+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:56:36.180+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:56:56.411+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:57:02.394+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 783ms 2016-04-18T05:57:10.084+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:57:11.988+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1010ms 2016-04-18T05:57:28.127+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1242ms 2016-04-18T05:57:28.127+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4350, after asserts: 7370, after connections: 9250, after extra_info: 12940, after globalLock: 13660, after locks: 14640, after network: 15410, after opcounters: 18100, after opcountersRepl: 18190, after repl: 25080, after storageEngine: 27750, after tcmalloc: 31050, after wiredTiger: 48460, at end: 55980 } 2016-04-18T05:57:48.051+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:58:12.192+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:58:38.001+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 254ms 2016-04-18T05:58:41.093+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:58:45.682+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T05:58:46.479+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 291ms 2016-04-18T05:58:57.567+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:58:57.790+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 130ms 2016-04-18T05:59:39.368+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T05:59:53.604+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T05:59:59.757+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4240, after asserts: 6980, after connections: 11610, after extra_info: 19720, after globalLock: 21480, after locks: 21480, after network: 22260, after opcounters: 22410, after opcountersRepl: 22410, after repl: 44980, after storageEngine: 47510, after tcmalloc: 54060, after wiredTiger: 70540, at end: 87810 } 2016-04-18T06:00:04.955+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 172ms 2016-04-18T06:00:18.807+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 335ms 2016-04-18T06:00:33.059+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1129ms 2016-04-18T06:00:43.177+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:01:00.816+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:01:41.499+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:01:48.495+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:01:50.836+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 522ms 2016-04-18T06:01:56.151+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:02:02.099+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1545ms 2016-04-18T06:02:11.881+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 175ms 2016-04-18T06:02:27.122+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:02:51.059+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3580, after asserts: 5390, after connections: 8690, after extra_info: 13790, after globalLock: 15030, after locks: 15330, after network: 15480, after opcounters: 16370, after opcountersRepl: 16370, after repl: 48650, after storageEngine: 51280, after tcmalloc: 56380, after wiredTiger: 68250, at end: 74720 } 2016-04-18T06:02:51.059+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:03:17.072+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:03:22.723+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 274ms 2016-04-18T06:03:32.358+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 895ms 2016-04-18T06:03:37.461+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T06:04:02.188+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:04:16.971+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:04:21.184+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:04:46.812+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 257ms 2016-04-18T06:04:59.541+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:05:01.118+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 205ms 2016-04-18T06:05:18.948+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:05:33.940+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2010, after asserts: 3840, after connections: 5720, after extra_info: 8460, after globalLock: 8520, after locks: 9930, after network: 10690, after opcounters: 10690, after opcountersRepl: 10690, after repl: 20170, after storageEngine: 22770, after tcmalloc: 29180, after wiredTiger: 46520, at end: 59300 } 2016-04-18T06:06:04.980+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 164ms 2016-04-18T06:06:18.786+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:06:18.462+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 512ms 2016-04-18T06:06:40.739+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:07:17.270+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:07:33.011+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:07:35.023+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 142ms 2016-04-18T06:07:36.672+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:07:50.576+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 289ms 2016-04-18T06:08:23.372+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:08:33.729+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2770, after asserts: 3790, after connections: 5430, after extra_info: 10930, after globalLock: 14680, after locks: 17130, after network: 17750, after opcounters: 20220, after opcountersRepl: 21220, after repl: 59910, after storageEngine: 64140, after tcmalloc: 67640, after wiredTiger: 77780, at end: 90770 } 2016-04-18T06:08:44.762+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:08:57.801+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T06:09:10.310+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1200ms 2016-04-18T06:09:20.475+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 103ms 2016-04-18T06:09:23.837+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:09:41.576+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:10:07.660+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:10:28.892+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 325ms 2016-04-18T06:10:32.708+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:10:44.867+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 373ms 2016-04-18T06:10:52.568+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 218ms 2016-04-18T06:10:58.780+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:11:20.005+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:11:36.067+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:11:36.729+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2750, after asserts: 4920, after connections: 6780, after extra_info: 10170, after globalLock: 12390, after locks: 12960, after network: 15360, after opcounters: 17600, after opcountersRepl: 19090, after repl: 49710, after storageEngine: 51400, after tcmalloc: 54260, after wiredTiger: 56700, at end: 68130 } 2016-04-18T06:11:54.286+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:12:03.462+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 662ms 2016-04-18T06:12:07.404+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1219ms 2016-04-18T06:12:13.254+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 371ms 2016-04-18T06:12:29.088+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:12:50.029+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:13:16.676+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 523ms 2016-04-18T06:13:21.952+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:13:31.623+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:13:32.083+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:14:02.486+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:14:09.242+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4110, after asserts: 5750, after connections: 5950, after extra_info: 12630, after globalLock: 13020, after locks: 13020, after network: 13020, after opcounters: 13020, after opcountersRepl: 13020, after repl: 36340, after storageEngine: 38350, after tcmalloc: 43150, after wiredTiger: 47530, at end: 56800 } 2016-04-18T06:14:15.805+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:14:25.358+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 316ms 2016-04-18T06:14:33.123+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 779ms 2016-04-18T06:14:41.569+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 252ms 2016-04-18T06:14:55.819+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 20426ms 2016-04-18T06:14:56.054+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:15:06.456+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:15:35.387+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:15:35.930+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:15:50.260+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 253ms 2016-04-18T06:15:51.399+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:16:09.432+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:16:16.182+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1750, after asserts: 4000, after connections: 7030, after extra_info: 11370, after globalLock: 15120, after locks: 15290, after network: 15290, after opcounters: 15290, after opcountersRepl: 15290, after repl: 20630, after storageEngine: 22450, after tcmalloc: 25610, after wiredTiger: 30270, at end: 37270 } 2016-04-18T06:16:19.864+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:16:46.998+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:16:53.855+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 566ms 2016-04-18T06:16:55.179+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:17:18.501+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:17:31.079+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:17:57.155+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 285ms 2016-04-18T06:17:57.798+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:17:58.838+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 299ms 2016-04-18T06:18:06.974+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1213ms 2016-04-18T06:18:11.886+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:18:12.901+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:18:21.709+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1850, after asserts: 3430, after connections: 3430, after extra_info: 6940, after globalLock: 11350, after locks: 12200, after network: 13350, after opcounters: 14050, after opcountersRepl: 14420, after repl: 28240, after storageEngine: 34270, after tcmalloc: 40970, after wiredTiger: 49460, at end: 59930 } 2016-04-18T06:18:27.332+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T06:18:49.231+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:19:20.583+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-04-18T06:19:25.926+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:19:26.580+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 106ms 2016-04-18T06:19:26.724+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 144ms 2016-04-18T06:19:45.497+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:20:03.928+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:20:13.569+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:20:27.986+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 209ms 2016-04-18T06:20:42.071+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:20:55.803+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1410, after asserts: 3970, after connections: 5330, after extra_info: 7860, after globalLock: 9480, after locks: 11650, after network: 12830, after opcounters: 15990, after opcountersRepl: 18100, after repl: 38190, after storageEngine: 45190, after tcmalloc: 49360, after wiredTiger: 60840, at end: 67830 } 2016-04-18T06:20:57.990+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:21:30.764+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:21:43.069+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 343ms 2016-04-18T06:21:46.383+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1521ms 2016-04-18T06:21:55.775+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:22:01.088+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 153ms 2016-04-18T06:22:31.757+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:22:45.351+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:22:45.452+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:23:11.271+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 223ms 2016-04-18T06:23:17.026+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4640, after asserts: 6200, after connections: 10690, after extra_info: 14030, after globalLock: 15830, after locks: 16090, after network: 16370, after opcounters: 16370, after opcountersRepl: 16370, after repl: 27390, after storageEngine: 28870, after tcmalloc: 29560, after wiredTiger: 40490, at end: 51830 } 2016-04-18T06:23:20.446+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:23:23.948+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 563ms 2016-04-18T06:23:31.353+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 167ms 2016-04-18T06:23:36.896+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:24:18.536+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:24:38.789+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:24:48.077+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 149ms 2016-04-18T06:24:56.261+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 385ms 2016-04-18T06:25:03.675+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 116ms 2016-04-18T06:25:23.848+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:25:36.959+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:26:12.344+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 556ms 2016-04-18T06:26:16.334+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:26:16.701+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 482ms 2016-04-18T06:26:17.117+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 260ms 2016-04-18T06:26:25.605+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:26:29.905+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1560, after asserts: 2400, after connections: 6220, after extra_info: 14280, after globalLock: 16800, after locks: 19770, after network: 21390, after opcounters: 21390, after opcountersRepl: 21390, after repl: 48580, after storageEngine: 53530, after tcmalloc: 56140, after wiredTiger: 64910, at end: 77940 } 2016-04-18T06:26:54.920+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T06:27:19.618+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 211ms 2016-04-18T06:27:21.030+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 142ms 2016-04-18T06:27:24.771+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:28:01.397+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:28:21.252+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:28:22.665+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 372ms 2016-04-18T06:28:38.950+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2146ms 2016-04-18T06:28:48.894+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 138ms 2016-04-18T06:28:55.790+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:29:08.595+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:29:14.488+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:29:21.713+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5480, after asserts: 9720, after connections: 12770, after extra_info: 15680, after globalLock: 21680, after locks: 23140, after network: 23770, after opcounters: 23770, after opcountersRepl: 23770, after repl: 28170, after storageEngine: 30720, after tcmalloc: 35140, after wiredTiger: 45290, at end: 62080 } 2016-04-18T06:29:48.680+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T06:29:57.398+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T06:30:08.282+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1058ms 2016-04-18T06:30:23.429+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 883ms 2016-04-18T06:30:36.293+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:31:02.297+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:31:34.764+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 218ms 2016-04-18T06:31:38.280+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:31:45.870+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 595ms 2016-04-18T06:31:47.036+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 463ms 2016-04-18T06:32:00.385+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:32:14.387+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:32:36.240+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T06:32:56.535+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3940, after asserts: 4430, after connections: 5400, after extra_info: 8820, after globalLock: 11590, after locks: 12760, after network: 12870, after opcounters: 12870, after opcountersRepl: 12870, after repl: 36580, after storageEngine: 41830, after tcmalloc: 48380, after wiredTiger: 56760, at end: 70190 } 2016-04-18T06:32:56.535+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:33:00.878+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 312ms 2016-04-18T06:33:41.515+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:33:52.736+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:34:11.880+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-18T06:34:28.682+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 760ms 2016-04-18T06:34:30.184+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:34:51.654+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:35:17.815+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:35:44.322+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 181ms 2016-04-18T06:35:44.322+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T06:35:51.384+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 641ms 2016-04-18T06:36:08.240+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:36:11.093+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2490, after asserts: 4060, after connections: 5160, after extra_info: 15330, after globalLock: 19200, after locks: 22550, after network: 23190, after opcounters: 23370, after opcountersRepl: 23370, after repl: 61430, after storageEngine: 64690, after tcmalloc: 69000, after wiredTiger: 90330, at end: 101380 } 2016-04-18T06:36:11.093+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1139ms 2016-04-18T06:36:27.505+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:37:20.390+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 126ms 2016-04-18T06:37:28.280+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 890ms 2016-04-18T06:37:28.494+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:37:37.595+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:37:39.084+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T06:37:53.366+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:38:24.475+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:38:47.450+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 165ms 2016-04-18T06:38:53.367+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:38:54.105+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1220, after asserts: 2670, after connections: 3780, after extra_info: 9210, after globalLock: 10470, after locks: 13450, after network: 14280, after opcounters: 14280, after opcountersRepl: 14280, after repl: 26000, after storageEngine: 30040, after tcmalloc: 33590, after wiredTiger: 38740, at end: 50110 } 2016-04-18T06:39:00.310+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2276ms 2016-04-18T06:39:15.177+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 360ms 2016-04-18T06:39:48.062+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:40:08.452+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:40:39.206+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 101ms 2016-04-18T06:40:48.891+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:40:57.205+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 912ms 2016-04-18T06:41:04.568+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:41:05.632+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 177ms 2016-04-18T06:41:22.130+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:41:50.316+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T06:41:57.932+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:42:09.540+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4020, after asserts: 6380, after connections: 13190, after extra_info: 19940, after globalLock: 24420, after locks: 27480, after network: 28560, after opcounters: 28950, after opcountersRepl: 28950, after repl: 38580, after storageEngine: 41670, after tcmalloc: 50490, after wiredTiger: 56250, at end: 65860 } 2016-04-18T06:42:13.933+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 155ms 2016-04-18T06:42:16.666+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:42:29.334+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 548ms 2016-04-18T06:42:32.884+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 151ms 2016-04-18T06:43:11.121+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:43:39.987+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 131ms 2016-04-18T06:43:54.277+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1108ms 2016-04-18T06:43:55.572+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:43:58.072+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:44:07.233+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 153ms 2016-04-18T06:44:43.591+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:45:16.011+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 122ms 2016-04-18T06:45:19.468+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:45:24.434+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1345ms 2016-04-18T06:45:30.536+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 526ms 2016-04-18T06:46:06.125+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1830, after asserts: 3220, after connections: 3880, after extra_info: 15200, after globalLock: 16710, after locks: 18290, after network: 18550, after opcounters: 18550, after opcountersRepl: 18550, after repl: 50060, after storageEngine: 55530, after tcmalloc: 62820, after wiredTiger: 78140, at end: 97450 } 2016-04-18T06:46:08.619+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:46:15.714+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:46:42.889+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 143ms 2016-04-18T06:47:02.453+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 738ms 2016-04-18T06:47:15.145+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 144ms 2016-04-18T06:47:32.689+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:47:42.982+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:47:45.411+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:48:29.301+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:48:36.224+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3210ms 2016-04-18T06:48:44.597+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:48:52.133+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 734ms 2016-04-18T06:49:28.442+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:49:53.685+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:50:06.923+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3620, after asserts: 5870, after connections: 6960, after extra_info: 18490, after globalLock: 20930, after locks: 22530, after network: 23640, after opcounters: 26310, after opcountersRepl: 26940, after repl: 64160, after storageEngine: 67930, after tcmalloc: 73060, after wiredTiger: 81450, at end: 93980 } 2016-04-18T06:50:33.734+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:51:02.446+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 108ms 2016-04-18T06:51:07.314+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:51:12.388+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 374ms 2016-04-18T06:51:17.710+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 145ms 2016-04-18T06:51:28.533+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:51:59.155+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T06:52:28.509+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:52:37.619+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 150ms 2016-04-18T06:52:53.365+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2128ms 2016-04-18T06:53:01.493+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1236ms 2016-04-18T06:53:04.687+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:53:27.864+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:53:53.551+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:53:56.720+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1420, after asserts: 3470, after connections: 7370, after extra_info: 11370, after globalLock: 15610, after locks: 18300, after network: 19020, after opcounters: 19020, after opcountersRepl: 19020, after repl: 49620, after storageEngine: 55120, after tcmalloc: 59950, after wiredTiger: 77710, at end: 95070 } 2016-04-18T06:54:05.046+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 107ms 2016-04-18T06:54:19.946+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 479ms 2016-04-18T06:54:30.154+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 154ms 2016-04-18T06:54:44.339+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:54:49.376+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:55:13.468+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T06:55:34.875+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 146ms 2016-04-18T06:55:46.550+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2711ms 2016-04-18T06:55:48.909+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:55:55.649+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 302ms 2016-04-18T06:56:03.373+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:56:38.836+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:57:03.299+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:57:09.523+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2295ms 2016-04-18T06:57:23.749+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 871ms 2016-04-18T06:57:42.966+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3480, after asserts: 6770, after connections: 11300, after extra_info: 16870, after globalLock: 24210, after locks: 26540, after network: 29490, after opcounters: 32130, after opcountersRepl: 32820, after repl: 61400, after storageEngine: 71590, after tcmalloc: 79710, after wiredTiger: 89300, at end: 103340 } 2016-04-18T06:57:48.710+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:58:02.895+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T06:58:08.234+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:58:44.833+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 231ms 2016-04-18T06:59:02.172+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T06:59:08.714+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3155ms 2016-04-18T06:59:17.329+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T06:59:19.555+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:00:08.125+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:00:24.370+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:00:35.982+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 456ms 2016-04-18T07:00:40.620+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4100, after asserts: 5040, after connections: 6150, after extra_info: 9610, after globalLock: 10410, after locks: 13210, after network: 14880, after opcounters: 15180, after opcountersRepl: 15180, after repl: 34990, after storageEngine: 38070, after tcmalloc: 45800, after wiredTiger: 53950, at end: 72370 } 2016-04-18T07:00:40.784+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 118ms 2016-04-18T07:01:04.500+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:01:16.534+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:01:16.721+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:01:45.494+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3409ms 2016-04-18T07:01:45.793+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:01:47.516+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 125ms 2016-04-18T07:02:01.426+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:02:24.911+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:02:57.925+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 347ms 2016-04-18T07:03:06.452+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:03:08.561+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2637ms 2016-04-18T07:03:16.971+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 240ms 2016-04-18T07:03:19.036+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:03:38.156+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2100, after asserts: 4760, after connections: 11680, after extra_info: 23760, after globalLock: 26950, after locks: 34530, after network: 41600, after opcounters: 42280, after opcountersRepl: 42280, after repl: 52500, after storageEngine: 54930, after tcmalloc: 64480, after wiredTiger: 74710, at end: 81650 } 2016-04-18T07:04:01.576+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:04:25.594+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 178ms 2016-04-18T07:04:33.969+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:04:35.250+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 545ms 2016-04-18T07:04:35.564+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 272ms 2016-04-18T07:04:38.017+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:04:54.936+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:05:22.137+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:05:38.028+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 386ms 2016-04-18T07:05:48.019+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 234ms 2016-04-18T07:05:52.783+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 102ms 2016-04-18T07:06:13.330+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:06:30.329+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3690, after asserts: 6130, after connections: 8710, after extra_info: 13850, after globalLock: 17360, after locks: 22930, after network: 27060, after opcounters: 29130, after opcountersRepl: 29420, after repl: 43870, after storageEngine: 45680, after tcmalloc: 51530, after wiredTiger: 58830, at end: 68140 } 2016-04-18T07:06:34.878+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:06:59.187+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 115ms 2016-04-18T07:07:07.647+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 927ms 2016-04-18T07:07:09.483+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:07:09.812+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T07:07:21.039+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:07:33.825+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:07:59.581+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T07:08:11.676+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-04-18T07:08:18.113+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:08:21.813+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3005ms 2016-04-18T07:08:30.346+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1172ms 2016-04-18T07:08:50.818+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:09:01.075+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:09:21.358+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5310, after asserts: 10850, after connections: 13360, after extra_info: 19040, after globalLock: 21460, after locks: 23120, after network: 24310, after opcounters: 24310, after opcountersRepl: 24310, after repl: 36120, after storageEngine: 41550, after tcmalloc: 47630, after wiredTiger: 56880, at end: 70390 } 2016-04-18T07:09:36.167+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 350ms 2016-04-18T07:09:51.801+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 451ms 2016-04-18T07:10:02.506+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 119ms 2016-04-18T07:10:07.324+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:10:33.391+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:10:42.142+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:11:10.658+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T07:11:16.106+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 167ms 2016-04-18T07:11:16.596+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 154ms 2016-04-18T07:11:18.568+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:11:50.463+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:12:12.681+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2390, after asserts: 4090, after connections: 6630, after extra_info: 9190, after globalLock: 10720, after locks: 11020, after network: 11780, after opcounters: 12810, after opcountersRepl: 12810, after repl: 32260, after storageEngine: 37270, after tcmalloc: 38290, after wiredTiger: 40310, at end: 56340 } 2016-04-18T07:12:15.405+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:12:21.910+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 4635ms 2016-04-18T07:12:35.205+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:13:07.084+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:13:26.358+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:13:30.875+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 125ms 2016-04-18T07:13:30.875+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:13:55.074+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:14:09.188+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:14:34.360+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T07:14:40.906+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:14:42.919+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 244ms 2016-04-18T07:14:52.174+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:15:05.314+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3520, after asserts: 5130, after connections: 7240, after extra_info: 11320, after globalLock: 13900, after locks: 15120, after network: 18310, after opcounters: 19570, after opcountersRepl: 19570, after repl: 39560, after storageEngine: 40270, after tcmalloc: 43560, after wiredTiger: 50800, at end: 66070 } 2016-04-18T07:15:35.530+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:15:45.503+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 448ms 2016-04-18T07:15:45.557+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:15:46.813+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:15:52.362+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1236ms 2016-04-18T07:16:33.708+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:16:54.033+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:17:06.126+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 184ms 2016-04-18T07:17:08.643+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:17:14.417+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2532ms 2016-04-18T07:17:58.545+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:18:19.088+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:18:19.088+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 584ms 2016-04-18T07:18:20.836+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6030, after asserts: 6950, after connections: 7570, after extra_info: 9790, after globalLock: 10150, after locks: 11230, after network: 13170, after opcounters: 13300, after opcountersRepl: 13300, after repl: 21840, after storageEngine: 33110, after tcmalloc: 35500, after wiredTiger: 47940, at end: 58630 } 2016-04-18T07:18:33.870+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 4159ms 2016-04-18T07:18:59.064+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:19:02.029+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:19:29.699+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:19:46.431+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:19:53.809+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 439ms 2016-04-18T07:20:16.558+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 5547ms 2016-04-18T07:20:28.819+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:20:33.157+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 377ms 2016-04-18T07:20:56.074+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:21:27.630+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:21:58.740+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T07:22:04.189+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 776ms 2016-04-18T07:22:19.311+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:22:28.825+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2400, after asserts: 3340, after connections: 12940, after extra_info: 21970, after globalLock: 28130, after locks: 30340, after network: 33850, after opcounters: 35440, after opcountersRepl: 35830, after repl: 87260, after storageEngine: 88580, after tcmalloc: 92180, after wiredTiger: 100230, at end: 117040 } 2016-04-18T07:22:28.881+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:22:33.995+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:23:00.184+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 5183ms 2016-04-18T07:23:07.663+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 316ms 2016-04-18T07:23:16.235+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2313ms 2016-04-18T07:23:27.043+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 187ms 2016-04-18T07:23:27.331+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:23:46.404+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:24:38.903+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 540ms 2016-04-18T07:24:39.348+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:24:45.206+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 775ms 2016-04-18T07:24:54.678+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:25:40.410+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:25:46.886+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-04-18T07:25:48.340+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 744ms 2016-04-18T07:26:09.801+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:26:10.002+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6190, after asserts: 8250, after connections: 12610, after extra_info: 25460, after globalLock: 27150, after locks: 27930, after network: 28130, after opcounters: 28610, after opcountersRepl: 28610, after repl: 61570, after storageEngine: 69830, after tcmalloc: 71970, after wiredTiger: 86010, at end: 105130 } 2016-04-18T07:26:24.544+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:26:40.931+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:26:52.661+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 375ms 2016-04-18T07:27:17.725+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 754ms 2016-04-18T07:27:20.018+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:27:31.082+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:28:18.287+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:28:26.382+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 901ms 2016-04-18T07:28:29.077+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:28:37.579+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 559ms 2016-04-18T07:28:49.584+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 172ms 2016-04-18T07:29:08.727+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:29:20.404+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:29:32.938+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4420, after asserts: 6440, after connections: 7360, after extra_info: 10610, after globalLock: 16610, after locks: 18670, after network: 18930, after opcounters: 19510, after opcountersRepl: 19510, after repl: 47800, after storageEngine: 49320, after tcmalloc: 53200, after wiredTiger: 72170, at end: 81840 } 2016-04-18T07:29:54.062+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:29:57.050+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 538ms 2016-04-18T07:30:01.549+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1982ms 2016-04-18T07:30:03.694+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:30:07.694+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:30:12.604+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 137ms 2016-04-18T07:30:54.196+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:31:08.310+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:31:27.680+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 183ms 2016-04-18T07:31:29.350+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 145ms 2016-04-18T07:31:29.522+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 171ms 2016-04-18T07:31:48.158+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:32:10.104+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:32:31.809+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 176ms 2016-04-18T07:32:33.336+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 900, after asserts: 4570, after connections: 7200, after extra_info: 9450, after globalLock: 10100, after locks: 10100, after network: 10100, after opcounters: 10100, after opcountersRepl: 10100, after repl: 20970, after storageEngine: 26530, after tcmalloc: 31780, after wiredTiger: 47540, at end: 63160 } 2016-04-18T07:32:41.260+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1127ms 2016-04-18T07:32:41.480+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:32:50.379+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:33:10.389+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:33:42.759+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 127ms 2016-04-18T07:33:43.504+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:33:51.579+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 505ms 2016-04-18T07:33:56.974+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 216ms 2016-04-18T07:34:03.111+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:34:56.345+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:34:58.578+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 113ms 2016-04-18T07:35:04.809+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3149ms 2016-04-18T07:35:14.432+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:35:19.534+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 835ms 2016-04-18T07:35:59.540+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:36:07.986+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:36:26.514+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2510, after asserts: 6180, after connections: 6550, after extra_info: 8950, after globalLock: 14250, after locks: 17420, after network: 19510, after opcounters: 19760, after opcountersRepl: 19760, after repl: 61060, after storageEngine: 66620, after tcmalloc: 68820, after wiredTiger: 80750, at end: 106580 } 2016-04-18T07:36:27.016+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 332ms 2016-04-18T07:36:27.184+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:36:37.561+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1099ms 2016-04-18T07:36:41.911+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1309ms 2016-04-18T07:37:16.736+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:37:44.275+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:37:54.006+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 177ms 2016-04-18T07:38:13.429+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 270ms 2016-04-18T07:38:22.561+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:38:23.317+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 152ms 2016-04-18T07:38:45.292+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:39:19.630+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 1850, after connections: 4440, after extra_info: 10900, after globalLock: 15200, after locks: 18060, after network: 20030, after opcounters: 25130, after opcountersRepl: 26680, after repl: 42100, after storageEngine: 45490, after tcmalloc: 49470, after wiredTiger: 55890, at end: 70830 } 2016-04-18T07:39:20.154+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:39:40.466+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 265ms 2016-04-18T07:39:42.483+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:39:43.957+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 427ms 2016-04-18T07:39:48.963+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 422ms 2016-04-18T07:40:01.431+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:40:23.785+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T07:40:44.629+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:41:02.513+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 397ms 2016-04-18T07:41:02.868+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:41:14.485+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:41:26.811+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:41:33.041+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1570, after asserts: 4010, after connections: 4770, after extra_info: 6690, after globalLock: 7060, after locks: 7060, after network: 7060, after opcounters: 7060, after opcountersRepl: 7060, after repl: 13880, after storageEngine: 16720, after tcmalloc: 18000, after wiredTiger: 24470, at end: 32120 } 2016-04-18T07:41:39.108+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:41:55.635+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:41:58.515+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:42:05.835+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 149ms 2016-04-18T07:42:13.584+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:42:31.450+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:42:48.911+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:43:02.734+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:43:15.553+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 123ms 2016-04-18T07:43:32.988+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 176ms 2016-04-18T07:43:34.113+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:43:40.233+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 504ms 2016-04-18T07:43:42.151+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:44:06.632+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:44:09.190+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:44:26.059+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4870, after asserts: 9550, after connections: 9980, after extra_info: 16880, after globalLock: 19590, after locks: 20620, after network: 21130, after opcounters: 21130, after opcountersRepl: 21130, after repl: 34310, after storageEngine: 37160, after tcmalloc: 39520, after wiredTiger: 49640, at end: 61800 } 2016-04-18T07:44:29.602+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T07:44:46.145+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 169ms 2016-04-18T07:44:47.991+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 139ms 2016-04-18T07:44:48.192+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:45:21.824+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:45:42.438+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:45:49.544+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 218ms 2016-04-18T07:46:02.815+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1627ms 2016-04-18T07:46:08.447+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:46:08.952+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 256ms 2016-04-18T07:46:17.605+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:46:20.309+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:46:42.420+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:46:48.351+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2270, after asserts: 2770, after connections: 3670, after extra_info: 7890, after globalLock: 8050, after locks: 8050, after network: 8050, after opcounters: 8050, after opcountersRepl: 8050, after repl: 21100, after storageEngine: 22320, after tcmalloc: 26120, after wiredTiger: 29640, at end: 39970 } 2016-04-18T07:46:50.457+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:47:10.793+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 131ms 2016-04-18T07:47:16.617+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1223ms 2016-04-18T07:47:31.226+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:47:45.210+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:48:16.024+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:48:24.447+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 464ms 2016-04-18T07:48:27.930+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 551ms 2016-04-18T07:48:33.172+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:48:38.553+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3570, after asserts: 5190, after connections: 5440, after extra_info: 12710, after globalLock: 14320, after locks: 14470, after network: 14560, after opcounters: 14560, after opcountersRepl: 14560, after repl: 32270, after storageEngine: 36660, after tcmalloc: 40720, after wiredTiger: 47410, at end: 49270 } 2016-04-18T07:48:40.296+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:49:07.835+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:49:11.514+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:49:36.997+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 271ms 2016-04-18T07:49:37.418+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:49:44.796+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 195ms 2016-04-18T07:49:58.203+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 171ms 2016-04-18T07:50:01.582+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:50:31.050+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:50:39.446+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:50:52.066+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:50:58.959+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 7490, after asserts: 8240, after connections: 10310, after extra_info: 14250, after globalLock: 16830, after locks: 17740, after network: 18250, after opcounters: 18250, after opcountersRepl: 18250, after repl: 24380, after storageEngine: 26730, after tcmalloc: 28190, after wiredTiger: 33120, at end: 49990 } 2016-04-18T07:51:05.620+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 252ms 2016-04-18T07:51:15.149+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 663ms 2016-04-18T07:51:29.558+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 119ms 2016-04-18T07:51:29.238+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:51:42.190+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:52:16.237+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:52:31.590+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:52:36.456+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 254ms 2016-04-18T07:52:42.015+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 203ms 2016-04-18T07:52:49.014+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 244ms 2016-04-18T07:52:56.249+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1670, after asserts: 4250, after connections: 8380, after extra_info: 11000, after globalLock: 13550, after locks: 14160, after network: 15580, after opcounters: 17120, after opcountersRepl: 17120, after repl: 32710, after storageEngine: 35990, after tcmalloc: 39800, after wiredTiger: 47240, at end: 57260 } 2016-04-18T07:53:01.140+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:53:12.374+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:53:15.889+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:53:42.180+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T07:53:51.366+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1378ms 2016-04-18T07:53:54.802+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1580ms 2016-04-18T07:53:55.635+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:53:58.829+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 216ms 2016-04-18T07:54:29.343+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:54:41.094+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:55:03.923+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 166ms 2016-04-18T07:55:07.211+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:55:15.422+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3547ms 2016-04-18T07:55:24.873+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:55:33.255+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2660, after asserts: 4430, after connections: 12450, after extra_info: 19440, after globalLock: 21330, after locks: 22410, after network: 24680, after opcounters: 26680, after opcountersRepl: 29300, after repl: 43510, after storageEngine: 47480, after tcmalloc: 51300, after wiredTiger: 60120, at end: 72610 } 2016-04-18T07:55:42.540+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:56:12.014+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T07:56:18.938+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 813ms 2016-04-18T07:56:28.590+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1309ms 2016-04-18T07:56:32.010+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:56:33.116+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 346ms 2016-04-18T07:57:12.434+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:57:33.971+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:57:49.037+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 120ms 2016-04-18T07:57:57.893+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:58:01.450+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2203ms 2016-04-18T07:58:05.329+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 876ms 2016-04-18T07:58:23.263+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T07:58:31.003+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T07:58:31.978+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5260, after asserts: 6870, after connections: 7490, after extra_info: 11630, after globalLock: 16210, after locks: 18250, after network: 18620, after opcounters: 18620, after opcountersRepl: 18620, after repl: 36000, after storageEngine: 41780, after tcmalloc: 44960, after wiredTiger: 64380, at end: 75960 } 2016-04-18T07:58:45.856+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T07:59:17.086+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 113ms 2016-04-18T07:59:27.755+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1222ms 2016-04-18T07:59:48.923+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 338ms 2016-04-18T07:59:49.009+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:00:17.888+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:00:50.298+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:01:00.819+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1025ms 2016-04-18T08:01:09.767+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:01:40.278+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:01:49.583+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:01:51.742+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:02:09.789+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4580, after asserts: 7510, after connections: 7980, after extra_info: 11430, after globalLock: 15030, after locks: 18970, after network: 21210, after opcounters: 21800, after opcountersRepl: 21800, after repl: 40100, after storageEngine: 42580, after tcmalloc: 44320, after wiredTiger: 53470, at end: 73680 } 2016-04-18T08:02:40.754+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:02:48.777+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:03:08.541+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 175ms 2016-04-18T08:03:17.066+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2685ms 2016-04-18T08:03:28.917+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 556ms 2016-04-18T08:03:34.748+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:03:54.840+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:04:38.566+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2206ms 2016-04-18T08:04:39.724+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:04:53.536+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 490ms 2016-04-18T08:05:02.443+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:05:02.960+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 333ms 2016-04-18T08:05:03.831+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2970, after asserts: 4620, after connections: 8550, after extra_info: 16490, after globalLock: 18650, after locks: 22710, after network: 24890, after opcounters: 26530, after opcountersRepl: 26670, after repl: 53120, after storageEngine: 57480, after tcmalloc: 69080, after wiredTiger: 74660, at end: 89270 } 2016-04-18T08:05:10.073+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:05:51.065+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:06:12.604+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:06:18.309+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 154ms 2016-04-18T08:06:29.445+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 468ms 2016-04-18T08:06:46.797+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 273ms 2016-04-18T08:07:03.612+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:07:20.429+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:07:47.478+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:08:09.582+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 717ms 2016-04-18T08:08:10.260+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3170, after asserts: 5100, after connections: 5540, after extra_info: 12280, after globalLock: 17810, after locks: 19830, after network: 19990, after opcounters: 19990, after opcountersRepl: 19990, after repl: 25380, after storageEngine: 28820, after tcmalloc: 35600, after wiredTiger: 45560, at end: 58410 } 2016-04-18T08:08:18.723+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1484ms 2016-04-18T08:08:23.606+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:08:41.569+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:09:23.580+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:09:34.319+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 177ms 2016-04-18T08:09:48.845+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 297ms 2016-04-18T08:09:49.414+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:09:59.658+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 208ms 2016-04-18T08:10:45.078+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:11:06.045+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:11:15.845+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 206ms 2016-04-18T08:11:38.522+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2929ms 2016-04-18T08:12:02.066+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:12:33.309+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1510, after asserts: 2460, after connections: 2700, after extra_info: 8110, after globalLock: 9270, after locks: 10310, after network: 11490, after opcounters: 11490, after opcountersRepl: 11490, after repl: 57940, after storageEngine: 60260, after tcmalloc: 67370, after wiredTiger: 89520, at end: 114770 } 2016-04-18T08:12:36.120+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:12:55.249+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2477ms 2016-04-18T08:13:01.080+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:13:13.584+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 748ms 2016-04-18T08:13:25.652+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T08:13:27.739+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 248ms 2016-04-18T08:13:57.153+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:14:46.270+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:14:53.495+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 186ms 2016-04-18T08:15:10.632+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 599ms 2016-04-18T08:15:18.376+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:15:28.468+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 349ms 2016-04-18T08:16:08.115+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:16:24.255+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:16:48.722+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6170, after asserts: 11620, after connections: 13520, after extra_info: 30870, after globalLock: 32020, after locks: 35190, after network: 35910, after opcounters: 35910, after opcountersRepl: 35910, after repl: 65110, after storageEngine: 71140, after tcmalloc: 80440, after wiredTiger: 88840, at end: 110410 } 2016-04-18T08:16:49.722+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 164ms 2016-04-18T08:17:12.468+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:17:13.048+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 549ms 2016-04-18T08:17:34.821+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 147ms 2016-04-18T08:17:58.351+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T08:19:02.813+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 130ms 2016-04-18T08:19:04.766+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:19:17.960+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 526ms 2016-04-18T08:19:29.788+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 176ms 2016-04-18T08:20:16.624+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:20:38.635+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-04-18T08:20:40.263+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:20:50.192+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1036ms 2016-04-18T08:21:42.717+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3420, after asserts: 5710, after connections: 11430, after extra_info: 32610, after globalLock: 39410, after locks: 41230, after network: 42300, after opcounters: 42480, after opcountersRepl: 42480, after repl: 91790, after storageEngine: 94630, after tcmalloc: 97570, after wiredTiger: 105570, at end: 124790 } 2016-04-18T08:21:42.012+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:21:44.841+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 8351ms 2016-04-18T08:21:57.502+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 242ms 2016-04-18T08:21:59.799+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:22:04.994+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 450ms 2016-04-18T08:22:13.801+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:22:17.583+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 321ms 2016-04-18T08:23:12.034+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:23:23.088+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 888ms 2016-04-18T08:23:29.483+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 664ms 2016-04-18T08:23:37.567+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 318ms 2016-04-18T08:23:41.179+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:24:38.581+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:24:51.483+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 179ms 2016-04-18T08:25:07.311+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 847ms 2016-04-18T08:25:07.048+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:25:19.547+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 495ms 2016-04-18T08:25:35.863+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:26:03.417+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3490, after asserts: 6500, after connections: 8600, after extra_info: 12990, after globalLock: 17900, after locks: 23210, after network: 24640, after opcounters: 24640, after opcountersRepl: 24640, after repl: 57830, after storageEngine: 69790, after tcmalloc: 76210, after wiredTiger: 92000, at end: 119180 } 2016-04-18T08:26:11.700+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:26:31.423+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 111ms 2016-04-18T08:26:54.193+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1685ms 2016-04-18T08:26:53.921+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:26:55.243+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:27:02.038+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 299ms 2016-04-18T08:28:07.005+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:28:17.298+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 354ms 2016-04-18T08:28:22.941+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:28:33.713+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 784ms 2016-04-18T08:28:50.260+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 330ms 2016-04-18T08:29:29.311+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:29:59.233+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:30:04.081+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-04-18T08:30:38.188+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 948ms 2016-04-18T08:30:53.242+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 476ms 2016-04-18T08:31:06.003+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:31:21.312+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:31:47.672+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5160, after asserts: 8300, after connections: 13830, after extra_info: 21070, after globalLock: 34020, after locks: 37860, after network: 39640, after opcounters: 40040, after opcountersRepl: 40040, after repl: 80980, after storageEngine: 98550, after tcmalloc: 110960, after wiredTiger: 129340, at end: 154850 } 2016-04-18T08:31:47.495+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:32:13.015+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 250ms 2016-04-18T08:32:30.076+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 871ms 2016-04-18T08:32:41.356+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T08:33:15.193+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:33:34.611+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T08:34:01.347+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 210ms 2016-04-18T08:34:12.899+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 709ms 2016-04-18T08:34:31.346+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:34:34.141+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 153ms 2016-04-18T08:34:55.094+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:35:37.617+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:35:42.689+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 172ms 2016-04-18T08:35:48.792+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1325ms 2016-04-18T08:35:54.351+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:35:54.500+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4550, after asserts: 6140, after connections: 6720, after extra_info: 11560, after globalLock: 15870, after locks: 18390, after network: 20060, after opcounters: 22200, after opcountersRepl: 22410, after repl: 55050, after storageEngine: 57370, after tcmalloc: 58330, after wiredTiger: 66240, at end: 78050 } 2016-04-18T08:35:56.088+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:36:51.017+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 253ms 2016-04-18T08:36:51.160+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:37:00.163+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T08:37:13.998+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:37:52.892+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:38:03.204+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 170ms 2016-04-18T08:38:16.442+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:38:16.924+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 8502ms 2016-04-18T08:38:31.868+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 178ms 2016-04-18T08:38:41.068+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4010, after asserts: 7280, after connections: 9520, after extra_info: 18500, after globalLock: 19990, after locks: 20010, after network: 20180, after opcounters: 20180, after opcountersRepl: 20180, after repl: 46060, after storageEngine: 49520, after tcmalloc: 53990, after wiredTiger: 63400, at end: 76490 } 2016-04-18T08:38:55.579+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:39:09.169+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:39:37.155+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:39:39.661+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 168ms 2016-04-18T08:39:52.470+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 4322ms 2016-04-18T08:39:57.990+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 127ms 2016-04-18T08:40:11.336+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:40:28.593+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:41:15.944+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1239ms 2016-04-18T08:41:19.834+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:41:22.244+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 472ms 2016-04-18T08:41:27.965+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 125ms 2016-04-18T08:41:57.338+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:42:13.817+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:42:22.925+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 9360, after asserts: 13850, after connections: 15120, after extra_info: 16350, after globalLock: 19440, after locks: 22760, after network: 30800, after opcounters: 32010, after opcountersRepl: 33230, after repl: 45380, after storageEngine: 48200, after tcmalloc: 50590, after wiredTiger: 57720, at end: 81230 } 2016-04-18T08:42:32.604+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 101ms 2016-04-18T08:42:47.102+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 265ms 2016-04-18T08:42:55.218+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:42:58.855+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-04-18T08:43:22.818+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:43:34.634+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:44:12.520+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 143ms 2016-04-18T08:44:21.598+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:44:29.940+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2303ms 2016-04-18T08:44:43.550+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 329ms 2016-04-18T08:44:58.370+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:45:14.036+0000 W NETWORK [HostnameCanonicalizationWorker] Failed to obtain address information for hostname ip-172-31-6-169: Name or service not known 2016-04-18T08:45:51.471+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 412ms 2016-04-18T08:45:52.640+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:46:02.061+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 518ms 2016-04-18T08:46:02.007+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3480, after asserts: 5020, after connections: 5920, after extra_info: 9590, after globalLock: 13780, after locks: 14790, after network: 16850, after opcounters: 17060, after opcountersRepl: 17060, after repl: 45160, after storageEngine: 49030, after tcmalloc: 53150, after wiredTiger: 64900, at end: 72800 } 2016-04-18T08:46:09.417+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:46:16.716+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 153ms 2016-04-18T08:46:49.439+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:47:04.526+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:47:18.627+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 265ms 2016-04-18T08:47:24.151+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 106ms 2016-04-18T08:47:26.046+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:47:30.765+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 190ms 2016-04-18T08:47:50.626+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T08:48:08.828+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:48:34.553+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-04-18T08:48:48.424+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 601ms 2016-04-18T08:48:53.434+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:48:56.807+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3400, after asserts: 5710, after connections: 6470, after extra_info: 15740, after globalLock: 17740, after locks: 19370, after network: 20330, after opcounters: 20330, after opcountersRepl: 20330, after repl: 54160, after storageEngine: 57120, after tcmalloc: 60900, after wiredTiger: 69030, at end: 75620 } 2016-04-18T08:48:59.277+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 177ms 2016-04-18T08:49:06.366+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:49:43.930+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:50:03.176+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:50:03.801+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1123ms 2016-04-18T08:50:17.061+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 502ms 2016-04-18T08:50:34.180+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:50:34.451+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 115ms 2016-04-18T08:50:37.864+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:50:40.659+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:51:08.399+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:51:25.656+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2120, after asserts: 3160, after connections: 3710, after extra_info: 7320, after globalLock: 9660, after locks: 12590, after network: 15110, after opcounters: 15340, after opcountersRepl: 15340, after repl: 24660, after storageEngine: 26660, after tcmalloc: 28390, after wiredTiger: 37880, at end: 51740 } 2016-04-18T08:51:32.142+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:51:46.609+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 154ms 2016-04-18T08:52:02.045+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1458ms 2016-04-18T08:52:13.397+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:52:13.939+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 177ms 2016-04-18T08:52:34.623+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:53:07.387+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:53:28.819+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:53:31.684+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:53:33.034+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 145ms 2016-04-18T08:53:41.956+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 437ms 2016-04-18T08:53:43.799+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 790ms 2016-04-18T08:54:08.706+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:54:16.784+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1950, after asserts: 3940, after connections: 6620, after extra_info: 16490, after globalLock: 18730, after locks: 19350, after network: 21530, after opcounters: 22220, after opcountersRepl: 22220, after repl: 39800, after storageEngine: 42110, after tcmalloc: 43840, after wiredTiger: 47460, at end: 60840 } 2016-04-18T08:54:34.615+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:54:54.462+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 368ms 2016-04-18T08:55:04.986+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 774ms 2016-04-18T08:55:12.444+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:55:18.180+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T08:55:27.549+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:55:43.709+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:56:23.820+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:56:28.646+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 406ms 2016-04-18T08:56:35.334+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:56:36.229+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2140ms 2016-04-18T08:56:38.609+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:56:41.920+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 712ms 2016-04-18T08:57:12.524+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:57:26.833+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4700, after asserts: 5240, after connections: 5640, after extra_info: 7830, after globalLock: 12060, after locks: 13260, after network: 16150, after opcounters: 18340, after opcountersRepl: 20400, after repl: 46630, after storageEngine: 47750, after tcmalloc: 51900, after wiredTiger: 62230, at end: 78170 } 2016-04-18T08:57:31.491+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T08:57:54.310+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 147ms 2016-04-18T08:58:00.131+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:58:05.092+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 397ms 2016-04-18T08:58:18.210+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-18T08:58:26.614+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:59:10.185+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:59:20.444+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 316ms 2016-04-18T08:59:22.749+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T08:59:32.182+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T08:59:31.187+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 4462ms 2016-04-18T08:59:40.359+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 416ms 2016-04-18T08:59:40.567+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2700, after asserts: 3190, after connections: 3680, after extra_info: 3890, after globalLock: 7660, after locks: 9610, after network: 9920, after opcounters: 9920, after opcountersRepl: 9920, after repl: 14450, after storageEngine: 19100, after tcmalloc: 23710, after wiredTiger: 39210, at end: 49270 } 2016-04-18T09:00:09.626+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:00:23.075+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T09:00:50.461+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 127ms 2016-04-18T09:01:15.869+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 970ms 2016-04-18T09:01:15.948+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:01:31.174+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:01:58.343+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:02:15.243+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:02:23.163+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2460, after asserts: 3670, after connections: 4200, after extra_info: 11360, after globalLock: 13060, after locks: 20520, after network: 26140, after opcounters: 29400, after opcountersRepl: 33270, after repl: 43020, after storageEngine: 46900, after tcmalloc: 51660, after wiredTiger: 63000, at end: 69960 } 2016-04-18T09:02:24.050+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 280ms 2016-04-18T09:02:31.660+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1683ms 2016-04-18T09:02:40.681+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T09:02:45.331+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 182ms 2016-04-18T09:03:05.478+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T09:03:24.813+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:03:59.335+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 374ms 2016-04-18T09:04:03.267+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:04:07.839+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 658ms 2016-04-18T09:04:24.233+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:04:55.781+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:04:57.737+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 890, after asserts: 1600, after connections: 2890, after extra_info: 5100, after globalLock: 8080, after locks: 11420, after network: 15640, after opcounters: 16230, after opcountersRepl: 16230, after repl: 32220, after storageEngine: 35650, after tcmalloc: 41010, after wiredTiger: 48370, at end: 51780 } 2016-04-18T09:05:02.579+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:05:13.324+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T09:05:17.626+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 819ms 2016-04-18T09:05:32.820+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 169ms 2016-04-18T09:05:32.534+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T09:05:49.687+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:06:09.722+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T09:06:44.040+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 155ms 2016-04-18T09:06:47.879+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:06:52.401+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 618ms 2016-04-18T09:06:56.389+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:07:00.602+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1132ms 2016-04-18T09:07:19.303+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5040, after asserts: 6170, after connections: 7880, after extra_info: 11400, after globalLock: 11690, after locks: 11690, after network: 12090, after opcounters: 16880, after opcountersRepl: 18000, after repl: 27200, after storageEngine: 27490, after tcmalloc: 31380, after wiredTiger: 39620, at end: 54490 } 2016-04-18T09:07:23.345+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:07:40.723+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:08:01.775+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T09:08:18.617+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 868ms 2016-04-18T09:08:31.627+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 404ms 2016-04-18T09:08:32.195+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:08:43.444+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 221ms 2016-04-18T09:08:50.964+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T09:09:29.523+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:09:50.514+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-04-18T09:09:51.308+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 104ms 2016-04-18T09:09:52.254+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:10:05.843+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1006ms 2016-04-18T09:10:39.880+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:10:49.705+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3600, after asserts: 4990, after connections: 5700, after extra_info: 7570, after globalLock: 7680, after locks: 8960, after network: 10320, after opcounters: 10610, after opcountersRepl: 10610, after repl: 46400, after storageEngine: 48980, after tcmalloc: 53560, after wiredTiger: 65440, at end: 79650 } 2016-04-18T09:10:54.536+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:11:16.377+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-04-18T09:11:17.739+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T09:11:18.629+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 101ms 2016-04-18T09:11:22.184+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1510ms 2016-04-18T09:11:37.491+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T09:11:59.942+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:12:31.636+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 375ms 2016-04-18T09:12:34.188+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:12:42.451+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 149ms 2016-04-18T09:12:53.377+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:13:23.854+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:13:37.915+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:13:53.358+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-18T09:13:53.556+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4080, after asserts: 6890, after connections: 8980, after extra_info: 15740, after globalLock: 18370, after locks: 18910, after network: 19050, after opcounters: 19050, after opcountersRepl: 19050, after repl: 39040, after storageEngine: 40770, after tcmalloc: 43350, after wiredTiger: 52830, at end: 71020 } 2016-04-18T09:14:09.002+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1344ms 2016-04-18T09:14:11.319+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:14:12.725+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T09:14:22.933+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T09:14:36.948+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:15:24.881+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 120ms 2016-04-18T09:15:34.025+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T09:15:41.447+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 422ms 2016-04-18T09:15:51.007+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 150ms 2016-04-18T09:15:57.771+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:16:34.193+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:16:51.413+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:16:59.380+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3960, after asserts: 5570, after connections: 6220, after extra_info: 12580, after globalLock: 16950, after locks: 20110, after network: 23830, after opcounters: 23830, after opcountersRepl: 23830, after repl: 46490, after storageEngine: 53680, after tcmalloc: 56930, after wiredTiger: 68870, at end: 80010 } 2016-04-18T09:16:59.290+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 222ms 2016-04-18T09:17:20.753+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 380ms 2016-04-18T09:17:31.881+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 216ms 2016-04-18T09:17:47.056+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:18:19.040+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:18:29.836+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T09:18:41.247+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 188ms 2016-04-18T09:18:58.569+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 896ms 2016-04-18T09:19:07.752+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T09:19:17.634+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-04-18T09:19:36.565+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:20:23.205+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 462ms 2016-04-18T09:20:29.473+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:20:33.143+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 542ms 2016-04-18T09:20:43.771+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 216ms 2016-04-18T09:20:44.849+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:20:45.136+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3620, after asserts: 4700, after connections: 8160, after extra_info: 13460, after globalLock: 17930, after locks: 20300, after network: 21360, after opcounters: 21510, after opcountersRepl: 21510, after repl: 53670, after storageEngine: 56260, after tcmalloc: 59240, after wiredTiger: 73940, at end: 92620 } 2016-04-18T09:21:44.787+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:21:51.885+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 186ms 2016-04-18T09:22:04.772+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:22:05.454+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1223ms 2016-04-18T09:22:24.808+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 294ms 2016-04-18T09:22:43.968+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T09:23:24.099+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T09:23:38.501+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 247ms 2016-04-18T09:23:52.347+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:23:55.523+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1142ms 2016-04-18T09:24:08.232+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 143ms 2016-04-18T09:24:57.319+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:25:22.934+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 356ms 2016-04-18T09:25:29.416+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:25:29.506+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2830, after asserts: 7410, after connections: 8340, after extra_info: 17410, after globalLock: 24800, after locks: 28160, after network: 33600, after opcounters: 40900, after opcountersRepl: 44090, after repl: 74920, after storageEngine: 79190, after tcmalloc: 89540, after wiredTiger: 108400, at end: 122250 } 2016-04-18T09:25:45.329+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 13614ms 2016-04-18T09:26:05.170+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T09:26:55.648+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:27:15.794+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:27:25.369+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 264ms 2016-04-18T09:27:43.069+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 575ms 2016-04-18T09:27:53.821+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T09:27:55.345+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 343ms 2016-04-18T09:28:24.941+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-18T09:29:01.303+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:29:17.442+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 434ms 2016-04-18T09:29:30.614+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1815ms 2016-04-18T09:29:47.894+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 779ms 2016-04-18T09:30:12.007+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:30:28.285+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3550, after asserts: 5790, after connections: 6370, after extra_info: 13180, after globalLock: 17420, after locks: 20550, after network: 20970, after opcounters: 20970, after opcountersRepl: 20970, after repl: 78090, after storageEngine: 81590, after tcmalloc: 84630, after wiredTiger: 102060, at end: 113920 } 2016-04-18T09:30:59.529+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:31:08.031+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 120ms 2016-04-18T09:31:17.092+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 681ms 2016-04-18T09:31:35.451+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 132ms 2016-04-18T09:32:06.927+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:32:20.677+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-18T09:32:40.315+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:32:50.875+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-18T09:33:04.579+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 279ms 2016-04-18T09:33:22.104+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 602ms 2016-04-18T09:33:29.523+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:33:31.176+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 163ms 2016-04-18T09:33:48.699+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:34:10.012+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:34:32.884+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2500, after asserts: 3290, after connections: 3890, after extra_info: 6300, after globalLock: 10710, after locks: 14000, after network: 18000, after opcounters: 20880, after opcountersRepl: 20880, after repl: 32140, after storageEngine: 36040, after tcmalloc: 40810, after wiredTiger: 62820, at end: 77960 } 2016-04-18T09:34:52.229+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1545ms 2016-04-18T09:35:05.573+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 344ms 2016-04-18T09:35:09.408+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T09:35:19.197+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:35:35.675+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:36:13.660+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:36:24.991+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1006ms 2016-04-18T09:36:37.453+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 512ms 2016-04-18T09:36:40.207+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:36:53.870+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T09:37:34.673+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:37:48.629+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1780, after asserts: 2410, after connections: 4310, after extra_info: 9500, after globalLock: 17120, after locks: 19580, after network: 22380, after opcounters: 25700, after opcountersRepl: 27640, after repl: 68060, after storageEngine: 70890, after tcmalloc: 75090, after wiredTiger: 91200, at end: 104030 } 2016-04-18T09:37:52.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:38:05.973+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 114ms 2016-04-18T09:38:21.384+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2526ms 2016-04-18T09:38:26.932+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:38:27.953+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 147ms 2016-04-18T09:38:59.379+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:39:29.286+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:39:34.150+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 111ms 2016-04-18T09:39:41.927+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 443ms 2016-04-18T09:39:51.379+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1817ms 2016-04-18T09:40:11.998+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:40:27.331+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:40:48.990+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4360, after asserts: 6280, after connections: 7070, after extra_info: 12030, after globalLock: 13900, after locks: 14560, after network: 14960, after opcounters: 14960, after opcountersRepl: 14960, after repl: 24010, after storageEngine: 28560, after tcmalloc: 30830, after wiredTiger: 48680, at end: 62000 } 2016-04-18T09:41:03.270+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T09:41:07.809+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:41:15.309+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1039ms 2016-04-18T09:41:26.147+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 240ms 2016-04-18T09:41:29.382+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:42:29.820+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:42:37.518+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 163ms 2016-04-18T09:42:49.295+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 411ms 2016-04-18T09:42:52.822+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:43:01.252+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 167ms 2016-04-18T09:43:29.505+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:43:50.491+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T09:44:18.792+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 206ms 2016-04-18T09:44:30.155+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 588ms 2016-04-18T09:44:32.505+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:44:45.079+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 644ms 2016-04-18T09:44:47.929+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3320, after asserts: 4120, after connections: 4460, after extra_info: 12110, after globalLock: 18270, after locks: 21190, after network: 21740, after opcounters: 21740, after opcountersRepl: 21740, after repl: 49200, after storageEngine: 51560, after tcmalloc: 59340, after wiredTiger: 69150, at end: 94540 } 2016-04-18T09:44:59.448+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:45:54.072+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:45:56.117+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-04-18T09:46:02.392+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1305ms 2016-04-18T09:46:08.325+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:46:14.967+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 407ms 2016-04-18T09:46:46.433+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:46:58.794+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T09:47:27.092+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 120ms 2016-04-18T09:47:32.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:47:35.071+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 878ms 2016-04-18T09:47:43.263+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 171ms 2016-04-18T09:47:46.397+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3970, after asserts: 7280, after connections: 12120, after extra_info: 20060, after globalLock: 22700, after locks: 23950, after network: 24180, after opcounters: 24180, after opcountersRepl: 24180, after repl: 35130, after storageEngine: 38150, after tcmalloc: 41920, after wiredTiger: 53500, at end: 66790 } 2016-04-18T09:47:51.881+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T09:48:40.936+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:48:48.012+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 203ms 2016-04-18T09:48:53.330+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 667ms 2016-04-18T09:49:01.136+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T09:49:05.189+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 137ms 2016-04-18T09:49:39.107+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T09:49:57.598+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:50:24.835+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 153ms 2016-04-18T09:50:37.503+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2221ms 2016-04-18T09:50:38.574+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:50:40.957+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 130ms 2016-04-18T09:50:52.425+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:50:59.048+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2560, after asserts: 4560, after connections: 6740, after extra_info: 14200, after globalLock: 17030, after locks: 17720, after network: 18640, after opcounters: 19720, after opcountersRepl: 19720, after repl: 60670, after storageEngine: 63480, after tcmalloc: 65710, after wiredTiger: 72110, at end: 80910 } 2016-04-18T09:51:12.156+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T09:51:44.546+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 208ms 2016-04-18T09:51:56.850+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1939ms 2016-04-18T09:52:09.374+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:52:25.163+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:53:03.793+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:53:12.949+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 436ms 2016-04-18T09:53:18.558+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:53:22.493+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1313ms 2016-04-18T09:53:56.391+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:54:11.059+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:54:11.059+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2440, after asserts: 4260, after connections: 5300, after extra_info: 11170, after globalLock: 15530, after locks: 18010, after network: 19950, after opcounters: 20720, after opcountersRepl: 20720, after repl: 47520, after storageEngine: 49910, after tcmalloc: 53380, after wiredTiger: 58980, at end: 69340 } 2016-04-18T09:54:29.149+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T09:54:39.600+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 874ms 2016-04-18T09:54:49.925+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:55:12.270+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:55:50.078+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 172ms 2016-04-18T09:55:54.379+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:56:04.899+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1156ms 2016-04-18T09:56:16.174+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 151ms 2016-04-18T09:56:20.201+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:56:42.717+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:56:52.624+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:57:13.786+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1690, after asserts: 4110, after connections: 5490, after extra_info: 13370, after globalLock: 15420, after locks: 15590, after network: 15720, after opcounters: 15720, after opcountersRepl: 15720, after repl: 43310, after storageEngine: 46250, after tcmalloc: 53020, after wiredTiger: 67020, at end: 83990 } 2016-04-18T09:57:22.847+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 174ms 2016-04-18T09:57:33.482+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 999ms 2016-04-18T09:57:40.712+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-04-18T09:57:44.191+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:57:57.853+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:58:25.777+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:58:41.410+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:58:46.962+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 114ms 2016-04-18T09:58:47.817+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 228ms 2016-04-18T09:59:22.110+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T09:59:26.019+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2820, after asserts: 4180, after connections: 5900, after extra_info: 11610, after globalLock: 15480, after locks: 17460, after network: 18270, after opcounters: 18270, after opcountersRepl: 18270, after repl: 43810, after storageEngine: 47840, after tcmalloc: 51530, after wiredTiger: 62460, at end: 69460 } 2016-04-18T09:59:38.168+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T09:59:49.236+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 896ms 2016-04-18T09:59:57.392+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 712ms 2016-04-18T10:00:00.667+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:00:16.344+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:00:55.255+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:01:03.236+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 108ms 2016-04-18T10:01:15.806+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:01:18.070+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1315ms 2016-04-18T10:01:47.056+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:02:02.786+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3800, after asserts: 4660, after connections: 6450, after extra_info: 13070, after globalLock: 15920, after locks: 17170, after network: 17520, after opcounters: 17520, after opcountersRepl: 17520, after repl: 45360, after storageEngine: 48330, after tcmalloc: 50710, after wiredTiger: 56940, at end: 67200 } 2016-04-18T10:02:03.434+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:02:21.401+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 255ms 2016-04-18T10:02:33.302+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 601ms 2016-04-18T10:02:40.336+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 142ms 2016-04-18T10:02:44.521+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:02:54.258+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:03:17.379+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:03:29.943+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:03:49.934+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 347ms 2016-04-18T10:04:01.583+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 486ms 2016-04-18T10:04:01.649+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:04:07.101+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 182ms 2016-04-18T10:04:07.953+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:04:13.654+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2370, after asserts: 2770, after connections: 3890, after extra_info: 6790, after globalLock: 8910, after locks: 12630, after network: 14060, after opcounters: 14060, after opcountersRepl: 14060, after repl: 36080, after storageEngine: 38030, after tcmalloc: 41230, after wiredTiger: 45720, at end: 50730 } 2016-04-18T10:04:36.499+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:04:48.020+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:05:09.393+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 118ms 2016-04-18T10:05:16.469+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 427ms 2016-04-18T10:05:21.154+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 236ms 2016-04-18T10:05:26.515+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 34465ms 2016-04-18T10:05:27.038+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:05:40.961+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:06:02.910+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:06:27.998+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 314ms 2016-04-18T10:06:30.293+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:06:32.603+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1860, after asserts: 3120, after connections: 3670, after extra_info: 9950, after globalLock: 11530, after locks: 13170, after network: 15010, after opcounters: 15010, after opcountersRepl: 15010, after repl: 42870, after storageEngine: 44250, after tcmalloc: 48150, after wiredTiger: 54500, at end: 67870 } 2016-04-18T10:06:37.283+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 864ms 2016-04-18T10:06:41.073+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:06:45.567+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 106ms 2016-04-18T10:07:14.105+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:07:37.488+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:07:46.776+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 151ms 2016-04-18T10:07:55.094+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1476ms 2016-04-18T10:08:10.437+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:08:24.659+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:09:02.570+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 444ms 2016-04-18T10:09:05.100+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:09:07.128+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 593ms 2016-04-18T10:09:11.085+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2510, after asserts: 4460, after connections: 8940, after extra_info: 14500, after globalLock: 18120, after locks: 19570, after network: 19660, after opcounters: 19660, after opcountersRepl: 19660, after repl: 42580, after storageEngine: 45970, after tcmalloc: 48080, after wiredTiger: 62870, at end: 69010 } 2016-04-18T10:09:14.711+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:09:53.396+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:10:10.399+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 416ms 2016-04-18T10:10:16.972+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:10:19.579+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1024ms 2016-04-18T10:10:29.792+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 109ms 2016-04-18T10:10:54.908+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:11:12.680+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:11:35.087+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 124ms 2016-04-18T10:11:38.048+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:11:41.298+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 531ms 2016-04-18T10:11:49.131+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 270ms 2016-04-18T10:11:51.168+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:11:57.693+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2990, after asserts: 6290, after connections: 8750, after extra_info: 18060, after globalLock: 22580, after locks: 24300, after network: 25900, after opcounters: 26340, after opcountersRepl: 26340, after repl: 52890, after storageEngine: 53930, after tcmalloc: 55360, after wiredTiger: 59040, at end: 66760 } 2016-04-18T10:12:06.092+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:12:22.298+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:12:36.011+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:12:54.553+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 279ms 2016-04-18T10:13:11.129+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2394ms 2016-04-18T10:13:14.357+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:13:32.834+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:14:16.000+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 247ms 2016-04-18T10:14:17.378+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:14:21.492+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 539ms 2016-04-18T10:14:29.985+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4800, after asserts: 7080, after connections: 11340, after extra_info: 16330, after globalLock: 20070, after locks: 23860, after network: 24370, after opcounters: 24370, after opcountersRepl: 24370, after repl: 34370, after storageEngine: 36460, after tcmalloc: 38360, after wiredTiger: 45860, at end: 52540 } 2016-04-18T10:14:31.121+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:14:56.412+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 42702ms 2016-04-18T10:15:02.963+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:15:10.794+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:15:29.086+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 168ms 2016-04-18T10:15:33.935+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 813ms 2016-04-18T10:15:36.361+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T10:15:47.177+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:16:05.241+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:16:36.828+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:16:46.087+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1220, after asserts: 4120, after connections: 5450, after extra_info: 9690, after globalLock: 11990, after locks: 13040, after network: 14070, after opcounters: 14070, after opcountersRepl: 14070, after repl: 44700, after storageEngine: 46690, after tcmalloc: 51050, after wiredTiger: 55160, at end: 64710 } 2016-04-18T10:16:49.634+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:16:50.887+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 967ms 2016-04-18T10:16:56.653+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 782ms 2016-04-18T10:17:05.820+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 212ms 2016-04-18T10:17:21.595+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:17:45.766+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:18:07.148+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 121ms 2016-04-18T10:18:14.052+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 263ms 2016-04-18T10:18:14.250+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:18:22.728+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:18:41.591+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1940, after asserts: 2640, after connections: 2980, after extra_info: 5790, after globalLock: 6250, after locks: 6390, after network: 6390, after opcounters: 6390, after opcountersRepl: 6390, after repl: 11900, after storageEngine: 13880, after tcmalloc: 15550, after wiredTiger: 21130, at end: 30070 } 2016-04-18T10:18:42.256+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:19:17.462+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 106ms 2016-04-18T10:19:23.539+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:19:25.109+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 545ms 2016-04-18T10:19:32.465+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 107ms 2016-04-18T10:19:43.833+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:20:03.550+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:20:28.612+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:20:40.279+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 121ms 2016-04-18T10:20:50.845+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1087ms 2016-04-18T10:21:04.989+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:21:19.070+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:21:35.186+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3600, after asserts: 5380, after connections: 7600, after extra_info: 15710, after globalLock: 18420, after locks: 19960, after network: 20500, after opcounters: 20500, after opcountersRepl: 20500, after repl: 40690, after storageEngine: 41720, after tcmalloc: 45950, after wiredTiger: 64240, at end: 75400 } 2016-04-18T10:21:55.593+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1618ms 2016-04-18T10:21:57.800+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 150ms 2016-04-18T10:22:03.989+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:22:57.285+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:22:59.937+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 231ms 2016-04-18T10:23:14.634+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:23:14.848+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2000ms 2016-04-18T10:23:52.117+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:24:10.998+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:24:25.040+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1345ms 2016-04-18T10:24:28.807+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:24:37.767+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T10:24:41.907+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:24:49.768+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5220, after asserts: 6520, after connections: 6800, after extra_info: 8560, after globalLock: 11430, after locks: 13370, after network: 13580, after opcounters: 13580, after opcountersRepl: 13580, after repl: 34600, after storageEngine: 38090, after tcmalloc: 40710, after wiredTiger: 52340, at end: 61410 } 2016-04-18T10:25:11.436+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:25:28.947+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:25:46.539+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1237ms 2016-04-18T10:26:03.763+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 218ms 2016-04-18T10:26:05.866+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:26:34.270+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:27:14.855+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:27:18.059+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 353ms 2016-04-18T10:27:32.252+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 808ms 2016-04-18T10:27:38.820+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:27:42.022+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 520ms 2016-04-18T10:27:58.544+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5540, after asserts: 7190, after connections: 10340, after extra_info: 20310, after globalLock: 22060, after locks: 24590, after network: 24910, after opcounters: 24910, after opcountersRepl: 24910, after repl: 54310, after storageEngine: 58770, after tcmalloc: 63310, after wiredTiger: 76200, at end: 92460 } 2016-04-18T10:28:17.811+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:28:43.792+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 114ms 2016-04-18T10:28:53.698+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:29:04.886+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 408ms 2016-04-18T10:29:10.175+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 532ms 2016-04-18T10:29:38.614+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:30:00.241+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:30:23.219+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 498ms 2016-04-18T10:30:35.068+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:30:36.957+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 711ms 2016-04-18T10:30:48.326+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:31:01.982+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3690, after asserts: 5160, after connections: 5580, after extra_info: 8160, after globalLock: 10000, after locks: 11830, after network: 14190, after opcounters: 15900, after opcountersRepl: 17000, after repl: 39950, after storageEngine: 42570, after tcmalloc: 48890, after wiredTiger: 57270, at end: 74570 } 2016-04-18T10:31:29.835+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:31:41.308+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:31:45.304+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 120ms 2016-04-18T10:31:54.613+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1135ms 2016-04-18T10:32:08.031+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 150ms 2016-04-18T10:32:12.421+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:32:21.050+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:32:58.440+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:33:14.960+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 187ms 2016-04-18T10:33:15.269+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:33:20.540+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1410, after asserts: 3580, after connections: 5910, after extra_info: 11460, after globalLock: 12100, after locks: 13520, after network: 16320, after opcounters: 16410, after opcountersRepl: 16410, after repl: 24930, after storageEngine: 27650, after tcmalloc: 31890, after wiredTiger: 44780, at end: 52160 } 2016-04-18T10:33:49.954+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:34:06.240+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:34:17.292+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 192ms 2016-04-18T10:34:26.023+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1965ms 2016-04-18T10:34:35.753+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:34:37.874+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 191ms 2016-04-18T10:34:54.832+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:35:15.347+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:35:48.162+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 806ms 2016-04-18T10:35:48.397+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2290, after asserts: 5650, after connections: 6670, after extra_info: 10680, after globalLock: 12330, after locks: 13640, after network: 14510, after opcounters: 14620, after opcountersRepl: 14620, after repl: 40800, after storageEngine: 47290, after tcmalloc: 54740, after wiredTiger: 62390, at end: 73440 } 2016-04-18T10:35:51.472+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:35:55.554+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 790ms 2016-04-18T10:36:10.626+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:36:47.297+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:37:07.865+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 181ms 2016-04-18T10:37:09.088+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:37:13.684+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1558ms 2016-04-18T10:37:40.459+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:37:57.772+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:38:21.165+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 150ms 2016-04-18T10:38:22.588+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2650, after asserts: 3430, after connections: 5140, after extra_info: 12620, after globalLock: 15170, after locks: 16290, after network: 16290, after opcounters: 16290, after opcountersRepl: 16290, after repl: 34760, after storageEngine: 38030, after tcmalloc: 41170, after wiredTiger: 50340, at end: 58220 } 2016-04-18T10:38:28.739+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 734ms 2016-04-18T10:38:35.195+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:38:38.698+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 123ms 2016-04-18T10:39:00.721+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:39:51.361+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:39:52.723+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 152ms 2016-04-18T10:39:58.161+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1408ms 2016-04-18T10:40:06.346+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:40:08.603+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 304ms 2016-04-18T10:40:31.430+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:40:49.053+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:40:52.839+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2240, after asserts: 4410, after connections: 6420, after extra_info: 11580, after globalLock: 13990, after locks: 15210, after network: 15580, after opcounters: 15580, after opcountersRepl: 15580, after repl: 29070, after storageEngine: 30410, after tcmalloc: 35350, after wiredTiger: 44700, at end: 60020 } 2016-04-18T10:41:19.110+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 847ms 2016-04-18T10:41:37.282+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:41:52.198+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:42:27.043+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 147ms 2016-04-18T10:42:29.529+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:42:36.816+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 598ms 2016-04-18T10:42:44.739+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:43:21.516+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:43:28.128+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3360, after asserts: 6930, after connections: 7630, after extra_info: 10250, after globalLock: 13690, after locks: 15030, after network: 16200, after opcounters: 16630, after opcountersRepl: 16630, after repl: 35120, after storageEngine: 36990, after tcmalloc: 41470, after wiredTiger: 45950, at end: 52290 } 2016-04-18T10:43:28.227+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:43:38.287+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 419ms 2016-04-18T10:43:49.665+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 163ms 2016-04-18T10:44:03.683+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:44:25.036+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:44:53.035+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 159ms 2016-04-18T10:45:01.749+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 999ms 2016-04-18T10:45:03.051+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:45:23.837+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:45:50.643+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:46:03.849+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2970, after asserts: 4320, after connections: 9640, after extra_info: 17380, after globalLock: 21960, after locks: 24870, after network: 27510, after opcounters: 30050, after opcountersRepl: 30230, after repl: 49310, after storageEngine: 51840, after tcmalloc: 55200, after wiredTiger: 66250, at end: 76770 } 2016-04-18T10:46:10.961+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 122ms 2016-04-18T10:46:11.341+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:46:20.262+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1319ms 2016-04-18T10:46:42.367+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:47:05.842+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:47:16.460+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:47:27.573+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1381ms 2016-04-18T10:47:38.965+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1382ms 2016-04-18T10:47:49.846+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:47:59.835+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:48:33.232+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:48:44.542+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1590, after asserts: 3200, after connections: 5850, after extra_info: 15790, after globalLock: 19210, after locks: 21930, after network: 23420, after opcounters: 24340, after opcountersRepl: 24340, after repl: 46560, after storageEngine: 47080, after tcmalloc: 51480, after wiredTiger: 60070, at end: 69040 } 2016-04-18T10:48:46.988+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:48:51.872+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 464ms 2016-04-18T10:48:58.927+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 598ms 2016-04-18T10:49:03.288+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-18T10:49:18.781+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:49:42.799+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:50:06.862+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 116ms 2016-04-18T10:50:12.372+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:50:16.316+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1575ms 2016-04-18T10:50:38.111+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:51:06.977+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2480, after asserts: 4880, after connections: 7380, after extra_info: 10660, after globalLock: 14260, after locks: 16810, after network: 17710, after opcounters: 17710, after opcountersRepl: 17710, after repl: 39660, after storageEngine: 41060, after tcmalloc: 41780, after wiredTiger: 53690, at end: 66050 } 2016-04-18T10:51:07.377+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:51:29.356+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:51:30.336+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 480ms 2016-04-18T10:51:46.094+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 428ms 2016-04-18T10:51:57.695+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 206ms 2016-04-18T10:52:19.662+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:52:36.551+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:52:58.941+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 951ms 2016-04-18T10:53:08.299+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 246ms 2016-04-18T10:53:30.087+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:53:47.818+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:54:17.728+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 7950, after asserts: 8750, after connections: 9780, after extra_info: 15270, after globalLock: 16900, after locks: 19110, after network: 21050, after opcounters: 21310, after opcountersRepl: 21310, after repl: 40320, after storageEngine: 43910, after tcmalloc: 48540, after wiredTiger: 58070, at end: 66170 } 2016-04-18T10:54:22.448+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:54:24.849+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 168ms 2016-04-18T10:54:27.102+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:54:30.076+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2415ms 2016-04-18T10:54:36.715+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 335ms 2016-04-18T10:55:10.640+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:55:34.006+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:55:47.574+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 151ms 2016-04-18T10:55:55.997+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 396ms 2016-04-18T10:55:59.367+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:56:01.023+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 237ms 2016-04-18T10:56:20.155+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:56:32.688+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1780, after asserts: 3660, after connections: 4050, after extra_info: 8380, after globalLock: 8860, after locks: 9010, after network: 9100, after opcounters: 9100, after opcountersRepl: 9100, after repl: 17670, after storageEngine: 20450, after tcmalloc: 23840, after wiredTiger: 38240, at end: 48500 } 2016-04-18T10:56:59.102+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:57:12.946+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 149ms 2016-04-18T10:57:17.408+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 684ms 2016-04-18T10:57:17.374+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T10:57:25.229+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-18T10:57:51.578+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:58:06.719+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:58:08.521+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 3234ms 2016-04-18T10:58:33.436+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-18T10:58:38.838+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:58:41.773+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 150ms 2016-04-18T10:58:51.533+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 123ms 2016-04-18T10:58:52.166+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4860, after asserts: 6740, after connections: 10440, after extra_info: 16690, after globalLock: 17930, after locks: 18050, after network: 18160, after opcounters: 18160, after opcountersRepl: 18160, after repl: 43140, after storageEngine: 45640, after tcmalloc: 46700, after wiredTiger: 53020, at end: 64560 } 2016-04-18T10:58:57.721+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:59:27.326+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T10:59:47.958+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:00:02.178+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 227ms 2016-04-18T11:00:10.542+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1516ms 2016-04-18T11:00:23.801+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 217ms 2016-04-18T11:00:24.887+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:00:35.609+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:01:06.132+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:01:18.133+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:01:29.240+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3220, after asserts: 5150, after connections: 6710, after extra_info: 14450, after globalLock: 16900, after locks: 16980, after network: 18060, after opcounters: 19860, after opcountersRepl: 19860, after repl: 38230, after storageEngine: 42380, after tcmalloc: 46470, after wiredTiger: 62030, at end: 74140 } 2016-04-18T11:01:32.422+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 385ms 2016-04-18T11:01:45.452+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 604ms 2016-04-18T11:01:59.736+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:02:13.333+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:02:49.718+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:02:51.266+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 270ms 2016-04-18T11:02:56.619+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 452ms 2016-04-18T11:03:06.059+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:03:36.034+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:03:59.716+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:04:01.487+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 119ms 2016-04-18T11:04:01.598+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3880, after asserts: 4800, after connections: 5250, after extra_info: 8180, after globalLock: 10180, after locks: 10480, after network: 10900, after opcounters: 10900, after opcountersRepl: 10900, after repl: 31870, after storageEngine: 34500, after tcmalloc: 43820, after wiredTiger: 55100, at end: 69400 } 2016-04-18T11:04:11.369+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1035ms 2016-04-18T11:04:22.533+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 176ms 2016-04-18T11:04:47.407+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:04:56.576+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:05:23.982+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:05:29.943+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 560ms 2016-04-18T11:05:38.085+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 145ms 2016-04-18T11:05:41.637+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:05:47.557+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 109ms 2016-04-18T11:06:22.183+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:06:34.515+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:06:50.880+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2870, after asserts: 4580, after connections: 7730, after extra_info: 15430, after globalLock: 17500, after locks: 18430, after network: 20330, after opcounters: 23640, after opcountersRepl: 25700, after repl: 33430, after storageEngine: 37620, after tcmalloc: 43460, after wiredTiger: 52710, at end: 69190 } 2016-04-18T11:06:55.144+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 953ms 2016-04-18T11:07:01.444+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:07:04.164+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 539ms 2016-04-18T11:07:11.479+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 119ms 2016-04-18T11:07:20.154+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:08:01.509+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:08:15.003+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:08:23.527+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 912ms 2016-04-18T11:08:34.408+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 162ms 2016-04-18T11:08:45.449+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T11:08:46.636+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:08:47.378+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:09:04.566+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5190, after asserts: 6930, after connections: 7860, after extra_info: 9220, after globalLock: 9550, after locks: 9720, after network: 9850, after opcounters: 9850, after opcountersRepl: 9850, after repl: 19330, after storageEngine: 20160, after tcmalloc: 27270, after wiredTiger: 29330, at end: 45830 } 2016-04-18T11:09:04.803+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:09:18.981+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:09:48.941+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 298ms 2016-04-18T11:09:52.209+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:10:04.013+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 917ms 2016-04-18T11:10:19.825+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 321ms 2016-04-18T11:10:44.992+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:10:58.964+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:11:33.518+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 533ms 2016-04-18T11:11:39.137+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:11:48.957+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2620, after asserts: 3760, after connections: 4090, after extra_info: 6200, after globalLock: 9500, after locks: 10100, after network: 10270, after opcounters: 10270, after opcountersRepl: 10270, after repl: 36220, after storageEngine: 38470, after tcmalloc: 43290, after wiredTiger: 51880, at end: 64850 } 2016-04-18T11:11:50.814+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:12:16.451+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:12:34.110+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:12:42.083+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 818ms 2016-04-18T11:12:45.837+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 262ms 2016-04-18T11:12:58.949+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 190ms 2016-04-18T11:13:07.390+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:13:28.164+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:13:58.563+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:13:59.714+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5600, after asserts: 6290, after connections: 6450, after extra_info: 6990, after globalLock: 8090, after locks: 8900, after network: 8900, after opcounters: 8900, after opcountersRepl: 8900, after repl: 18460, after storageEngine: 21250, after tcmalloc: 29090, after wiredTiger: 33240, at end: 49460 } 2016-04-18T11:14:08.185+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 155ms 2016-04-18T11:14:18.351+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1150ms 2016-04-18T11:14:33.848+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:14:49.936+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:15:20.344+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:15:28.922+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 141ms 2016-04-18T11:15:35.949+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 606ms 2016-04-18T11:15:36.989+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:15:37.641+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 176ms 2016-04-18T11:16:03.678+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:16:20.201+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:16:33.026+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3500, after asserts: 4450, after connections: 4820, after extra_info: 6530, after globalLock: 8070, after locks: 11950, after network: 13370, after opcounters: 13940, after opcountersRepl: 13940, after repl: 32110, after storageEngine: 36030, after tcmalloc: 43710, after wiredTiger: 53410, at end: 74960 } 2016-04-18T11:16:39.173+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 107ms 2016-04-18T11:16:40.573+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 341ms 2016-04-18T11:16:56.834+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:17:21.943+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:17:43.109+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 314ms 2016-04-18T11:18:02.056+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:18:04.412+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 4247ms 2016-04-18T11:18:18.317+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 193ms 2016-04-18T11:18:19.451+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:18:55.788+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:19:17.528+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:19:19.006+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3340, after asserts: 5510, after connections: 7330, after extra_info: 20000, after globalLock: 23010, after locks: 24670, after network: 25160, after opcounters: 25160, after opcountersRepl: 25160, after repl: 38630, after storageEngine: 41930, after tcmalloc: 49610, after wiredTiger: 59550, at end: 74800 } 2016-04-18T11:19:30.824+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 132ms 2016-04-18T11:19:40.073+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 597ms 2016-04-18T11:20:08.880+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:20:29.654+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:20:43.351+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 116ms 2016-04-18T11:20:53.730+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 407ms 2016-04-18T11:21:04.278+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 118ms 2016-04-18T11:21:08.175+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:21:32.952+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:22:08.749+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 45041ms 2016-04-18T11:22:13.727+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 787ms 2016-04-18T11:22:21.949+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 175ms 2016-04-18T11:22:24.858+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:22:39.733+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:22:42.247+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2220, after asserts: 3910, after connections: 8900, after extra_info: 16350, after globalLock: 20610, after locks: 22300, after network: 23110, after opcounters: 24150, after opcountersRepl: 24150, after repl: 60420, after storageEngine: 62240, after tcmalloc: 65430, after wiredTiger: 73530, at end: 82710 } 2016-04-18T11:23:01.201+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:23:33.717+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 850ms 2016-04-18T11:23:44.430+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 668ms 2016-04-18T11:23:50.732+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:23:54.107+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 114ms 2016-04-18T11:24:37.911+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:25:08.228+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:25:11.792+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 397ms 2016-04-18T11:25:23.175+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 532ms 2016-04-18T11:25:32.592+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:25:33.400+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1217ms 2016-04-18T11:25:49.582+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:26:09.111+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1540, after asserts: 2600, after connections: 3010, after extra_info: 8180, after globalLock: 11550, after locks: 14130, after network: 16930, after opcounters: 19620, after opcountersRepl: 19620, after repl: 33930, after storageEngine: 37910, after tcmalloc: 39780, after wiredTiger: 56830, at end: 72960 } 2016-04-18T11:26:33.506+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:26:49.209+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 116ms 2016-04-18T11:27:04.213+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1341ms 2016-04-18T11:27:10.917+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:27:53.283+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:28:06.219+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:28:12.822+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 127ms 2016-04-18T11:28:22.950+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 624ms 2016-04-18T11:28:33.733+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1129ms 2016-04-18T11:28:46.766+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:29:02.822+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2620, after asserts: 4710, after connections: 6610, after extra_info: 9600, after globalLock: 11120, after locks: 12920, after network: 13670, after opcounters: 13670, after opcountersRepl: 13670, after repl: 31470, after storageEngine: 34220, after tcmalloc: 39500, after wiredTiger: 53210, at end: 62370 } 2016-04-18T11:29:06.334+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:29:47.972+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1284ms 2016-04-18T11:29:50.145+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:29:52.644+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 540ms 2016-04-18T11:29:57.702+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:30:02.055+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 101ms 2016-04-18T11:30:23.141+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:30:40.779+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:31:14.494+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 257ms 2016-04-18T11:31:20.248+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:31:23.647+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 822ms 2016-04-18T11:31:33.382+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:31:34.872+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1898ms 2016-04-18T11:31:35.275+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4150, after asserts: 8740, after connections: 10220, after extra_info: 14570, after globalLock: 17810, after locks: 18470, after network: 18710, after opcounters: 18710, after opcountersRepl: 18710, after repl: 44760, after storageEngine: 48450, after tcmalloc: 52070, after wiredTiger: 63690, at end: 69960 } 2016-04-18T11:32:14.231+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:32:31.749+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:32:42.907+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 531ms 2016-04-18T11:32:51.439+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 760ms 2016-04-18T11:32:58.120+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 147ms 2016-04-18T11:33:12.921+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:33:40.594+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:34:01.969+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-04-18T11:34:13.376+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:34:19.238+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3572ms 2016-04-18T11:34:27.724+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:34:43.030+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2760, after asserts: 4670, after connections: 5160, after extra_info: 10420, after globalLock: 13630, after locks: 15320, after network: 16570, after opcounters: 21030, after opcountersRepl: 23690, after repl: 51520, after storageEngine: 52450, after tcmalloc: 58180, after wiredTiger: 77480, at end: 89970 } 2016-04-18T11:35:07.221+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:35:23.407+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 234ms 2016-04-18T11:35:34.298+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:35:39.472+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1262ms 2016-04-18T11:35:52.256+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 130ms 2016-04-18T11:36:06.563+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:36:29.540+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:36:58.071+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 329ms 2016-04-18T11:37:08.065+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 141ms 2016-04-18T11:37:09.518+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:37:19.900+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 109ms 2016-04-18T11:37:30.357+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:38:06.427+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:38:07.317+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5640, after asserts: 7190, after connections: 8800, after extra_info: 12110, after globalLock: 14900, after locks: 17360, after network: 17750, after opcounters: 18600, after opcountersRepl: 18600, after repl: 42070, after storageEngine: 45660, after tcmalloc: 52020, after wiredTiger: 65310, at end: 75670 } 2016-04-18T11:38:30.773+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 327ms 2016-04-18T11:38:37.788+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:38:42.281+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 403ms 2016-04-18T11:38:52.664+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:39:20.676+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:39:38.257+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:39:51.898+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 163ms 2016-04-18T11:39:59.727+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 459ms 2016-04-18T11:40:10.768+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:40:10.960+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1089ms 2016-04-18T11:40:30.103+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:40:50.480+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5020, after asserts: 6470, after connections: 8550, after extra_info: 15780, after globalLock: 19570, after locks: 22450, after network: 24580, after opcounters: 24600, after opcountersRepl: 24600, after repl: 35590, after storageEngine: 40560, after tcmalloc: 48580, after wiredTiger: 59240, at end: 70330 } 2016-04-18T11:41:06.107+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:41:31.200+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 563ms 2016-04-18T11:41:41.055+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:42:18.740+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:42:38.838+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T11:42:46.047+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:42:50.892+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1468ms 2016-04-18T11:42:57.739+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T11:43:15.760+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:43:34.907+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:43:43.923+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2820, after asserts: 3820, after connections: 5670, after extra_info: 8550, after globalLock: 11990, after locks: 17050, after network: 18100, after opcounters: 20460, after opcountersRepl: 21280, after repl: 36700, after storageEngine: 39270, after tcmalloc: 44050, after wiredTiger: 52090, at end: 63930 } 2016-04-18T11:44:05.155+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 483ms 2016-04-18T11:44:13.178+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 315ms 2016-04-18T11:44:24.208+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1169ms 2016-04-18T11:44:35.518+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:44:42.785+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:45:08.811+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:45:23.207+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:45:35.839+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 863ms 2016-04-18T11:45:52.814+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 5579ms 2016-04-18T11:45:54.687+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:45:57.630+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T11:46:14.504+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3300, after asserts: 4680, after connections: 7420, after extra_info: 12270, after globalLock: 15380, after locks: 16250, after network: 16540, after opcounters: 16540, after opcountersRepl: 16540, after repl: 39260, after storageEngine: 39900, after tcmalloc: 42650, after wiredTiger: 51850, at end: 60030 } 2016-04-18T11:46:15.624+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:46:42.956+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:47:14.347+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 472ms 2016-04-18T11:47:21.312+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1440ms 2016-04-18T11:47:23.266+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 210ms 2016-04-18T11:47:41.222+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:48:06.952+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:48:30.940+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 330ms 2016-04-18T11:48:38.276+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 122ms 2016-04-18T11:48:42.361+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2471ms 2016-04-18T11:48:54.172+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:49:10.838+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:49:27.754+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4550, after asserts: 6510, after connections: 7340, after extra_info: 12720, after globalLock: 14480, after locks: 14480, after network: 14480, after opcounters: 14480, after opcountersRepl: 14480, after repl: 29310, after storageEngine: 34310, after tcmalloc: 40120, after wiredTiger: 50470, at end: 66060 } 2016-04-18T11:49:50.919+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:49:51.829+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 200ms 2016-04-18T11:50:05.534+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 829ms 2016-04-18T11:50:17.299+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:50:46.706+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:50:55.614+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:51:13.075+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 259ms 2016-04-18T11:51:25.986+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 106ms 2016-04-18T11:51:28.963+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:52:05.050+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:52:24.064+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3070, after asserts: 3660, after connections: 4070, after extra_info: 9090, after globalLock: 11850, after locks: 15140, after network: 16340, after opcounters: 16340, after opcountersRepl: 16340, after repl: 43800, after storageEngine: 45720, after tcmalloc: 47080, after wiredTiger: 58960, at end: 66040 } 2016-04-18T11:52:39.095+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:52:42.908+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 172ms 2016-04-18T11:52:55.322+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:52:55.884+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 384ms 2016-04-18T11:53:00.471+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 224ms 2016-04-18T11:53:45.528+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:54:04.415+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:54:11.510+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 218ms 2016-04-18T11:54:15.820+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 111ms 2016-04-18T11:54:47.005+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:55:02.110+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:55:18.489+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 103ms 2016-04-18T11:55:23.644+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1570ms 2016-04-18T11:55:34.812+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T11:55:35.638+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:55:55.074+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2100, after asserts: 3340, after connections: 5090, after extra_info: 9540, after globalLock: 13930, after locks: 16230, after network: 19480, after opcounters: 23140, after opcountersRepl: 25420, after repl: 51860, after storageEngine: 52970, after tcmalloc: 56890, after wiredTiger: 73970, at end: 88540 } 2016-04-18T11:56:01.961+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:56:34.034+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:56:50.633+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 127ms 2016-04-18T11:56:53.477+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:57:03.069+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 568ms 2016-04-18T11:57:15.595+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 182ms 2016-04-18T11:57:27.981+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:57:47.717+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:58:23.234+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-04-18T11:58:25.534+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:58:33.015+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 553ms 2016-04-18T11:58:43.731+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:58:43.673+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T11:58:48.526+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1750, after asserts: 4090, after connections: 6330, after extra_info: 14840, after globalLock: 16230, after locks: 16440, after network: 16770, after opcounters: 16770, after opcountersRepl: 16770, after repl: 42120, after storageEngine: 44660, after tcmalloc: 48590, after wiredTiger: 61430, at end: 75610 } 2016-04-18T11:59:27.253+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T11:59:37.912+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T11:59:54.011+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 243ms 2016-04-18T12:00:03.131+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 777ms 2016-04-18T12:00:17.103+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:00:41.453+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:01:14.678+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T12:01:22.897+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:01:25.296+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1018ms 2016-04-18T12:01:28.800+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 168ms 2016-04-18T12:01:32.653+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:01:32.791+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4150, after asserts: 5780, after connections: 10650, after extra_info: 25150, after globalLock: 27980, after locks: 30650, after network: 32820, after opcounters: 33180, after opcountersRepl: 33180, after repl: 59700, after storageEngine: 63960, after tcmalloc: 68170, after wiredTiger: 79220, at end: 89280 } 2016-04-18T12:02:15.951+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:02:34.255+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 172ms 2016-04-18T12:02:35.007+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:02:43.828+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 526ms 2016-04-18T12:03:01.315+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 285ms 2016-04-18T12:03:15.800+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:03:31.256+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:04:11.036+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2410, after asserts: 3850, after connections: 4730, after extra_info: 8240, after globalLock: 10150, after locks: 11450, after network: 11660, after opcounters: 11660, after opcountersRepl: 11660, after repl: 29080, after storageEngine: 31850, after tcmalloc: 38140, after wiredTiger: 49200, at end: 61190 } 2016-04-18T12:04:11.715+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:04:12.199+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 456ms 2016-04-18T12:04:27.445+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T12:04:33.633+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:05:25.434+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:05:41.978+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 166ms 2016-04-18T12:05:42.129+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:05:43.854+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 404ms 2016-04-18T12:05:48.474+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 300ms 2016-04-18T12:06:09.902+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:06:29.616+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:07:01.628+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 282ms 2016-04-18T12:07:06.485+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:07:14.981+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1052ms 2016-04-18T12:07:16.315+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 354ms 2016-04-18T12:07:23.361+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3830, after asserts: 6030, after connections: 7800, after extra_info: 15960, after globalLock: 16820, after locks: 16890, after network: 17910, after opcounters: 19640, after opcountersRepl: 19720, after repl: 44190, after storageEngine: 47080, after tcmalloc: 51240, after wiredTiger: 63520, at end: 72700 } 2016-04-18T12:07:23.842+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:08:03.642+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:08:18.343+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:08:26.321+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 102ms 2016-04-18T12:08:42.391+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1250ms 2016-04-18T12:08:59.224+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:09:16.842+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:09:57.310+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 258ms 2016-04-18T12:09:59.809+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:10:03.038+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 469ms 2016-04-18T12:10:07.609+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:10:14.819+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-04-18T12:10:20.164+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3490, after asserts: 5520, after connections: 9080, after extra_info: 17340, after globalLock: 21420, after locks: 21830, after network: 21830, after opcounters: 21830, after opcountersRepl: 21830, after repl: 55680, after storageEngine: 58450, after tcmalloc: 59150, after wiredTiger: 67390, at end: 79880 } 2016-04-18T12:10:48.188+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:11:05.233+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:11:18.706+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 306ms 2016-04-18T12:11:31.966+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 4857ms 2016-04-18T12:11:46.464+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:12:05.931+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:12:39.868+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:12:44.370+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 844ms 2016-04-18T12:12:54.762+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 588ms 2016-04-18T12:12:56.852+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:13:13.323+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2780, after asserts: 7330, after connections: 12120, after extra_info: 16410, after globalLock: 23410, after locks: 27000, after network: 28800, after opcounters: 28800, after opcountersRepl: 28800, after repl: 45630, after storageEngine: 48810, after tcmalloc: 52340, after wiredTiger: 63610, at end: 82900 } 2016-04-18T12:13:42.808+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:14:05.830+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:14:11.378+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 615ms 2016-04-18T12:14:13.270+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 656ms 2016-04-18T12:14:20.264+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 141ms 2016-04-18T12:14:38.176+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:14:56.188+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:15:33.331+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 191ms 2016-04-18T12:15:43.389+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:15:45.603+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1522ms 2016-04-18T12:15:51.576+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T12:16:01.590+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:16:03.618+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3690, after asserts: 5160, after connections: 8890, after extra_info: 17980, after globalLock: 21120, after locks: 25490, after network: 26640, after opcounters: 26970, after opcountersRepl: 26970, after repl: 55010, after storageEngine: 58950, after tcmalloc: 62500, after wiredTiger: 80400, at end: 88130 } 2016-04-18T12:16:49.409+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:17:04.797+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 235ms 2016-04-18T12:17:08.678+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:17:18.778+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1062ms 2016-04-18T12:17:27.149+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 156ms 2016-04-18T12:17:55.212+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:18:16.946+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:18:39.032+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 356ms 2016-04-18T12:18:48.956+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1421ms 2016-04-18T12:19:01.452+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3580, after asserts: 5120, after connections: 7920, after extra_info: 13840, after globalLock: 18790, after locks: 20710, after network: 20880, after opcounters: 20880, after opcountersRepl: 20880, after repl: 52280, after storageEngine: 53840, after tcmalloc: 54370, after wiredTiger: 61550, at end: 70280 } 2016-04-18T12:19:04.396+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:19:04.477+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 216ms 2016-04-18T12:19:08.511+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 4449ms 2016-04-18T12:19:26.747+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:20:15.554+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 209ms 2016-04-18T12:20:16.512+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:20:28.685+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2194ms 2016-04-18T12:20:34.617+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:20:36.897+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 284ms 2016-04-18T12:21:19.893+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:21:41.794+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:21:48.568+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 137ms 2016-04-18T12:21:55.064+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4070, after asserts: 4860, after connections: 5210, after extra_info: 12620, after globalLock: 15980, after locks: 17780, after network: 17910, after opcounters: 17910, after opcountersRepl: 17910, after repl: 27970, after storageEngine: 29600, after tcmalloc: 34170, after wiredTiger: 45060, at end: 62060 } 2016-04-18T12:21:56.963+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 349ms 2016-04-18T12:22:18.599+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:22:19.318+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-04-18T12:22:38.827+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:23:21.235+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:23:22.454+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 863ms 2016-04-18T12:23:32.322+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:23:51.765+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:24:08.173+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:24:33.137+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 674ms 2016-04-18T12:24:42.783+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:24:44.103+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 703ms 2016-04-18T12:24:44.517+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 300ms 2016-04-18T12:24:58.230+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:25:02.455+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3000, after asserts: 5620, after connections: 8450, after extra_info: 13530, after globalLock: 16900, after locks: 20920, after network: 22530, after opcounters: 22530, after opcountersRepl: 22530, after repl: 47320, after storageEngine: 49350, after tcmalloc: 54840, after wiredTiger: 64430, at end: 74680 } 2016-04-18T12:25:47.458+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T12:25:48.378+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:25:57.819+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 895ms 2016-04-18T12:26:10.211+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:26:10.288+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 116ms 2016-04-18T12:26:50.599+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:27:06.244+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:27:17.418+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2200, after asserts: 3270, after connections: 3780, after extra_info: 8510, after globalLock: 11050, after locks: 12570, after network: 12950, after opcounters: 12950, after opcountersRepl: 12950, after repl: 23890, after storageEngine: 24320, after tcmalloc: 27270, after wiredTiger: 31790, at end: 46240 } 2016-04-18T12:27:28.448+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 511ms 2016-04-18T12:27:39.276+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 816ms 2016-04-18T12:27:39.952+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:27:54.242+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 103ms 2016-04-18T12:28:14.436+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:28:44.065+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:29:00.788+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:29:06.745+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 538ms 2016-04-18T12:29:19.745+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1393ms 2016-04-18T12:29:31.187+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 131ms 2016-04-18T12:29:39.398+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:30:04.569+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:30:19.432+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3000, after asserts: 6580, after connections: 9010, after extra_info: 22990, after globalLock: 24930, after locks: 26400, after network: 26880, after opcounters: 26880, after opcountersRepl: 26880, after repl: 35800, after storageEngine: 38950, after tcmalloc: 42110, after wiredTiger: 56920, at end: 71210 } 2016-04-18T12:30:40.154+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 440ms 2016-04-18T12:30:49.851+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 274ms 2016-04-18T12:30:50.478+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:30:55.224+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 115ms 2016-04-18T12:31:01.850+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:31:45.287+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:32:08.595+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 171ms 2016-04-18T12:32:09.068+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:32:18.019+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1318ms 2016-04-18T12:32:19.711+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 952ms 2016-04-18T12:33:00.397+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:33:19.110+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:33:33.233+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 310ms 2016-04-18T12:33:46.893+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:33:51.187+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 682ms 2016-04-18T12:34:02.621+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1870, after asserts: 3790, after connections: 6640, after extra_info: 10910, after globalLock: 12610, after locks: 14790, after network: 15260, after opcounters: 15260, after opcountersRepl: 15260, after repl: 47070, after storageEngine: 49880, after tcmalloc: 55020, after wiredTiger: 63840, at end: 74200 } 2016-04-18T12:34:02.638+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 276ms 2016-04-18T12:34:02.606+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:34:54.212+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:35:05.778+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:35:14.122+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 247ms 2016-04-18T12:35:37.759+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:35:51.389+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:36:26.830+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 369ms 2016-04-18T12:36:29.899+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:36:34.000+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 111ms 2016-04-18T12:36:50.798+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:37:06.991+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4180, after asserts: 6580, after connections: 9640, after extra_info: 14540, after globalLock: 17730, after locks: 18920, after network: 20690, after opcounters: 20930, after opcountersRepl: 20930, after repl: 48870, after storageEngine: 52390, after tcmalloc: 54520, after wiredTiger: 69150, at end: 82310 } 2016-04-18T12:37:17.374+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:37:52.787+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 105ms 2016-04-18T12:38:00.845+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 400ms 2016-04-18T12:38:01.642+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:38:33.633+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:39:10.053+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:39:12.634+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 143ms 2016-04-18T12:39:21.399+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1189ms 2016-04-18T12:39:23.403+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:39:25.980+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 189ms 2016-04-18T12:39:51.092+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:40:07.497+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2300, after asserts: 4130, after connections: 5590, after extra_info: 10710, after globalLock: 14220, after locks: 16490, after network: 17660, after opcounters: 18450, after opcountersRepl: 18760, after repl: 41880, after storageEngine: 45080, after tcmalloc: 51060, after wiredTiger: 61630, at end: 78130 } 2016-04-18T12:40:08.289+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:40:27.832+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 286ms 2016-04-18T12:40:48.578+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:41:06.341+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:41:37.944+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 279ms 2016-04-18T12:41:45.597+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:41:53.011+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 853ms 2016-04-18T12:42:00.455+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 285ms 2016-04-18T12:42:00.143+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:42:43.154+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:43:00.116+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:43:14.973+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3530, after asserts: 4420, after connections: 8210, after extra_info: 13640, after globalLock: 15200, after locks: 17280, after network: 17810, after opcounters: 17810, after opcountersRepl: 17810, after repl: 43440, after storageEngine: 47000, after tcmalloc: 54820, after wiredTiger: 65090, at end: 81350 } 2016-04-18T12:43:14.973+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-04-18T12:43:28.461+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 846ms 2016-04-18T12:43:33.975+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:43:35.003+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 181ms 2016-04-18T12:44:05.601+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:44:41.556+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:44:43.655+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 581ms 2016-04-18T12:44:54.387+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1692ms 2016-04-18T12:45:00.820+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:45:02.116+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 295ms 2016-04-18T12:45:06.193+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 5425ms 2016-04-18T12:45:31.798+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:45:42.322+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:46:06.904+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2660, after asserts: 4640, after connections: 6340, after extra_info: 13000, after globalLock: 13980, after locks: 14370, after network: 14630, after opcounters: 14630, after opcountersRepl: 14630, after repl: 21280, after storageEngine: 27380, after tcmalloc: 30940, after wiredTiger: 41280, at end: 55010 } 2016-04-18T12:46:13.379+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 259ms 2016-04-18T12:46:14.670+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:46:17.200+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 712ms 2016-04-18T12:46:29.674+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 124ms 2016-04-18T12:46:44.590+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:47:04.248+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:47:35.604+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 432ms 2016-04-18T12:47:45.705+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:47:50.483+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1125ms 2016-04-18T12:47:57.885+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 766ms 2016-04-18T12:48:04.202+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:48:40.822+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:49:03.422+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4160, after asserts: 6650, after connections: 9290, after extra_info: 12910, after globalLock: 18530, after locks: 22140, after network: 24370, after opcounters: 31330, after opcountersRepl: 31550, after repl: 56810, after storageEngine: 60060, after tcmalloc: 69610, after wiredTiger: 79920, at end: 93340 } 2016-04-18T12:49:04.936+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:49:08.480+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 389ms 2016-04-18T12:49:10.641+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 778ms 2016-04-18T12:49:24.000+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 125ms 2016-04-18T12:49:43.433+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:50:03.441+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:50:29.305+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 196ms 2016-04-18T12:50:37.607+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 557ms 2016-04-18T12:50:43.000+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:51:11.531+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:51:37.491+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2120, after asserts: 4300, after connections: 6530, after extra_info: 13800, after globalLock: 15370, after locks: 15600, after network: 16660, after opcounters: 17740, after opcountersRepl: 17740, after repl: 39390, after storageEngine: 40900, after tcmalloc: 44640, after wiredTiger: 50250, at end: 65030 } 2016-04-18T12:51:47.313+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 275ms 2016-04-18T12:51:52.038+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:51:53.296+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 566ms 2016-04-18T12:52:02.104+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:52:38.776+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:52:55.071+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 189ms 2016-04-18T12:52:54.850+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:52:57.323+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 211ms 2016-04-18T12:53:18.805+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:53:38.150+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:53:59.853+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 231ms 2016-04-18T12:54:16.045+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 703ms 2016-04-18T12:54:23.954+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:54:36.464+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:54:36.204+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2790, after asserts: 3390, after connections: 4050, after extra_info: 8220, after globalLock: 11670, after locks: 13250, after network: 14380, after opcounters: 15110, after opcountersRepl: 15110, after repl: 42800, after storageEngine: 47950, after tcmalloc: 57410, after wiredTiger: 64670, at end: 73670 } 2016-04-18T12:55:14.253+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:55:26.418+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 479ms 2016-04-18T12:55:29.932+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 343ms 2016-04-18T12:55:33.228+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:56:12.712+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:56:31.075+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:56:40.239+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 110ms 2016-04-18T12:56:47.613+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 128ms 2016-04-18T12:56:55.084+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:57:17.880+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5240, after asserts: 6060, after connections: 6850, after extra_info: 12340, after globalLock: 13760, after locks: 13760, after network: 13810, after opcounters: 15640, after opcountersRepl: 15640, after repl: 33870, after storageEngine: 36950, after tcmalloc: 41450, after wiredTiger: 47040, at end: 65170 } 2016-04-18T12:57:18.225+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:57:24.856+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:57:54.863+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:57:55.020+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 195ms 2016-04-18T12:57:55.481+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 290ms 2016-04-18T12:57:55.564+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:57:55.564+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:57:55.564+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:58:23.264+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T12:58:45.653+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:58:57.581+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 497ms 2016-04-18T12:59:11.179+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 608ms 2016-04-18T12:59:15.207+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:59:15.391+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 334ms 2016-04-18T12:59:34.127+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T12:59:45.427+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2600, after asserts: 5770, after connections: 8200, after extra_info: 15600, after globalLock: 17840, after locks: 19150, after network: 20580, after opcounters: 21000, after opcountersRepl: 21000, after repl: 42020, after storageEngine: 43580, after tcmalloc: 45350, after wiredTiger: 57920, at end: 69660 } 2016-04-18T12:59:49.923+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:00:19.664+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 239ms 2016-04-18T13:00:24.445+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:00:27.999+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 800ms 2016-04-18T13:00:30.652+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1291ms 2016-04-18T13:00:36.318+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:01:00.613+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:01:13.438+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:01:40.159+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2010ms 2016-04-18T13:01:48.321+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 281ms 2016-04-18T13:01:49.612+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:02:00.317+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2800, after asserts: 4550, after connections: 7980, after extra_info: 13120, after globalLock: 15450, after locks: 16670, after network: 16760, after opcounters: 16760, after opcountersRepl: 16760, after repl: 34250, after storageEngine: 35820, after tcmalloc: 39000, after wiredTiger: 48780, at end: 52330 } 2016-04-18T13:02:02.349+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:02:36.057+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:02:45.804+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:02:57.607+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 186ms 2016-04-18T13:03:08.154+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1177ms 2016-04-18T13:03:18.186+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 107ms 2016-04-18T13:03:23.751+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:03:34.767+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:04:04.501+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:04:20.206+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:04:27.395+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1821ms 2016-04-18T13:04:32.938+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4360, after asserts: 6910, after connections: 10220, after extra_info: 13980, after globalLock: 17300, after locks: 22110, after network: 22530, after opcounters: 22530, after opcountersRepl: 22530, after repl: 39920, after storageEngine: 42450, after tcmalloc: 50910, after wiredTiger: 61050, at end: 70970 } 2016-04-18T13:04:35.993+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1571ms 2016-04-18T13:05:00.281+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:05:15.476+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:05:40.616+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:05:44.755+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 166ms 2016-04-18T13:05:58.169+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1457ms 2016-04-18T13:06:03.155+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:06:06.785+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 173ms 2016-04-18T13:06:40.160+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:06:58.329+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:07:04.640+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1640, after asserts: 3050, after connections: 5850, after extra_info: 9130, after globalLock: 10340, after locks: 10990, after network: 11470, after opcounters: 12380, after opcountersRepl: 12380, after repl: 39770, after storageEngine: 42850, after tcmalloc: 46880, after wiredTiger: 49240, at end: 60110 } 2016-04-18T13:07:14.589+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 512ms 2016-04-18T13:07:22.035+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:07:25.965+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1162ms 2016-04-18T13:07:56.381+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:08:31.095+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:08:38.435+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:08:38.447+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3829ms 2016-04-18T13:09:13.164+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:09:33.681+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:09:41.178+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1070, after asserts: 1670, after connections: 1940, after extra_info: 2460, after globalLock: 2460, after locks: 2460, after network: 2460, after opcounters: 2460, after opcountersRepl: 2460, after repl: 10060, after storageEngine: 13460, after tcmalloc: 18400, after wiredTiger: 27610, at end: 37350 } 2016-04-18T13:09:41.925+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 114ms 2016-04-18T13:09:51.018+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1276ms 2016-04-18T13:10:27.741+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:10:43.461+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:11:03.608+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 329ms 2016-04-18T13:11:10.945+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 728ms 2016-04-18T13:11:22.148+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:11:23.201+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 281ms 2016-04-18T13:11:53.121+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:12:00.271+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2760, after asserts: 3580, after connections: 5200, after extra_info: 10720, after globalLock: 14770, after locks: 16940, after network: 18600, after opcounters: 18600, after opcountersRepl: 18600, after repl: 26720, after storageEngine: 28450, after tcmalloc: 30210, after wiredTiger: 40600, at end: 48530 } 2016-04-18T13:12:12.467+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:12:25.872+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 410ms 2016-04-18T13:12:40.468+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:12:57.037+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:13:12.081+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:13:32.367+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 687ms 2016-04-18T13:13:41.013+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1607ms 2016-04-18T13:13:42.456+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:13:49.816+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 806ms 2016-04-18T13:14:05.867+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:14:37.106+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:14:59.754+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:15:00.971+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 384ms 2016-04-18T13:15:07.441+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4780, after asserts: 5720, after connections: 6840, after extra_info: 10050, after globalLock: 12940, after locks: 15410, after network: 19160, after opcounters: 20240, after opcountersRepl: 20240, after repl: 50850, after storageEngine: 52680, after tcmalloc: 56470, after wiredTiger: 68020, at end: 78180 } 2016-04-18T13:15:11.206+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 863ms 2016-04-18T13:15:11.407+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 169ms 2016-04-18T13:15:11.416+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:15:35.470+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:15:53.488+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:16:14.249+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 927ms 2016-04-18T13:16:23.108+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 535ms 2016-04-18T13:16:32.019+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 121ms 2016-04-18T13:16:40.445+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:17:05.250+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:17:37.884+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 416ms 2016-04-18T13:17:45.397+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:17:52.269+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1513ms 2016-04-18T13:17:59.839+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 142ms 2016-04-18T13:18:00.227+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3830, after asserts: 5310, after connections: 8950, after extra_info: 17020, after globalLock: 19450, after locks: 21320, after network: 22180, after opcounters: 22830, after opcountersRepl: 22940, after repl: 50420, after storageEngine: 52350, after tcmalloc: 54370, after wiredTiger: 63820, at end: 76380 } 2016-04-18T13:18:04.586+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:18:52.817+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:19:06.981+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:19:13.160+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 258ms 2016-04-18T13:19:25.550+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 415ms 2016-04-18T13:19:40.181+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 289ms 2016-04-18T13:19:40.504+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:19:52.935+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:20:42.678+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:20:49.369+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 151ms 2016-04-18T13:20:49.770+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5620, after asserts: 5930, after connections: 6250, after extra_info: 10840, after globalLock: 13670, after locks: 14810, after network: 14980, after opcounters: 14980, after opcountersRepl: 14980, after repl: 39860, after storageEngine: 45040, after tcmalloc: 49030, after wiredTiger: 55380, at end: 66450 } 2016-04-18T13:20:53.116+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:20:53.163+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 202ms 2016-04-18T13:21:32.921+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:21:48.617+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:21:54.875+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 269ms 2016-04-18T13:22:07.976+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 113ms 2016-04-18T13:22:15.174+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 225ms 2016-04-18T13:22:23.316+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:22:46.038+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:23:25.813+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 528ms 2016-04-18T13:23:33.095+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:23:48.010+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1907ms 2016-04-18T13:23:51.919+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5220, after asserts: 5610, after connections: 6260, after extra_info: 10580, after globalLock: 12700, after locks: 14010, after network: 14130, after opcounters: 14130, after opcountersRepl: 14130, after repl: 51660, after storageEngine: 56300, after tcmalloc: 58310, after wiredTiger: 73770, at end: 88200 } 2016-04-18T13:23:52.140+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:23:54.421+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 657ms 2016-04-18T13:24:23.148+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:24:47.858+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:25:04.362+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 325ms 2016-04-18T13:25:14.370+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 950ms 2016-04-18T13:25:29.029+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:25:47.820+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:26:27.180+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 347ms 2016-04-18T13:26:41.918+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:26:41.918+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 655ms 2016-04-18T13:26:59.416+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1770, after asserts: 3220, after connections: 6760, after extra_info: 12870, after globalLock: 17810, after locks: 21390, after network: 24640, after opcounters: 26200, after opcountersRepl: 26820, after repl: 43930, after storageEngine: 48350, after tcmalloc: 53370, after wiredTiger: 64420, at end: 74130 } 2016-04-18T13:27:00.979+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:27:41.338+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:27:49.962+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 118ms 2016-04-18T13:28:03.119+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 868ms 2016-04-18T13:28:03.776+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:28:20.063+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-04-18T13:28:52.540+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:29:01.248+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:29:36.337+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 754ms 2016-04-18T13:29:43.842+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:29:47.716+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 501ms 2016-04-18T13:29:55.475+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:29:59.544+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T13:30:22.549+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:30:23.294+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5310, after asserts: 11070, after connections: 13270, after extra_info: 21930, after globalLock: 25780, after locks: 28160, after network: 29110, after opcounters: 29110, after opcountersRepl: 29110, after repl: 52940, after storageEngine: 56440, after tcmalloc: 62060, after wiredTiger: 72570, at end: 88910 } 2016-04-18T13:30:43.559+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:31:07.529+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 196ms 2016-04-18T13:31:25.275+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1201ms 2016-04-18T13:31:36.317+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:32:08.997+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:32:31.154+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:32:46.353+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 335ms 2016-04-18T13:33:00.660+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1837ms 2016-04-18T13:33:10.221+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 209ms 2016-04-18T13:33:10.738+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:33:31.279+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:33:47.312+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4240, after asserts: 6320, after connections: 7880, after extra_info: 13940, after globalLock: 16420, after locks: 18570, after network: 19070, after opcounters: 19070, after opcountersRepl: 19070, after repl: 25890, after storageEngine: 29120, after tcmalloc: 33750, after wiredTiger: 52540, at end: 59790 } 2016-04-18T13:34:08.762+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:34:20.190+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 154ms 2016-04-18T13:34:31.399+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 388ms 2016-04-18T13:34:43.933+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T13:34:57.039+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:35:38.236+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:35:48.445+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 356ms 2016-04-18T13:35:56.770+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:35:57.231+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 115ms 2016-04-18T13:36:29.926+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:36:45.869+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 500, after asserts: 1920, after connections: 2910, after extra_info: 8190, after globalLock: 8390, after locks: 10190, after network: 11770, after opcounters: 11770, after opcountersRepl: 11770, after repl: 29850, after storageEngine: 32980, after tcmalloc: 36420, after wiredTiger: 49090, at end: 63430 } 2016-04-18T13:36:58.781+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 114ms 2016-04-18T13:37:02.053+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:37:11.990+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 482ms 2016-04-18T13:37:24.717+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 163ms 2016-04-18T13:37:44.395+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:38:01.001+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:38:36.214+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 180ms 2016-04-18T13:38:38.929+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:38:45.032+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 214ms 2016-04-18T13:39:03.710+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:39:24.042+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:39:57.831+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 381ms 2016-04-18T13:40:11.061+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:40:14.026+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 131ms 2016-04-18T13:40:22.388+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3120, after asserts: 5220, after connections: 10230, after extra_info: 12000, after globalLock: 13370, after locks: 15060, after network: 16520, after opcounters: 16520, after opcountersRepl: 16520, after repl: 46350, after storageEngine: 50350, after tcmalloc: 55940, after wiredTiger: 65100, at end: 76060 } 2016-04-18T13:40:23.665+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:41:11.134+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:41:16.007+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 427ms 2016-04-18T13:41:24.086+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:41:28.495+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1057ms 2016-04-18T13:41:34.302+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 102ms 2016-04-18T13:42:01.378+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:42:18.891+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:42:46.555+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 711ms 2016-04-18T13:42:55.580+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2130, after asserts: 4710, after connections: 10060, after extra_info: 20840, after globalLock: 22290, after locks: 23120, after network: 23530, after opcounters: 23530, after opcountersRepl: 23530, after repl: 43250, after storageEngine: 45070, after tcmalloc: 46720, after wiredTiger: 49540, at end: 58060 } 2016-04-18T13:42:58.887+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:43:01.039+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2232ms 2016-04-18T13:43:09.678+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:43:12.819+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 184ms 2016-04-18T13:43:47.661+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:44:02.962+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:44:21.930+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 141ms 2016-04-18T13:44:32.429+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1247ms 2016-04-18T13:44:42.965+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 125ms 2016-04-18T13:44:44.833+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:45:01.640+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:45:39.328+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:45:48.294+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3760, after asserts: 4850, after connections: 6020, after extra_info: 7790, after globalLock: 10760, after locks: 12030, after network: 13430, after opcounters: 13430, after opcountersRepl: 13430, after repl: 28470, after storageEngine: 31630, after tcmalloc: 38940, after wiredTiger: 46580, at end: 57080 } 2016-04-18T13:45:52.469+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 597ms 2016-04-18T13:45:56.043+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:46:01.255+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1383ms 2016-04-18T13:46:04.749+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 126ms 2016-04-18T13:46:25.306+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:46:37.127+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:47:06.229+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 227ms 2016-04-18T13:47:09.086+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:47:14.034+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 667ms 2016-04-18T13:47:20.126+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:47:25.938+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T13:47:59.946+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:48:18.324+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5320, after asserts: 6840, after connections: 7390, after extra_info: 9830, after globalLock: 10920, after locks: 11460, after network: 11460, after opcounters: 11460, after opcountersRepl: 11460, after repl: 32240, after storageEngine: 36850, after tcmalloc: 39280, after wiredTiger: 49070, at end: 57580 } 2016-04-18T13:48:20.948+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:48:34.030+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 354ms 2016-04-18T13:48:42.090+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 214ms 2016-04-18T13:49:00.609+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:49:18.588+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:49:44.400+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 231ms 2016-04-18T13:49:52.811+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 760ms 2016-04-18T13:49:56.355+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:50:15.924+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:50:30.091+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3060, after asserts: 3920, after connections: 4260, after extra_info: 4580, after globalLock: 5170, after locks: 8180, after network: 10870, after opcounters: 12090, after opcountersRepl: 14330, after repl: 27650, after storageEngine: 30980, after tcmalloc: 32730, after wiredTiger: 40400, at end: 55000 } 2016-04-18T13:50:45.490+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:51:02.482+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T13:51:10.120+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 110ms 2016-04-18T13:51:12.520+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:52:06.658+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:52:18.474+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 535ms 2016-04-18T13:52:28.819+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:52:34.037+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3646ms 2016-04-18T13:52:40.774+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 153ms 2016-04-18T13:53:18.840+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:53:31.091+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:53:49.023+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1370, after asserts: 2940, after connections: 3920, after extra_info: 13150, after globalLock: 16430, after locks: 17780, after network: 20080, after opcounters: 20830, after opcountersRepl: 20830, after repl: 44360, after storageEngine: 48090, after tcmalloc: 51280, after wiredTiger: 74060, at end: 82390 } 2016-04-18T13:53:49.022+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 114ms 2016-04-18T13:53:56.920+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 787ms 2016-04-18T13:54:09.980+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:54:10.373+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 131ms 2016-04-18T13:54:29.322+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:55:01.730+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:55:13.811+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 123ms 2016-04-18T13:55:21.264+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:55:25.580+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 517ms 2016-04-18T13:55:34.874+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T13:56:14.162+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:56:27.537+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 383ms 2016-04-18T13:56:34.308+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 799ms 2016-04-18T13:56:34.512+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:56:38.952+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1420, after asserts: 2280, after connections: 3550, after extra_info: 10940, after globalLock: 15270, after locks: 17590, after network: 19270, after opcounters: 21730, after opcountersRepl: 23340, after repl: 38810, after storageEngine: 41060, after tcmalloc: 44240, after wiredTiger: 53860, at end: 61960 } 2016-04-18T13:56:57.389+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:57:19.198+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:57:36.085+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1177ms 2016-04-18T13:57:56.548+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:58:24.917+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:58:43.686+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 217ms 2016-04-18T13:58:55.468+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 847ms 2016-04-18T13:58:55.969+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:59:20.972+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T13:59:29.975+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3450, after asserts: 5460, after connections: 7470, after extra_info: 13070, after globalLock: 14340, after locks: 15480, after network: 15850, after opcounters: 16910, after opcountersRepl: 16910, after repl: 38240, after storageEngine: 41950, after tcmalloc: 44890, after wiredTiger: 55520, at end: 73550 } 2016-04-18T14:00:04.902+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:00:10.076+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 108ms 2016-04-18T14:00:15.401+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 378ms 2016-04-18T14:00:22.619+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:00:27.209+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 501ms 2016-04-18T14:00:51.117+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:01:05.267+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T14:01:39.749+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 255ms 2016-04-18T14:01:45.890+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:01:47.632+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 583ms 2016-04-18T14:02:04.327+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:02:03.868+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 433ms 2016-04-18T14:02:09.581+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3390, after asserts: 4790, after connections: 7580, after extra_info: 12090, after globalLock: 13910, after locks: 14220, after network: 17160, after opcounters: 17370, after opcountersRepl: 17480, after repl: 41260, after storageEngine: 44400, after tcmalloc: 51840, after wiredTiger: 55320, at end: 66900 } 2016-04-18T14:02:51.374+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:03:07.107+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:03:14.637+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 199ms 2016-04-18T14:03:24.287+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1181ms 2016-04-18T14:03:36.837+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 882ms 2016-04-18T14:03:41.110+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:03:48.892+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:04:31.926+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:04:43.322+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 110ms 2016-04-18T14:04:48.376+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1524ms 2016-04-18T14:04:50.277+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:05:05.312+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2990, after asserts: 5330, after connections: 6840, after extra_info: 10280, after globalLock: 13040, after locks: 16550, after network: 16800, after opcounters: 16800, after opcountersRepl: 16800, after repl: 39670, after storageEngine: 45570, after tcmalloc: 52500, after wiredTiger: 67780, at end: 79190 } 2016-04-18T14:05:05.312+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T14:05:51.913+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:06:13.315+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:06:20.875+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 229ms 2016-04-18T14:06:34.527+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 222ms 2016-04-18T14:06:37.368+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T14:06:43.623+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 183ms 2016-04-18T14:06:52.317+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:07:32.204+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:07:45.863+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 291ms 2016-04-18T14:07:47.601+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:07:48.872+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2350, after asserts: 3190, after connections: 3930, after extra_info: 10400, after globalLock: 12080, after locks: 13520, after network: 14360, after opcounters: 14360, after opcountersRepl: 14360, after repl: 30090, after storageEngine: 37200, after tcmalloc: 38710, after wiredTiger: 43290, at end: 54180 } 2016-04-18T14:07:57.218+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1049ms 2016-04-18T14:08:03.388+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 327ms 2016-04-18T14:08:41.652+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:09:00.803+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:09:13.526+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 125ms 2016-04-18T14:09:19.949+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 355ms 2016-04-18T14:09:31.657+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 535ms 2016-04-18T14:09:32.582+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T14:09:46.027+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:10:33.839+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:10:38.916+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-18T14:10:48.133+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 534ms 2016-04-18T14:10:52.805+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:10:59.059+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 146ms 2016-04-18T14:11:06.312+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4150, after asserts: 6710, after connections: 7840, after extra_info: 14990, after globalLock: 17420, after locks: 19690, after network: 22780, after opcounters: 23130, after opcountersRepl: 23130, after repl: 39940, after storageEngine: 46220, after tcmalloc: 49940, after wiredTiger: 77930, at end: 91380 } 2016-04-18T14:11:28.601+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:11:41.641+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:12:04.655+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:12:10.151+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 320ms 2016-04-18T14:12:26.209+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2686ms 2016-04-18T14:12:26.976+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:12:37.302+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 310ms 2016-04-18T14:12:46.715+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:13:14.297+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:13:23.564+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T14:13:34.365+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3200, after asserts: 6470, after connections: 8140, after extra_info: 14210, after globalLock: 14680, after locks: 14680, after network: 14680, after opcounters: 14680, after opcountersRepl: 14680, after repl: 19270, after storageEngine: 21730, after tcmalloc: 24990, after wiredTiger: 37090, at end: 46430 } 2016-04-18T14:13:45.906+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:13:47.573+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 174ms 2016-04-18T14:13:56.472+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1496ms 2016-04-18T14:14:06.266+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 969ms 2016-04-18T14:14:07.195+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:15:00.805+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:15:18.787+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T14:15:18.814+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 154ms 2016-04-18T14:15:28.880+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 412ms 2016-04-18T14:15:35.473+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1420ms 2016-04-18T14:15:56.959+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:16:06.340+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5450, after asserts: 8110, after connections: 10020, after extra_info: 14560, after globalLock: 16320, after locks: 16740, after network: 16980, after opcounters: 16980, after opcountersRepl: 16980, after repl: 27780, after storageEngine: 31270, after tcmalloc: 34870, after wiredTiger: 41650, at end: 42940 } 2016-04-18T14:16:14.936+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T14:16:44.059+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:16:49.223+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 479ms 2016-04-18T14:16:58.727+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 812ms 2016-04-18T14:17:00.650+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:17:06.792+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T14:17:43.456+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:18:09.470+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:18:19.017+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1271ms 2016-04-18T14:18:35.233+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 193ms 2016-04-18T14:18:42.003+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:18:57.937+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5420, after asserts: 8280, after connections: 9920, after extra_info: 13920, after globalLock: 18080, after locks: 23190, after network: 24250, after opcounters: 24380, after opcountersRepl: 24380, after repl: 48650, after storageEngine: 51640, after tcmalloc: 62480, after wiredTiger: 71580, at end: 78270 } 2016-04-18T14:19:06.296+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:19:37.969+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:19:57.448+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:20:00.068+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 170ms 2016-04-18T14:20:07.873+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 663ms 2016-04-18T14:20:18.466+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 150ms 2016-04-18T14:20:42.513+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:20:58.491+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:21:25.836+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 316ms 2016-04-18T14:21:35.000+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 25815ms 2016-04-18T14:21:37.577+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 498ms 2016-04-18T14:21:40.030+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:21:45.944+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-04-18T14:21:54.289+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2130, after asserts: 2960, after connections: 3300, after extra_info: 6690, after globalLock: 10050, after locks: 10410, after network: 10630, after opcounters: 10630, after opcountersRepl: 10630, after repl: 29770, after storageEngine: 32790, after tcmalloc: 36090, after wiredTiger: 49620, at end: 57910 } 2016-04-18T14:21:58.069+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T14:22:43.868+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:23:01.497+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1645ms 2016-04-18T14:23:08.376+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:23:12.618+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 549ms 2016-04-18T14:23:30.119+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1609ms 2016-04-18T14:23:48.194+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:24:07.911+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:24:47.106+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:24:48.326+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 159ms 2016-04-18T14:24:58.076+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 914ms 2016-04-18T14:25:06.650+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2310, after asserts: 3490, after connections: 6430, after extra_info: 10970, after globalLock: 13560, after locks: 21140, after network: 22100, after opcounters: 22100, after opcountersRepl: 22100, after repl: 46650, after storageEngine: 48440, after tcmalloc: 50870, after wiredTiger: 62580, at end: 79790 } 2016-04-18T14:25:07.418+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:25:08.862+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 124ms 2016-04-18T14:26:07.671+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:26:19.321+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 159ms 2016-04-18T14:26:19.372+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:26:29.426+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1911ms 2016-04-18T14:26:37.230+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 558ms 2016-04-18T14:27:11.489+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:27:17.732+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 36836ms 2016-04-18T14:27:21.225+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:27:48.698+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 947ms 2016-04-18T14:27:55.789+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:28:01.527+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 467ms 2016-04-18T14:28:05.732+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 113ms 2016-04-18T14:28:11.080+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:28:31.840+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3350, after asserts: 5340, after connections: 6090, after extra_info: 9580, after globalLock: 16970, after locks: 18150, after network: 18800, after opcounters: 18800, after opcountersRepl: 18800, after repl: 42280, after storageEngine: 47050, after tcmalloc: 50510, after wiredTiger: 61970, at end: 72820 } 2016-04-18T14:29:00.278+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:29:15.409+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:29:15.984+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 323ms 2016-04-18T14:29:29.794+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1765ms 2016-04-18T14:29:42.250+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 144ms 2016-04-18T14:30:08.354+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:30:24.695+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:30:45.098+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 434ms 2016-04-18T14:30:58.116+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 417ms 2016-04-18T14:31:03.374+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:31:08.563+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2172ms 2016-04-18T14:31:13.356+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:31:33.948+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:32:07.836+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:32:16.531+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6850, after asserts: 8100, after connections: 12670, after extra_info: 22720, after globalLock: 28700, after locks: 29070, after network: 29290, after opcounters: 29290, after opcountersRepl: 29290, after repl: 47610, after storageEngine: 49440, after tcmalloc: 55190, after wiredTiger: 66080, at end: 79510 } 2016-04-18T14:32:19.659+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 475ms 2016-04-18T14:32:34.013+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 348ms 2016-04-18T14:32:36.938+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:32:44.482+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 533ms 2016-04-18T14:33:11.826+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:33:27.146+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:33:56.116+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 119ms 2016-04-18T14:33:59.117+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:34:06.360+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 220ms 2016-04-18T14:34:21.877+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 596ms 2016-04-18T14:34:22.111+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:34:41.383+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:35:11.913+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:35:18.354+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2340, after asserts: 4330, after connections: 7180, after extra_info: 12880, after globalLock: 19090, after locks: 21410, after network: 23190, after opcounters: 24890, after opcountersRepl: 24990, after repl: 42960, after storageEngine: 43690, after tcmalloc: 49060, after wiredTiger: 55100, at end: 63870 } 2016-04-18T14:35:21.603+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T14:35:31.761+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 120ms 2016-04-18T14:35:43.692+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:35:44.096+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 674ms 2016-04-18T14:35:59.709+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 787ms 2016-04-18T14:36:02.960+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:36:35.453+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:36:58.603+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:37:08.504+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 181ms 2016-04-18T14:37:19.601+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 273ms 2016-04-18T14:37:33.433+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 415ms 2016-04-18T14:37:38.584+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:38:01.373+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:38:25.092+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2490, after asserts: 4490, after connections: 5500, after extra_info: 8130, after globalLock: 11920, after locks: 13570, after network: 14990, after opcounters: 14990, after opcountersRepl: 14990, after repl: 37220, after storageEngine: 41260, after tcmalloc: 47350, after wiredTiger: 75560, at end: 85140 } 2016-04-18T14:38:38.914+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:38:42.886+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 632ms 2016-04-18T14:39:00.461+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 619ms 2016-04-18T14:39:08.922+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:39:16.234+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 110ms 2016-04-18T14:39:37.213+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T14:39:50.617+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:40:23.209+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 447ms 2016-04-18T14:40:31.247+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T14:40:32.890+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 385ms 2016-04-18T14:40:48.207+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:41:02.372+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2870, after asserts: 5130, after connections: 6200, after extra_info: 8510, after globalLock: 11350, after locks: 13970, after network: 14160, after opcounters: 14160, after opcountersRepl: 14160, after repl: 32280, after storageEngine: 35930, after tcmalloc: 39660, after wiredTiger: 50740, at end: 65720 } 2016-04-18T14:41:28.802+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:41:38.560+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 109ms 2016-04-18T14:41:51.951+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 610ms 2016-04-18T14:42:01.142+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 959ms 2016-04-18T14:42:03.934+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:42:52.411+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:43:11.263+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 166ms 2016-04-18T14:43:11.875+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:43:21.452+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 292ms 2016-04-18T14:43:25.853+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 947ms 2016-04-18T14:43:56.489+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T14:44:13.490+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:44:24.172+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5010, after asserts: 7750, after connections: 11800, after extra_info: 17270, after globalLock: 17970, after locks: 18310, after network: 18310, after opcounters: 18310, after opcountersRepl: 18310, after repl: 42380, after storageEngine: 44690, after tcmalloc: 48810, after wiredTiger: 57750, at end: 73260 } 2016-04-18T14:44:42.102+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 460ms 2016-04-18T14:44:51.948+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 247ms 2016-04-18T14:45:01.167+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T14:45:23.852+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:45:55.661+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:46:05.758+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 113ms 2016-04-18T14:46:09.536+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 228ms 2016-04-18T14:46:11.246+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:46:21.714+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 171ms 2016-04-18T14:46:51.054+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:47:15.008+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:47:17.072+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1990, after asserts: 2200, after connections: 3290, after extra_info: 4570, after globalLock: 6980, after locks: 12430, after network: 14410, after opcounters: 15230, after opcountersRepl: 15230, after repl: 39920, after storageEngine: 42440, after tcmalloc: 50140, after wiredTiger: 57730, at end: 70050 } 2016-04-18T14:47:35.789+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 119ms 2016-04-18T14:47:45.936+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1803ms 2016-04-18T14:47:54.020+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:47:56.402+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 153ms 2016-04-18T14:48:08.358+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:48:47.495+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:49:00.420+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1428ms 2016-04-18T14:49:07.119+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:49:09.641+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1228ms 2016-04-18T14:49:21.260+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T14:49:24.489+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2190, after asserts: 3980, after connections: 4560, after extra_info: 11520, after globalLock: 12980, after locks: 13550, after network: 13550, after opcounters: 13550, after opcountersRepl: 13550, after repl: 26970, after storageEngine: 29840, after tcmalloc: 36550, after wiredTiger: 44760, at end: 59130 } 2016-04-18T14:49:36.661+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:50:07.900+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:50:33.772+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 318ms 2016-04-18T14:50:57.889+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T14:51:20.017+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:51:40.418+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1004ms 2016-04-18T14:51:54.585+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1328ms 2016-04-18T14:51:58.169+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:51:59.190+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 824ms 2016-04-18T14:52:12.944+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:52:53.906+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T14:53:05.608+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 820ms 2016-04-18T14:53:08.075+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2250, after asserts: 8620, after connections: 10480, after extra_info: 14460, after globalLock: 16780, after locks: 20540, after network: 22040, after opcounters: 22040, after opcountersRepl: 22040, after repl: 36910, after storageEngine: 41980, after tcmalloc: 46610, after wiredTiger: 51530, at end: 59790 } 2016-04-18T14:53:13.498+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:53:17.487+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1533ms 2016-04-18T14:53:44.981+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T14:54:00.012+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:54:23.905+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 467ms 2016-04-18T14:54:33.313+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T14:54:34.560+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 726ms 2016-04-18T14:54:42.944+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 117ms 2016-04-18T14:55:04.282+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:55:22.555+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:55:56.537+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 206ms 2016-04-18T14:56:00.003+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3060, after asserts: 4900, after connections: 5390, after extra_info: 11020, after globalLock: 16710, after locks: 17370, after network: 17370, after opcounters: 17370, after opcountersRepl: 17370, after repl: 42210, after storageEngine: 45540, after tcmalloc: 51910, after wiredTiger: 62390, at end: 71700 } 2016-04-18T14:56:10.699+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 806ms 2016-04-18T14:56:11.690+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:56:22.696+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 620ms 2016-04-18T14:56:36.328+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:57:25.023+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:57:34.507+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:57:41.260+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 249ms 2016-04-18T14:57:49.721+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 579ms 2016-04-18T14:58:01.289+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2139ms 2016-04-18T14:58:17.646+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:58:45.592+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:59:13.356+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 633ms 2016-04-18T14:59:24.965+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T14:59:27.499+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 617ms 2016-04-18T14:59:34.658+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 310ms 2016-04-18T14:59:40.275+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2870, after asserts: 4350, after connections: 6360, after extra_info: 10260, after globalLock: 12750, after locks: 16430, after network: 17260, after opcounters: 17260, after opcountersRepl: 17260, after repl: 49280, after storageEngine: 53710, after tcmalloc: 56870, after wiredTiger: 74160, at end: 81960 } 2016-04-18T14:59:44.541+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T15:00:23.557+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:00:42.229+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 338ms 2016-04-18T15:00:42.621+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:00:47.101+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1427ms 2016-04-18T15:01:02.204+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 107ms 2016-04-18T15:01:15.497+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:01:27.278+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:01:53.934+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1620, after asserts: 2800, after connections: 4340, after extra_info: 6730, after globalLock: 7250, after locks: 7380, after network: 7380, after opcounters: 7380, after opcountersRepl: 7380, after repl: 14710, after storageEngine: 15730, after tcmalloc: 21410, after wiredTiger: 33970, at end: 42660 } 2016-04-18T15:01:56.274+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T15:02:12.808+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:02:13.536+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 121ms 2016-04-18T15:02:25.620+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 835ms 2016-04-18T15:02:45.134+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:03:08.074+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:03:25.406+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:03:41.201+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 477ms 2016-04-18T15:03:56.387+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 406ms 2016-04-18T15:04:01.781+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:04:25.427+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:04:49.031+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 710, after asserts: 1800, after connections: 2910, after extra_info: 8210, after globalLock: 9000, after locks: 9410, after network: 13530, after opcounters: 16630, after opcountersRepl: 16630, after repl: 36690, after storageEngine: 39260, after tcmalloc: 43090, after wiredTiger: 48040, at end: 57090 } 2016-04-18T15:05:02.656+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:05:10.253+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 196ms 2016-04-18T15:05:12.334+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:05:14.955+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1105ms 2016-04-18T15:05:31.358+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 346ms 2016-04-18T15:05:52.112+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:06:16.150+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T15:06:47.337+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:07:08.336+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:07:49.674+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 325ms 2016-04-18T15:07:54.980+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:08:02.666+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 720ms 2016-04-18T15:08:08.225+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2580, after asserts: 6200, after connections: 7110, after extra_info: 11330, after globalLock: 15100, after locks: 18240, after network: 20040, after opcounters: 20040, after opcountersRepl: 20040, after repl: 50740, after storageEngine: 52520, after tcmalloc: 55720, after wiredTiger: 64610, at end: 70900 } 2016-04-18T15:08:12.458+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 854ms 2016-04-18T15:08:16.458+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T15:09:00.694+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:09:18.510+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 843ms 2016-04-18T15:09:22.008+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:09:25.994+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1294ms 2016-04-18T15:09:55.217+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:10:18.317+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T15:10:36.596+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T15:10:47.031+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 192ms 2016-04-18T15:10:57.107+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:10:58.464+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-04-18T15:11:12.356+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3860, after asserts: 5910, after connections: 7390, after extra_info: 12430, after globalLock: 15610, after locks: 17650, after network: 19250, after opcounters: 19720, after opcountersRepl: 19720, after repl: 39220, after storageEngine: 42100, after tcmalloc: 46110, after wiredTiger: 54800, at end: 59400 } 2016-04-18T15:11:15.471+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:12:10.728+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:12:15.502+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 210ms 2016-04-18T15:12:26.772+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:13:09.511+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:13:18.530+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 355ms 2016-04-18T15:13:30.081+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 703ms 2016-04-18T15:13:36.356+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:13:45.394+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 263ms 2016-04-18T15:13:46.531+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2000, after asserts: 3750, after connections: 6500, after extra_info: 9490, after globalLock: 9570, after locks: 9610, after network: 9610, after opcounters: 9610, after opcountersRepl: 9610, after repl: 25780, after storageEngine: 27920, after tcmalloc: 30260, after wiredTiger: 43680, at end: 63020 } 2016-04-18T15:14:19.446+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:14:59.881+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T15:15:01.252+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:15:05.728+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1925ms 2016-04-18T15:15:38.029+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:16:05.151+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T15:16:17.912+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 532ms 2016-04-18T15:16:34.816+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 826ms 2016-04-18T15:16:45.625+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 175ms 2016-04-18T15:16:51.027+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:17:06.136+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2660, after asserts: 3920, after connections: 4650, after extra_info: 5230, after globalLock: 7370, after locks: 9040, after network: 12310, after opcounters: 15780, after opcountersRepl: 16680, after repl: 38290, after storageEngine: 43460, after tcmalloc: 46000, after wiredTiger: 52270, at end: 63690 } 2016-04-18T15:17:21.952+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:17:50.852+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 144ms 2016-04-18T15:18:03.537+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 504ms 2016-04-18T15:18:11.758+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:18:11.790+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T15:18:37.377+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:19:15.045+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 2858ms 2016-04-18T15:19:19.987+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:19:22.361+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 292ms 2016-04-18T15:19:26.199+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 363ms 2016-04-18T15:19:40.968+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T15:20:14.895+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2880, after asserts: 4230, after connections: 4890, after extra_info: 7210, after globalLock: 10890, after locks: 12760, after network: 13510, after opcounters: 13510, after opcountersRepl: 13510, after repl: 26920, after storageEngine: 29320, after tcmalloc: 33920, after wiredTiger: 53520, at end: 68210 } 2016-04-18T15:20:28.081+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 411ms 2016-04-18T15:20:28.033+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:20:44.349+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 273ms 2016-04-18T15:20:54.234+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:21:51.201+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 313ms 2016-04-18T15:21:51.875+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:22:01.934+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1250ms 2016-04-18T15:22:04.817+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 228ms 2016-04-18T15:22:15.145+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:23:01.766+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:23:18.038+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 233ms 2016-04-18T15:23:26.414+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:23:28.509+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 562ms 2016-04-18T15:23:48.137+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 141ms 2016-04-18T15:24:13.356+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2510, after asserts: 4950, after connections: 10670, after extra_info: 18340, after globalLock: 20020, after locks: 23340, after network: 24400, after opcounters: 25620, after opcountersRepl: 25620, after repl: 51750, after storageEngine: 59770, after tcmalloc: 63790, after wiredTiger: 75890, at end: 98670 } 2016-04-18T15:24:16.505+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:24:28.383+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:25:07.244+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 154ms 2016-04-18T15:25:19.271+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2258ms 2016-04-18T15:25:23.356+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:25:29.145+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 170ms 2016-04-18T15:25:37.545+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:26:12.595+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:26:32.765+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 935ms 2016-04-18T15:26:38.293+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:26:39.277+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 327ms 2016-04-18T15:27:12.249+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:27:33.528+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3950, after asserts: 7840, after connections: 14560, after extra_info: 19580, after globalLock: 22750, after locks: 23650, after network: 24880, after opcounters: 24890, after opcountersRepl: 24890, after repl: 39440, after storageEngine: 43150, after tcmalloc: 49190, after wiredTiger: 60570, at end: 75060 } 2016-04-18T15:27:38.711+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:27:46.679+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 130ms 2016-04-18T15:27:55.244+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 658ms 2016-04-18T15:28:07.369+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 202ms 2016-04-18T15:28:33.176+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:28:55.225+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:29:24.076+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T15:29:29.717+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 230ms 2016-04-18T15:29:30.328+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:29:37.362+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1289ms 2016-04-18T15:29:43.839+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:30:22.708+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:30:41.110+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:30:45.552+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 107ms 2016-04-18T15:30:54.555+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3750, after asserts: 6090, after connections: 8850, after extra_info: 15660, after globalLock: 18100, after locks: 20660, after network: 22200, after opcounters: 22700, after opcountersRepl: 22700, after repl: 39960, after storageEngine: 41330, after tcmalloc: 45620, after wiredTiger: 58530, at end: 74430 } 2016-04-18T15:30:55.428+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 479ms 2016-04-18T15:31:14.911+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 186ms 2016-04-18T15:31:28.812+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:31:45.188+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T15:32:29.711+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 127ms 2016-04-18T15:32:30.509+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:32:31.927+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 873ms 2016-04-18T15:32:53.434+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:32:54.003+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 438ms 2016-04-18T15:33:16.079+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:33:52.574+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T15:34:02.018+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 429ms 2016-04-18T15:34:12.454+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1768ms 2016-04-18T15:34:13.269+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2770, after asserts: 6010, after connections: 8510, after extra_info: 11030, after globalLock: 17510, after locks: 20000, after network: 24250, after opcounters: 25720, after opcountersRepl: 30210, after repl: 53840, after storageEngine: 57060, after tcmalloc: 61730, after wiredTiger: 76920, at end: 95830 } 2016-04-18T15:34:17.058+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:34:17.058+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 282ms 2016-04-18T15:35:22.816+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:35:32.587+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 506ms 2016-04-18T15:35:43.212+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 177ms 2016-04-18T15:35:44.176+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:36:19.963+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:36:42.545+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:36:47.542+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 239ms 2016-04-18T15:36:58.884+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 218ms 2016-04-18T15:37:21.724+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:37:39.568+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:37:54.216+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1490, after asserts: 4090, after connections: 6910, after extra_info: 12870, after globalLock: 18510, after locks: 20650, after network: 22860, after opcounters: 26660, after opcountersRepl: 29080, after repl: 68730, after storageEngine: 71500, after tcmalloc: 73250, after wiredTiger: 82710, at end: 99590 } 2016-04-18T15:38:13.141+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 170ms 2016-04-18T15:38:23.005+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 390ms 2016-04-18T15:38:43.792+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 625ms 2016-04-18T15:38:50.890+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:39:05.827+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:39:47.663+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:39:55.156+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 154ms 2016-04-18T15:40:08.560+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 373ms 2016-04-18T15:40:08.770+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:40:23.717+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 374ms 2016-04-18T15:40:49.878+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:41:10.016+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:41:29.948+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4630, after asserts: 6750, after connections: 10610, after extra_info: 18600, after globalLock: 23120, after locks: 25520, after network: 26470, after opcounters: 26670, after opcountersRepl: 26670, after repl: 46000, after storageEngine: 49350, after tcmalloc: 56210, after wiredTiger: 71710, at end: 89840 } 2016-04-18T15:41:36.123+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 253ms 2016-04-18T15:41:43.076+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1100ms 2016-04-18T15:42:19.393+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:42:42.076+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:43:01.182+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T15:43:15.219+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 4364ms 2016-04-18T15:43:21.163+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 435ms 2016-04-18T15:43:31.224+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:43:50.427+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:44:29.408+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:44:29.472+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 163ms 2016-04-18T15:44:45.520+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 15131ms 2016-04-18T15:44:47.720+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3750, after asserts: 6410, after connections: 8360, after extra_info: 17780, after globalLock: 20040, after locks: 22920, after network: 24640, after opcounters: 25070, after opcountersRepl: 25070, after repl: 60400, after storageEngine: 64150, after tcmalloc: 67750, after wiredTiger: 74530, at end: 82540 } 2016-04-18T15:44:51.371+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1824ms 2016-04-18T15:44:56.596+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:44:58.836+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 197ms 2016-04-18T15:45:36.153+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:45:57.359+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:46:04.421+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 254ms 2016-04-18T15:46:15.012+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1620ms 2016-04-18T15:46:25.950+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 150ms 2016-04-18T15:46:40.736+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:46:59.750+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:47:35.839+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 725ms 2016-04-18T15:47:38.335+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:47:47.046+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 724ms 2016-04-18T15:47:52.080+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:48:03.549+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 230ms 2016-04-18T15:48:10.170+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3140, after asserts: 6700, after connections: 20620, after extra_info: 24860, after globalLock: 28360, after locks: 30920, after network: 32620, after opcounters: 34940, after opcountersRepl: 37150, after repl: 60920, after storageEngine: 65240, after tcmalloc: 70980, after wiredTiger: 81430, at end: 94660 } 2016-04-18T15:48:48.496+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:49:05.994+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:49:14.534+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 884ms 2016-04-18T15:49:44.358+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:50:03.518+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:50:27.847+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1576ms 2016-04-18T15:50:33.083+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:50:40.754+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1461ms 2016-04-18T15:51:09.726+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:51:21.949+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5020, after asserts: 6770, after connections: 7320, after extra_info: 9540, after globalLock: 9770, after locks: 15590, after network: 20660, after opcounters: 23740, after opcountersRepl: 26130, after repl: 66480, after storageEngine: 69060, after tcmalloc: 73030, after wiredTiger: 83830, at end: 90670 } 2016-04-18T15:51:24.030+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T15:51:53.550+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2331ms 2016-04-18T15:52:07.524+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:52:08.086+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 333ms 2016-04-18T15:52:26.872+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:53:07.887+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:53:21.962+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 420ms 2016-04-18T15:53:23.939+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:53:30.639+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 440ms 2016-04-18T15:53:40.707+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 138ms 2016-04-18T15:54:04.962+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:54:10.713+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4400, after asserts: 4950, after connections: 6380, after extra_info: 11920, after globalLock: 13550, after locks: 13800, after network: 14020, after opcounters: 14020, after opcountersRepl: 14020, after repl: 43280, after storageEngine: 45060, after tcmalloc: 50790, after wiredTiger: 59740, at end: 66370 } 2016-04-18T15:54:29.570+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:54:51.616+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T15:55:04.410+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 5558ms 2016-04-18T15:55:16.454+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:55:17.868+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 260ms 2016-04-18T15:55:33.571+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:56:15.073+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:56:26.133+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 162ms 2016-04-18T15:56:30.631+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:56:35.688+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 747ms 2016-04-18T15:57:08.368+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:57:28.355+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4340, after asserts: 6350, after connections: 7390, after extra_info: 11380, after globalLock: 14330, after locks: 16160, after network: 17670, after opcounters: 17880, after opcountersRepl: 17880, after repl: 46060, after storageEngine: 49470, after tcmalloc: 51890, after wiredTiger: 58750, at end: 71940 } 2016-04-18T15:57:35.340+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:57:47.554+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 399ms 2016-04-18T15:58:01.381+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 469ms 2016-04-18T15:58:15.445+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 107ms 2016-04-18T15:58:24.662+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:58:45.374+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:59:24.231+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 557ms 2016-04-18T15:59:24.929+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T15:59:25.552+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 472ms 2016-04-18T15:59:34.473+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T16:00:25.919+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:00:28.720+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 117ms 2016-04-18T16:00:33.589+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1558ms 2016-04-18T16:00:35.910+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1740, after asserts: 3300, after connections: 4220, after extra_info: 9210, after globalLock: 13230, after locks: 13750, after network: 14020, after opcounters: 14390, after opcountersRepl: 14390, after repl: 44480, after storageEngine: 46020, after tcmalloc: 52800, after wiredTiger: 64450, at end: 79540 } 2016-04-18T16:00:39.517+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T16:00:40.432+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 160ms 2016-04-18T16:01:14.959+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:01:40.812+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T16:01:46.164+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 309ms 2016-04-18T16:01:50.587+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 823ms 2016-04-18T16:02:03.107+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1274ms 2016-04-18T16:02:19.106+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:02:34.474+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:03:03.357+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:03:15.260+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 128ms 2016-04-18T16:03:22.807+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:03:22.391+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 189ms 2016-04-18T16:03:28.223+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2400, after asserts: 6300, after connections: 13110, after extra_info: 20600, after globalLock: 22880, after locks: 26380, after network: 29080, after opcounters: 29080, after opcountersRepl: 29080, after repl: 44530, after storageEngine: 45240, after tcmalloc: 47110, after wiredTiger: 54610, at end: 70340 } 2016-04-18T16:04:11.104+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:04:31.813+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T16:04:35.883+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 586ms 2016-04-18T16:04:39.041+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 235ms 2016-04-18T16:04:46.008+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 181ms 2016-04-18T16:05:06.863+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:05:33.430+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:05:57.862+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 369ms 2016-04-18T16:06:17.846+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:06:17.846+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 219ms 2016-04-18T16:06:37.099+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1230, after asserts: 3250, after connections: 8150, after extra_info: 13380, after globalLock: 15200, after locks: 18030, after network: 19410, after opcounters: 19410, after opcountersRepl: 19410, after repl: 60370, after storageEngine: 63700, after tcmalloc: 68390, after wiredTiger: 79790, at end: 93390 } 2016-04-18T16:06:43.947+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:07:26.923+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:07:34.648+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 315ms 2016-04-18T16:07:48.518+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:07:48.742+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1185ms 2016-04-18T16:08:00.962+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 159ms 2016-04-18T16:08:25.946+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:08:48.540+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:09:10.966+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T16:09:11.710+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 203ms 2016-04-18T16:09:32.741+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4500, after asserts: 5610, after connections: 7070, after extra_info: 9050, after globalLock: 12220, after locks: 18090, after network: 20610, after opcounters: 20840, after opcountersRepl: 20840, after repl: 48180, after storageEngine: 50030, after tcmalloc: 50610, after wiredTiger: 57300, at end: 68980 } 2016-04-18T16:09:34.563+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:09:58.061+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T16:10:13.256+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 323ms 2016-04-18T16:10:21.507+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 511ms 2016-04-18T16:10:34.550+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1481ms 2016-04-18T16:11:05.118+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:11:21.560+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:11:42.930+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 345ms 2016-04-18T16:11:59.818+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1108ms 2016-04-18T16:12:01.829+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:12:21.323+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:13:06.939+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T16:13:11.493+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 122ms 2016-04-18T16:13:17.229+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2590, after asserts: 5010, after connections: 5920, after extra_info: 13520, after globalLock: 14650, after locks: 15200, after network: 15610, after opcounters: 16040, after opcountersRepl: 16040, after repl: 58330, after storageEngine: 61560, after tcmalloc: 66820, after wiredTiger: 71620, at end: 87410 } 2016-04-18T16:13:24.218+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:13:24.968+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 103ms 2016-04-18T16:13:59.148+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:14:24.179+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:14:26.610+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 143ms 2016-04-18T16:14:41.593+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 308ms 2016-04-18T16:14:49.576+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 116ms 2016-04-18T16:15:03.402+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:15:26.173+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:16:02.658+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 126ms 2016-04-18T16:16:05.061+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3540, after asserts: 6360, after connections: 8160, after extra_info: 12750, after globalLock: 16130, after locks: 17430, after network: 17650, after opcounters: 17650, after opcountersRepl: 17650, after repl: 30370, after storageEngine: 33410, after tcmalloc: 39400, after wiredTiger: 51940, at end: 68700 } 2016-04-18T16:16:13.124+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:16:15.371+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3241ms 2016-04-18T16:16:25.987+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 316ms 2016-04-18T16:16:34.977+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:17:32.560+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T16:17:36.678+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 153ms 2016-04-18T16:17:47.316+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 496ms 2016-04-18T16:17:52.882+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:17:54.951+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 306ms 2016-04-18T16:18:22.540+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:18:44.290+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:18:57.534+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 234ms 2016-04-18T16:19:16.896+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1438ms 2016-04-18T16:19:28.743+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T16:19:28.836+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:19:44.766+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:19:57.592+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2920, after asserts: 4940, after connections: 7790, after extra_info: 14400, after globalLock: 17310, after locks: 19810, after network: 20980, after opcounters: 20980, after opcountersRepl: 20980, after repl: 58660, after storageEngine: 62110, after tcmalloc: 70190, after wiredTiger: 80730, at end: 95390 } 2016-04-18T16:20:13.296+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:20:30.972+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:20:31.359+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 672ms 2016-04-18T16:20:46.495+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1099ms 2016-04-18T16:20:55.914+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 180ms 2016-04-18T16:21:20.790+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:21:45.262+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:22:03.087+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 367ms 2016-04-18T16:22:10.375+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 671ms 2016-04-18T16:22:30.501+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:22:31.997+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T16:22:46.701+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:23:08.206+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3890, after asserts: 5780, after connections: 9660, after extra_info: 19960, after globalLock: 21150, after locks: 21280, after network: 21580, after opcounters: 21580, after opcountersRepl: 21580, after repl: 33690, after storageEngine: 38040, after tcmalloc: 39790, after wiredTiger: 55650, at end: 74630 } 2016-04-18T16:23:28.264+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T16:23:40.185+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 125ms 2016-04-18T16:23:51.082+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 664ms 2016-04-18T16:24:10.946+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:24:57.234+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:25:05.654+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 329ms 2016-04-18T16:25:11.720+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:25:14.748+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 951ms 2016-04-18T16:25:50.011+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T16:26:18.675+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:26:27.645+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4600, after asserts: 6060, after connections: 8930, after extra_info: 13320, after globalLock: 16580, after locks: 18520, after network: 19610, after opcounters: 19610, after opcountersRepl: 19610, after repl: 40250, after storageEngine: 44100, after tcmalloc: 46220, after wiredTiger: 60040, at end: 75070 } 2016-04-18T16:26:29.212+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 723ms 2016-04-18T16:26:33.041+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1167ms 2016-04-18T16:26:47.734+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 232ms 2016-04-18T16:27:22.739+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:27:40.070+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:28:01.043+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 457ms 2016-04-18T16:28:07.286+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 604ms 2016-04-18T16:28:21.490+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 162ms 2016-04-18T16:28:23.221+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:28:34.108+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:29:20.605+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:29:30.027+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 247ms 2016-04-18T16:29:36.697+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2090, after asserts: 5830, after connections: 8390, after extra_info: 12020, after globalLock: 13910, after locks: 15050, after network: 15600, after opcounters: 15600, after opcountersRepl: 15600, after repl: 46580, after storageEngine: 51040, after tcmalloc: 53050, after wiredTiger: 66420, at end: 78980 } 2016-04-18T16:29:40.535+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:29:44.908+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1593ms 2016-04-18T16:30:05.637+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 165ms 2016-04-18T16:30:39.527+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:31:01.024+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:31:16.437+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 122ms 2016-04-18T16:31:24.283+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 158ms 2016-04-18T16:31:45.845+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:32:03.360+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:32:35.884+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1353ms 2016-04-18T16:32:49.626+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 139ms 2016-04-18T16:32:52.186+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:33:05.791+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 217ms 2016-04-18T16:33:11.751+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:33:43.568+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4510, after asserts: 8020, after connections: 11880, after extra_info: 17760, after globalLock: 20590, after locks: 22000, after network: 22340, after opcounters: 22340, after opcountersRepl: 22340, after repl: 58080, after storageEngine: 67180, after tcmalloc: 73650, after wiredTiger: 89960, at end: 113450 } 2016-04-18T16:34:03.162+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:34:10.086+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1267ms 2016-04-18T16:34:16.157+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 485ms 2016-04-18T16:34:27.118+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 170ms 2016-04-18T16:34:44.239+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:35:08.369+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T16:35:37.866+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1298ms 2016-04-18T16:35:57.137+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 470ms 2016-04-18T16:36:00.430+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:36:16.037+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 214ms 2016-04-18T16:36:20.090+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:36:50.741+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3360, after asserts: 6010, after connections: 7270, after extra_info: 15960, after globalLock: 18510, after locks: 20080, after network: 22010, after opcounters: 23960, after opcountersRepl: 24950, after repl: 32910, after storageEngine: 33540, after tcmalloc: 37150, after wiredTiger: 54010, at end: 62430 } 2016-04-18T16:37:03.850+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:37:18.421+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:37:26.042+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 108ms 2016-04-18T16:37:38.171+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1264ms 2016-04-18T16:37:47.681+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 833ms 2016-04-18T16:38:20.436+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:38:48.985+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:38:57.394+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 124ms 2016-04-18T16:39:10.963+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 473ms 2016-04-18T16:39:20.790+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 138ms 2016-04-18T16:39:25.406+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:39:50.568+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3050, after asserts: 5110, after connections: 6140, after extra_info: 10340, after globalLock: 13450, after locks: 16250, after network: 18090, after opcounters: 19030, after opcountersRepl: 19030, after repl: 28370, after storageEngine: 30760, after tcmalloc: 34500, after wiredTiger: 38960, at end: 47640 } 2016-04-18T16:39:58.113+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:40:14.342+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:40:32.644+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 561ms 2016-04-18T16:40:44.020+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1638ms 2016-04-18T16:41:09.759+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:41:22.652+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:41:57.786+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 543ms 2016-04-18T16:42:03.475+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:42:13.192+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 458ms 2016-04-18T16:42:22.695+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:42:23.671+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 177ms 2016-04-18T16:42:50.101+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:43:14.350+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:43:28.378+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 144ms 2016-04-18T16:43:37.182+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2860, after asserts: 9700, after connections: 18300, after extra_info: 27920, after globalLock: 30560, after locks: 31890, after network: 35660, after opcounters: 36300, after opcountersRepl: 36300, after repl: 52780, after storageEngine: 54940, after tcmalloc: 67280, after wiredTiger: 89300, at end: 110350 } 2016-04-18T16:43:44.556+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 692ms 2016-04-18T16:43:55.300+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 123ms 2016-04-18T16:43:58.188+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:44:40.176+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:45:10.502+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 174ms 2016-04-18T16:45:20.810+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 740ms 2016-04-18T16:45:32.160+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 152ms 2016-04-18T16:45:35.286+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:46:05.558+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:46:46.951+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 127ms 2016-04-18T16:46:53.727+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:46:55.940+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 787ms 2016-04-18T16:47:05.235+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 181ms 2016-04-18T16:47:11.056+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:47:16.193+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3780, after asserts: 6260, after connections: 7110, after extra_info: 14320, after globalLock: 17080, after locks: 19240, after network: 20450, after opcounters: 21000, after opcountersRepl: 21000, after repl: 49030, after storageEngine: 57490, after tcmalloc: 64440, after wiredTiger: 77840, at end: 90800 } 2016-04-18T16:48:06.037+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:48:19.478+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 330ms 2016-04-18T16:48:28.499+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 475ms 2016-04-18T16:48:29.298+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:48:40.810+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 153ms 2016-04-18T16:49:16.639+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T16:49:52.555+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 158ms 2016-04-18T16:49:52.810+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:50:00.432+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 622ms 2016-04-18T16:50:09.670+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 315ms 2016-04-18T16:50:31.868+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:50:54.878+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:51:16.100+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2210, after asserts: 4680, after connections: 8320, after extra_info: 26240, after globalLock: 29490, after locks: 30850, after network: 31060, after opcounters: 31060, after opcountersRepl: 31060, after repl: 69710, after storageEngine: 74580, after tcmalloc: 80470, after wiredTiger: 92080, at end: 113130 } 2016-04-18T16:51:21.693+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 170ms 2016-04-18T16:51:26.665+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:51:31.920+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3097ms 2016-04-18T16:51:47.375+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1479ms 2016-04-18T16:52:07.310+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:52:21.856+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T16:52:56.865+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:52:59.747+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 212ms 2016-04-18T16:53:08.345+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 662ms 2016-04-18T16:53:12.986+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:53:25.425+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 182ms 2016-04-18T16:54:02.877+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:54:24.116+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:54:41.080+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 132ms 2016-04-18T16:54:46.168+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2580, after asserts: 5680, after connections: 6910, after extra_info: 11910, after globalLock: 23130, after locks: 25150, after network: 30030, after opcounters: 30680, after opcountersRepl: 30970, after repl: 57220, after storageEngine: 59540, after tcmalloc: 63230, after wiredTiger: 72760, at end: 88370 } 2016-04-18T16:55:01.095+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2235ms 2016-04-18T16:55:10.100+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:55:12.604+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1985ms 2016-04-18T16:55:23.484+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:56:15.564+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 331ms 2016-04-18T16:56:22.713+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:56:23.816+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 494ms 2016-04-18T16:56:31.833+0000 I COMMAND [conn17] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 5355ms 2016-04-18T16:56:37.452+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 703ms 2016-04-18T16:56:43.525+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:57:24.086+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:57:40.891+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 759ms 2016-04-18T16:57:44.719+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T16:57:52.300+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 163ms 2016-04-18T16:58:27.692+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:58:44.200+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2570, after asserts: 6210, after connections: 7040, after extra_info: 12290, after globalLock: 18840, after locks: 21490, after network: 22430, after opcounters: 22430, after opcountersRepl: 22430, after repl: 50530, after storageEngine: 54260, after tcmalloc: 57410, after wiredTiger: 74700, at end: 88130 } 2016-04-18T16:58:51.752+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T16:58:56.460+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 204ms 2016-04-18T16:59:10.643+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 389ms 2016-04-18T16:59:23.143+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 994ms 2016-04-18T16:59:49.008+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:00:12.574+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:00:33.743+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 458ms 2016-04-18T17:00:45.656+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 412ms 2016-04-18T17:00:58.004+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:00:58.841+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 114ms 2016-04-18T17:01:16.774+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:01:59.141+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:02:07.606+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 444ms 2016-04-18T17:02:14.719+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3283ms 2016-04-18T17:02:25.702+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 146ms 2016-04-18T17:02:25.702+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1110, after asserts: 2960, after connections: 5790, after extra_info: 11070, after globalLock: 17950, after locks: 19030, after network: 19030, after opcounters: 19030, after opcountersRepl: 19030, after repl: 60860, after storageEngine: 65200, after tcmalloc: 72190, after wiredTiger: 88250, at end: 106460 } 2016-04-18T17:02:29.563+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:02:44.638+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:03:36.179+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2671ms 2016-04-18T17:03:39.468+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:03:43.611+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 312ms 2016-04-18T17:03:54.806+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 145ms 2016-04-18T17:03:57.796+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:04:32.108+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:04:56.020+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:04:59.351+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 237ms 2016-04-18T17:05:14.471+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 842ms 2016-04-18T17:05:29.928+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 221ms 2016-04-18T17:05:42.309+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T17:05:56.970+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3490, after asserts: 4740, after connections: 5990, after extra_info: 14380, after globalLock: 17380, after locks: 19860, after network: 22620, after opcounters: 23990, after opcountersRepl: 24540, after repl: 60420, after storageEngine: 63370, after tcmalloc: 73210, after wiredTiger: 81660, at end: 94000 } 2016-04-18T17:06:03.778+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:06:33.757+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 425ms 2016-04-18T17:06:40.691+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2324ms 2016-04-18T17:06:50.667+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 114ms 2016-04-18T17:06:58.408+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:07:16.585+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:07:57.365+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:07:58.616+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 108ms 2016-04-18T17:08:18.554+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 467ms 2016-04-18T17:08:20.355+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:08:54.649+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1840, after asserts: 2870, after connections: 3850, after extra_info: 10250, after globalLock: 14100, after locks: 18240, after network: 20230, after opcounters: 21340, after opcountersRepl: 26500, after repl: 46940, after storageEngine: 49370, after tcmalloc: 54510, after wiredTiger: 63770, at end: 74430 } 2016-04-18T17:08:55.248+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:09:25.519+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:09:26.016+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 754ms 2016-04-18T17:09:34.653+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 725ms 2016-04-18T17:09:46.183+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 123ms 2016-04-18T17:10:20.177+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:10:36.056+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:10:54.057+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 145ms 2016-04-18T17:11:01.842+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 312ms 2016-04-18T17:11:12.397+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:11:19.104+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 304ms 2016-04-18T17:11:36.066+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:12:09.843+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:12:15.021+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2780, after asserts: 5950, after connections: 8790, after extra_info: 14180, after globalLock: 15980, after locks: 17650, after network: 21420, after opcounters: 21830, after opcountersRepl: 21830, after repl: 47710, after storageEngine: 50080, after tcmalloc: 58410, after wiredTiger: 71260, at end: 81290 } 2016-04-18T17:12:35.337+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:12:35.869+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 604ms 2016-04-18T17:12:58.331+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 966ms 2016-04-18T17:13:23.671+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:13:42.739+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:14:05.655+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 400ms 2016-04-18T17:14:16.358+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:14:16.983+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 385ms 2016-04-18T17:14:32.329+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 285ms 2016-04-18T17:15:04.067+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:15:29.814+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:15:39.888+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3190, after asserts: 5970, after connections: 10840, after extra_info: 17310, after globalLock: 21340, after locks: 25730, after network: 28300, after opcounters: 28300, after opcountersRepl: 28300, after repl: 45020, after storageEngine: 48190, after tcmalloc: 55940, after wiredTiger: 61920, at end: 75730 } 2016-04-18T17:15:43.950+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 245ms 2016-04-18T17:16:00.128+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 691ms 2016-04-18T17:16:15.632+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1730ms 2016-04-18T17:16:36.921+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:16:56.026+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:17:23.399+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:17:31.703+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 286ms 2016-04-18T17:17:40.790+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2468ms 2016-04-18T17:17:45.920+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:17:53.872+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 170ms 2016-04-18T17:18:25.339+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:18:52.560+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:18:52.847+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 8590, after asserts: 10420, after connections: 11160, after extra_info: 16770, after globalLock: 20610, after locks: 21890, after network: 22220, after opcounters: 22220, after opcountersRepl: 22220, after repl: 25720, after storageEngine: 27150, after tcmalloc: 32370, after wiredTiger: 49740, at end: 65710 } 2016-04-18T17:19:02.725+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 172ms 2016-04-18T17:19:14.238+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 404ms 2016-04-18T17:19:27.881+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-18T17:19:38.648+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:20:01.219+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:20:41.806+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:20:43.516+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 379ms 2016-04-18T17:20:58.579+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1814ms 2016-04-18T17:21:01.740+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:21:03.943+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 210ms 2016-04-18T17:21:35.648+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:21:57.440+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:22:15.657+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 171ms 2016-04-18T17:22:24.666+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1960, after asserts: 4310, after connections: 7670, after extra_info: 13880, after globalLock: 16530, after locks: 18480, after network: 22410, after opcounters: 23670, after opcountersRepl: 23670, after repl: 35710, after storageEngine: 42690, after tcmalloc: 49800, after wiredTiger: 72150, at end: 83870 } 2016-04-18T17:22:25.770+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 367ms 2016-04-18T17:22:37.749+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:22:40.904+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-18T17:22:50.128+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T17:23:28.572+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:23:45.903+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:23:52.250+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 115ms 2016-04-18T17:24:05.521+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1482ms 2016-04-18T17:24:14.904+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 203ms 2016-04-18T17:24:25.650+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:24:26.964+0000 I COMMAND [conn38] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 3574ms 2016-04-18T17:24:43.184+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:25:19.877+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T17:25:30.861+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 591ms 2016-04-18T17:25:39.816+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 736ms 2016-04-18T17:25:39.816+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2740, after asserts: 3800, after connections: 4650, after extra_info: 7020, after globalLock: 7560, after locks: 8330, after network: 8880, after opcounters: 10480, after opcountersRepl: 13730, after repl: 26030, after storageEngine: 28550, after tcmalloc: 33780, after wiredTiger: 44230, at end: 54940 } 2016-04-18T17:25:44.197+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:26:22.319+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:26:43.807+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:26:46.868+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 182ms 2016-04-18T17:26:58.329+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1076ms 2016-04-18T17:27:08.476+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 115ms 2016-04-18T17:27:33.765+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:27:59.656+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:28:21.193+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 267ms 2016-04-18T17:28:28.519+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 486ms 2016-04-18T17:28:38.965+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 253ms 2016-04-18T17:28:44.670+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:29:02.303+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:29:15.271+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4060, after asserts: 8770, after connections: 13830, after extra_info: 17340, after globalLock: 19960, after locks: 20850, after network: 21040, after opcounters: 21040, after opcountersRepl: 21040, after repl: 59880, after storageEngine: 62980, after tcmalloc: 73330, after wiredTiger: 92990, at end: 103900 } 2016-04-18T17:29:53.728+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 168ms 2016-04-18T17:29:56.336+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:30:04.580+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 589ms 2016-04-18T17:30:18.407+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 151ms 2016-04-18T17:30:25.847+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:31:04.006+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:31:18.648+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:31:27.873+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 182ms 2016-04-18T17:31:39.291+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2863ms 2016-04-18T17:31:51.580+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 177ms 2016-04-18T17:32:15.276+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1970, after asserts: 3210, after connections: 3320, after extra_info: 9270, after globalLock: 13500, after locks: 15390, after network: 15630, after opcounters: 15630, after opcountersRepl: 15630, after repl: 25510, after storageEngine: 28740, after tcmalloc: 33360, after wiredTiger: 44130, at end: 76900 } 2016-04-18T17:32:15.276+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:32:44.766+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:33:07.928+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 111ms 2016-04-18T17:33:21.133+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 455ms 2016-04-18T17:33:40.655+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 130ms 2016-04-18T17:33:49.398+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:34:13.526+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:34:51.884+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 468ms 2016-04-18T17:35:11.951+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 241ms 2016-04-18T17:35:12.751+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:35:42.425+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:36:23.865+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 414ms 2016-04-18T17:36:28.195+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:36:30.349+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 622ms 2016-04-18T17:36:36.275+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 7050, after asserts: 10030, after connections: 12670, after extra_info: 14570, after globalLock: 16520, after locks: 21880, after network: 23570, after opcounters: 26870, after opcountersRepl: 27000, after repl: 75960, after storageEngine: 78470, after tcmalloc: 81820, after wiredTiger: 92110, at end: 101430 } 2016-04-18T17:36:36.398+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:37:29.607+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T17:37:35.895+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 739ms 2016-04-18T17:37:51.272+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1399ms 2016-04-18T17:37:53.000+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:37:58.835+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 159ms 2016-04-18T17:38:30.555+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:38:54.737+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:39:12.175+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 176ms 2016-04-18T17:39:27.885+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 513ms 2016-04-18T17:39:31.613+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:39:32.377+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 205ms 2016-04-18T17:39:48.666+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:39:57.175+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4080, after asserts: 5380, after connections: 6190, after extra_info: 15580, after globalLock: 19680, after locks: 23640, after network: 25220, after opcounters: 25540, after opcountersRepl: 25540, after repl: 59310, after storageEngine: 65780, after tcmalloc: 69860, after wiredTiger: 78210, at end: 88090 } 2016-04-18T17:40:48.037+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 121ms 2016-04-18T17:40:49.046+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T17:40:59.967+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1897ms 2016-04-18T17:41:09.710+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 166ms 2016-04-18T17:41:18.278+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:41:55.720+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:42:18.507+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:42:25.217+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 565ms 2016-04-18T17:42:34.913+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 292ms 2016-04-18T17:42:47.421+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 205ms 2016-04-18T17:42:59.084+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:43:21.034+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:43:30.215+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4060, after asserts: 7800, after connections: 13070, after extra_info: 19450, after globalLock: 21060, after locks: 21730, after network: 22520, after opcounters: 26680, after opcountersRepl: 27970, after repl: 51280, after storageEngine: 53280, after tcmalloc: 58680, after wiredTiger: 73800, at end: 89110 } 2016-04-18T17:44:06.076+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 220ms 2016-04-18T17:44:17.589+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:44:25.647+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 820ms 2016-04-18T17:44:32.134+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:44:32.072+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T17:45:08.338+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:45:36.911+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:45:44.726+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 172ms 2016-04-18T17:46:01.959+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1389ms 2016-04-18T17:46:18.341+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3580, after asserts: 6120, after connections: 8500, after extra_info: 13690, after globalLock: 14900, after locks: 15180, after network: 15400, after opcounters: 15400, after opcountersRepl: 15400, after repl: 29820, after storageEngine: 33910, after tcmalloc: 38690, after wiredTiger: 54040, at end: 72300 } 2016-04-18T17:46:19.093+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:46:25.721+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 298ms 2016-04-18T17:46:45.325+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:47:36.476+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 178ms 2016-04-18T17:47:46.172+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1228ms 2016-04-18T17:48:00.646+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:48:07.813+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1540ms 2016-04-18T17:48:16.392+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:48:54.520+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:49:16.466+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:49:18.909+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 119ms 2016-04-18T17:49:28.886+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2696ms 2016-04-18T17:49:34.593+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 310ms 2016-04-18T17:49:52.433+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4870, after asserts: 7030, after connections: 11110, after extra_info: 13820, after globalLock: 17030, after locks: 17650, after network: 17980, after opcounters: 17980, after opcountersRepl: 17980, after repl: 35000, after storageEngine: 37350, after tcmalloc: 42970, after wiredTiger: 58450, at end: 70220 } 2016-04-18T17:49:56.066+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:50:11.810+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:50:42.809+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 125ms 2016-04-18T17:50:53.528+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 602ms 2016-04-18T17:50:57.885+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:51:02.078+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T17:51:21.386+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:51:43.865+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T17:52:13.135+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 120ms 2016-04-18T17:52:20.900+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:52:22.533+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 317ms 2016-04-18T17:52:37.472+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:53:12.767+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4180, after asserts: 5230, after connections: 5600, after extra_info: 10490, after globalLock: 15680, after locks: 19380, after network: 20890, after opcounters: 20890, after opcountersRepl: 20890, after repl: 30120, after storageEngine: 33400, after tcmalloc: 37670, after wiredTiger: 54920, at end: 73190 } 2016-04-18T17:53:15.721+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:53:27.217+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 190ms 2016-04-18T17:53:40.001+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1535ms 2016-04-18T17:53:39.330+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:53:50.040+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 479ms 2016-04-18T17:54:33.708+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:55:00.030+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:55:04.871+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 219ms 2016-04-18T17:55:25.339+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 750ms 2016-04-18T17:55:37.641+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 172ms 2016-04-18T17:55:38.079+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:56:02.188+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T17:56:42.943+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:56:52.819+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 144ms 2016-04-18T17:56:54.828+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 732ms 2016-04-18T17:57:04.723+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5460, after asserts: 7750, after connections: 10470, after extra_info: 15910, after globalLock: 17080, after locks: 21720, after network: 22740, after opcounters: 22870, after opcountersRepl: 22870, after repl: 49320, after storageEngine: 50720, after tcmalloc: 54120, after wiredTiger: 65410, at end: 75250 } 2016-04-18T17:57:05.537+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:57:10.534+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 248ms 2016-04-18T17:57:44.239+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:58:04.227+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:58:13.035+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 403ms 2016-04-18T17:58:21.264+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 879ms 2016-04-18T17:58:32.026+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 956ms 2016-04-18T17:58:34.629+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:58:43.616+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T17:59:17.189+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:59:36.824+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T17:59:41.288+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T17:59:44.614+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2630, after asserts: 4070, after connections: 4500, after extra_info: 7900, after globalLock: 10420, after locks: 11880, after network: 12050, after opcounters: 12050, after opcountersRepl: 12050, after repl: 31420, after storageEngine: 35110, after tcmalloc: 39990, after wiredTiger: 50500, at end: 63620 } 2016-04-18T17:59:46.139+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2020ms 2016-04-18T17:59:51.175+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 106ms 2016-04-18T18:00:33.966+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:00:53.733+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T18:01:07.975+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1632ms 2016-04-18T18:01:21.772+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 856ms 2016-04-18T18:01:32.218+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:01:33.032+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 169ms 2016-04-18T18:01:50.860+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:02:24.158+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:02:43.026+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 759ms 2016-04-18T18:02:47.076+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1880, after asserts: 3900, after connections: 6870, after extra_info: 10710, after globalLock: 13710, after locks: 16060, after network: 16520, after opcounters: 16520, after opcountersRepl: 16520, after repl: 45680, after storageEngine: 48680, after tcmalloc: 55410, after wiredTiger: 63890, at end: 83170 } 2016-04-18T18:02:52.534+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:03:49.280+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:03:55.616+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 917ms 2016-04-18T18:04:04.722+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:04:04.940+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 150ms 2016-04-18T18:04:46.487+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:05:10.745+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:05:16.442+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 155ms 2016-04-18T18:05:26.765+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 988ms 2016-04-18T18:05:40.863+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 596ms 2016-04-18T18:05:56.921+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:06:11.895+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:06:21.038+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2650, after asserts: 4540, after connections: 7590, after extra_info: 8830, after globalLock: 8870, after locks: 8870, after network: 10140, after opcounters: 12630, after opcountersRepl: 13900, after repl: 44210, after storageEngine: 51340, after tcmalloc: 62800, after wiredTiger: 70740, at end: 83130 } 2016-04-18T18:06:53.787+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:06:54.639+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 166ms 2016-04-18T18:07:12.550+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 409ms 2016-04-18T18:07:15.014+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:07:21.901+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 104ms 2016-04-18T18:07:55.138+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:08:16.396+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:08:31.305+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 440ms 2016-04-18T18:08:45.289+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1700ms 2016-04-18T18:09:00.131+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T18:09:02.284+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:09:13.697+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3230, after asserts: 3930, after connections: 5290, after extra_info: 9180, after globalLock: 11510, after locks: 11610, after network: 12670, after opcounters: 16110, after opcountersRepl: 18930, after repl: 53440, after storageEngine: 59460, after tcmalloc: 64000, after wiredTiger: 69790, at end: 82250 } 2016-04-18T18:09:22.285+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:10:08.110+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 160ms 2016-04-18T18:10:13.836+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:10:14.977+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 360ms 2016-04-18T18:10:25.626+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-04-18T18:10:29.640+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:11:08.740+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:11:23.989+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:11:35.651+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 617ms 2016-04-18T18:11:50.415+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 545ms 2016-04-18T18:11:57.873+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 121ms 2016-04-18T18:12:02.803+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:12:20.277+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T18:12:29.020+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5810, after asserts: 7030, after connections: 10520, after extra_info: 17230, after globalLock: 21080, after locks: 22370, after network: 23090, after opcounters: 23090, after opcountersRepl: 23090, after repl: 38880, after storageEngine: 41040, after tcmalloc: 45310, after wiredTiger: 60930, at end: 72260 } 2016-04-18T18:13:09.902+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 529ms 2016-04-18T18:13:19.473+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:13:20.272+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 194ms 2016-04-18T18:13:32.368+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:14:11.607+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:14:22.537+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 378ms 2016-04-18T18:14:26.194+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T18:14:32.449+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1411ms 2016-04-18T18:14:42.101+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 169ms 2016-04-18T18:15:03.718+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:15:18.809+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:15:28.367+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2390, after asserts: 3540, after connections: 6160, after extra_info: 12210, after globalLock: 15370, after locks: 16660, after network: 17490, after opcounters: 17490, after opcountersRepl: 17490, after repl: 43680, after storageEngine: 46140, after tcmalloc: 50530, after wiredTiger: 66550, at end: 82670 } 2016-04-18T18:15:56.273+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T18:16:09.336+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1165ms 2016-04-18T18:16:14.131+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:16:21.315+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 627ms 2016-04-18T18:16:30.596+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:17:07.397+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:17:30.570+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:17:34.420+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 358ms 2016-04-18T18:17:48.109+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1066ms 2016-04-18T18:17:55.246+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 126ms 2016-04-18T18:18:13.016+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2210, after asserts: 2940, after connections: 3240, after extra_info: 6480, after globalLock: 11320, after locks: 15040, after network: 17540, after opcounters: 17740, after opcountersRepl: 17740, after repl: 39650, after storageEngine: 42230, after tcmalloc: 45050, after wiredTiger: 54300, at end: 65640 } 2016-04-18T18:18:13.373+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:18:25.665+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:19:16.866+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 282ms 2016-04-18T18:19:27.633+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 535ms 2016-04-18T18:19:37.105+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:20:02.884+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:20:40.994+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 250ms 2016-04-18T18:20:46.314+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:20:55.759+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 752ms 2016-04-18T18:21:08.988+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 116ms 2016-04-18T18:21:09.508+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:21:35.498+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5810, after asserts: 9060, after connections: 10680, after extra_info: 19310, after globalLock: 23260, after locks: 25220, after network: 25670, after opcounters: 25830, after opcountersRepl: 25830, after repl: 45920, after storageEngine: 47800, after tcmalloc: 52170, after wiredTiger: 73480, at end: 89340 } 2016-04-18T18:21:45.869+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:22:05.209+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:22:12.854+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 170ms 2016-04-18T18:22:31.836+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3893ms 2016-04-18T18:22:36.697+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T18:23:14.069+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:23:38.744+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:23:56.128+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 141ms 2016-04-18T18:24:05.317+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1004ms 2016-04-18T18:24:14.360+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:24:17.066+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 145ms 2016-04-18T18:24:42.681+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:25:27.427+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:25:32.492+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 199ms 2016-04-18T18:25:54.453+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 898ms 2016-04-18T18:25:55.254+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:26:01.398+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5620, after asserts: 9480, after connections: 10540, after extra_info: 13380, after globalLock: 14480, after locks: 15310, after network: 15560, after opcounters: 15560, after opcountersRepl: 15560, after repl: 38470, after storageEngine: 42420, after tcmalloc: 46140, after wiredTiger: 68630, at end: 88410 } 2016-04-18T18:26:05.169+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 159ms 2016-04-18T18:26:36.959+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:26:53.799+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:27:07.439+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 144ms 2016-04-18T18:27:19.842+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 556ms 2016-04-18T18:27:46.956+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:28:12.820+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T18:28:31.383+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 158ms 2016-04-18T18:28:45.429+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 920ms 2016-04-18T18:28:53.442+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2220ms 2016-04-18T18:28:58.993+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:29:28.995+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:29:34.400+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2830, after asserts: 4340, after connections: 6120, after extra_info: 10880, after globalLock: 16080, after locks: 18820, after network: 21900, after opcounters: 24990, after opcountersRepl: 25220, after repl: 43980, after storageEngine: 48800, after tcmalloc: 54730, after wiredTiger: 65340, at end: 80270 } 2016-04-18T18:30:03.331+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 117ms 2016-04-18T18:30:17.090+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 476ms 2016-04-18T18:30:36.705+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:30:36.705+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 119ms 2016-04-18T18:31:08.009+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:31:55.526+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T18:32:02.996+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:32:10.848+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 676ms 2016-04-18T18:32:20.265+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 146ms 2016-04-18T18:32:20.852+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:32:50.899+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:32:50.929+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3300, after asserts: 3950, after connections: 4210, after extra_info: 7630, after globalLock: 9670, after locks: 10560, after network: 11830, after opcounters: 17970, after opcountersRepl: 19130, after repl: 38970, after storageEngine: 44590, after tcmalloc: 49420, after wiredTiger: 64890, at end: 82140 } 2016-04-18T18:33:18.890+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:33:26.678+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 822ms 2016-04-18T18:33:39.257+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 738ms 2016-04-18T18:33:53.790+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 163ms 2016-04-18T18:34:18.582+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:34:51.909+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:35:07.210+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 219ms 2016-04-18T18:35:24.076+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2665ms 2016-04-18T18:35:32.385+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:35:38.867+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 117ms 2016-04-18T18:36:01.503+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:36:45.612+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3660, after asserts: 6010, after connections: 8050, after extra_info: 15350, after globalLock: 20080, after locks: 20370, after network: 20780, after opcounters: 21280, after opcountersRepl: 21280, after repl: 55510, after storageEngine: 59120, after tcmalloc: 62440, after wiredTiger: 74860, at end: 91080 } 2016-04-18T18:36:52.241+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 237ms 2016-04-18T18:36:58.352+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:37:00.087+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1011ms 2016-04-18T18:37:07.945+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2266ms 2016-04-18T18:37:15.772+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:38:23.949+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 483ms 2016-04-18T18:38:23.949+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:38:35.798+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 531ms 2016-04-18T18:38:45.329+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 244ms 2016-04-18T18:38:48.755+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T18:39:25.583+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:39:49.240+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:39:53.320+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 120ms 2016-04-18T18:40:06.806+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 825ms 2016-04-18T18:40:17.050+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 137ms 2016-04-18T18:40:39.863+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:40:58.304+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:41:04.440+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6240, after asserts: 8390, after connections: 9720, after extra_info: 14100, after globalLock: 16100, after locks: 16610, after network: 16850, after opcounters: 16850, after opcountersRepl: 16850, after repl: 71810, after storageEngine: 76630, after tcmalloc: 82790, after wiredTiger: 97440, at end: 117140 } 2016-04-18T18:41:37.578+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 106ms 2016-04-18T18:41:53.847+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2067ms 2016-04-18T18:42:02.189+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:42:11.192+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T18:42:21.094+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:42:46.115+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:43:08.446+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:43:24.725+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 168ms 2016-04-18T18:43:38.956+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 382ms 2016-04-18T18:44:02.685+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:44:14.239+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2770, after asserts: 4780, after connections: 6680, after extra_info: 14130, after globalLock: 16530, after locks: 22700, after network: 24900, after opcounters: 26840, after opcountersRepl: 28770, after repl: 50030, after storageEngine: 55000, after tcmalloc: 65420, after wiredTiger: 71450, at end: 81630 } 2016-04-18T18:44:14.918+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 123ms 2016-04-18T18:44:30.834+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:45:28.198+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:45:31.156+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 430ms 2016-04-18T18:45:36.892+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 963ms 2016-04-18T18:45:39.773+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:45:42.895+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 402ms 2016-04-18T18:46:14.536+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:46:38.111+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T18:46:57.956+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 552ms 2016-04-18T18:47:14.274+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1747ms 2016-04-18T18:47:23.666+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T18:47:28.817+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:47:47.693+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:48:09.458+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5010, after asserts: 7490, after connections: 7990, after extra_info: 14150, after globalLock: 16260, after locks: 20520, after network: 21920, after opcounters: 23240, after opcountersRepl: 23240, after repl: 47950, after storageEngine: 52730, after tcmalloc: 56470, after wiredTiger: 75790, at end: 84480 } 2016-04-18T18:48:31.460+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 147ms 2016-04-18T18:48:43.618+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 327ms 2016-04-18T18:48:51.531+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 157ms 2016-04-18T18:48:51.486+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:49:10.816+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:49:55.921+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:50:01.938+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 142ms 2016-04-18T18:50:12.846+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 313ms 2016-04-18T18:50:17.176+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:50:28.220+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3481ms 2016-04-18T18:51:08.337+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:51:31.562+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T18:51:34.288+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 8170, after asserts: 9260, after connections: 9450, after extra_info: 18890, after globalLock: 20440, after locks: 20920, after network: 21160, after opcounters: 21160, after opcountersRepl: 21160, after repl: 49160, after storageEngine: 54780, after tcmalloc: 59890, after wiredTiger: 72700, at end: 87540 } 2016-04-18T18:51:39.158+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 566ms 2016-04-18T18:51:46.606+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 905ms 2016-04-18T18:52:00.108+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 164ms 2016-04-18T18:52:36.469+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:52:58.112+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:53:13.600+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 366ms 2016-04-18T18:53:24.813+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 435ms 2016-04-18T18:53:26.757+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 115ms 2016-04-18T18:53:42.978+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:54:06.439+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T18:54:30.915+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 137ms 2016-04-18T18:54:43.272+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3035ms 2016-04-18T18:54:50.104+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:54:56.626+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T18:55:09.717+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6950, after asserts: 10450, after connections: 11890, after extra_info: 17540, after globalLock: 22290, after locks: 25380, after network: 26430, after opcounters: 27820, after opcountersRepl: 27820, after repl: 42900, after storageEngine: 44900, after tcmalloc: 50940, after wiredTiger: 64520, at end: 82290 } 2016-04-18T18:55:14.574+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:56:03.520+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1058ms 2016-04-18T18:56:11.767+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:56:22.642+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 976ms 2016-04-18T18:56:25.478+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T18:56:34.355+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T18:57:21.642+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:57:28.003+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 202ms 2016-04-18T18:57:41.510+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:57:43.871+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 371ms 2016-04-18T18:58:01.507+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 258ms 2016-04-18T18:58:40.413+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:58:45.634+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6520, after asserts: 10020, after connections: 13830, after extra_info: 17390, after globalLock: 20630, after locks: 22760, after network: 24900, after opcounters: 25950, after opcountersRepl: 26680, after repl: 53730, after storageEngine: 59650, after tcmalloc: 65000, after wiredTiger: 79540, at end: 96670 } 2016-04-18T18:59:04.577+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T18:59:17.235+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 463ms 2016-04-18T18:59:49.603+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 7146ms 2016-04-18T19:00:01.601+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 118ms 2016-04-18T19:00:14.196+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:00:44.630+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:01:26.259+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 620ms 2016-04-18T19:01:33.035+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:01:35.283+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 36126ms 2016-04-18T19:01:36.946+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 684ms 2016-04-18T19:01:47.257+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 296ms 2016-04-18T19:01:51.136+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:02:08.177+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4430, after asserts: 7270, after connections: 9940, after extra_info: 18020, after globalLock: 21450, after locks: 23380, after network: 23520, after opcounters: 23520, after opcountersRepl: 23520, after repl: 29800, after storageEngine: 31690, after tcmalloc: 34790, after wiredTiger: 50460, at end: 63100 } 2016-04-18T19:02:51.611+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:02:55.935+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 307ms 2016-04-18T19:03:08.095+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 844ms 2016-04-18T19:03:19.647+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-04-18T19:03:23.750+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T19:04:06.654+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:04:31.070+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 364ms 2016-04-18T19:04:34.791+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:04:49.588+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1647ms 2016-04-18T19:05:04.391+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 319ms 2016-04-18T19:05:23.811+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:05:48.002+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:06:14.823+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 151ms 2016-04-18T19:06:29.910+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2933ms 2016-04-18T19:06:37.513+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3340, after asserts: 3870, after connections: 4390, after extra_info: 13290, after globalLock: 15750, after locks: 17130, after network: 17270, after opcounters: 17270, after opcountersRepl: 17270, after repl: 47300, after storageEngine: 49220, after tcmalloc: 53550, after wiredTiger: 60840, at end: 95350 } 2016-04-18T19:06:38.492+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 143ms 2016-04-18T19:06:38.644+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:07:21.648+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:07:23.958+0000 I COMMAND [conn38] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 42608ms 2016-04-18T19:07:57.944+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 252ms 2016-04-18T19:08:13.827+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 697ms 2016-04-18T19:08:30.823+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 183ms 2016-04-18T19:08:35.617+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:08:53.520+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:09:42.851+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 434ms 2016-04-18T19:09:43.753+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:09:49.472+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 113ms 2016-04-18T19:09:56.342+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T19:10:41.000+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:10:57.432+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 640ms 2016-04-18T19:11:02.931+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:11:11.188+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 817ms 2016-04-18T19:11:15.984+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5030, after asserts: 6400, after connections: 8190, after extra_info: 9780, after globalLock: 11760, after locks: 14790, after network: 18480, after opcounters: 20930, after opcountersRepl: 20930, after repl: 48550, after storageEngine: 53570, after tcmalloc: 58600, after wiredTiger: 79810, at end: 90610 } 2016-04-18T19:11:51.122+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:12:02.155+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:12:27.002+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 494ms 2016-04-18T19:12:44.411+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 711ms 2016-04-18T19:12:48.633+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:12:54.841+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 198ms 2016-04-18T19:13:08.911+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:14:03.438+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T19:14:04.573+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:14:16.048+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 531ms 2016-04-18T19:14:24.887+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T19:14:27.501+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:14:47.623+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2030, after asserts: 4180, after connections: 9120, after extra_info: 15830, after globalLock: 17180, after locks: 18470, after network: 20610, after opcounters: 21780, after opcountersRepl: 22680, after repl: 48860, after storageEngine: 50090, after tcmalloc: 52940, after wiredTiger: 80820, at end: 92620 } 2016-04-18T19:15:25.040+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:15:35.104+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 468ms 2016-04-18T19:15:49.008+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 289ms 2016-04-18T19:15:59.403+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:16:02.955+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 102ms 2016-04-18T19:16:42.200+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:16:59.466+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:17:13.104+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 216ms 2016-04-18T19:17:26.101+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 424ms 2016-04-18T19:17:38.597+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 300ms 2016-04-18T19:17:39.496+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:17:56.857+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:18:18.525+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 1110, after connections: 2160, after extra_info: 8570, after globalLock: 10340, after locks: 11180, after network: 11480, after opcounters: 11480, after opcountersRepl: 11480, after repl: 32410, after storageEngine: 35890, after tcmalloc: 47030, after wiredTiger: 53980, at end: 76670 } 2016-04-18T19:18:39.388+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:18:47.464+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 152ms 2016-04-18T19:19:01.716+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1595ms 2016-04-18T19:19:07.454+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:19:11.461+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 162ms 2016-04-18T19:19:44.597+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:20:15.174+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T19:20:24.891+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 992ms 2016-04-18T19:20:36.519+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 556ms 2016-04-18T19:20:51.553+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:20:51.356+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 165ms 2016-04-18T19:21:17.420+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:21:36.845+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 7080, after asserts: 8300, after connections: 9470, after extra_info: 17780, after globalLock: 25210, after locks: 30130, after network: 33000, after opcounters: 33730, after opcountersRepl: 33730, after repl: 48400, after storageEngine: 51880, after tcmalloc: 55860, after wiredTiger: 76760, at end: 87740 } 2016-04-18T19:21:55.328+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:22:06.400+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 152ms 2016-04-18T19:22:23.121+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:22:22.999+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1184ms 2016-04-18T19:23:24.282+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:23:37.389+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1154ms 2016-04-18T19:23:42.996+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:23:50.425+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 263ms 2016-04-18T19:23:56.320+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 934ms 2016-04-18T19:24:37.251+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:25:05.967+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T19:25:13.368+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 500ms 2016-04-18T19:25:31.714+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1589ms 2016-04-18T19:25:45.614+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 372ms 2016-04-18T19:25:56.853+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:26:23.834+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:26:34.356+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4680, after asserts: 6990, after connections: 10750, after extra_info: 16910, after globalLock: 20240, after locks: 23570, after network: 28740, after opcounters: 30240, after opcountersRepl: 31380, after repl: 64660, after storageEngine: 64970, after tcmalloc: 72300, after wiredTiger: 99700, at end: 117820 } 2016-04-18T19:26:57.036+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 200ms 2016-04-18T19:26:58.033+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:27:13.348+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 251ms 2016-04-18T19:27:22.974+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:27:26.338+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1327ms 2016-04-18T19:28:29.977+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 177ms 2016-04-18T19:28:30.680+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:28:43.947+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 238ms 2016-04-18T19:29:00.715+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 425ms 2016-04-18T19:29:06.456+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:29:58.345+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:30:17.400+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 181ms 2016-04-18T19:30:21.142+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:30:30.088+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 690ms 2016-04-18T19:30:35.354+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3140, after asserts: 7590, after connections: 8880, after extra_info: 15590, after globalLock: 16890, after locks: 18120, after network: 20410, after opcounters: 22380, after opcountersRepl: 22630, after repl: 49580, after storageEngine: 53590, after tcmalloc: 56890, after wiredTiger: 67030, at end: 90050 } 2016-04-18T19:30:40.372+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 143ms 2016-04-18T19:31:01.832+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:31:42.903+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:31:54.861+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 628ms 2016-04-18T19:32:17.360+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 532ms 2016-04-18T19:32:39.572+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 155ms 2016-04-18T19:32:53.070+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:33:19.257+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:33:51.993+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 158ms 2016-04-18T19:34:04.262+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1171ms 2016-04-18T19:34:12.557+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:34:32.697+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:35:02.805+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3550, after asserts: 5800, after connections: 6760, after extra_info: 14490, after globalLock: 16830, after locks: 23110, after network: 24580, after opcounters: 25070, after opcountersRepl: 25070, after repl: 64020, after storageEngine: 71250, after tcmalloc: 75440, after wiredTiger: 96770, at end: 120020 } 2016-04-18T19:35:18.105+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 160ms 2016-04-18T19:35:30.414+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:35:33.355+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 632ms 2016-04-18T19:35:50.060+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2773ms 2016-04-18T19:35:56.835+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:36:58.543+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:37:01.711+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 503ms 2016-04-18T19:37:18.105+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 145ms 2016-04-18T19:37:20.797+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:37:58.783+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T19:38:23.579+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:38:24.599+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 547ms 2016-04-18T19:38:46.706+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 768ms 2016-04-18T19:38:58.984+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 164ms 2016-04-18T19:39:11.234+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:39:35.699+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:40:10.187+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 168ms 2016-04-18T19:40:19.693+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3680, after asserts: 6580, after connections: 10370, after extra_info: 18960, after globalLock: 20880, after locks: 23230, after network: 24260, after opcounters: 24720, after opcountersRepl: 24720, after repl: 45690, after storageEngine: 56120, after tcmalloc: 64680, after wiredTiger: 102420, at end: 129870 } 2016-04-18T19:40:26.243+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1105ms 2016-04-18T19:40:27.723+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:40:37.032+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T19:41:11.580+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:41:56.556+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 168ms 2016-04-18T19:42:06.259+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 170ms 2016-04-18T19:42:21.014+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T19:42:52.718+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:43:11.982+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 529ms 2016-04-18T19:43:28.779+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1294ms 2016-04-18T19:43:40.453+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:43:44.408+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 309ms 2016-04-18T19:43:59.566+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:44:24.887+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5030, after asserts: 5150, after connections: 5420, after extra_info: 10380, after globalLock: 15100, after locks: 19940, after network: 21730, after opcounters: 29700, after opcountersRepl: 29940, after repl: 42260, after storageEngine: 46100, after tcmalloc: 58460, after wiredTiger: 65480, at end: 83540 } 2016-04-18T19:44:42.890+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T19:44:58.050+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 634ms 2016-04-18T19:45:12.029+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:45:14.779+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1174ms 2016-04-18T19:45:28.186+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 162ms 2016-04-18T19:45:55.932+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:46:25.553+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:46:45.288+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 752ms 2016-04-18T19:46:56.951+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2518ms 2016-04-18T19:47:12.333+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 199ms 2016-04-18T19:47:41.898+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:48:12.620+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:48:28.552+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3610, after asserts: 4650, after connections: 5420, after extra_info: 10690, after globalLock: 17880, after locks: 30380, after network: 32560, after opcounters: 32560, after opcountersRepl: 32560, after repl: 70160, after storageEngine: 74830, after tcmalloc: 82690, after wiredTiger: 98450, at end: 116000 } 2016-04-18T19:48:31.915+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 334ms 2016-04-18T19:48:45.315+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 423ms 2016-04-18T19:48:57.368+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T19:48:58.930+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 397ms 2016-04-18T19:49:26.359+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:50:12.051+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 347ms 2016-04-18T19:50:12.353+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T19:50:25.116+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 951ms 2016-04-18T19:50:39.036+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 131ms 2016-04-18T19:50:42.292+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:51:23.740+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:51:42.553+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:51:51.619+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4010, after asserts: 6160, after connections: 10390, after extra_info: 18360, after globalLock: 21080, after locks: 24750, after network: 26670, after opcounters: 27080, after opcountersRepl: 27080, after repl: 57500, after storageEngine: 58950, after tcmalloc: 68240, after wiredTiger: 80460, at end: 89740 } 2016-04-18T19:51:53.479+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 463ms 2016-04-18T19:52:07.101+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 522ms 2016-04-18T19:52:19.825+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:52:20.368+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 239ms 2016-04-18T19:52:40.146+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:53:19.859+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:53:33.627+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 303ms 2016-04-18T19:53:39.574+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:53:41.597+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 839ms 2016-04-18T19:53:46.608+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 196ms 2016-04-18T19:54:10.974+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:54:31.178+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:54:44.081+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3560, after asserts: 5130, after connections: 5910, after extra_info: 9850, after globalLock: 11430, after locks: 12630, after network: 13450, after opcounters: 13550, after opcountersRepl: 13550, after repl: 26900, after storageEngine: 29310, after tcmalloc: 34230, after wiredTiger: 45340, at end: 64000 } 2016-04-18T19:55:04.270+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 107ms 2016-04-18T19:55:14.534+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 602ms 2016-04-18T19:55:17.817+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 166ms 2016-04-18T19:55:31.227+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:55:52.043+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:56:26.042+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 660ms 2016-04-18T19:56:34.845+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 591ms 2016-04-18T19:56:39.813+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:56:46.115+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 152ms 2016-04-18T19:56:58.408+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:57:38.138+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:57:56.009+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 207ms 2016-04-18T19:58:04.163+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:58:06.583+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 863ms 2016-04-18T19:58:13.610+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2010, after asserts: 4310, after connections: 8160, after extra_info: 15810, after globalLock: 17310, after locks: 19460, after network: 22590, after opcounters: 25390, after opcountersRepl: 28560, after repl: 49700, after storageEngine: 52050, after tcmalloc: 59720, after wiredTiger: 72830, at end: 84880 } 2016-04-18T19:58:16.123+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 132ms 2016-04-18T19:59:01.670+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:59:19.240+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T19:59:26.948+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 453ms 2016-04-18T19:59:49.127+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1039ms 2016-04-18T20:00:00.361+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:00:06.294+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2090ms 2016-04-18T20:00:27.806+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:00:54.628+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:01:15.733+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 106ms 2016-04-18T20:01:30.471+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 687ms 2016-04-18T20:01:40.829+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:01:41.754+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 141ms 2016-04-18T20:01:48.955+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3240, after asserts: 5080, after connections: 10520, after extra_info: 19920, after globalLock: 25650, after locks: 28870, after network: 31570, after opcounters: 32660, after opcountersRepl: 32820, after repl: 65000, after storageEngine: 66710, after tcmalloc: 68990, after wiredTiger: 75000, at end: 95570 } 2016-04-18T20:02:00.573+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T20:02:54.161+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 361ms 2016-04-18T20:02:56.612+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:03:04.869+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1723ms 2016-04-18T20:03:14.102+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 247ms 2016-04-18T20:03:15.405+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:03:55.868+0000 I COMMAND [conn14] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 6027ms 2016-04-18T20:04:01.464+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:04:14.982+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:04:25.538+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 878ms 2016-04-18T20:04:34.500+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 434ms 2016-04-18T20:04:51.307+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 191ms 2016-04-18T20:04:54.688+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:05:06.479+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4350, after asserts: 5640, after connections: 6390, after extra_info: 12520, after globalLock: 15110, after locks: 17420, after network: 17810, after opcounters: 17810, after opcountersRepl: 17810, after repl: 43760, after storageEngine: 46520, after tcmalloc: 49540, after wiredTiger: 58490, at end: 71290 } 2016-04-18T20:05:12.761+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:06:00.659+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:06:03.719+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 615ms 2016-04-18T20:06:27.628+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 598ms 2016-04-18T20:06:32.270+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:06:37.836+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 251ms 2016-04-18T20:07:09.092+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:07:29.340+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:07:47.067+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 167ms 2016-04-18T20:08:01.274+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 774ms 2016-04-18T20:08:18.787+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:08:27.905+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-04-18T20:08:27.905+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3010, after asserts: 4610, after connections: 6270, after extra_info: 14030, after globalLock: 17470, after locks: 18840, after network: 19050, after opcounters: 19050, after opcountersRepl: 19050, after repl: 50360, after storageEngine: 54300, after tcmalloc: 61810, after wiredTiger: 72510, at end: 82470 } 2016-04-18T20:08:36.475+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:09:37.710+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:09:41.777+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 162ms 2016-04-18T20:09:47.106+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1727ms 2016-04-18T20:09:50.671+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:09:54.896+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 150ms 2016-04-18T20:10:39.929+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T20:11:04.274+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:11:09.216+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 161ms 2016-04-18T20:11:24.261+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1646ms 2016-04-18T20:11:48.588+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:12:12.694+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:12:24.013+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2160, after asserts: 4040, after connections: 6260, after extra_info: 10380, after globalLock: 15260, after locks: 17430, after network: 18050, after opcounters: 18050, after opcountersRepl: 18050, after repl: 51090, after storageEngine: 59800, after tcmalloc: 64600, after wiredTiger: 77410, at end: 95740 } 2016-04-18T20:12:34.462+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 641ms 2016-04-18T20:12:43.409+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 565ms 2016-04-18T20:13:01.896+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1688ms 2016-04-18T20:13:25.127+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:13:51.545+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:14:14.278+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 246ms 2016-04-18T20:14:29.595+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1595ms 2016-04-18T20:14:30.544+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:14:45.106+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 786ms 2016-04-18T20:14:55.496+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:15:47.915+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:15:53.027+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 303ms 2016-04-18T20:16:00.243+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 702ms 2016-04-18T20:16:09.116+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 144ms 2016-04-18T20:16:14.070+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:16:32.383+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4760, after asserts: 6620, after connections: 9500, after extra_info: 18870, after globalLock: 21860, after locks: 26550, after network: 30100, after opcounters: 32380, after opcountersRepl: 34120, after repl: 57600, after storageEngine: 60140, after tcmalloc: 60550, after wiredTiger: 80150, at end: 96030 } 2016-04-18T20:16:54.875+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:17:17.982+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 147ms 2016-04-18T20:17:33.112+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 503ms 2016-04-18T20:17:44.706+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:17:46.928+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 365ms 2016-04-18T20:18:40.970+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:19:06.154+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 246ms 2016-04-18T20:19:13.825+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:19:21.349+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 422ms 2016-04-18T20:19:35.846+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 196ms 2016-04-18T20:20:03.971+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:20:24.521+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2500, after asserts: 3860, after connections: 7660, after extra_info: 12800, after globalLock: 17210, after locks: 20050, after network: 22380, after opcounters: 23310, after opcountersRepl: 23310, after repl: 63540, after storageEngine: 65980, after tcmalloc: 70630, after wiredTiger: 80400, at end: 98360 } 2016-04-18T20:20:32.490+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:20:54.729+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 518ms 2016-04-18T20:21:13.345+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1867ms 2016-04-18T20:21:32.777+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2265ms 2016-04-18T20:21:38.756+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:22:03.013+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:22:43.834+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 102ms 2016-04-18T20:23:04.626+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 950ms 2016-04-18T20:23:05.030+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:23:07.673+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 341ms 2016-04-18T20:23:14.940+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:23:56.580+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:24:17.754+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 302ms 2016-04-18T20:24:18.263+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:24:32.104+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 675ms 2016-04-18T20:24:38.662+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 300ms 2016-04-18T20:24:41.493+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2830, after asserts: 6770, after connections: 12900, after extra_info: 24980, after globalLock: 25830, after locks: 26990, after network: 27090, after opcounters: 27090, after opcountersRepl: 27090, after repl: 33920, after storageEngine: 36080, after tcmalloc: 41380, after wiredTiger: 52460, at end: 72040 } 2016-04-18T20:25:22.715+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:25:45.600+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 176ms 2016-04-18T20:25:56.860+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 768ms 2016-04-18T20:25:59.009+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:26:24.403+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 310ms 2016-04-18T20:27:11.904+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:27:31.629+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:27:42.633+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1110ms 2016-04-18T20:27:59.683+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 343ms 2016-04-18T20:27:59.683+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3840, after asserts: 5430, after connections: 6250, after extra_info: 10980, after globalLock: 11770, after locks: 13070, after network: 13340, after opcounters: 13340, after opcountersRepl: 13340, after repl: 37930, after storageEngine: 41410, after tcmalloc: 53270, after wiredTiger: 71430, at end: 86630 } 2016-04-18T20:28:12.839+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 143ms 2016-04-18T20:28:19.003+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:28:49.361+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:29:30.940+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-18T20:29:43.019+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:29:44.588+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1043ms 2016-04-18T20:29:46.298+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 142ms 2016-04-18T20:30:08.155+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T20:30:43.140+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:30:59.584+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 343ms 2016-04-18T20:31:19.743+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 418ms 2016-04-18T20:31:47.892+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:32:19.979+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:32:32.281+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 248ms 2016-04-18T20:32:43.432+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 996ms 2016-04-18T20:32:48.465+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5530, after asserts: 6930, after connections: 7550, after extra_info: 13850, after globalLock: 18480, after locks: 23250, after network: 24320, after opcounters: 24320, after opcountersRepl: 24320, after repl: 44680, after storageEngine: 47620, after tcmalloc: 51660, after wiredTiger: 75110, at end: 98200 } 2016-04-18T20:33:01.663+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-04-18T20:33:06.381+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:33:26.864+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:34:09.199+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 166ms 2016-04-18T20:34:24.376+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 908ms 2016-04-18T20:34:29.686+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:34:32.120+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 103ms 2016-04-18T20:34:45.211+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:35:35.904+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:35:48.808+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 169ms 2016-04-18T20:35:58.430+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:35:58.430+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 905ms 2016-04-18T20:36:11.543+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 264ms 2016-04-18T20:36:36.520+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:36:55.411+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:37:16.848+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 542ms 2016-04-18T20:37:36.321+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 996ms 2016-04-18T20:37:50.246+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:37:51.911+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 197ms 2016-04-18T20:38:21.550+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:38:25.315+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2090, after asserts: 3060, after connections: 3380, after extra_info: 9960, after globalLock: 13960, after locks: 15750, after network: 20710, after opcounters: 24770, after opcountersRepl: 26230, after repl: 69940, after storageEngine: 74240, after tcmalloc: 83250, after wiredTiger: 95860, at end: 121220 } 2016-04-18T20:39:03.208+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 482ms 2016-04-18T20:39:20.154+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 4014ms 2016-04-18T20:39:26.763+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:39:29.813+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 250ms 2016-04-18T20:39:48.620+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:40:38.647+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:40:44.784+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 131ms 2016-04-18T20:40:59.808+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3134ms 2016-04-18T20:41:00.673+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:41:16.550+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1652ms 2016-04-18T20:41:49.026+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:42:11.659+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:42:24.328+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2330, after asserts: 4730, after connections: 6700, after extra_info: 13780, after globalLock: 15720, after locks: 16860, after network: 18000, after opcounters: 18000, after opcountersRepl: 18000, after repl: 52180, after storageEngine: 54320, after tcmalloc: 61900, after wiredTiger: 78110, at end: 100410 } 2016-04-18T20:42:24.795+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 164ms 2016-04-18T20:42:43.123+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 464ms 2016-04-18T20:42:58.377+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 259ms 2016-04-18T20:43:03.731+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:43:59.003+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:44:10.966+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 156ms 2016-04-18T20:44:30.192+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1050ms 2016-04-18T20:44:43.404+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-18T20:45:04.219+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:45:24.668+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:46:03.674+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 181ms 2016-04-18T20:46:21.555+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 683ms 2016-04-18T20:46:24.480+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:46:27.687+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 111ms 2016-04-18T20:46:51.246+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:47:19.723+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:47:30.663+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4250, after asserts: 6480, after connections: 7730, after extra_info: 16760, after globalLock: 19110, after locks: 20770, after network: 21330, after opcounters: 21330, after opcountersRepl: 21330, after repl: 42490, after storageEngine: 47190, after tcmalloc: 56850, after wiredTiger: 95330, at end: 118080 } 2016-04-18T20:47:33.939+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2211ms 2016-04-18T20:47:36.376+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 675ms 2016-04-18T20:47:50.428+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 142ms 2016-04-18T20:48:37.351+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:49:04.401+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 273ms 2016-04-18T20:49:06.685+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:49:18.286+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 747ms 2016-04-18T20:49:25.994+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 258ms 2016-04-18T20:49:54.761+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:50:28.889+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T20:50:44.849+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 182ms 2016-04-18T20:51:11.147+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2171ms 2016-04-18T20:51:11.044+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:51:20.056+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 352ms 2016-04-18T20:51:33.678+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:52:02.053+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4780, after asserts: 7870, after connections: 10560, after extra_info: 17910, after globalLock: 23010, after locks: 25410, after network: 29680, after opcounters: 29680, after opcountersRepl: 29680, after repl: 66030, after storageEngine: 69470, after tcmalloc: 74690, after wiredTiger: 101350, at end: 125570 } 2016-04-18T20:52:08.742+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:52:30.980+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:52:35.990+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 127ms 2016-04-18T20:52:50.547+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 758ms 2016-04-18T20:53:07.636+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 250ms 2016-04-18T20:53:39.133+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:54:00.074+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:54:27.813+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 192ms 2016-04-18T20:54:55.807+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1926ms 2016-04-18T20:54:56.482+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:55:06.502+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 165ms 2016-04-18T20:55:31.420+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:56:20.722+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 179ms 2016-04-18T20:56:22.867+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:56:34.734+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 862ms 2016-04-18T20:56:46.728+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3020, after asserts: 5280, after connections: 9210, after extra_info: 17510, after globalLock: 22870, after locks: 27040, after network: 29850, after opcounters: 35170, after opcountersRepl: 36640, after repl: 76050, after storageEngine: 78980, after tcmalloc: 90820, after wiredTiger: 103530, at end: 122500 } 2016-04-18T20:56:50.653+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 254ms 2016-04-18T20:56:55.312+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T20:58:02.408+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1110ms 2016-04-18T20:58:11.418+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:58:15.989+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 570ms 2016-04-18T20:58:34.063+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 143ms 2016-04-18T20:58:46.205+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:59:35.648+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T20:59:51.902+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 173ms 2016-04-18T20:59:58.505+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:00:09.326+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 778ms 2016-04-18T21:00:39.193+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3143ms 2016-04-18T21:00:55.662+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:01:33.423+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T21:01:48.187+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2660, after asserts: 5440, after connections: 8580, after extra_info: 19520, after globalLock: 22240, after locks: 24810, after network: 26690, after opcounters: 27320, after opcountersRepl: 27320, after repl: 72810, after storageEngine: 85230, after tcmalloc: 91350, after wiredTiger: 112220, at end: 152190 } 2016-04-18T21:02:00.773+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 374ms 2016-04-18T21:02:18.868+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 590ms 2016-04-18T21:02:34.264+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 392ms 2016-04-18T21:02:54.089+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:03:15.347+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T21:03:49.082+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 132ms 2016-04-18T21:04:01.713+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:04:04.011+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 757ms 2016-04-18T21:04:19.865+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 130ms 2016-04-18T21:04:25.888+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:05:11.379+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:05:32.186+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:05:34.320+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 526ms 2016-04-18T21:05:35.712+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 864ms 2016-04-18T21:05:51.006+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4570, after asserts: 7190, after connections: 12370, after extra_info: 21780, after globalLock: 25560, after locks: 27820, after network: 29190, after opcounters: 29190, after opcountersRepl: 29190, after repl: 61890, after storageEngine: 65070, after tcmalloc: 68000, after wiredTiger: 95410, at end: 112090 } 2016-04-18T21:05:54.043+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:06:39.496+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 427ms 2016-04-18T21:06:47.714+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:06:54.309+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1520ms 2016-04-18T21:07:03.951+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:07:06.782+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 472ms 2016-04-18T21:07:50.523+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:08:14.031+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:08:22.475+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 205ms 2016-04-18T21:08:32.937+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 590ms 2016-04-18T21:09:04.901+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:09:28.571+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:09:49.210+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3330, after asserts: 7250, after connections: 10820, after extra_info: 15670, after globalLock: 18020, after locks: 18650, after network: 19230, after opcounters: 20710, after opcountersRepl: 21070, after repl: 33670, after storageEngine: 37960, after tcmalloc: 48230, after wiredTiger: 63090, at end: 79840 } 2016-04-18T21:09:49.096+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 277ms 2016-04-18T21:10:10.607+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1818ms 2016-04-18T21:10:18.273+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:10:21.665+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 157ms 2016-04-18T21:11:02.263+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:11:30.162+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 153ms 2016-04-18T21:11:43.498+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1289ms 2016-04-18T21:11:52.084+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:12:00.691+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 178ms 2016-04-18T21:12:19.682+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:13:10.767+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:13:15.117+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 126ms 2016-04-18T21:13:20.923+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 314ms 2016-04-18T21:13:29.350+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:13:30.912+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 194ms 2016-04-18T21:13:36.581+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2640, after asserts: 4150, after connections: 5350, after extra_info: 12510, after globalLock: 15240, after locks: 18560, after network: 20420, after opcounters: 21770, after opcountersRepl: 22510, after repl: 34720, after storageEngine: 37250, after tcmalloc: 43590, after wiredTiger: 52240, at end: 67090 } 2016-04-18T21:13:59.842+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:14:32.308+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:14:43.429+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 786ms 2016-04-18T21:14:54.908+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 818ms 2016-04-18T21:15:16.790+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1761ms 2016-04-18T21:15:17.129+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:15:43.478+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:16:24.396+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 160ms 2016-04-18T21:16:24.396+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:16:33.826+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1203ms 2016-04-18T21:16:53.192+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 268ms 2016-04-18T21:16:53.559+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:17:51.965+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3020, after asserts: 4880, after connections: 6670, after extra_info: 14840, after globalLock: 18210, after locks: 20790, after network: 22320, after opcounters: 22530, after opcountersRepl: 22530, after repl: 53070, after storageEngine: 53440, after tcmalloc: 59960, after wiredTiger: 79430, at end: 101250 } 2016-04-18T21:17:52.399+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:18:06.831+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 733ms 2016-04-18T21:18:19.175+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 155ms 2016-04-18T21:18:32.884+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:18:38.294+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 313ms 2016-04-18T21:19:42.512+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:19:54.585+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 151ms 2016-04-18T21:20:07.062+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 422ms 2016-04-18T21:20:11.537+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:20:57.917+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:21:24.578+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 145ms 2016-04-18T21:21:34.240+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:21:42.038+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1867ms 2016-04-18T21:21:56.572+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 144ms 2016-04-18T21:22:24.699+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:22:27.003+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2780, after asserts: 3880, after connections: 8770, after extra_info: 22970, after globalLock: 24800, after locks: 26390, after network: 28270, after opcounters: 28770, after opcountersRepl: 28770, after repl: 59770, after storageEngine: 63200, after tcmalloc: 79100, after wiredTiger: 103650, at end: 116960 } 2016-04-18T21:22:44.061+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:23:09.036+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 314ms 2016-04-18T21:23:26.870+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 265ms 2016-04-18T21:23:37.110+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:24:01.149+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:24:39.156+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 103ms 2016-04-18T21:24:48.734+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:24:49.672+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 334ms 2016-04-18T21:25:04.635+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 164ms 2016-04-18T21:25:19.028+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:26:14.383+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:26:16.007+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 149ms 2016-04-18T21:26:30.829+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1488ms 2016-04-18T21:26:46.104+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 115ms 2016-04-18T21:26:48.396+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:26:55.123+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4260, after asserts: 6460, after connections: 11330, after extra_info: 21100, after globalLock: 24750, after locks: 26450, after network: 28030, after opcounters: 28030, after opcountersRepl: 28030, after repl: 64520, after storageEngine: 68010, after tcmalloc: 78750, after wiredTiger: 93740, at end: 115060 } 2016-04-18T21:27:52.161+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:27:58.194+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 180ms 2016-04-18T21:28:12.482+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1720ms 2016-04-18T21:28:16.184+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:28:27.269+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 378ms 2016-04-18T21:28:58.155+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:29:22.283+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:29:40.635+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 317ms 2016-04-18T21:29:54.484+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 924ms 2016-04-18T21:30:17.517+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 183ms 2016-04-18T21:30:27.595+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:30:54.459+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:31:11.000+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3860, after asserts: 5570, after connections: 7490, after extra_info: 13870, after globalLock: 19690, after locks: 21590, after network: 21990, after opcounters: 24120, after opcountersRepl: 24870, after repl: 55030, after storageEngine: 57440, after tcmalloc: 64550, after wiredTiger: 82900, at end: 100690 } 2016-04-18T21:31:37.897+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:31:37.897+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 416ms 2016-04-18T21:32:01.300+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 234ms 2016-04-18T21:32:08.630+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 220ms 2016-04-18T21:32:21.619+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:33:07.294+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:33:23.655+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 287ms 2016-04-18T21:33:36.063+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:33:40.894+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 666ms 2016-04-18T21:33:57.199+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 195ms 2016-04-18T21:34:14.259+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:34:46.730+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:35:12.995+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T21:35:20.260+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1296ms 2016-04-18T21:35:33.179+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:35:32.672+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 141ms 2016-04-18T21:35:44.417+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1470, after asserts: 2680, after connections: 8300, after extra_info: 16410, after globalLock: 18300, after locks: 21250, after network: 25730, after opcounters: 27920, after opcountersRepl: 29200, after repl: 59350, after storageEngine: 62270, after tcmalloc: 65220, after wiredTiger: 95430, at end: 115230 } 2016-04-18T21:36:01.917+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:36:49.508+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 178ms 2016-04-18T21:37:05.762+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2558ms 2016-04-18T21:37:22.066+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T21:37:25.728+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:37:54.012+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:38:33.886+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 330ms 2016-04-18T21:38:35.193+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:38:49.545+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 509ms 2016-04-18T21:38:59.917+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 127ms 2016-04-18T21:39:14.730+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:40:09.658+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:40:28.788+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 339ms 2016-04-18T21:40:40.046+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:40:48.100+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1169ms 2016-04-18T21:40:52.036+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2120, after asserts: 4130, after connections: 4880, after extra_info: 14200, after globalLock: 16850, after locks: 19920, after network: 21840, after opcounters: 23520, after opcountersRepl: 27980, after repl: 82820, after storageEngine: 91550, after tcmalloc: 99620, after wiredTiger: 126390, at end: 152420 } 2016-04-18T21:40:57.593+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 159ms 2016-04-18T21:41:51.026+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:42:12.949+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 157ms 2016-04-18T21:42:13.029+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:42:28.457+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 747ms 2016-04-18T21:43:14.057+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:43:37.861+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:43:42.081+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 341ms 2016-04-18T21:44:00.967+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 697ms 2016-04-18T21:44:14.157+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-04-18T21:44:42.806+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:45:11.369+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:45:28.610+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 280ms 2016-04-18T21:45:34.759+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3390, after asserts: 4660, after connections: 9560, after extra_info: 23850, after globalLock: 26970, after locks: 31080, after network: 32410, after opcounters: 32880, after opcountersRepl: 32880, after repl: 91410, after storageEngine: 98690, after tcmalloc: 110510, after wiredTiger: 121740, at end: 149410 } 2016-04-18T21:45:39.860+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 571ms 2016-04-18T21:46:02.014+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 190ms 2016-04-18T21:46:10.713+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:46:48.929+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:47:15.766+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 187ms 2016-04-18T21:47:28.983+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1150ms 2016-04-18T21:47:46.459+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T21:47:54.699+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:48:23.063+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:48:59.656+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1201ms 2016-04-18T21:49:05.577+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:49:09.291+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 888ms 2016-04-18T21:49:31.380+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 131ms 2016-04-18T21:49:37.369+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5130, after asserts: 5490, after connections: 7370, after extra_info: 15370, after globalLock: 18510, after locks: 21030, after network: 21380, after opcounters: 21380, after opcountersRepl: 21380, after repl: 55270, after storageEngine: 58540, after tcmalloc: 65950, after wiredTiger: 75880, at end: 93430 } 2016-04-18T21:49:37.889+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:50:42.522+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 171ms 2016-04-18T21:50:47.784+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:50:55.733+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 916ms 2016-04-18T21:51:16.918+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 260ms 2016-04-18T21:51:30.298+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:52:27.832+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:52:33.137+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-04-18T21:52:51.027+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 576ms 2016-04-18T21:52:51.859+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:54:01.222+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:54:07.693+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T21:54:34.568+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:54:37.514+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 588ms 2016-04-18T21:54:49.735+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1990, after asserts: 4020, after connections: 4700, after extra_info: 16380, after globalLock: 21050, after locks: 26750, after network: 28200, after opcounters: 28500, after opcountersRepl: 28500, after repl: 83270, after storageEngine: 86240, after tcmalloc: 104180, after wiredTiger: 118150, at end: 156160 } 2016-04-18T21:54:51.012+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 170ms 2016-04-18T21:55:38.308+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:56:05.978+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 165ms 2016-04-18T21:56:07.089+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:56:19.857+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2733ms 2016-04-18T21:56:44.010+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 5327ms 2016-04-18T21:56:53.198+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:57:23.072+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:57:53.946+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-04-18T21:58:17.248+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 814ms 2016-04-18T21:58:19.962+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:58:31.007+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 311ms 2016-04-18T21:58:56.872+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T21:59:13.077+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5220, after asserts: 7370, after connections: 11500, after extra_info: 23120, after globalLock: 27600, after locks: 31190, after network: 32890, after opcounters: 35420, after opcountersRepl: 36950, after repl: 62590, after storageEngine: 67040, after tcmalloc: 73920, after wiredTiger: 102770, at end: 121970 } 2016-04-18T21:59:50.429+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 285ms 2016-04-18T22:00:10.409+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1267ms 2016-04-18T22:00:21.056+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:00:28.851+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 122ms 2016-04-18T22:00:49.417+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:01:35.781+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:01:42.484+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 151ms 2016-04-18T22:02:08.049+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 667ms 2016-04-18T22:02:18.612+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:02:30.054+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2219ms 2016-04-18T22:03:22.302+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:03:46.314+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3056ms 2016-04-18T22:03:50.192+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:03:49.931+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4190, after asserts: 5760, after connections: 7230, after extra_info: 17410, after globalLock: 20540, after locks: 21610, after network: 22420, after opcounters: 22420, after opcountersRepl: 22420, after repl: 72130, after storageEngine: 77640, after tcmalloc: 90820, after wiredTiger: 105040, at end: 127610 } 2016-04-18T22:04:05.459+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2189ms 2016-04-18T22:04:24.109+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 626ms 2016-04-18T22:04:46.229+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:05:14.535+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:05:36.333+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 132ms 2016-04-18T22:05:49.034+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1082ms 2016-04-18T22:06:03.727+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 894ms 2016-04-18T22:06:13.113+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:06:32.707+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:07:16.580+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 159ms 2016-04-18T22:07:19.533+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:07:24.386+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2507ms 2016-04-18T22:07:32.154+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-18T22:07:36.545+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:07:59.835+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:08:00.080+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 10530, after asserts: 12170, after connections: 13480, after extra_info: 21340, after globalLock: 27530, after locks: 29130, after network: 30480, after opcounters: 30480, after opcountersRepl: 30480, after repl: 74640, after storageEngine: 81490, after tcmalloc: 91500, after wiredTiger: 111980, at end: 132470 } 2016-04-18T22:08:49.883+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 491ms 2016-04-18T22:09:03.181+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:09:09.005+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2343ms 2016-04-18T22:09:24.344+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 149ms 2016-04-18T22:09:24.830+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:10:22.918+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:10:41.450+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 153ms 2016-04-18T22:10:44.470+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:11:00.295+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 501ms 2016-04-18T22:11:19.448+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 143ms 2016-04-18T22:11:36.049+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:12:10.394+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:12:14.773+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5280, after asserts: 8810, after connections: 12720, after extra_info: 21240, after globalLock: 23000, after locks: 29770, after network: 30830, after opcounters: 30830, after opcountersRepl: 30830, after repl: 76420, after storageEngine: 77270, after tcmalloc: 85220, after wiredTiger: 103590, at end: 126060 } 2016-04-18T22:12:44.654+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-18T22:12:55.562+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3597ms 2016-04-18T22:13:06.003+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 173ms 2016-04-18T22:13:19.942+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:13:42.389+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:14:20.195+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 374ms 2016-04-18T22:14:29.090+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:14:31.581+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 473ms 2016-04-18T22:14:35.236+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 155ms 2016-04-18T22:14:51.313+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:15:36.662+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:15:48.669+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 127ms 2016-04-18T22:16:01.320+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 389ms 2016-04-18T22:16:14.707+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 338ms 2016-04-18T22:16:20.709+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4010, after asserts: 9070, after connections: 15930, after extra_info: 21410, after globalLock: 25860, after locks: 27560, after network: 28600, after opcounters: 29020, after opcountersRepl: 29020, after repl: 53910, after storageEngine: 62080, after tcmalloc: 70530, after wiredTiger: 81990, at end: 108400 } 2016-04-18T22:16:25.688+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:16:46.228+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:17:27.692+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 367ms 2016-04-18T22:17:40.044+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 396ms 2016-04-18T22:17:48.440+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:17:50.741+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 189ms 2016-04-18T22:18:13.018+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:19:03.398+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 265ms 2016-04-18T22:19:05.714+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T22:19:15.905+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1037ms 2016-04-18T22:19:29.888+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 254ms 2016-04-18T22:19:32.904+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:20:38.194+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4050, after asserts: 5930, after connections: 12680, after extra_info: 19950, after globalLock: 23880, after locks: 28360, after network: 30530, after opcounters: 31080, after opcountersRepl: 31080, after repl: 64190, after storageEngine: 68380, after tcmalloc: 76130, after wiredTiger: 97840, at end: 122050 } 2016-04-18T22:20:39.524+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:20:43.371+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 690ms 2016-04-18T22:21:07.032+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3621ms 2016-04-18T22:21:13.909+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:21:20.968+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 138ms 2016-04-18T22:22:16.713+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:22:33.735+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 162ms 2016-04-18T22:22:35.302+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:22:39.239+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1002ms 2016-04-18T22:23:27.409+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:23:51.260+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1696ms 2016-04-18T22:24:01.965+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:24:04.360+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2678ms 2016-04-18T22:24:19.057+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 165ms 2016-04-18T22:24:49.082+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:25:35.759+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 6033ms 2016-04-18T22:25:35.529+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4160, after asserts: 7640, after connections: 11730, after extra_info: 18840, after globalLock: 21410, after locks: 22700, after network: 23080, after opcounters: 23080, after opcountersRepl: 23080, after repl: 59030, after storageEngine: 61280, after tcmalloc: 65070, after wiredTiger: 85030, at end: 108790 } 2016-04-18T22:25:37.247+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:25:43.927+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 575ms 2016-04-18T22:25:56.566+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 330ms 2016-04-18T22:26:47.638+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:27:15.099+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:27:21.334+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1917ms 2016-04-18T22:27:36.118+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 728ms 2016-04-18T22:27:55.799+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 119ms 2016-04-18T22:28:13.643+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:28:41.561+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:29:16.595+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-04-18T22:29:27.537+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:29:34.706+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 292ms 2016-04-18T22:29:47.550+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:29:50.247+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 298ms 2016-04-18T22:30:11.333+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4880, after asserts: 9400, after connections: 13170, after extra_info: 24340, after globalLock: 28520, after locks: 30770, after network: 32550, after opcounters: 32930, after opcountersRepl: 32930, after repl: 78740, after storageEngine: 81880, after tcmalloc: 91480, after wiredTiger: 102220, at end: 123870 } 2016-04-18T22:30:33.500+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:31:07.120+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1418ms 2016-04-18T22:31:22.599+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:31:24.735+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 410ms 2016-04-18T22:31:41.311+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 303ms 2016-04-18T22:32:17.603+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:32:41.004+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:32:57.358+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 175ms 2016-04-18T22:33:07.414+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1752ms 2016-04-18T22:33:21.989+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 196ms 2016-04-18T22:33:38.144+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:34:15.656+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 10060, after asserts: 12120, after connections: 15100, after extra_info: 24420, after globalLock: 26730, after locks: 31740, after network: 37850, after opcounters: 39420, after opcountersRepl: 40690, after repl: 51690, after storageEngine: 54790, after tcmalloc: 69190, after wiredTiger: 82360, at end: 99470 } 2016-04-18T22:34:18.863+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:34:40.723+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 643ms 2016-04-18T22:34:56.795+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1581ms 2016-04-18T22:35:10.845+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 626ms 2016-04-18T22:35:32.455+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:36:12.449+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:36:22.566+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 236ms 2016-04-18T22:36:37.081+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 745ms 2016-04-18T22:36:52.055+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 375ms 2016-04-18T22:36:57.866+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:37:28.541+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:38:05.348+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 349ms 2016-04-18T22:38:21.799+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 793ms 2016-04-18T22:38:26.628+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:38:28.065+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 120ms 2016-04-18T22:38:41.071+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:39:21.852+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2510, after asserts: 5840, after connections: 15180, after extra_info: 21420, after globalLock: 27090, after locks: 29760, after network: 32190, after opcounters: 36410, after opcountersRepl: 41670, after repl: 74280, after storageEngine: 80640, after tcmalloc: 86360, after wiredTiger: 112210, at end: 132350 } 2016-04-18T22:39:35.438+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 197ms 2016-04-18T22:39:36.149+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:39:45.568+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 899ms 2016-04-18T22:39:54.933+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 161ms 2016-04-18T22:40:03.452+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:41:13.622+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 204ms 2016-04-18T22:41:17.336+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:41:29.868+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 903ms 2016-04-18T22:41:44.751+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 196ms 2016-04-18T22:41:56.419+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:42:57.621+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 520ms 2016-04-18T22:43:09.288+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:43:14.016+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1034ms 2016-04-18T22:43:42.747+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:43:57.104+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3660, after asserts: 5300, after connections: 8150, after extra_info: 11110, after globalLock: 14530, after locks: 19160, after network: 20430, after opcounters: 20430, after opcountersRepl: 20430, after repl: 68250, after storageEngine: 71460, after tcmalloc: 81850, after wiredTiger: 97580, at end: 118870 } 2016-04-18T22:44:33.390+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 285ms 2016-04-18T22:44:51.151+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:44:54.732+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 933ms 2016-04-18T22:45:07.045+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:45:12.349+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 144ms 2016-04-18T22:45:58.408+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:46:33.223+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 271ms 2016-04-18T22:46:38.654+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:46:48.104+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 619ms 2016-04-18T22:47:07.798+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 153ms 2016-04-18T22:47:27.297+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:48:00.040+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:48:25.089+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 172ms 2016-04-18T22:48:39.992+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 7350, after asserts: 11930, after connections: 19020, after extra_info: 28780, after globalLock: 34530, after locks: 36640, after network: 39940, after opcounters: 41600, after opcountersRepl: 53570, after repl: 96110, after storageEngine: 102250, after tcmalloc: 109210, after wiredTiger: 117200, at end: 135710 } 2016-04-18T22:48:40.762+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1340ms 2016-04-18T22:48:44.365+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 201ms 2016-04-18T22:48:58.525+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:49:55.489+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:50:00.171+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3432ms 2016-04-18T22:50:06.991+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 576ms 2016-04-18T22:50:28.495+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 169ms 2016-04-18T22:50:52.265+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:51:17.611+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:51:49.090+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 238ms 2016-04-18T22:52:06.188+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 944ms 2016-04-18T22:52:16.040+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:52:27.982+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 732ms 2016-04-18T22:52:45.950+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:53:08.388+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6030, after asserts: 8360, after connections: 10990, after extra_info: 23230, after globalLock: 24460, after locks: 27720, after network: 31590, after opcounters: 32470, after opcountersRepl: 32470, after repl: 55920, after storageEngine: 59230, after tcmalloc: 67350, after wiredTiger: 81310, at end: 110890 } 2016-04-18T22:53:37.934+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:53:55.750+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 229ms 2016-04-18T22:54:15.441+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2206ms 2016-04-18T22:54:32.525+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 131ms 2016-04-18T22:54:40.509+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:55:40.852+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:55:43.904+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 154ms 2016-04-18T22:56:00.799+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 848ms 2016-04-18T22:56:06.815+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:56:11.419+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 201ms 2016-04-18T22:56:49.190+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:57:20.904+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:57:29.958+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 387ms 2016-04-18T22:57:49.829+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1903ms 2016-04-18T22:58:01.551+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 117ms 2016-04-18T22:58:19.799+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4020, after asserts: 6730, after connections: 14230, after extra_info: 19480, after globalLock: 21240, after locks: 25370, after network: 28290, after opcounters: 30370, after opcountersRepl: 31800, after repl: 71760, after storageEngine: 73820, after tcmalloc: 77690, after wiredTiger: 90850, at end: 127570 } 2016-04-18T22:58:25.582+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:58:51.685+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T22:59:16.822+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 671ms 2016-04-18T22:59:43.192+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 578ms 2016-04-18T22:59:54.599+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 331ms 2016-04-18T23:00:19.014+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:00:52.186+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:01:16.718+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1983ms 2016-04-18T23:01:31.731+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 605ms 2016-04-18T23:01:40.650+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:01:46.338+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 191ms 2016-04-18T23:02:12.966+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:03:03.253+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 884ms 2016-04-18T23:03:03.924+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:03:14.177+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1381ms 2016-04-18T23:03:28.811+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:03:35.162+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 294ms 2016-04-18T23:03:44.363+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4980, after asserts: 6940, after connections: 8570, after extra_info: 14900, after globalLock: 20650, after locks: 23580, after network: 29480, after opcounters: 32550, after opcountersRepl: 38140, after repl: 89270, after storageEngine: 91100, after tcmalloc: 94850, after wiredTiger: 119490, at end: 134870 } 2016-04-18T23:04:09.788+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:04:47.773+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 554ms 2016-04-18T23:04:54.267+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 263ms 2016-04-18T23:05:17.043+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:05:17.699+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 5110ms 2016-04-18T23:05:56.089+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:06:22.734+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:06:31.709+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 121ms 2016-04-18T23:06:48.983+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 855ms 2016-04-18T23:07:00.022+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 472ms 2016-04-18T23:07:19.892+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:07:49.382+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:08:01.368+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3640, after asserts: 7950, after connections: 11850, after extra_info: 25900, after globalLock: 30230, after locks: 32480, after network: 33220, after opcounters: 34830, after opcountersRepl: 36780, after repl: 47240, after storageEngine: 51540, after tcmalloc: 62290, after wiredTiger: 81960, at end: 98860 } 2016-04-18T23:08:07.937+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 101ms 2016-04-18T23:08:23.949+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2120ms 2016-04-18T23:08:37.991+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 196ms 2016-04-18T23:08:56.285+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:09:35.961+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:09:55.451+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 757ms 2016-04-18T23:10:11.389+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 483ms 2016-04-18T23:10:26.315+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 212ms 2016-04-18T23:10:27.995+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:11:00.060+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:11:37.896+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 205ms 2016-04-18T23:11:54.369+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 489ms 2016-04-18T23:12:09.517+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:12:10.121+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 159ms 2016-04-18T23:12:30.941+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2310, after asserts: 11190, after connections: 13160, after extra_info: 21870, after globalLock: 25680, after locks: 28330, after network: 30300, after opcounters: 33840, after opcountersRepl: 37710, after repl: 85610, after storageEngine: 89460, after tcmalloc: 94840, after wiredTiger: 109700, at end: 137060 } 2016-04-18T23:12:33.418+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:13:32.578+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 346ms 2016-04-18T23:13:46.706+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 476ms 2016-04-18T23:13:48.232+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:14:02.945+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 176ms 2016-04-18T23:14:20.936+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:15:11.026+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:15:23.890+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 252ms 2016-04-18T23:15:35.690+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:15:38.501+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1390ms 2016-04-18T23:15:57.255+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 972ms 2016-04-18T23:16:24.024+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2980, after asserts: 4720, after connections: 5050, after extra_info: 12820, after globalLock: 16230, after locks: 21270, after network: 23020, after opcounters: 23610, after opcountersRepl: 23610, after repl: 51310, after storageEngine: 54330, after tcmalloc: 59620, after wiredTiger: 76340, at end: 98210 } 2016-04-18T23:16:26.575+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:16:46.816+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:17:13.519+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 114ms 2016-04-18T23:17:31.685+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1730ms 2016-04-18T23:17:49.007+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 316ms 2016-04-18T23:17:56.128+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:18:16.798+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:19:01.503+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 255ms 2016-04-18T23:19:08.405+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:19:24.769+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 626ms 2016-04-18T23:19:41.507+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:19:43.587+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 881ms 2016-04-18T23:20:43.322+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:21:09.913+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 188ms 2016-04-18T23:21:16.583+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:21:23.607+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 710ms 2016-04-18T23:21:23.558+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4060, after asserts: 9830, after connections: 18080, after extra_info: 26400, after globalLock: 31800, after locks: 34010, after network: 34740, after opcounters: 34740, after opcountersRepl: 34740, after repl: 84080, after storageEngine: 87280, after tcmalloc: 92760, after wiredTiger: 132720, at end: 144580 } 2016-04-18T23:21:41.742+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-04-18T23:22:40.244+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:22:54.188+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 338ms 2016-04-18T23:23:05.533+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:23:06.541+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 668ms 2016-04-18T23:23:31.052+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 245ms 2016-04-18T23:23:55.419+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:24:19.534+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:24:52.751+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 480ms 2016-04-18T23:24:56.914+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:25:05.645+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 249ms 2016-04-18T23:25:10.617+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 387ms 2016-04-18T23:25:20.567+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:26:24.645+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 280ms 2016-04-18T23:26:27.527+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:26:36.873+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 389ms 2016-04-18T23:26:41.799+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2830, after asserts: 5200, after connections: 6620, after extra_info: 11720, after globalLock: 14080, after locks: 17790, after network: 20310, after opcounters: 20630, after opcountersRepl: 20630, after repl: 65260, after storageEngine: 69830, after tcmalloc: 82150, after wiredTiger: 92320, at end: 109620 } 2016-04-18T23:26:50.913+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:26:55.996+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 380ms 2016-04-18T23:28:10.383+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 157ms 2016-04-18T23:28:16.068+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:28:28.314+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1495ms 2016-04-18T23:28:35.832+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 152ms 2016-04-18T23:28:39.022+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:29:26.561+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:29:48.300+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 405ms 2016-04-18T23:29:50.747+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:30:08.448+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 4346ms 2016-04-18T23:30:22.364+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4620, after asserts: 9140, after connections: 10610, after extra_info: 19540, after globalLock: 22260, after locks: 27420, after network: 29140, after opcounters: 29140, after opcountersRepl: 29140, after repl: 45570, after storageEngine: 49920, after tcmalloc: 60610, after wiredTiger: 75080, at end: 95660 } 2016-04-18T23:30:26.941+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 237ms 2016-04-18T23:30:59.321+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:31:44.585+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 123ms 2016-04-18T23:31:55.490+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:32:00.958+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 943ms 2016-04-18T23:32:12.529+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 154ms 2016-04-18T23:32:39.265+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:33:07.781+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:33:26.245+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 131ms 2016-04-18T23:33:52.422+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1052ms 2016-04-18T23:34:04.766+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:34:10.254+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-18T23:34:27.623+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:35:25.485+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:35:26.321+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 226ms 2016-04-18T23:35:29.552+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2220, after asserts: 3690, after connections: 4110, after extra_info: 10730, after globalLock: 15870, after locks: 20830, after network: 22830, after opcounters: 22950, after opcountersRepl: 22950, after repl: 57640, after storageEngine: 61750, after tcmalloc: 72640, after wiredTiger: 97420, at end: 115860 } 2016-04-18T23:35:40.108+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 353ms 2016-04-18T23:35:51.351+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:35:55.010+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 124ms 2016-04-18T23:37:18.361+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 117ms 2016-04-18T23:37:29.070+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:37:33.196+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1644ms 2016-04-18T23:37:44.333+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 152ms 2016-04-18T23:37:50.538+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:38:55.901+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:38:59.002+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 115ms 2016-04-18T23:39:15.231+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 518ms 2016-04-18T23:39:26.531+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:39:31.266+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 246ms 2016-04-18T23:39:49.170+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:40:40.526+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:40:49.121+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5730, after asserts: 10110, after connections: 15510, after extra_info: 25010, after globalLock: 25640, after locks: 30780, after network: 32070, after opcounters: 32070, after opcountersRepl: 32070, after repl: 67910, after storageEngine: 73380, after tcmalloc: 85570, after wiredTiger: 98780, at end: 120260 } 2016-04-18T23:40:49.121+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 290ms 2016-04-18T23:41:15.252+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 378ms 2016-04-18T23:41:19.469+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:41:32.866+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 252ms 2016-04-18T23:42:35.572+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:42:41.730+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2068ms 2016-04-18T23:42:57.230+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 423ms 2016-04-18T23:43:01.818+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:43:12.465+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 131ms 2016-04-18T23:43:58.977+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:44:20.551+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 191ms 2016-04-18T23:44:31.418+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:44:31.515+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2218ms 2016-04-18T23:44:48.423+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1976ms 2016-04-18T23:45:33.152+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:46:04.966+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 222ms 2016-04-18T23:46:06.592+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:46:10.456+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6450, after asserts: 8420, after connections: 11060, after extra_info: 23030, after globalLock: 33030, after locks: 35240, after network: 36710, after opcounters: 40250, after opcountersRepl: 46490, after repl: 93830, after storageEngine: 97240, after tcmalloc: 104080, after wiredTiger: 123520, at end: 149670 } 2016-04-18T23:46:42.969+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 5584ms 2016-04-18T23:47:01.441+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 388ms 2016-04-18T23:47:46.632+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:48:15.145+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 383ms 2016-04-18T23:48:22.111+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:48:30.911+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1117ms 2016-04-18T23:48:45.310+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 243ms 2016-04-18T23:49:10.606+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:49:51.434+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:49:57.009+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 480ms 2016-04-18T23:50:23.813+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 6363ms 2016-04-18T23:51:14.772+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:51:40.880+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 542ms 2016-04-18T23:51:52.075+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:51:57.313+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2969ms 2016-04-18T23:51:57.837+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3800, after asserts: 7480, after connections: 9800, after extra_info: 23880, after globalLock: 26680, after locks: 29320, after network: 29620, after opcounters: 29620, after opcountersRepl: 29620, after repl: 88940, after storageEngine: 97600, after tcmalloc: 106430, after wiredTiger: 133200, at end: 157810 } 2016-04-18T23:52:03.942+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-18T23:53:19.362+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 141ms 2016-04-18T23:53:26.032+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:53:39.354+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2314ms 2016-04-18T23:53:44.031+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-04-18T23:53:48.589+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1690ms 2016-04-18T23:54:28.796+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:55:04.651+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 202ms 2016-04-18T23:55:07.856+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:55:25.961+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3232ms 2016-04-18T23:55:39.036+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 196ms 2016-04-18T23:55:57.276+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:56:25.241+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:56:38.456+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3880, after asserts: 5780, after connections: 7060, after extra_info: 15410, after globalLock: 20090, after locks: 22670, after network: 27320, after opcounters: 29210, after opcountersRepl: 29500, after repl: 66200, after storageEngine: 69060, after tcmalloc: 84070, after wiredTiger: 93040, at end: 123520 } 2016-04-18T23:57:00.928+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 403ms 2016-04-18T23:57:16.480+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:57:23.113+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1326ms 2016-04-18T23:57:45.085+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1571ms 2016-04-18T23:57:44.645+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:59:00.917+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-18T23:59:11.301+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-18T23:59:15.180+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2053ms 2016-04-18T23:59:29.314+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-18T23:59:38.325+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-19T00:00:29.902+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-19T00:00:43.609+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 287ms 2016-04-19T00:01:03.156+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 782ms 2016-04-19T00:01:08.474+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-19T00:01:25.803+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3923ms 2016-04-19T00:01:58.385+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3750, after asserts: 7430, after connections: 12700, after extra_info: 21910, after globalLock: 28560, after locks: 36280, after network: 38430, after opcounters: 39360, after opcountersRepl: 39360, after repl: 51880, after storageEngine: 58900, after tcmalloc: 64490, after wiredTiger: 93230, at end: 136590 } 2016-04-19T00:02:10.840+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-19T00:02:47.974+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-19T00:02:48.025+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 503ms 2016-04-19T00:03:14.358+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1774ms 2016-04-19T00:03:35.331+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 174ms 2016-04-19T00:08:55.406+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-04-19T00:08:56.007+0000 I CONTROL [initandlisten] MongoDB starting : pid=1015 port=27016 dbpath=/var/lib/mongodb-replica/mongodbreplica2 64-bit host=ip-172-31-6-169 2016-04-19T00:08:56.007+0000 I CONTROL [initandlisten] db version v3.2.4 2016-04-19T00:08:56.007+0000 I CONTROL [initandlisten] git version: e2ee9ffcf9f5a94fad76802e28cc978718bb7a30 2016-04-19T00:08:56.007+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014 2016-04-19T00:08:56.007+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-04-19T00:08:56.007+0000 I CONTROL [initandlisten] modules: none 2016-04-19T00:08:56.007+0000 I CONTROL [initandlisten] build environment: 2016-04-19T00:08:56.007+0000 I CONTROL [initandlisten] distmod: ubuntu1404 2016-04-19T00:08:56.007+0000 I CONTROL [initandlisten] distarch: x86_64 2016-04-19T00:08:56.007+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-04-19T00:08:56.007+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb.d/mongodbreplica2.conf", net: { http: { RESTInterfaceEnabled: true, enabled: true }, port: 27016 }, processManagement: { pidFilePath: "/var/run/mongodb-replica/mongodbreplica2.pid" }, replication: { oplogSizeMB: 128, replSet: "mongodbreplica" }, storage: { dbPath: "/var/lib/mongodb-replica/mongodbreplica2", mmapv1: { smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb-replica/mongodbreplica2.log" } } 2016-04-19T00:08:56.217+0000 I - [initandlisten] Detected data files in /var/lib/mongodb-replica/mongodbreplica2 created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2016-04-19T00:08:56.229+0000 W - [initandlisten] Detected unclean shutdown - /var/lib/mongodb-replica/mongodbreplica2/mongod.lock is not empty. 2016-04-19T00:08:56.229+0000 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2016-04-19T00:08:56.229+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-04-19T00:09:01.496+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-04-19T00:09:01.497+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 121726 records totaling to 2917328811 bytes 2016-04-19T00:09:01.529+0000 I STORAGE [initandlisten] Sampling from the oplog between Apr 12 03:41:50:2 and Apr 18 02:16:41:1 to determine where to place markers for truncation 2016-04-19T00:09:01.529+0000 I STORAGE [initandlisten] Taking 1001 samples and assuming that each section of oplog contains approximately 1215 records totaling to 29119124 bytes 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 04:40:52:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 05:39:45:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 06:17:27:4 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 19:11:46:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 20:43:09:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 21:59:03:3 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 23:33:08:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 00:50:09:2 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 01:44:20:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 02:47:45:5 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 03:46:44:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 04:26:44:2 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 05:25:27:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 06:24:45:5 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 07:03:07:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 08:01:52:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 09:00:22:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 09:40:26:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 10:38:45:5 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 11:37:01:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 12:15:45:4 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 13:17:07:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 14:27:14:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 15:36:08:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 14 21:15:10:2 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 14 22:38:10:2 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 00:00:18:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 01:28:00:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 02:56:41:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 04:27:08:2 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 05:47:57:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 06:27:51:2 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 07:29:00:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 08:28:33:2 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 09:29:42:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 10:30:31:2 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 11:09:07:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 12:08:52:2 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 13:11:08:2 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 13:56:16:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 15:26:55:2 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 16:36:53:2 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 17:14:55:2 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 18:16:45:3 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 19:54:54:2 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 21:02:40:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 22:29:18:1 2016-04-19T00:09:21.833+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 23:57:57:2 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 00:58:29:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 02:24:01:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 03:49:45:3 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 04:51:45:5 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 06:28:28:2 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 07:33:37:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 08:11:40:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 09:11:45:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 10:10:39:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 10:50:33:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 11:50:52:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 12:50:00:6 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 13:28:55:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 14:44:10:2 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 15:48:51:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 16:30:01:2 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 17:29:00:6 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 18:27:49:3 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 19:05:52:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 20:05:18:2 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 21:22:49:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 22:11:29:2 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 23:26:45:7 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 00:26:54:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 01:06:53:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 02:18:01:2 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 03:18:49:2 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 03:59:57:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 04:58:55:2 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 05:56:57:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 06:35:36:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 07:34:45:5 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 08:33:00:6 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 09:12:38:2 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 10:10:40:2 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 11:10:45:5 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 11:49:51:2 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 12:49:01:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 13:47:56:2 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 14:48:45:3 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 15:53:00:2 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 16:54:08:2 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 17:34:48:3 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 18:33:02:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 19:31:45:3 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 20:21:01:2 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 21:36:45:3 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 22:34:57:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 23:14:53:3 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 18 00:21:02:2 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 18 01:27:09:1 2016-04-19T00:09:21.834+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 18 02:13:45:3 2016-04-19T00:09:23.523+0000 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2016-04-19T00:09:23.750+0000 I NETWORK [websvr] admin web console waiting for connections on port 28016 2016-04-19T00:09:23.802+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb-replica/mongodbreplica2/diagnostic.data' 2016-04-19T00:09:23.803+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-04-19T00:09:23.851+0000 I NETWORK [initandlisten] waiting for connections on port 27016 2016-04-19T00:09:23.851+0000 W NETWORK [ReplicationExecutor] Failed to connect to 127.0.0.1:27017, reason: errno:111 Connection refused 2016-04-19T00:09:23.851+0000 W NETWORK [ReplicationExecutor] Failed to connect to 127.0.0.1:27015, reason: errno:111 Connection refused 2016-04-19T00:09:23.851+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "mongodbreplica", version: 2, protocolVersion: 1, members: [ { _id: 0, host: "localhost:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "localhost:27016", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "localhost:27015", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-04-19T00:09:23.851+0000 I REPL [ReplicationExecutor] This node is localhost:27016 in the config 2016-04-19T00:09:23.851+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-04-19T00:09:23.851+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-04-19T00:09:23.852+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable: Connection refused 2016-04-19T00:09:23.852+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: Connection refused 2016-04-19T00:09:23.852+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable: Connection refused 2016-04-19T00:09:23.852+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: Connection refused 2016-04-19T00:09:23.852+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable: Connection refused 2016-04-19T00:09:23.853+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: Connection refused 2016-04-19T00:09:23.853+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-04-19T00:09:23.854+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-04-19T00:09:23.859+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44953 #1 (1 connection now open) 2016-04-19T00:09:23.884+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44955 #2 (2 connections now open) 2016-04-19T00:09:24.017+0000 I NETWORK [conn1] end connection 127.0.0.1:44953 (1 connection now open) 2016-04-19T00:09:24.080+0000 I FTDC [ftdc] Unclean full-time diagnostic data capture shutdown detected, found interim file, some metrics may have been lost. OK 2016-04-19T00:09:24.094+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44958 #3 (2 connections now open) 2016-04-19T00:09:24.094+0000 I NETWORK [conn3] end connection 127.0.0.1:44958 (1 connection now open) 2016-04-19T00:09:24.128+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44960 #4 (2 connections now open) 2016-04-19T00:09:28.852+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-19T00:09:28.853+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-19T00:09:28.853+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-19T00:09:28.853+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-19T00:09:30.129+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44965 #5 (3 connections now open) 2016-04-19T00:09:30.130+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44966 #6 (4 connections now open) 2016-04-19T00:09:30.130+0000 I NETWORK [conn5] end connection 127.0.0.1:44965 (3 connections now open) 2016-04-19T00:09:30.130+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44967 #7 (4 connections now open) 2016-04-19T00:09:33.876+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44968 #8 (5 connections now open) 2016-04-19T00:09:33.877+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44969 #9 (6 connections now open) 2016-04-19T00:09:33.877+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44970 #10 (7 connections now open) 2016-04-19T00:09:33.877+0000 I NETWORK [conn8] end connection 127.0.0.1:44968 (6 connections now open) 2016-04-19T00:09:34.078+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-19T00:09:34.078+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-19T00:09:34.080+0000 I REPL [ReplicationExecutor] dry election run succeeded, running for election 2016-04-19T00:09:34.081+0000 I REPL [ReplicationExecutor] election succeeded, assuming primary role in term 38 2016-04-19T00:09:34.081+0000 I REPL [ReplicationExecutor] transition to PRIMARY 2016-04-19T00:09:34.082+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-19T00:09:34.855+0000 I REPL [rsSync] transition to primary complete; database writes are now permitted 2016-04-19T00:09:39.856+0000 I NETWORK [conn9] end connection 127.0.0.1:44969 (5 connections now open) 2016-04-19T00:09:44.177+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44972 #11 (6 connections now open) 2016-04-19T00:09:44.178+0000 I REPL [ReplicationExecutor] stepping down from primary, because a new term has begun: 39 2016-04-19T00:09:44.178+0000 I REPL [replExecDBWorker-1] transition to SECONDARY 2016-04-19T00:09:44.178+0000 I NETWORK [conn2] end connection 127.0.0.1:44955 (5 connections now open) 2016-04-19T00:09:44.178+0000 I NETWORK [conn6] end connection 127.0.0.1:44966 (5 connections now open) 2016-04-19T00:09:44.178+0000 I NETWORK [conn10] end connection 127.0.0.1:44970 (5 connections now open) 2016-04-19T00:09:44.178+0000 I NETWORK [conn4] end connection 127.0.0.1:44960 (5 connections now open) 2016-04-19T00:09:44.178+0000 I NETWORK [conn11] end connection 127.0.0.1:44972 (1 connection now open) 2016-04-19T00:09:44.179+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44973 #12 (2 connections now open) 2016-04-19T00:09:44.858+0000 I NETWORK [conn7] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:44967] 2016-04-19T00:09:44.860+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44974 #13 (2 connections now open) 2016-04-19T00:09:46.085+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state PRIMARY 2016-04-19T00:09:46.856+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-19T00:09:46.856+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-19T00:09:46.858+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-19T00:14:22.900+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44993 #14 (3 connections now open) 2016-04-19T00:14:22.901+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44994 #15 (4 connections now open) 2016-04-19T00:14:22.901+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44995 #16 (5 connections now open) 2016-04-19T00:14:22.901+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44996 #17 (6 connections now open) 2016-04-19T00:14:22.901+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44997 #18 (7 connections now open) 2016-04-19T00:14:23.021+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45001 #19 (8 connections now open) 2016-04-19T00:14:23.021+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45003 #20 (9 connections now open) 2016-04-19T00:14:23.084+0000 I NETWORK [conn20] end connection 127.0.0.1:45003 (8 connections now open) 2016-04-19T00:14:23.163+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45006 #21 (9 connections now open) 2016-04-19T00:14:23.323+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45011 #22 (10 connections now open) 2016-04-19T00:14:24.416+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45023 #23 (11 connections now open) 2016-04-19T00:14:24.416+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45024 #24 (12 connections now open) 2016-04-19T00:14:24.416+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45025 #25 (13 connections now open) 2016-04-19T00:14:24.416+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45026 #26 (14 connections now open) 2016-04-19T00:14:24.416+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45027 #27 (15 connections now open) 2016-04-19T00:14:24.534+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45031 #28 (16 connections now open) 2016-04-19T00:14:24.534+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45033 #29 (17 connections now open) 2016-04-19T00:14:24.560+0000 I NETWORK [conn29] end connection 127.0.0.1:45033 (16 connections now open) 2016-04-19T00:14:24.802+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45036 #30 (17 connections now open) 2016-04-19T00:14:24.911+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45041 #31 (18 connections now open) 2016-04-19T00:14:28.682+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45053 #32 (19 connections now open) 2016-04-19T00:14:28.692+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45054 #33 (20 connections now open) 2016-04-19T00:14:28.693+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45055 #34 (21 connections now open) 2016-04-19T00:14:28.695+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45056 #35 (22 connections now open) 2016-04-19T00:14:28.696+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45057 #36 (23 connections now open) 2016-04-19T00:14:28.826+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45061 #37 (24 connections now open) 2016-04-19T00:14:28.826+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45063 #38 (25 connections now open) 2016-04-19T00:14:28.843+0000 I NETWORK [conn38] end connection 127.0.0.1:45063 (24 connections now open) 2016-04-19T00:14:28.979+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45066 #39 (25 connections now open) 2016-04-19T00:14:29.120+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45071 #40 (26 connections now open) 2016-04-19T00:14:30.498+0000 I ACCESS [conn21] Successfully authenticated as principal oplogger on admin 2016-04-19T00:14:30.536+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45073 #41 (27 connections now open) 2016-04-19T00:14:30.593+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45076 #42 (28 connections now open) 2016-04-19T00:14:30.593+0000 I NETWORK [conn41] end connection 127.0.0.1:45073 (27 connections now open) 2016-04-19T00:14:31.173+0000 I ACCESS [conn39] Successfully authenticated as principal oplogger on admin 2016-04-19T00:14:31.765+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45089 #43 (28 connections now open) 2016-04-19T00:14:31.766+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45090 #44 (29 connections now open) 2016-04-19T00:14:31.767+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45091 #45 (30 connections now open) 2016-04-19T00:14:31.802+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45092 #46 (31 connections now open) 2016-04-19T00:14:31.803+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45093 #47 (32 connections now open) 2016-04-19T00:14:31.904+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45097 #48 (33 connections now open) 2016-04-19T00:14:31.904+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45099 #49 (34 connections now open) 2016-04-19T00:14:31.947+0000 I NETWORK [conn49] end connection 127.0.0.1:45099 (33 connections now open) 2016-04-19T00:14:32.095+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45102 #50 (34 connections now open) 2016-04-19T00:14:32.312+0000 I ACCESS [conn30] Successfully authenticated as principal oplogger on admin 2016-04-19T00:14:32.354+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45105 #51 (35 connections now open) 2016-04-19T00:14:32.377+0000 I NETWORK [conn51] end connection 127.0.0.1:45105 (34 connections now open) 2016-04-19T00:14:32.443+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45108 #52 (35 connections now open) 2016-04-19T00:14:33.170+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45113 #53 (36 connections now open) 2016-04-19T00:14:34.341+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45117 #54 (37 connections now open) 2016-04-19T00:14:34.763+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45121 #55 (38 connections now open) 2016-04-19T00:14:35.762+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45133 #56 (39 connections now open) 2016-04-19T00:14:35.762+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45134 #57 (40 connections now open) 2016-04-19T00:14:35.762+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45135 #58 (41 connections now open) 2016-04-19T00:14:35.762+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45136 #59 (42 connections now open) 2016-04-19T00:14:35.762+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45137 #60 (43 connections now open) 2016-04-19T00:14:35.965+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45141 #61 (44 connections now open) 2016-04-19T00:14:35.974+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45143 #62 (45 connections now open) 2016-04-19T00:14:36.096+0000 I NETWORK [conn62] end connection 127.0.0.1:45143 (44 connections now open) 2016-04-19T00:14:36.161+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45146 #63 (45 connections now open) 2016-04-19T00:14:36.161+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45148 #64 (46 connections now open) 2016-04-19T00:14:36.167+0000 I NETWORK [conn64] end connection 127.0.0.1:45148 (45 connections now open) 2016-04-19T00:14:36.196+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45152 #65 (46 connections now open) 2016-04-19T00:14:37.593+0000 I ACCESS [conn42] Successfully authenticated as principal oplogger on admin 2016-04-19T00:14:38.404+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45160 #66 (47 connections now open) 2016-04-19T00:14:38.404+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45161 #67 (48 connections now open) 2016-04-19T00:14:39.110+0000 I ACCESS [conn50] Successfully authenticated as principal oplogger on admin 2016-04-19T00:14:39.249+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45163 #68 (49 connections now open) 2016-04-19T00:14:39.267+0000 I NETWORK [conn68] end connection 127.0.0.1:45163 (48 connections now open) 2016-04-19T00:14:39.327+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45166 #69 (49 connections now open) 2016-04-19T00:14:39.392+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45171 #70 (50 connections now open) 2016-04-19T00:14:40.353+0000 I ACCESS [conn52] Successfully authenticated as principal oplogger on admin 2016-04-19T00:14:42.603+0000 I ACCESS [conn65] Successfully authenticated as principal oplogger on admin 2016-04-19T00:14:43.370+0000 I ACCESS [conn63] Successfully authenticated as principal oplogger on admin 2016-04-19T00:14:43.426+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45173 #71 (51 connections now open) 2016-04-19T00:14:43.483+0000 I NETWORK [conn71] end connection 127.0.0.1:45173 (50 connections now open) 2016-04-19T00:14:43.555+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45176 #72 (51 connections now open) 2016-04-19T00:14:45.815+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45181 #73 (52 connections now open) 2016-04-19T00:14:46.324+0000 I ACCESS [conn69] Successfully authenticated as principal oplogger on admin 2016-04-19T00:14:49.742+0000 I ACCESS [conn72] Successfully authenticated as principal oplogger on admin 2016-04-19T00:16:22.734+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T00:16:27.742+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-19T00:16:27.742+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-19T00:19:22.851+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 39, timestamp: Apr 19 00:18:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 39, timestamp: Apr 19 00:19:22:1) 2016-04-19T00:19:22.851+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T00:19:28.855+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-19T00:19:28.856+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-19T00:21:02.903+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-19T00:23:51.844+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T00:24:01.846+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-19T00:24:01.847+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-19T00:24:01.848+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-19T00:25:30.621+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-19T00:29:46.381+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 39, timestamp: Apr 19 00:28:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 39, timestamp: Apr 19 00:29:45:5) 2016-04-19T00:29:46.381+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T00:29:51.399+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-19T00:29:51.400+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-19T00:34:15.091+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45302 #74 (53 connections now open) 2016-04-19T00:34:15.091+0000 I NETWORK [conn74] end connection 127.0.0.1:45302 (52 connections now open) 2016-04-19T00:34:15.092+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45303 #75 (53 connections now open) 2016-04-19T00:34:15.096+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45304 #76 (54 connections now open) 2016-04-19T00:39:00.054+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45323 #77 (55 connections now open) 2016-04-19T00:50:28.821+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 39, timestamp: Apr 19 00:49:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 39, timestamp: Apr 19 00:50:28:1) 2016-04-19T00:50:28.821+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T00:50:33.821+0000 I NETWORK [conn76] end connection 127.0.0.1:45304 (54 connections now open) 2016-04-19T00:50:34.823+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-19T00:50:34.823+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-19T00:50:34.824+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-19T00:53:07.738+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-19T00:54:30.686+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T00:54:31.686+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-19T00:54:31.688+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-19T00:55:28.853+0000 I NETWORK [conn77] end connection 127.0.0.1:45323 (53 connections now open) 2016-04-19T00:55:28.853+0000 I NETWORK [conn75] end connection 127.0.0.1:45303 (53 connections now open) 2016-04-19T03:03:18.194+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 39, timestamp: Apr 19 03:02:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 39, timestamp: Apr 19 03:03:17:1) 2016-04-19T03:03:18.195+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T03:03:23.215+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-19T03:03:23.216+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-19T03:03:23.217+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-19T03:03:29.456+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-19T03:35:35.066+0000 I CONTROL [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends 2016-04-19T03:35:35.066+0000 I FTDC [signalProcessingThread] Shutting down full-time diagnostic data capture 2016-04-19T03:35:35.084+0000 I REPL [signalProcessingThread] Stopping replication applier threads 2016-04-19T03:35:35.184+0000 I STORAGE [conn67] got request after shutdown() 2016-04-19T03:35:35.184+0000 I STORAGE [conn73] got request after shutdown() 2016-04-19T03:35:35.787+0000 I STORAGE [conn53] got request after shutdown() 2016-04-19T03:35:35.808+0000 I NETWORK [conn12] end connection 127.0.0.1:44973 (48 connections now open) 2016-04-19T03:35:35.815+0000 I STORAGE [conn37] got request after shutdown() 2016-04-19T03:35:35.953+0000 I STORAGE [conn70] got request after shutdown() 2016-04-19T03:35:35.953+0000 I STORAGE [conn54] got request after shutdown() 2016-04-19T03:35:36.770+0000 I CONTROL [signalProcessingThread] now exiting 2016-04-19T03:35:36.770+0000 I NETWORK [signalProcessingThread] shutdown: going to close listening sockets... 2016-04-19T03:35:36.770+0000 I NETWORK [signalProcessingThread] closing listening socket: 6 2016-04-19T03:35:36.770+0000 I NETWORK [signalProcessingThread] closing listening socket: 7 2016-04-19T03:35:36.770+0000 I NETWORK [signalProcessingThread] closing listening socket: 8 2016-04-19T03:35:36.770+0000 I NETWORK [signalProcessingThread] removing socket file: /tmp/mongodb-27016.sock 2016-04-19T03:35:36.770+0000 I NETWORK [signalProcessingThread] shutdown: going to flush diaglog... 2016-04-19T03:35:36.770+0000 I NETWORK [signalProcessingThread] shutdown: going to close sockets... 2016-04-19T03:35:36.770+0000 I STORAGE [signalProcessingThread] WiredTigerKVEngine shutting down 2016-04-19T03:35:36.770+0000 I NETWORK [conn13] end connection 127.0.0.1:44974 (44 connections now open) 2016-04-19T03:35:36.771+0000 I NETWORK [conn14] end connection 127.0.0.1:44993 (44 connections now open) 2016-04-19T03:35:36.771+0000 I NETWORK [conn15] end connection 127.0.0.1:44994 (44 connections now open) 2016-04-19T03:35:36.771+0000 I NETWORK [conn16] end connection 127.0.0.1:44995 (44 connections now open) 2016-04-19T03:35:36.771+0000 I NETWORK [conn17] end connection 127.0.0.1:44996 (44 connections now open) 2016-04-19T03:35:36.773+0000 I NETWORK [conn58] end connection 127.0.0.1:45135 (44 connections now open) 2016-04-19T03:35:36.773+0000 I NETWORK [conn59] end connection 127.0.0.1:45136 (44 connections now open) 2016-04-19T03:35:36.772+0000 I NETWORK [conn63] end connection 127.0.0.1:45146 (44 connections now open) 2016-04-19T03:35:36.772+0000 I NETWORK [conn65] end connection 127.0.0.1:45152 (44 connections now open) 2016-04-19T03:35:36.772+0000 I NETWORK [conn66] end connection 127.0.0.1:45160 (44 connections now open) 2016-04-19T03:35:36.772+0000 I NETWORK [conn61] end connection 127.0.0.1:45141 (44 connections now open) 2016-04-19T03:35:36.772+0000 I NETWORK [conn60] end connection 127.0.0.1:45137 (44 connections now open) 2016-04-19T03:35:36.773+0000 I NETWORK [conn69] end connection 127.0.0.1:45166 (44 connections now open) 2016-04-19T03:35:36.773+0000 I NETWORK [conn56] end connection 127.0.0.1:45133 (44 connections now open) 2016-04-19T03:35:36.773+0000 I NETWORK [conn57] end connection 127.0.0.1:45134 (44 connections now open) 2016-04-19T03:35:36.771+0000 I NETWORK [conn18] end connection 127.0.0.1:44997 (44 connections now open) 2016-04-19T03:35:36.774+0000 I NETWORK [conn72] end connection 127.0.0.1:45176 (44 connections now open) 2016-04-19T03:35:36.774+0000 I NETWORK [conn55] end connection 127.0.0.1:45121 (44 connections now open) 2016-04-19T03:35:36.775+0000 I NETWORK [conn52] end connection 127.0.0.1:45108 (44 connections now open) 2016-04-19T03:35:36.787+0000 I NETWORK [conn30] end connection 127.0.0.1:45036 (44 connections now open) 2016-04-19T03:35:36.787+0000 I NETWORK [conn32] end connection 127.0.0.1:45053 (44 connections now open) 2016-04-19T03:35:36.787+0000 I NETWORK [conn33] end connection 127.0.0.1:45054 (44 connections now open) 2016-04-19T03:35:36.788+0000 I NETWORK [conn34] end connection 127.0.0.1:45055 (44 connections now open) 2016-04-19T03:35:36.788+0000 I NETWORK [conn35] end connection 127.0.0.1:45056 (44 connections now open) 2016-04-19T03:35:36.788+0000 I NETWORK [conn36] end connection 127.0.0.1:45057 (44 connections now open) 2016-04-19T03:35:36.788+0000 I NETWORK [conn39] end connection 127.0.0.1:45066 (44 connections now open) 2016-04-19T03:35:36.788+0000 I NETWORK [conn31] end connection 127.0.0.1:45041 (44 connections now open) 2016-04-19T03:35:36.788+0000 I NETWORK [conn50] end connection 127.0.0.1:45102 (44 connections now open) 2016-04-19T03:35:36.788+0000 I NETWORK [conn40] end connection 127.0.0.1:45071 (44 connections now open) 2016-04-19T03:35:36.789+0000 I NETWORK [conn28] end connection 127.0.0.1:45031 (44 connections now open) 2016-04-19T03:35:36.789+0000 I NETWORK [conn42] end connection 127.0.0.1:45076 (44 connections now open) 2016-04-19T03:35:36.789+0000 I NETWORK [conn26] end connection 127.0.0.1:45026 (44 connections now open) 2016-04-19T03:35:36.789+0000 I NETWORK [conn25] end connection 127.0.0.1:45025 (44 connections now open) 2016-04-19T03:35:36.790+0000 I NETWORK [conn44] end connection 127.0.0.1:45090 (44 connections now open) 2016-04-19T03:35:36.790+0000 I NETWORK [conn43] end connection 127.0.0.1:45089 (44 connections now open) 2016-04-19T03:35:36.790+0000 I NETWORK [conn45] end connection 127.0.0.1:45091 (44 connections now open) 2016-04-19T03:35:36.790+0000 I NETWORK [conn46] end connection 127.0.0.1:45092 (44 connections now open) 2016-04-19T03:35:36.790+0000 I NETWORK [conn47] end connection 127.0.0.1:45093 (44 connections now open) 2016-04-19T03:35:36.790+0000 I NETWORK [conn27] end connection 127.0.0.1:45027 (44 connections now open) 2016-04-19T03:35:36.790+0000 I NETWORK [conn23] end connection 127.0.0.1:45023 (44 connections now open) 2016-04-19T03:35:36.792+0000 I NETWORK [conn19] end connection 127.0.0.1:45001 (44 connections now open) 2016-04-19T03:35:36.792+0000 I NETWORK [conn24] end connection 127.0.0.1:45024 (44 connections now open) 2016-04-19T03:35:36.792+0000 I NETWORK [conn22] end connection 127.0.0.1:45011 (44 connections now open) 2016-04-19T03:35:36.792+0000 I NETWORK [conn48] end connection 127.0.0.1:45097 (44 connections now open) 2016-04-19T03:35:36.793+0000 I NETWORK [conn21] end connection 127.0.0.1:45006 (44 connections now open) 2016-04-19T03:35:36.838+0000 I STORAGE [signalProcessingThread] shutdown: removing fs lock... 2016-04-19T03:35:36.838+0000 I CONTROL [signalProcessingThread] dbexit: rc: 0 2016-04-19T03:36:27.403+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-04-19T03:36:27.460+0000 I CONTROL [initandlisten] MongoDB starting : pid=1105 port=27016 dbpath=/var/lib/mongodb-replica/mongodbreplica2 64-bit host=ip-172-31-6-169 2016-04-19T03:36:27.463+0000 I CONTROL [initandlisten] db version v3.2.5 2016-04-19T03:36:27.463+0000 I CONTROL [initandlisten] git version: 34e65e5383f7ea1726332cb175b73077ec4a1b02 2016-04-19T03:36:27.463+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014 2016-04-19T03:36:27.463+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-04-19T03:36:27.463+0000 I CONTROL [initandlisten] modules: none 2016-04-19T03:36:27.463+0000 I CONTROL [initandlisten] build environment: 2016-04-19T03:36:27.463+0000 I CONTROL [initandlisten] distmod: ubuntu1404 2016-04-19T03:36:27.463+0000 I CONTROL [initandlisten] distarch: x86_64 2016-04-19T03:36:27.463+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-04-19T03:36:27.463+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb.d/mongodbreplica2.conf", net: { http: { RESTInterfaceEnabled: true, enabled: true }, port: 27016 }, processManagement: { pidFilePath: "/var/run/mongodb-replica/mongodbreplica2.pid" }, replication: { oplogSizeMB: 128, replSet: "mongodbreplica" }, storage: { dbPath: "/var/lib/mongodb-replica/mongodbreplica2", mmapv1: { smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb-replica/mongodbreplica2.log" } } 2016-04-19T03:36:27.738+0000 I - [initandlisten] Detected data files in /var/lib/mongodb-replica/mongodbreplica2 created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2016-04-19T03:36:27.738+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-04-19T03:36:29.589+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-04-19T03:36:29.589+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 122508 records totaling to 2931040059 bytes 2016-04-19T03:36:29.602+0000 I STORAGE [initandlisten] Sampling from the oplog between Apr 12 05:39:45:2 and Apr 19 03:35:09:2 to determine where to place markers for truncation 2016-04-19T03:36:29.602+0000 I STORAGE [initandlisten] Taking 1006 samples and assuming that each section of oplog contains approximately 1217 records totaling to 29117084 bytes 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 06:30:46:2 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 19:22:27:3 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 20:47:06:2 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 22:23:38:2 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 12 23:53:45:3 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 01:04:00:5 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 02:14:53:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 03:08:07:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 04:01:23:2 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 05:00:56:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 05:55:45:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 06:48:30:2 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 07:42:30:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 08:35:08:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 09:28:19:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 10:27:43:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 11:20:34:2 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 12:14:39:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 13:08:21:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 14:02:10:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 15:18:55:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 16:18:07:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 14 22:14:26:3 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 14 23:33:01:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 00:49:14:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 02:06:08:2 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 03:33:23:2 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 04:58:59:2 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 05:59:44:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 06:52:39:2 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 07:44:51:3 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 08:45:02:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 09:38:32:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 10:31:54:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 11:26:44:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 12:20:08:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 13:16:45:7 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 14:18:21:2 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 15:26:55:2 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 16:30:57:1 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 17:17:49:2 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 18:13:55:2 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 19:43:41:2 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 20:59:38:2 2016-04-19T03:36:32.467+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 22:10:00:4 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 23:32:23:1 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 00:42:09:2 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 02:00:51:1 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 03:17:23:2 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 04:26:17:1 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 05:45:22:2 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 07:00:57:2 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 07:46:45:4 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 08:41:45:5 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 09:34:34:2 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 10:21:45:7 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 11:08:36:2 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 12:02:56:1 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 12:50:00:5 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 13:43:45:5 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 14:58:03:1 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 15:46:00:2 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 16:33:55:2 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 17:27:46:1 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 18:13:56:1 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 19:07:02:1 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 19:59:46:2 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 21:06:53:3 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 21:56:28:1 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 23:11:53:2 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 23:59:50:2 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 00:54:45:4 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 01:59:00:1 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 02:47:59:1 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 03:42:45:1 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 04:36:50:3 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 05:36:44:1 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 06:29:34:1 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 07:22:07:1 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 08:15:56:3 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 09:09:00:6 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 10:07:53:2 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 11:01:45:4 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 11:57:00:5 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 12:50:37:1 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 13:43:49:3 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 15:03:18:2 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 16:03:08:1 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 16:59:58:2 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 17:54:45:5 2016-04-19T03:36:32.468+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 18:47:02:2 2016-04-19T03:36:32.469+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 19:40:53:1 2016-04-19T03:36:32.469+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 21:03:45:2 2016-04-19T03:36:32.469+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 22:00:01:1 2016-04-19T03:36:32.469+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 22:53:51:3 2016-04-19T03:36:32.469+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 23:52:02:2 2016-04-19T03:36:32.469+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 18 00:52:08:1 2016-04-19T03:36:32.469+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 18 01:53:08:1 2016-04-19T03:36:32.469+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 19 01:19:04:2 2016-04-19T03:36:32.469+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 19 02:43:45:4 2016-04-19T03:36:32.939+0000 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2016-04-19T03:36:32.939+0000 I CONTROL [initandlisten] 2016-04-19T03:36:32.939+0000 I CONTROL [initandlisten] ** WARNING: Insecure configuration, access control is not enabled and no --bind_ip has been specified. 2016-04-19T03:36:32.939+0000 I CONTROL [initandlisten] ** Read and write access to data and configuration is unrestricted, 2016-04-19T03:36:32.939+0000 I CONTROL [initandlisten] ** and the server listens on all available network interfaces. 2016-04-19T03:36:32.939+0000 I CONTROL [initandlisten] 2016-04-19T03:36:32.942+0000 I STORAGE [initandlisten] Scanning admin db for SERVER-23299 eligibility 2016-04-19T03:36:32.942+0000 I STORAGE [initandlisten] Done scanning admin for SERVER-23299 eligibility 2016-04-19T03:36:32.942+0000 I STORAGE [initandlisten] Scanning local db for SERVER-23299 eligibility 2016-04-19T03:36:32.942+0000 I STORAGE [initandlisten] Done scanning local for SERVER-23299 eligibility 2016-04-19T03:36:32.974+0000 I STORAGE [initandlisten] Scanning sherpa db for SERVER-23299 eligibility 2016-04-19T03:36:32.974+0000 I STORAGE [initandlisten] Done scanning sherpa for SERVER-23299 eligibility 2016-04-19T03:36:32.983+0000 I NETWORK [websvr] admin web console waiting for connections on port 28016 2016-04-19T03:36:32.985+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb-replica/mongodbreplica2/diagnostic.data' 2016-04-19T03:36:32.985+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-04-19T03:36:32.988+0000 I NETWORK [initandlisten] waiting for connections on port 27016 2016-04-19T03:36:32.989+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "mongodbreplica", version: 2, protocolVersion: 1, members: [ { _id: 0, host: "localhost:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "localhost:27016", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "localhost:27015", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-04-19T03:36:32.989+0000 I REPL [ReplicationExecutor] This node is localhost:27016 in the config 2016-04-19T03:36:32.989+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-04-19T03:36:32.989+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-04-19T03:36:32.990+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-19T03:36:32.990+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-19T03:36:32.990+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-04-19T03:36:32.990+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-04-19T03:36:32.999+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-19T03:36:32.999+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-19T03:36:37.865+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51328 #1 (1 connection now open) 2016-04-19T03:36:37.986+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51330 #2 (2 connections now open) 2016-04-19T03:36:47.996+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state PRIMARY 2016-04-19T03:36:47.996+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-19T03:36:47.999+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-19T03:36:48.015+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-19T03:38:26.808+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51349 #3 (3 connections now open) 2016-04-19T03:38:26.808+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51350 #4 (4 connections now open) 2016-04-19T03:38:26.808+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51351 #5 (5 connections now open) 2016-04-19T03:38:26.808+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51352 #6 (6 connections now open) 2016-04-19T03:38:26.808+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51353 #7 (7 connections now open) 2016-04-19T03:38:26.873+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51357 #8 (8 connections now open) 2016-04-19T03:38:26.885+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51359 #9 (9 connections now open) 2016-04-19T03:38:26.920+0000 I NETWORK [conn9] end connection 127.0.0.1:51359 (8 connections now open) 2016-04-19T03:38:27.021+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51362 #10 (9 connections now open) 2016-04-19T03:38:27.145+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51367 #11 (10 connections now open) 2016-04-19T03:38:29.065+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51379 #12 (11 connections now open) 2016-04-19T03:38:29.067+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51380 #13 (12 connections now open) 2016-04-19T03:38:29.067+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51381 #14 (13 connections now open) 2016-04-19T03:38:29.069+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51382 #15 (14 connections now open) 2016-04-19T03:38:29.070+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51383 #16 (15 connections now open) 2016-04-19T03:38:29.200+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51387 #17 (16 connections now open) 2016-04-19T03:38:29.210+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51389 #18 (17 connections now open) 2016-04-19T03:38:29.234+0000 I NETWORK [conn18] end connection 127.0.0.1:51389 (16 connections now open) 2016-04-19T03:38:29.290+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51392 #19 (17 connections now open) 2016-04-19T03:38:29.478+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51397 #20 (18 connections now open) 2016-04-19T03:38:32.780+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51409 #21 (19 connections now open) 2016-04-19T03:38:32.783+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51410 #22 (20 connections now open) 2016-04-19T03:38:32.791+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51411 #23 (21 connections now open) 2016-04-19T03:38:32.794+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51412 #24 (22 connections now open) 2016-04-19T03:38:32.795+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51413 #25 (23 connections now open) 2016-04-19T03:38:33.023+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51417 #26 (24 connections now open) 2016-04-19T03:38:33.023+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51419 #27 (25 connections now open) 2016-04-19T03:38:33.031+0000 I NETWORK [conn27] end connection 127.0.0.1:51419 (24 connections now open) 2016-04-19T03:38:33.131+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51422 #28 (25 connections now open) 2016-04-19T03:38:34.012+0000 I ACCESS [conn10] Successfully authenticated as principal oplogger on admin 2016-04-19T03:38:34.037+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51425 #29 (26 connections now open) 2016-04-19T03:38:34.136+0000 I NETWORK [conn29] end connection 127.0.0.1:51425 (25 connections now open) 2016-04-19T03:38:34.157+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51428 #30 (26 connections now open) 2016-04-19T03:38:34.195+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51433 #31 (27 connections now open) 2016-04-19T03:38:35.568+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51437 #32 (28 connections now open) 2016-04-19T03:38:36.593+0000 I ACCESS [conn19] Successfully authenticated as principal oplogger on admin 2016-04-19T03:38:36.659+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51439 #33 (29 connections now open) 2016-04-19T03:38:36.660+0000 I NETWORK [conn33] end connection 127.0.0.1:51439 (28 connections now open) 2016-04-19T03:38:36.675+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51442 #34 (29 connections now open) 2016-04-19T03:38:37.585+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51455 #35 (30 connections now open) 2016-04-19T03:38:37.588+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51456 #36 (31 connections now open) 2016-04-19T03:38:37.672+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51457 #37 (32 connections now open) 2016-04-19T03:38:37.672+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51458 #38 (33 connections now open) 2016-04-19T03:38:37.672+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51459 #39 (34 connections now open) 2016-04-19T03:38:37.763+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51463 #40 (35 connections now open) 2016-04-19T03:38:37.794+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51465 #41 (36 connections now open) 2016-04-19T03:38:37.855+0000 I NETWORK [conn41] end connection 127.0.0.1:51465 (35 connections now open) 2016-04-19T03:38:37.922+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51468 #42 (36 connections now open) 2016-04-19T03:38:38.058+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51473 #43 (37 connections now open) 2016-04-19T03:38:38.690+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51477 #44 (38 connections now open) 2016-04-19T03:38:40.611+0000 I ACCESS [conn28] Successfully authenticated as principal oplogger on admin 2016-04-19T03:38:40.691+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51479 #45 (39 connections now open) 2016-04-19T03:38:40.713+0000 I NETWORK [conn45] end connection 127.0.0.1:51479 (38 connections now open) 2016-04-19T03:38:40.791+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51482 #46 (39 connections now open) 2016-04-19T03:38:40.949+0000 I ACCESS [conn30] Successfully authenticated as principal oplogger on admin 2016-04-19T03:38:41.179+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51495 #47 (40 connections now open) 2016-04-19T03:38:41.188+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51496 #48 (41 connections now open) 2016-04-19T03:38:41.189+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51497 #49 (42 connections now open) 2016-04-19T03:38:41.189+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51498 #50 (43 connections now open) 2016-04-19T03:38:41.189+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51499 #51 (44 connections now open) 2016-04-19T03:38:41.321+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51503 #52 (45 connections now open) 2016-04-19T03:38:41.321+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51505 #53 (46 connections now open) 2016-04-19T03:38:41.384+0000 I NETWORK [conn53] end connection 127.0.0.1:51505 (45 connections now open) 2016-04-19T03:38:41.454+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51508 #54 (46 connections now open) 2016-04-19T03:38:43.317+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51513 #55 (47 connections now open) 2016-04-19T03:38:43.327+0000 I ACCESS [conn34] Successfully authenticated as principal oplogger on admin 2016-04-19T03:38:43.765+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51517 #56 (48 connections now open) 2016-04-19T03:38:44.840+0000 I ACCESS [conn42] Successfully authenticated as principal oplogger on admin 2016-04-19T03:38:44.956+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51519 #57 (49 connections now open) 2016-04-19T03:38:44.960+0000 I NETWORK [conn57] end connection 127.0.0.1:51519 (48 connections now open) 2016-04-19T03:38:45.093+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51522 #58 (49 connections now open) 2016-04-19T03:38:47.265+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51527 #59 (50 connections now open) 2016-04-19T03:38:47.798+0000 I ACCESS [conn46] Successfully authenticated as principal oplogger on admin 2016-04-19T03:38:48.639+0000 I ACCESS [conn54] Successfully authenticated as principal oplogger on admin 2016-04-19T03:38:48.740+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51529 #60 (51 connections now open) 2016-04-19T03:38:48.759+0000 I NETWORK [conn60] end connection 127.0.0.1:51529 (50 connections now open) 2016-04-19T03:38:48.821+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51532 #61 (51 connections now open) 2016-04-19T03:38:50.843+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51537 #62 (52 connections now open) 2016-04-19T03:38:51.367+0000 I ACCESS [conn58] Successfully authenticated as principal oplogger on admin 2016-04-19T03:38:52.329+0000 I ACCESS [conn61] Successfully authenticated as principal oplogger on admin 2016-04-19T03:39:11.348+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-19T03:41:28.900+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 40, timestamp: Apr 19 03:40:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 40, timestamp: Apr 19 03:41:28:1) 2016-04-19T03:41:28.900+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T03:41:34.902+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-19T03:41:34.903+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-19T04:36:49.962+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51901 #63 (53 connections now open) 2016-04-19T04:36:49.964+0000 I NETWORK [conn63] end connection 127.0.0.1:51901 (52 connections now open) 2016-04-19T04:36:49.964+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51902 #64 (53 connections now open) 2016-04-19T04:36:49.966+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51903 #65 (54 connections now open) 2016-04-19T04:42:45.051+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51946 #66 (55 connections now open) 2016-04-19T05:34:42.935+0000 I NETWORK [conn65] end connection 127.0.0.1:51903 (54 connections now open) 2016-04-19T05:39:42.935+0000 I NETWORK [conn64] end connection 127.0.0.1:51902 (53 connections now open) 2016-04-19T05:39:42.935+0000 I NETWORK [conn66] end connection 127.0.0.1:51946 (52 connections now open) 2016-04-19T05:40:50.503+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52343 #67 (53 connections now open) 2016-04-19T05:40:50.504+0000 I NETWORK [conn67] end connection 127.0.0.1:52343 (52 connections now open) 2016-04-19T05:40:50.505+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52344 #68 (53 connections now open) 2016-04-19T05:40:50.506+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52345 #69 (54 connections now open) 2016-04-19T05:42:50.082+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52360 #70 (55 connections now open) 2016-04-19T06:07:45.038+0000 I NETWORK [conn69] end connection 127.0.0.1:52345 (54 connections now open) 2016-04-19T06:12:45.056+0000 I NETWORK [conn68] end connection 127.0.0.1:52344 (53 connections now open) 2016-04-19T06:12:45.056+0000 I NETWORK [conn70] end connection 127.0.0.1:52360 (52 connections now open) 2016-04-19T06:18:40.241+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 40, timestamp: Apr 19 06:17:57:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 40, timestamp: Apr 19 06:18:40:1) 2016-04-19T06:18:40.241+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T06:18:40.248+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-19T06:18:45.242+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-19T06:18:45.243+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-19T06:18:45.244+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-19T06:19:50.578+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-19T06:24:41.344+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 40, timestamp: Apr 19 06:23:59:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 40, timestamp: Apr 19 06:24:41:1) 2016-04-19T06:24:41.344+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T06:24:47.345+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-19T06:24:47.345+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-19T07:25:40.486+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 40, timestamp: Apr 19 07:24:59:4) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 40, timestamp: Apr 19 07:25:40:1) 2016-04-19T07:25:40.486+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T07:25:46.487+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-19T07:25:46.488+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-19T07:37:38.755+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T07:37:43.776+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-19T07:37:43.777+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-19T07:37:43.777+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-19T07:38:01.565+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-19T07:43:45.846+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53206 #71 (53 connections now open) 2016-04-19T07:43:45.847+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53207 #72 (54 connections now open) 2016-04-19T07:43:45.847+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53208 #73 (55 connections now open) 2016-04-19T07:43:45.847+0000 I NETWORK [conn71] end connection 127.0.0.1:53206 (54 connections now open) 2016-04-19T07:44:02.751+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53212 #74 (55 connections now open) 2016-04-19T07:52:45.034+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 40, timestamp: Apr 19 07:52:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 40, timestamp: Apr 19 07:52:45:1) 2016-04-19T07:52:45.035+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T07:52:46.035+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-19T07:52:46.035+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-19T09:43:44.048+0000 I NETWORK [conn73] end connection 127.0.0.1:53208 (54 connections now open) 2016-04-19T09:47:46.798+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54084 #75 (55 connections now open) 2016-04-19T09:47:46.799+0000 I NETWORK [conn75] end connection 127.0.0.1:54084 (54 connections now open) 2016-04-19T09:47:46.800+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54085 #76 (55 connections now open) 2016-04-19T10:41:39.757+0000 I NETWORK [conn76] end connection 127.0.0.1:54085 (54 connections now open) 2016-04-19T10:41:45.756+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54464 #77 (55 connections now open) 2016-04-19T10:41:45.756+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54465 #78 (56 connections now open) 2016-04-19T10:41:45.757+0000 I NETWORK [conn77] end connection 127.0.0.1:54464 (55 connections now open) 2016-04-19T11:26:40.528+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 40, timestamp: Apr 19 11:25:59:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 40, timestamp: Apr 19 11:26:40:1) 2016-04-19T11:26:40.528+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T11:26:40.532+0000 I NETWORK [conn78] end connection 127.0.0.1:54465 (54 connections now open) 2016-04-19T11:26:45.531+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-19T11:26:45.533+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-19T11:31:40.546+0000 I NETWORK [conn74] end connection 127.0.0.1:53212 (53 connections now open) 2016-04-19T11:31:40.547+0000 I NETWORK [conn72] end connection 127.0.0.1:53207 (52 connections now open) 2016-04-19T11:56:50.085+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54984 #79 (53 connections now open) 2016-04-19T11:56:50.086+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54985 #80 (54 connections now open) 2016-04-19T11:56:50.086+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54986 #81 (55 connections now open) 2016-04-19T11:56:50.086+0000 I NETWORK [conn79] end connection 127.0.0.1:54984 (54 connections now open) 2016-04-19T11:56:51.076+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54989 #82 (55 connections now open) 2016-04-19T12:32:45.747+0000 I NETWORK [conn81] end connection 127.0.0.1:54986 (54 connections now open) 2016-04-19T12:32:50.753+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:55232 #83 (55 connections now open) 2016-04-19T12:32:50.753+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:55233 #84 (56 connections now open) 2016-04-19T12:32:50.754+0000 I NETWORK [conn83] end connection 127.0.0.1:55232 (55 connections now open) 2016-04-19T13:31:37.817+0000 I NETWORK [conn84] end connection 127.0.0.1:55233 (54 connections now open) 2016-04-19T13:31:47.822+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:55584 #85 (55 connections now open) 2016-04-19T13:31:47.823+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:55585 #86 (56 connections now open) 2016-04-19T13:31:47.823+0000 I NETWORK [conn85] end connection 127.0.0.1:55584 (55 connections now open) 2016-04-19T14:36:43.826+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 40, timestamp: Apr 19 14:35:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 40, timestamp: Apr 19 14:36:42:2) 2016-04-19T14:36:43.827+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T14:36:44.827+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-19T14:36:44.829+0000 I NETWORK [conn86] end connection 127.0.0.1:55585 (54 connections now open) 2016-04-19T14:41:43.828+0000 I NETWORK [conn82] end connection 127.0.0.1:54989 (53 connections now open) 2016-04-19T14:41:43.828+0000 I NETWORK [conn80] end connection 127.0.0.1:54985 (52 connections now open) 2016-04-19T15:50:34.232+0000 I CONTROL [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends 2016-04-19T15:50:34.232+0000 I FTDC [signalProcessingThread] Shutting down full-time diagnostic data capture 2016-04-19T15:50:34.276+0000 I REPL [signalProcessingThread] Stopping replication applier threads 2016-04-19T15:50:34.277+0000 I ASIO [rsBackgroundSync-179] dropping unhealthy pooled connection to localhost:27017 2016-04-19T15:50:34.278+0000 I STORAGE [conn2] got request after shutdown() 2016-04-19T15:50:34.279+0000 W EXECUTOR [rsBackgroundSync] killCursors command task failed: CallbackCanceled: Callback canceled 2016-04-19T15:50:34.306+0000 I REPL [SyncSourceFeedback] SyncSourceFeedback error sending update: network error while attempting to run command 'replSetUpdatePosition' on host 'localhost:27017' 2016-04-19T15:50:34.307+0000 I REPL [SyncSourceFeedback] updateUpstream failed: HostUnreachable: network error while attempting to run command 'replSetUpdatePosition' on host 'localhost:27017' , will retry 2016-04-19T15:50:34.956+0000 I STORAGE [conn44] got request after shutdown() 2016-04-19T15:50:35.253+0000 I NETWORK [conn1] end connection 127.0.0.1:51328 (49 connections now open) 2016-04-19T15:50:35.276+0000 I CONTROL [signalProcessingThread] now exiting 2016-04-19T15:50:35.276+0000 I NETWORK [signalProcessingThread] shutdown: going to close listening sockets... 2016-04-19T15:50:35.276+0000 I NETWORK [signalProcessingThread] closing listening socket: 6 2016-04-19T15:50:35.276+0000 I NETWORK [signalProcessingThread] closing listening socket: 7 2016-04-19T15:50:35.276+0000 I NETWORK [signalProcessingThread] closing listening socket: 8 2016-04-19T15:50:35.276+0000 I NETWORK [signalProcessingThread] removing socket file: /tmp/mongodb-27016.sock 2016-04-19T15:50:35.276+0000 I NETWORK [signalProcessingThread] shutdown: going to flush diaglog... 2016-04-19T15:50:35.276+0000 I NETWORK [signalProcessingThread] shutdown: going to close sockets... 2016-04-19T15:50:35.276+0000 I STORAGE [signalProcessingThread] WiredTigerKVEngine shutting down 2016-04-19T15:50:35.277+0000 I NETWORK [conn3] end connection 127.0.0.1:51349 (48 connections now open) 2016-04-19T15:50:35.277+0000 I NETWORK [conn4] end connection 127.0.0.1:51350 (48 connections now open) 2016-04-19T15:50:35.277+0000 I NETWORK [conn5] end connection 127.0.0.1:51351 (48 connections now open) 2016-04-19T15:50:35.277+0000 I NETWORK [conn6] end connection 127.0.0.1:51352 (48 connections now open) 2016-04-19T15:50:35.277+0000 I NETWORK [conn7] end connection 127.0.0.1:51353 (48 connections now open) 2016-04-19T15:50:35.278+0000 I NETWORK [conn8] end connection 127.0.0.1:51357 (48 connections now open) 2016-04-19T15:50:35.279+0000 I NETWORK [conn10] end connection 127.0.0.1:51362 (48 connections now open) 2016-04-19T15:50:35.279+0000 I NETWORK [conn11] end connection 127.0.0.1:51367 (48 connections now open) 2016-04-19T15:50:35.280+0000 I NETWORK [conn12] end connection 127.0.0.1:51379 (48 connections now open) 2016-04-19T15:50:35.280+0000 I NETWORK [conn13] end connection 127.0.0.1:51380 (48 connections now open) 2016-04-19T15:50:35.280+0000 I NETWORK [conn14] end connection 127.0.0.1:51381 (48 connections now open) 2016-04-19T15:50:35.280+0000 I NETWORK [conn15] end connection 127.0.0.1:51382 (48 connections now open) 2016-04-19T15:50:35.281+0000 I NETWORK [conn16] end connection 127.0.0.1:51383 (48 connections now open) 2016-04-19T15:50:35.281+0000 I NETWORK [conn17] end connection 127.0.0.1:51387 (48 connections now open) 2016-04-19T15:50:35.281+0000 I NETWORK [conn59] end connection 127.0.0.1:51527 (48 connections now open) 2016-04-19T15:50:35.283+0000 I NETWORK [conn50] end connection 127.0.0.1:51498 (48 connections now open) 2016-04-19T15:50:35.283+0000 I NETWORK [conn47] end connection 127.0.0.1:51495 (48 connections now open) 2016-04-19T15:50:35.283+0000 I NETWORK [conn48] end connection 127.0.0.1:51496 (48 connections now open) 2016-04-19T15:50:35.283+0000 I NETWORK [conn49] end connection 127.0.0.1:51497 (48 connections now open) 2016-04-19T15:50:35.283+0000 I NETWORK [conn51] end connection 127.0.0.1:51499 (48 connections now open) 2016-04-19T15:50:35.283+0000 I NETWORK [conn61] end connection 127.0.0.1:51532 (48 connections now open) 2016-04-19T15:50:35.284+0000 I NETWORK [conn38] end connection 127.0.0.1:51458 (48 connections now open) 2016-04-19T15:50:35.284+0000 I NETWORK [conn35] end connection 127.0.0.1:51455 (48 connections now open) 2016-04-19T15:50:35.284+0000 I NETWORK [conn36] end connection 127.0.0.1:51456 (48 connections now open) 2016-04-19T15:50:35.284+0000 I NETWORK [conn37] end connection 127.0.0.1:51457 (48 connections now open) 2016-04-19T15:50:35.284+0000 I NETWORK [conn39] end connection 127.0.0.1:51459 (48 connections now open) 2016-04-19T15:50:35.284+0000 I NETWORK [conn40] end connection 127.0.0.1:51463 (48 connections now open) 2016-04-19T15:50:35.285+0000 I NETWORK [conn58] end connection 127.0.0.1:51522 (48 connections now open) 2016-04-19T15:50:35.285+0000 I NETWORK [conn54] end connection 127.0.0.1:51508 (48 connections now open) 2016-04-19T15:50:35.285+0000 I NETWORK [conn32] end connection 127.0.0.1:51437 (48 connections now open) 2016-04-19T15:50:35.286+0000 I NETWORK [conn43] end connection 127.0.0.1:51473 (48 connections now open) 2016-04-19T15:50:35.286+0000 I NETWORK [conn34] end connection 127.0.0.1:51442 (48 connections now open) 2016-04-19T15:50:35.286+0000 I NETWORK [conn42] end connection 127.0.0.1:51468 (48 connections now open) 2016-04-19T15:50:35.295+0000 I NETWORK [conn56] end connection 127.0.0.1:51517 (48 connections now open) 2016-04-19T15:50:35.295+0000 I NETWORK [conn62] end connection 127.0.0.1:51537 (48 connections now open) 2016-04-19T15:50:35.295+0000 I NETWORK [conn55] end connection 127.0.0.1:51513 (48 connections now open) 2016-04-19T15:50:35.296+0000 I NETWORK [conn31] end connection 127.0.0.1:51433 (48 connections now open) 2016-04-19T15:50:35.296+0000 I NETWORK [conn46] end connection 127.0.0.1:51482 (48 connections now open) 2016-04-19T15:50:35.296+0000 I NETWORK [conn52] end connection 127.0.0.1:51503 (48 connections now open) 2016-04-19T15:50:35.296+0000 I NETWORK [conn19] end connection 127.0.0.1:51392 (48 connections now open) 2016-04-19T15:50:35.297+0000 I NETWORK [conn20] end connection 127.0.0.1:51397 (48 connections now open) 2016-04-19T15:50:35.297+0000 I NETWORK [conn21] end connection 127.0.0.1:51409 (48 connections now open) 2016-04-19T15:50:35.297+0000 I NETWORK [conn22] end connection 127.0.0.1:51410 (48 connections now open) 2016-04-19T15:50:35.297+0000 I NETWORK [conn23] end connection 127.0.0.1:51411 (48 connections now open) 2016-04-19T15:50:35.297+0000 I NETWORK [conn24] end connection 127.0.0.1:51412 (48 connections now open) 2016-04-19T15:50:35.297+0000 I NETWORK [conn25] end connection 127.0.0.1:51413 (48 connections now open) 2016-04-19T15:50:35.297+0000 I NETWORK [conn26] end connection 127.0.0.1:51417 (48 connections now open) 2016-04-19T15:50:35.297+0000 I NETWORK [conn28] end connection 127.0.0.1:51422 (48 connections now open) 2016-04-19T15:50:35.299+0000 I NETWORK [conn30] end connection 127.0.0.1:51428 (48 connections now open) 2016-04-19T15:50:35.430+0000 I STORAGE [signalProcessingThread] shutdown: removing fs lock... 2016-04-19T15:50:35.430+0000 I CONTROL [signalProcessingThread] dbexit: rc: 0 2016-04-19T15:50:46.897+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-04-19T15:50:46.964+0000 I CONTROL [initandlisten] MongoDB starting : pid=3748 port=27016 dbpath=/var/lib/mongodb-replica/mongodbreplica2 64-bit host=ip-172-31-6-169 2016-04-19T15:50:46.964+0000 I CONTROL [initandlisten] db version v3.2.5 2016-04-19T15:50:46.964+0000 I CONTROL [initandlisten] git version: 34e65e5383f7ea1726332cb175b73077ec4a1b02 2016-04-19T15:50:46.964+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014 2016-04-19T15:50:46.964+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-04-19T15:50:46.964+0000 I CONTROL [initandlisten] modules: none 2016-04-19T15:50:46.964+0000 I CONTROL [initandlisten] build environment: 2016-04-19T15:50:46.964+0000 I CONTROL [initandlisten] distmod: ubuntu1404 2016-04-19T15:50:46.964+0000 I CONTROL [initandlisten] distarch: x86_64 2016-04-19T15:50:46.964+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-04-19T15:50:46.964+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb.d/mongodbreplica2.conf", net: { bindIp: "127.0.0.1", http: { RESTInterfaceEnabled: true, enabled: true }, port: 27016 }, processManagement: { pidFilePath: "/var/run/mongodb-replica/mongodbreplica2.pid" }, replication: { oplogSizeMB: 128, replSet: "mongodbreplica" }, storage: { dbPath: "/var/lib/mongodb-replica/mongodbreplica2", mmapv1: { smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb-replica/mongodbreplica2.log" } } 2016-04-19T15:50:47.097+0000 I - [initandlisten] Detected data files in /var/lib/mongodb-replica/mongodbreplica2 created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2016-04-19T15:50:47.097+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-04-19T15:50:48.532+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-04-19T15:50:48.532+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 122800 records totaling to 2930065704 bytes 2016-04-19T15:50:48.532+0000 I STORAGE [initandlisten] Sampling from the oplog between Apr 13 06:48:30:3 and Apr 19 15:50:14:2 to determine where to place markers for truncation 2016-04-19T15:50:48.532+0000 I STORAGE [initandlisten] Taking 1006 samples and assuming that each section of oplog contains approximately 1220 records totaling to 29109773 bytes 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 07:40:45:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 08:35:45:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 09:29:48:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 10:24:21:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 11:17:45:4 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 12:12:49:3 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 13:08:21:2 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 14:04:45:3 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 15:14:46:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 13 16:13:29:2 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 14 22:12:31:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 14 23:30:45:5 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 00:49:23:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 02:08:45:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 03:29:59:2 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 04:55:00:4 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 05:57:48:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 06:52:45:4 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 07:46:50:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 08:39:47:3 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 09:35:45:4 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 10:30:31:2 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 11:24:49:2 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 12:20:09:2 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 13:18:49:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 14:37:10:2 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 15:47:49:7 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 16:49:53:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 17:44:46:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 19:01:45:5 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 20:22:15:2 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 21:38:08:3 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 15 22:58:45:4 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 00:15:08:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 01:30:08:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 02:42:10:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 03:52:08:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 05:10:02:3 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 06:37:20:2 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 07:30:51:2 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 08:19:54:2 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 09:09:51:3 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 09:58:33:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 10:48:32:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 11:42:56:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 12:33:35:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 13:22:03:2 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 14:22:09:2 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 15:22:51:2 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 16:13:54:2 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 17:07:45:4 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 17:57:46:2 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 18:45:49:2 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 19:35:08:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 20:39:00:5 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 21:33:02:1 2016-04-19T15:50:50.470+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 22:48:12:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 16 23:42:02:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 00:30:59:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 01:26:19:2 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 02:24:53:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 03:15:42:2 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 04:09:54:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 05:00:10:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 05:48:06:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 06:38:02:2 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 07:26:02:2 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 08:21:09:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 09:15:46:2 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 10:08:01:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 11:03:08:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 11:59:57:2 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 12:53:52:2 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 13:49:08:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 15:10:45:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 16:05:00:6 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 17:01:58:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 17:58:01:2 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 18:52:45:2 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 19:47:45:4 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 21:04:12:2 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 22:02:00:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 22:58:09:2 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 17 23:56:45:2 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 18 00:58:02:2 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 18 02:00:57:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 19 01:22:56:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 19 02:45:31:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 19 04:04:15:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 19 05:04:09:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 19 05:59:49:9 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 19 06:52:01:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 19 07:50:51:3 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 19 08:44:56:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 19 09:37:39:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 19 10:32:00:4 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 19 11:27:06:1 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 19 12:22:56:2 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 19 13:24:00:4 2016-04-19T15:50:50.471+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 19 14:56:45:5 2016-04-19T15:50:50.792+0000 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2016-04-19T15:50:50.792+0000 I CONTROL [initandlisten] 2016-04-19T15:50:50.792+0000 I CONTROL [initandlisten] ** WARNING: Access control is not enabled for the database. 2016-04-19T15:50:50.792+0000 I CONTROL [initandlisten] ** Read and write access to data and configuration is unrestricted. 2016-04-19T15:50:50.792+0000 I CONTROL [initandlisten] 2016-04-19T15:50:50.869+0000 I NETWORK [websvr] admin web console waiting for connections on port 28016 2016-04-19T15:50:50.871+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb-replica/mongodbreplica2/diagnostic.data' 2016-04-19T15:50:50.871+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-04-19T15:50:50.873+0000 I NETWORK [initandlisten] waiting for connections on port 27016 2016-04-19T15:50:50.873+0000 W NETWORK [ReplicationExecutor] Failed to connect to 127.0.0.1:27017, reason: errno:111 Connection refused 2016-04-19T15:50:50.874+0000 W NETWORK [ReplicationExecutor] Failed to connect to 127.0.0.1:27015, reason: errno:111 Connection refused 2016-04-19T15:50:50.874+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "mongodbreplica", version: 2, protocolVersion: 1, members: [ { _id: 0, host: "localhost:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "localhost:27016", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "localhost:27015", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-04-19T15:50:50.874+0000 I REPL [ReplicationExecutor] This node is localhost:27016 in the config 2016-04-19T15:50:50.874+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-04-19T15:50:50.874+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-04-19T15:50:50.875+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable: Connection refused 2016-04-19T15:50:50.875+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: Connection refused 2016-04-19T15:50:50.875+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable: Connection refused 2016-04-19T15:50:50.875+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: Connection refused 2016-04-19T15:50:50.875+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; HostUnreachable: Connection refused 2016-04-19T15:50:50.875+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: Connection refused 2016-04-19T15:50:50.875+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-04-19T15:50:50.894+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-04-19T15:50:50.965+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56276 #1 (1 connection now open) 2016-04-19T15:50:50.965+0000 I NETWORK [conn1] end connection 127.0.0.1:56276 (0 connections now open) 2016-04-19T15:50:50.965+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56278 #2 (1 connection now open) 2016-04-19T15:50:51.070+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56282 #3 (2 connections now open) 2016-04-19T15:50:51.072+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56283 #4 (3 connections now open) 2016-04-19T15:50:51.089+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56286 #5 (4 connections now open) 2016-04-19T15:50:51.094+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56288 #6 (5 connections now open) 2016-04-19T15:50:51.112+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56289 #7 (6 connections now open) 2016-04-19T15:50:51.112+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56291 #8 (7 connections now open) 2016-04-19T15:50:51.112+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56292 #9 (8 connections now open) 2016-04-19T15:50:51.116+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56293 #10 (9 connections now open) 2016-04-19T15:50:51.207+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56295 #11 (10 connections now open) 2016-04-19T15:50:51.207+0000 I NETWORK [conn11] end connection 127.0.0.1:56295 (9 connections now open) 2016-04-19T15:50:51.208+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56297 #12 (10 connections now open) 2016-04-19T15:50:51.404+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56298 #13 (11 connections now open) 2016-04-19T15:50:51.407+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56299 #14 (12 connections now open) 2016-04-19T15:50:51.407+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56300 #15 (13 connections now open) 2016-04-19T15:50:53.084+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56301 #16 (14 connections now open) 2016-04-19T15:50:53.090+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56302 #17 (15 connections now open) 2016-04-19T15:50:53.144+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56306 #18 (16 connections now open) 2016-04-19T15:50:53.162+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56307 #19 (17 connections now open) 2016-04-19T15:50:55.946+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-19T15:50:55.946+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-19T15:50:55.950+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-19T15:50:55.984+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-19T15:50:57.825+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56332 #20 (18 connections now open) 2016-04-19T15:50:58.042+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56340 #21 (19 connections now open) 2016-04-19T15:50:58.045+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56341 #22 (20 connections now open) 2016-04-19T15:50:58.046+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56342 #23 (21 connections now open) 2016-04-19T15:50:58.054+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56344 #24 (22 connections now open) 2016-04-19T15:50:58.057+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56345 #25 (23 connections now open) 2016-04-19T15:50:58.057+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56346 #26 (24 connections now open) 2016-04-19T15:50:58.941+0000 I ACCESS [conn20] Successfully authenticated as principal oplogger on admin 2016-04-19T15:50:58.944+0000 I ACCESS [conn23] Successfully authenticated as principal oplogger on admin 2016-04-19T15:50:59.597+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56351 #27 (25 connections now open) 2016-04-19T15:50:59.830+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56352 #28 (26 connections now open) 2016-04-19T15:50:59.937+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56353 #29 (27 connections now open) 2016-04-19T15:50:59.938+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56354 #30 (28 connections now open) 2016-04-19T15:51:00.088+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56355 #31 (29 connections now open) 2016-04-19T15:51:00.088+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56356 #32 (30 connections now open) 2016-04-19T15:51:00.088+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56357 #33 (31 connections now open) 2016-04-19T15:51:01.010+0000 I ACCESS [conn27] Successfully authenticated as principal oplogger on admin 2016-04-19T15:51:01.026+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56363 #34 (32 connections now open) 2016-04-19T15:51:01.026+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56364 #35 (33 connections now open) 2016-04-19T15:51:01.032+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56365 #36 (34 connections now open) 2016-04-19T15:51:01.892+0000 I ACCESS [conn28] Successfully authenticated as principal oplogger on admin 2016-04-19T15:51:01.934+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56368 #37 (35 connections now open) 2016-04-19T15:51:01.934+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56370 #38 (36 connections now open) 2016-04-19T15:51:02.012+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56371 #39 (37 connections now open) 2016-04-19T15:51:02.036+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56372 #40 (38 connections now open) 2016-04-19T15:51:02.036+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56373 #41 (39 connections now open) 2016-04-19T15:51:02.079+0000 I ACCESS [conn30] Successfully authenticated as principal oplogger on admin 2016-04-19T15:51:02.374+0000 I ACCESS [conn33] Successfully authenticated as principal oplogger on admin 2016-04-19T15:51:02.394+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56375 #42 (40 connections now open) 2016-04-19T15:51:02.395+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56376 #43 (41 connections now open) 2016-04-19T15:51:02.395+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56377 #44 (42 connections now open) 2016-04-19T15:51:02.396+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56378 #45 (43 connections now open) 2016-04-19T15:51:02.415+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56379 #46 (44 connections now open) 2016-04-19T15:51:03.189+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56380 #47 (45 connections now open) 2016-04-19T15:51:03.189+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56382 #48 (46 connections now open) 2016-04-19T15:51:03.189+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56383 #49 (47 connections now open) 2016-04-19T15:51:03.194+0000 I ACCESS [conn34] Successfully authenticated as principal oplogger on admin 2016-04-19T15:51:04.309+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56384 #50 (48 connections now open) 2016-04-19T15:51:04.310+0000 I ACCESS [conn29] Successfully authenticated as principal oplogger on admin 2016-04-19T15:51:04.317+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56385 #51 (49 connections now open) 2016-04-19T15:51:04.346+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56386 #52 (50 connections now open) 2016-04-19T15:51:04.346+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56387 #53 (51 connections now open) 2016-04-19T15:51:04.346+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56388 #54 (52 connections now open) 2016-04-19T15:51:04.778+0000 I ACCESS [conn32] Successfully authenticated as principal oplogger on admin 2016-04-19T15:51:04.778+0000 I ACCESS [conn31] Successfully authenticated as principal oplogger on admin 2016-04-19T15:51:05.968+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state PRIMARY 2016-04-19T15:51:06.032+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-19T15:51:06.162+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-19T15:51:06.199+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-19T15:51:06.366+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56405 #55 (53 connections now open) 2016-04-19T15:51:06.367+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56406 #56 (54 connections now open) 2016-04-19T15:51:06.414+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56407 #57 (55 connections now open) 2016-04-19T15:51:06.423+0000 I NETWORK [conn55] end connection 127.0.0.1:56405 (53 connections now open) 2016-04-19T15:51:45.195+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56423 #58 (55 connections now open) 2016-04-19T15:52:45.036+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 19 15:52:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 19 15:52:45:2) 2016-04-19T15:52:45.036+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T15:52:50.036+0000 I NETWORK [conn56] end connection 127.0.0.1:56406 (54 connections now open) 2016-04-19T15:52:51.037+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-19T15:52:51.038+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-19T15:57:45.057+0000 I NETWORK [conn58] end connection 127.0.0.1:56423 (53 connections now open) 2016-04-19T15:57:45.057+0000 I NETWORK [conn57] end connection 127.0.0.1:56407 (53 connections now open) 2016-04-19T16:00:14.708+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-19T17:36:45.064+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 19 17:36:10:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 19 17:36:45:2) 2016-04-19T17:36:45.064+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T17:37:40.073+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-19T17:37:40.074+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-19T17:37:40.075+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-19T17:39:45.067+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-19T18:09:18.774+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T18:09:24.775+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-19T18:09:24.776+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-19T18:09:24.776+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-19T18:10:02.436+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-19T18:24:45.026+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56932 #59 (53 connections now open) 2016-04-19T18:24:45.028+0000 I NETWORK [conn59] end connection 127.0.0.1:56932 (52 connections now open) 2016-04-19T18:24:45.028+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56933 #60 (53 connections now open) 2016-04-19T18:24:45.040+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56934 #61 (54 connections now open) 2016-04-19T18:25:29.481+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56937 #62 (55 connections now open) 2016-04-19T18:29:45.061+0000 I NETWORK [conn61] end connection 127.0.0.1:56934 (54 connections now open) 2016-04-19T18:34:45.065+0000 I NETWORK [conn62] end connection 127.0.0.1:56937 (53 connections now open) 2016-04-19T18:34:45.065+0000 I NETWORK [conn60] end connection 127.0.0.1:56933 (52 connections now open) 2016-04-19T18:43:29.334+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 19 18:42:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 19 18:43:29:1) 2016-04-19T18:43:29.334+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T18:43:35.335+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-19T18:43:35.336+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-19T19:04:38.492+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57048 #63 (53 connections now open) 2016-04-19T19:04:38.492+0000 I NETWORK [conn63] end connection 127.0.0.1:57048 (52 connections now open) 2016-04-19T19:04:38.493+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57049 #64 (53 connections now open) 2016-04-19T19:04:38.494+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57050 #65 (54 connections now open) 2016-04-19T19:07:19.029+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57058 #66 (55 connections now open) 2016-04-19T19:28:45.825+0000 I NETWORK [conn65] end connection 127.0.0.1:57050 (54 connections now open) 2016-04-19T19:28:51.826+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57133 #67 (55 connections now open) 2016-04-19T19:28:51.826+0000 I NETWORK [conn67] end connection 127.0.0.1:57133 (54 connections now open) 2016-04-19T19:28:51.829+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57134 #68 (55 connections now open) 2016-04-19T19:53:20.223+0000 I NETWORK [conn68] end connection 127.0.0.1:57134 (54 connections now open) 2016-04-19T19:53:26.220+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57205 #69 (55 connections now open) 2016-04-19T19:53:26.220+0000 I NETWORK [conn69] end connection 127.0.0.1:57205 (54 connections now open) 2016-04-19T19:53:26.223+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57206 #70 (55 connections now open) 2016-04-19T20:35:45.027+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 19 20:34:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 19 20:35:45:1) 2016-04-19T20:35:45.027+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T20:35:50.029+0000 I NETWORK [conn70] end connection 127.0.0.1:57206 (54 connections now open) 2016-04-19T20:35:51.028+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-19T20:35:51.029+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-19T20:40:50.029+0000 I NETWORK [conn64] end connection 127.0.0.1:57049 (53 connections now open) 2016-04-19T20:40:50.029+0000 I NETWORK [conn66] end connection 127.0.0.1:57058 (52 connections now open) 2016-04-19T20:44:50.043+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57342 #71 (53 connections now open) 2016-04-19T20:44:50.043+0000 I NETWORK [conn71] end connection 127.0.0.1:57342 (52 connections now open) 2016-04-19T20:44:50.044+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57343 #72 (53 connections now open) 2016-04-19T20:44:50.048+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57344 #73 (54 connections now open) 2016-04-19T20:46:48.297+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57353 #74 (55 connections now open) 2016-04-19T21:44:46.892+0000 I NETWORK [conn73] end connection 127.0.0.1:57344 (54 connections now open) 2016-04-19T21:44:47.895+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57567 #75 (55 connections now open) 2016-04-19T21:44:47.897+0000 I NETWORK [conn75] end connection 127.0.0.1:57567 (54 connections now open) 2016-04-19T21:44:47.901+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57568 #76 (55 connections now open) 2016-04-19T22:23:17.177+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 19 22:22:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 19 22:23:17:1) 2016-04-19T22:23:17.177+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-19T22:23:17.178+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-19T22:23:22.180+0000 I NETWORK [conn76] end connection 127.0.0.1:57568 (54 connections now open) 2016-04-19T22:23:22.181+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-19T22:23:22.183+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-19T22:28:22.178+0000 I NETWORK [conn72] end connection 127.0.0.1:57343 (53 connections now open) 2016-04-19T22:28:22.179+0000 I NETWORK [conn74] end connection 127.0.0.1:57353 (52 connections now open) 2016-04-19T22:46:30.075+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57790 #77 (53 connections now open) 2016-04-19T22:46:30.076+0000 I NETWORK [conn77] end connection 127.0.0.1:57790 (52 connections now open) 2016-04-19T22:46:30.077+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57791 #78 (53 connections now open) 2016-04-19T22:46:30.079+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57792 #79 (54 connections now open) 2016-04-19T22:46:30.081+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57793 #80 (55 connections now open) 2016-04-19T22:57:27.267+0000 I NETWORK [conn80] end connection 127.0.0.1:57793 (54 connections now open) 2016-04-19T23:02:27.268+0000 I NETWORK [conn79] end connection 127.0.0.1:57792 (53 connections now open) 2016-04-19T23:02:27.268+0000 I NETWORK [conn78] end connection 127.0.0.1:57791 (52 connections now open) 2016-04-20T00:22:22.912+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58178 #81 (53 connections now open) 2016-04-20T00:22:22.912+0000 I NETWORK [conn81] end connection 127.0.0.1:58178 (52 connections now open) 2016-04-20T00:22:22.913+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58179 #82 (53 connections now open) 2016-04-20T00:22:22.916+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58180 #83 (54 connections now open) 2016-04-20T00:24:09.828+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58190 #84 (55 connections now open) 2016-04-20T00:53:33.732+0000 I NETWORK [conn83] end connection 127.0.0.1:58180 (54 connections now open) 2016-04-20T00:58:33.735+0000 I NETWORK [conn84] end connection 127.0.0.1:58190 (53 connections now open) 2016-04-20T00:58:33.735+0000 I NETWORK [conn82] end connection 127.0.0.1:58179 (52 connections now open) 2016-04-20T01:32:45.032+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 01:32:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 20 01:32:45:2) 2016-04-20T01:32:45.032+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T01:32:50.033+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-20T01:32:50.034+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-20T01:42:46.032+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58562 #85 (53 connections now open) 2016-04-20T01:42:46.033+0000 I NETWORK [conn85] end connection 127.0.0.1:58562 (52 connections now open) 2016-04-20T01:42:46.033+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58563 #86 (53 connections now open) 2016-04-20T01:42:46.033+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58564 #87 (54 connections now open) 2016-04-20T01:42:46.475+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58565 #88 (55 connections now open) 2016-04-20T02:24:18.958+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 02:23:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 20 02:24:18:1) 2016-04-20T02:24:18.958+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T02:24:19.003+0000 I NETWORK [conn87] end connection 127.0.0.1:58564 (54 connections now open) 2016-04-20T02:24:23.967+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-20T02:24:23.968+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-20T02:24:24.970+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58668 #89 (55 connections now open) 2016-04-20T02:24:24.971+0000 I NETWORK [conn89] end connection 127.0.0.1:58668 (54 connections now open) 2016-04-20T02:24:24.987+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58669 #90 (55 connections now open) 2016-04-20T03:15:45.043+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 03:15:12:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 20 03:15:45:1) 2016-04-20T03:15:45.043+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T03:15:45.044+0000 I NETWORK [conn90] end connection 127.0.0.1:58669 (54 connections now open) 2016-04-20T03:15:50.044+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-20T03:15:50.045+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-20T03:17:45.094+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58962 #91 (55 connections now open) 2016-04-20T03:17:45.094+0000 I NETWORK [conn91] end connection 127.0.0.1:58962 (54 connections now open) 2016-04-20T03:17:45.095+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58963 #92 (55 connections now open) 2016-04-20T04:05:46.049+0000 I NETWORK [conn92] end connection 127.0.0.1:58963 (54 connections now open) 2016-04-20T04:05:52.051+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59223 #93 (55 connections now open) 2016-04-20T04:05:52.052+0000 I NETWORK [conn93] end connection 127.0.0.1:59223 (54 connections now open) 2016-04-20T04:05:52.055+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59224 #94 (55 connections now open) 2016-04-20T04:10:45.042+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 04:10:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 20 04:10:45:1) 2016-04-20T04:10:45.042+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T04:10:46.042+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-20T04:10:46.043+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-20T04:51:45.042+0000 I NETWORK [conn94] end connection 127.0.0.1:59224 (54 connections now open) 2016-04-20T04:56:45.043+0000 I NETWORK [conn86] end connection 127.0.0.1:58563 (53 connections now open) 2016-04-20T04:56:45.043+0000 I NETWORK [conn88] end connection 127.0.0.1:58565 (52 connections now open) 2016-04-20T05:35:46.025+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59833 #95 (53 connections now open) 2016-04-20T05:35:46.026+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59834 #96 (54 connections now open) 2016-04-20T05:35:46.026+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59835 #97 (55 connections now open) 2016-04-20T05:35:46.026+0000 I NETWORK [conn95] end connection 127.0.0.1:59833 (54 connections now open) 2016-04-20T05:36:45.079+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59843 #98 (55 connections now open) 2016-04-20T05:39:47.083+0000 I NETWORK [conn97] end connection 127.0.0.1:59835 (54 connections now open) 2016-04-20T05:39:47.087+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59865 #99 (55 connections now open) 2016-04-20T05:39:47.087+0000 I NETWORK [conn99] end connection 127.0.0.1:59865 (54 connections now open) 2016-04-20T05:39:47.089+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59866 #100 (55 connections now open) 2016-04-20T05:45:41.939+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 05:44:57:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 20 05:45:41:1) 2016-04-20T05:45:41.939+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T05:45:41.942+0000 I NETWORK [conn100] end connection 127.0.0.1:59866 (54 connections now open) 2016-04-20T05:45:47.955+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-20T05:45:47.955+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-20T05:50:41.942+0000 I NETWORK [conn96] end connection 127.0.0.1:59834 (53 connections now open) 2016-04-20T05:50:41.943+0000 I NETWORK [conn98] end connection 127.0.0.1:59843 (52 connections now open) 2016-04-20T06:44:45.051+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 06:44:08:1) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 20 06:44:45:3) 2016-04-20T06:44:45.051+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-20T06:44:45.052+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-20T06:44:45.052+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-20T06:45:53.185+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-20T06:46:45.035+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 06:46:01:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 20 06:46:44:8) 2016-04-20T06:46:45.035+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T06:46:50.036+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-20T06:46:50.036+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-20T06:50:44.115+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 06:50:01:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 20 06:50:43:1) 2016-04-20T06:50:44.115+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T06:50:49.121+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-20T06:50:49.122+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-20T06:50:49.122+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-20T06:56:00.652+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-20T06:58:45.465+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 06:58:01:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 20 06:58:45:5) 2016-04-20T06:58:45.465+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T06:58:50.466+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-20T06:58:50.467+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-20T06:58:50.468+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-20T06:59:53.333+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-20T07:00:44.736+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 07:00:00:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 20 07:00:43:2) 2016-04-20T07:00:44.737+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T07:00:49.738+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-20T07:00:49.738+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-20T07:18:45.026+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 07:18:09:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 20 07:18:45:2) 2016-04-20T07:18:45.026+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T07:18:50.027+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-20T07:18:50.028+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-20T07:41:42.270+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T07:41:48.271+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-20T07:41:48.272+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-20T07:41:48.272+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-20T07:42:59.360+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-20T07:53:47.413+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60782 #101 (53 connections now open) 2016-04-20T07:53:47.415+0000 I NETWORK [conn101] end connection 127.0.0.1:60782 (52 connections now open) 2016-04-20T07:53:47.415+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60783 #102 (53 connections now open) 2016-04-20T07:53:47.418+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60784 #103 (54 connections now open) 2016-04-20T07:54:23.407+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60791 #104 (55 connections now open) 2016-04-20T08:18:45.030+0000 I NETWORK [conn103] end connection 127.0.0.1:60784 (54 connections now open) 2016-04-20T08:23:45.030+0000 I NETWORK [conn102] end connection 127.0.0.1:60783 (53 connections now open) 2016-04-20T08:23:45.030+0000 I NETWORK [conn104] end connection 127.0.0.1:60791 (52 connections now open) 2016-04-20T08:32:50.044+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:32809 #105 (53 connections now open) 2016-04-20T08:32:50.045+0000 I NETWORK [conn105] end connection 127.0.0.1:32809 (52 connections now open) 2016-04-20T08:32:50.045+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:32810 #106 (53 connections now open) 2016-04-20T08:32:50.047+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:32811 #107 (54 connections now open) 2016-04-20T08:35:59.876+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:32839 #108 (55 connections now open) 2016-04-20T08:55:44.517+0000 I NETWORK [conn107] end connection 127.0.0.1:32811 (54 connections now open) 2016-04-20T08:55:49.532+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:32967 #109 (55 connections now open) 2016-04-20T08:55:49.533+0000 I NETWORK [conn109] end connection 127.0.0.1:32967 (54 connections now open) 2016-04-20T08:55:49.534+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:32968 #110 (55 connections now open) 2016-04-20T09:23:50.085+0000 I NETWORK [conn110] end connection 127.0.0.1:32968 (54 connections now open) 2016-04-20T09:23:55.096+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33162 #111 (55 connections now open) 2016-04-20T09:23:55.096+0000 I NETWORK [conn111] end connection 127.0.0.1:33162 (54 connections now open) 2016-04-20T09:23:55.100+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33163 #112 (55 connections now open) 2016-04-20T09:52:45.069+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 09:52:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 20 09:52:45:3) 2016-04-20T09:52:45.069+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T09:52:45.070+0000 I NETWORK [conn112] end connection 127.0.0.1:33163 (54 connections now open) 2016-04-20T09:53:00.091+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-20T09:53:00.092+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-20T09:57:45.077+0000 I NETWORK [conn108] end connection 127.0.0.1:32839 (53 connections now open) 2016-04-20T09:57:45.078+0000 I NETWORK [conn106] end connection 127.0.0.1:32810 (52 connections now open) 2016-04-20T10:44:44.214+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 10:43:56:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 20 10:44:43:1) 2016-04-20T10:44:44.214+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T10:44:50.216+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-20T10:44:50.217+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-20T11:12:43.687+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33919 #113 (53 connections now open) 2016-04-20T11:12:43.688+0000 I NETWORK [conn113] end connection 127.0.0.1:33919 (52 connections now open) 2016-04-20T11:12:43.688+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33920 #114 (53 connections now open) 2016-04-20T11:12:43.691+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33921 #115 (54 connections now open) 2016-04-20T11:18:47.660+0000 I NETWORK [conn115] end connection 127.0.0.1:33921 (53 connections now open) 2016-04-20T11:18:47.663+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33964 #116 (54 connections now open) 2016-04-20T11:18:47.663+0000 I NETWORK [conn116] end connection 127.0.0.1:33964 (53 connections now open) 2016-04-20T11:18:47.664+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33965 #117 (54 connections now open) 2016-04-20T11:21:00.074+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33980 #118 (55 connections now open) 2016-04-20T11:31:45.835+0000 I NETWORK [conn117] end connection 127.0.0.1:33965 (54 connections now open) 2016-04-20T11:31:46.838+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34051 #119 (55 connections now open) 2016-04-20T11:31:46.838+0000 I NETWORK [conn119] end connection 127.0.0.1:34051 (54 connections now open) 2016-04-20T11:31:46.840+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34052 #120 (55 connections now open) 2016-04-20T11:32:45.056+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 11:32:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 20 11:32:45:1) 2016-04-20T11:32:45.056+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T11:32:50.066+0000 I NETWORK [conn120] end connection 127.0.0.1:34052 (54 connections now open) 2016-04-20T11:33:00.059+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-20T11:33:00.060+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-20T11:37:50.058+0000 I NETWORK [conn118] end connection 127.0.0.1:33980 (53 connections now open) 2016-04-20T11:37:50.058+0000 I NETWORK [conn114] end connection 127.0.0.1:33920 (52 connections now open) 2016-04-20T11:39:42.923+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 11:38:59:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 20 11:39:41:2) 2016-04-20T11:39:42.960+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T11:39:48.961+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-20T11:39:48.962+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-20T11:39:48.963+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-20T11:40:51.783+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-20T11:41:38.993+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 11:40:56:3) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 20 11:41:38:2) 2016-04-20T11:41:38.994+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T11:41:44.996+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-20T11:41:44.997+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-20T11:42:45.058+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 11:42:07:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 20 11:42:45:1) 2016-04-20T11:42:45.058+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T11:42:46.058+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-20T11:42:46.059+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-20T12:15:45.683+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T12:15:50.692+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-20T12:15:50.694+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-20T12:37:45.096+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T12:37:50.109+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-20T12:37:50.110+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-20T12:37:50.110+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-20T12:38:01.361+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-20T14:37:45.041+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 14:36:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 20 14:37:45:1) 2016-04-20T14:37:45.041+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T14:37:50.042+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-20T14:37:50.042+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-20T14:37:50.043+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-20T14:43:19.070+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-20T14:49:16.252+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T14:49:46.267+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-20T14:49:46.268+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-20T14:49:46.268+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-20T14:54:14.260+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-20T16:27:45.024+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 16:27:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 20 16:27:45:2) 2016-04-20T16:27:45.024+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T16:27:50.025+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-20T16:27:50.027+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-20T16:27:50.028+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-20T16:31:03.619+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-20T17:36:18.163+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 17:35:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 20 17:36:17:3) 2016-04-20T17:36:18.163+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T17:36:23.164+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-20T17:36:23.165+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-20T17:36:23.165+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-20T17:38:40.979+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-20T18:08:43.706+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 18:07:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 20 18:08:43:1) 2016-04-20T18:08:43.706+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T18:08:48.719+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-20T18:08:48.720+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-20T18:08:48.720+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-20T18:10:29.580+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-20T19:07:20.661+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 19:06:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 20 19:07:20:1) 2016-04-20T19:07:20.661+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T19:07:25.662+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-20T19:07:25.664+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-20T19:07:25.664+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-20T19:08:17.796+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 19:07:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 20 19:08:17:1) 2016-04-20T19:08:17.796+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T19:08:22.797+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-20T19:08:22.797+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-20T19:19:20.984+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 19:18:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 20 19:19:20:1) 2016-04-20T19:19:20.985+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T19:19:25.988+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-20T19:19:25.989+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-20T19:24:24.558+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 19:23:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 20 19:24:23:2) 2016-04-20T19:24:24.558+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T19:24:30.560+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-20T19:24:30.561+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-20T19:24:30.561+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-20T19:29:00.461+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-20T19:55:45.070+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 19:55:08:3) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 20 19:55:45:5) 2016-04-20T19:55:45.070+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T19:56:00.074+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-20T19:56:00.075+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-20T20:54:18.240+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 20:53:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 20 20:54:17:1) 2016-04-20T20:54:18.257+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T20:54:23.273+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-20T20:54:23.274+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-20T21:33:45.081+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T21:33:55.130+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-20T21:33:55.131+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-20T21:33:55.141+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-20T21:33:55.146+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-20T22:24:45.056+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 22:24:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 20 22:24:45:2) 2016-04-20T22:24:45.056+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T22:24:55.066+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-20T22:24:55.067+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-20T22:25:50.084+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37492 #121 (53 connections now open) 2016-04-20T22:25:50.085+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37493 #122 (54 connections now open) 2016-04-20T22:25:50.085+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37494 #123 (55 connections now open) 2016-04-20T22:25:50.085+0000 I NETWORK [conn121] end connection 127.0.0.1:37492 (54 connections now open) 2016-04-20T22:30:00.080+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37524 #124 (55 connections now open) 2016-04-20T23:28:39.469+0000 I NETWORK [conn123] end connection 127.0.0.1:37494 (54 connections now open) 2016-04-20T23:28:39.471+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37773 #125 (55 connections now open) 2016-04-20T23:28:39.473+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37774 #126 (56 connections now open) 2016-04-20T23:28:39.473+0000 I NETWORK [conn125] end connection 127.0.0.1:37773 (55 connections now open) 2016-04-20T23:33:45.903+0000 I NETWORK [conn126] end connection 127.0.0.1:37774 (54 connections now open) 2016-04-20T23:33:50.915+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37792 #127 (55 connections now open) 2016-04-20T23:33:50.916+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37793 #128 (56 connections now open) 2016-04-20T23:33:50.918+0000 I NETWORK [conn127] end connection 127.0.0.1:37792 (55 connections now open) 2016-04-20T23:52:41.615+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 23:51:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 20 23:52:41:1) 2016-04-20T23:52:41.615+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T23:52:41.647+0000 I NETWORK [conn128] end connection 127.0.0.1:37793 (54 connections now open) 2016-04-20T23:52:46.623+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-20T23:52:46.634+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-20T23:52:46.653+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37880 #129 (55 connections now open) 2016-04-20T23:52:46.653+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37881 #130 (56 connections now open) 2016-04-20T23:52:46.654+0000 I NETWORK [conn129] end connection 127.0.0.1:37880 (55 connections now open) 2016-04-20T23:58:37.183+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 20 23:57:45:7) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 20 23:58:36:1) 2016-04-20T23:58:37.183+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-20T23:58:42.193+0000 I NETWORK [conn130] end connection 127.0.0.1:37881 (54 connections now open) 2016-04-20T23:58:47.184+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-20T23:58:47.185+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-21T00:03:42.184+0000 I NETWORK [conn124] end connection 127.0.0.1:37524 (53 connections now open) 2016-04-21T00:03:42.184+0000 I NETWORK [conn122] end connection 127.0.0.1:37493 (52 connections now open) 2016-04-21T00:17:26.444+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 00:16:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 21 00:17:26:2) 2016-04-21T00:17:26.445+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T00:17:26.446+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-21T00:17:31.447+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-21T00:17:31.448+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-21T00:17:31.449+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-21T00:27:45.074+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-21T00:50:45.081+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 00:49:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 21 00:50:45:5) 2016-04-21T00:50:45.082+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T00:50:50.094+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-21T00:50:50.095+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-21T01:43:39.957+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 01:42:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 21 01:43:39:3) 2016-04-21T01:43:39.958+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T01:43:44.958+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-21T01:43:44.959+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-21T02:45:45.031+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 02:45:09:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 21 02:45:45:1) 2016-04-21T02:45:45.031+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T02:45:51.032+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-21T02:45:51.033+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-21T02:47:45.053+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 02:46:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 21 02:47:44:1) 2016-04-21T02:47:45.053+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T02:47:50.066+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-21T02:47:50.067+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-21T02:48:45.067+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 02:48:09:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 21 02:48:45:5) 2016-04-21T02:48:45.067+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T02:49:25.078+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-21T02:49:25.079+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-21T03:23:30.778+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T03:23:36.781+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-21T03:23:36.781+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-21T03:23:36.782+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-21T03:23:38.498+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-21T04:14:31.479+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 04:13:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 21 04:14:30:1) 2016-04-21T04:14:31.480+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T04:14:37.481+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-21T04:14:37.482+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-21T04:14:37.482+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-21T04:17:14.519+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-21T04:25:21.598+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 04:24:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 21 04:25:21:1) 2016-04-21T04:25:21.598+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T04:25:26.603+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-21T04:25:26.604+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-21T05:30:38.880+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T05:30:44.883+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-21T05:30:44.884+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-21T05:33:24.772+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T05:33:25.773+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-21T05:33:25.774+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-21T05:33:25.774+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-21T05:44:01.311+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-21T05:50:45.071+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39302 #131 (53 connections now open) 2016-04-21T05:50:45.080+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39303 #132 (54 connections now open) 2016-04-21T05:50:45.080+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39304 #133 (55 connections now open) 2016-04-21T05:50:45.080+0000 I NETWORK [conn131] end connection 127.0.0.1:39302 (54 connections now open) 2016-04-21T05:51:45.028+0000 I NETWORK [conn133] end connection 127.0.0.1:39304 (53 connections now open) 2016-04-21T05:51:46.028+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39311 #134 (54 connections now open) 2016-04-21T05:51:46.029+0000 I NETWORK [conn134] end connection 127.0.0.1:39311 (53 connections now open) 2016-04-21T05:51:46.030+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39312 #135 (54 connections now open) 2016-04-21T05:55:32.591+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39314 #136 (55 connections now open) 2016-04-21T06:21:40.565+0000 I NETWORK [conn135] end connection 127.0.0.1:39312 (54 connections now open) 2016-04-21T06:26:40.566+0000 I NETWORK [conn132] end connection 127.0.0.1:39303 (53 connections now open) 2016-04-21T06:26:40.566+0000 I NETWORK [conn136] end connection 127.0.0.1:39314 (53 connections now open) 2016-04-21T07:40:49.711+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39831 #137 (53 connections now open) 2016-04-21T07:40:49.712+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39832 #138 (54 connections now open) 2016-04-21T07:40:49.713+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39833 #139 (55 connections now open) 2016-04-21T07:40:49.713+0000 I NETWORK [conn137] end connection 127.0.0.1:39831 (54 connections now open) 2016-04-21T07:43:55.748+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39859 #140 (55 connections now open) 2016-04-21T07:57:45.038+0000 I NETWORK [conn139] end connection 127.0.0.1:39833 (54 connections now open) 2016-04-21T07:57:51.038+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39954 #141 (55 connections now open) 2016-04-21T07:57:51.039+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39955 #142 (56 connections now open) 2016-04-21T07:57:51.039+0000 I NETWORK [conn141] end connection 127.0.0.1:39954 (55 connections now open) 2016-04-21T08:46:45.025+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 08:46:02:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 21 08:46:45:2) 2016-04-21T08:46:45.025+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T08:46:50.024+0000 I NETWORK [conn142] end connection 127.0.0.1:39955 (54 connections now open) 2016-04-21T08:46:51.032+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-21T08:46:51.038+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-21T08:47:45.033+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 08:47:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 21 08:47:45:2) 2016-04-21T08:47:45.033+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T08:47:50.034+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-21T08:47:50.034+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-21T08:47:50.035+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-21T08:47:54.085+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-21T08:51:45.049+0000 I NETWORK [conn138] end connection 127.0.0.1:39832 (53 connections now open) 2016-04-21T08:51:45.049+0000 I NETWORK [conn140] end connection 127.0.0.1:39859 (52 connections now open) 2016-04-21T10:01:44.163+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 10:01:01:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 21 10:01:44:1) 2016-04-21T10:01:44.163+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T10:01:50.164+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-21T10:01:50.167+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-21T10:07:42.262+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 10:06:59:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 21 10:07:41:1) 2016-04-21T10:07:42.263+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T10:07:47.270+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-21T10:07:47.271+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-21T10:47:45.049+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 10:47:01:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 21 10:47:44:1) 2016-04-21T10:47:45.049+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T10:47:51.050+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-21T10:47:51.052+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-21T10:47:51.052+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-21T10:48:02.792+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-21T12:42:45.025+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 12:42:02:1) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 21 12:42:45:1) 2016-04-21T12:42:45.025+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T12:42:50.041+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-21T12:42:50.042+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-21T12:42:50.042+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-21T12:45:00.076+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-21T12:45:45.066+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 12:45:08:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 21 12:45:45:5) 2016-04-21T12:45:45.066+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T12:45:55.068+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-21T12:45:55.069+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-21T14:50:22.134+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 14:49:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 21 14:50:21:1) 2016-04-21T14:50:22.134+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T14:50:27.150+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-21T14:50:27.151+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-21T15:28:16.834+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 15:27:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 21 15:28:16:1) 2016-04-21T15:28:16.835+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T15:28:21.838+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-21T15:28:21.840+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-21T15:38:45.076+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 15:38:10:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 21 15:38:45:4) 2016-04-21T15:38:45.076+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T15:39:20.085+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-21T15:39:20.086+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-21T15:42:16.864+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T15:42:22.865+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-21T15:42:22.866+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-21T15:42:22.867+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-21T15:47:00.078+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-21T15:53:45.071+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 15:53:10:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 21 15:53:45:2) 2016-04-21T15:53:45.072+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T15:53:55.090+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-21T15:53:55.091+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-21T16:10:38.452+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 16:09:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 21 16:10:38:1) 2016-04-21T16:10:38.452+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T16:10:38.471+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-21T16:10:43.465+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-21T16:10:43.466+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-21T16:10:43.466+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-21T16:12:40.024+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 16:11:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 21 16:12:39:2) 2016-04-21T16:12:40.024+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T16:12:45.025+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-21T16:12:45.025+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-21T16:13:45.060+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 16:12:48:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 21 16:13:45:5) 2016-04-21T16:13:45.060+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-21T16:13:45.061+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-21T16:17:30.667+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 16:16:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 21 16:17:29:2) 2016-04-21T16:17:30.667+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T16:17:45.670+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-21T16:17:45.671+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-21T16:28:58.810+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-21T16:37:45.063+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 16:37:11:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 21 16:37:45:3) 2016-04-21T16:37:45.063+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-21T16:37:45.064+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-21T16:37:45.067+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-21T16:38:50.812+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-21T20:10:45.027+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43973 #143 (53 connections now open) 2016-04-21T20:10:45.036+0000 I NETWORK [conn143] end connection 127.0.0.1:43973 (52 connections now open) 2016-04-21T20:10:45.055+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43974 #144 (53 connections now open) 2016-04-21T20:10:45.055+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43975 #145 (54 connections now open) 2016-04-21T20:12:45.086+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43983 #146 (55 connections now open) 2016-04-21T22:04:45.041+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 21 22:04:09:4) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 21 22:04:45:2) 2016-04-21T22:04:45.041+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-21T22:04:45.043+0000 I NETWORK [conn144] end connection 127.0.0.1:43974 (54 connections now open) 2016-04-21T22:04:50.043+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-21T22:09:45.053+0000 I NETWORK [conn145] end connection 127.0.0.1:43975 (53 connections now open) 2016-04-21T22:09:45.061+0000 I NETWORK [conn146] end connection 127.0.0.1:43983 (53 connections now open) 2016-04-22T00:09:45.066+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 00:09:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 22 00:09:45:5) 2016-04-22T00:09:45.066+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-22T00:09:45.068+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-22T00:09:45.069+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-22T00:16:13.037+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-22T01:38:50.062+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-22T01:38:50.064+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-22T01:38:50.065+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-22T01:40:22.574+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 01:39:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 22 01:40:22:1) 2016-04-22T01:40:22.574+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T01:40:28.576+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-22T01:40:28.579+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-22T02:09:45.030+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 02:09:13:1) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 22 02:09:45:3) 2016-04-22T02:09:45.031+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T02:09:51.032+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-22T02:09:51.032+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-22T06:06:45.023+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 06:06:05:8) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 22 06:06:45:2) 2016-04-22T06:06:45.023+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T06:06:46.026+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-22T06:06:46.026+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-22T06:06:46.027+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-22T06:08:04.957+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-22T06:55:45.079+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 06:55:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 22 06:55:45:5) 2016-04-22T06:55:45.081+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T06:55:56.083+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-22T06:55:56.086+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-22T06:55:56.086+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-22T06:58:05.063+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-22T07:51:45.064+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 07:51:02:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 22 07:51:45:1) 2016-04-22T07:51:45.064+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T07:51:46.064+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-22T08:20:45.077+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T08:20:55.090+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-22T08:20:55.091+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-22T08:20:55.091+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-22T08:22:00.689+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-22T09:13:45.058+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 09:13:01:4) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 22 09:13:45:5) 2016-04-22T09:13:45.058+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-22T09:13:45.060+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-22T09:13:45.060+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-22T09:16:45.026+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 09:16:08:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 22 09:16:45:2) 2016-04-22T09:16:45.026+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T09:16:46.038+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-22T09:20:57.079+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-22T10:07:45.035+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 10:07:07:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 22 10:07:45:1) 2016-04-22T10:07:45.035+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T10:07:51.036+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-22T10:07:51.037+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-22T11:26:46.362+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 11:26:01:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 22 11:26:45:5) 2016-04-22T11:26:46.364+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T11:26:52.370+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-22T11:26:52.373+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-22T12:04:45.042+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 12:04:04:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 22 12:04:45:3) 2016-04-22T12:04:45.042+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-22T12:04:45.044+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-22T12:04:45.061+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-22T12:08:23.277+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-22T12:10:00.085+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49565 #147 (53 connections now open) 2016-04-22T12:10:00.087+0000 I NETWORK [conn147] end connection 127.0.0.1:49565 (52 connections now open) 2016-04-22T12:10:00.087+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49566 #148 (53 connections now open) 2016-04-22T12:10:00.099+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49567 #149 (54 connections now open) 2016-04-22T12:11:09.718+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49574 #150 (55 connections now open) 2016-04-22T12:59:19.688+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 12:58:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 22 12:59:19:1) 2016-04-22T12:59:19.688+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T12:59:19.697+0000 I NETWORK [conn149] end connection 127.0.0.1:49567 (54 connections now open) 2016-04-22T12:59:25.689+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-22T12:59:25.690+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-22T13:04:19.694+0000 I NETWORK [conn150] end connection 127.0.0.1:49574 (53 connections now open) 2016-04-22T13:04:19.694+0000 I NETWORK [conn148] end connection 127.0.0.1:49566 (52 connections now open) 2016-04-22T13:53:22.758+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 13:52:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 22 13:53:22:1) 2016-04-22T13:53:22.758+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T13:53:27.759+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-22T13:53:27.761+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-22T13:53:27.762+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-22T13:54:46.451+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 13:53:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 22 13:54:45:5) 2016-04-22T13:54:46.451+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T13:54:51.476+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-22T13:54:51.477+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-22T13:55:00.067+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-22T14:30:26.890+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 14:29:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 22 14:30:26:2) 2016-04-22T14:30:26.891+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T14:30:31.900+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-22T14:30:31.900+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-22T14:59:29.498+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 14:58:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 22 14:59:29:1) 2016-04-22T14:59:29.498+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T14:59:34.500+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-22T14:59:34.502+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-22T15:00:43.527+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 14:59:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 22 15:00:43:2) 2016-04-22T15:00:43.535+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T15:00:43.546+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-22T15:00:48.548+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-22T15:00:48.549+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-22T16:04:32.542+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T16:04:38.543+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-22T16:04:38.562+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-22T16:04:38.563+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-22T16:07:04.737+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-22T16:32:45.059+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 16:32:08:3) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 22 16:32:45:5) 2016-04-22T16:32:45.071+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-22T16:32:45.074+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-22T16:32:45.076+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-22T16:33:33.107+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-22T16:34:45.059+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 16:33:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 22 16:34:45:3) 2016-04-22T16:34:45.059+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-22T16:34:45.060+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-22T18:28:40.971+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 18:27:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 22 18:28:40:1) 2016-04-22T18:28:40.971+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T18:28:45.985+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-22T18:28:45.987+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-22T18:28:45.988+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-22T18:33:45.057+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 18:33:08:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 22 18:33:45:4) 2016-04-22T18:33:45.057+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T18:33:51.059+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-22T18:33:51.071+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-22T18:36:45.085+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-22T20:39:45.035+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T20:39:46.035+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-22T20:39:46.037+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-22T20:39:46.038+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-22T20:46:34.876+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-22T21:38:51.044+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51952 #151 (53 connections now open) 2016-04-22T21:38:51.045+0000 I NETWORK [conn151] end connection 127.0.0.1:51952 (52 connections now open) 2016-04-22T21:38:51.046+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51953 #152 (53 connections now open) 2016-04-22T21:38:51.047+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51954 #153 (54 connections now open) 2016-04-22T21:39:45.088+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51956 #154 (55 connections now open) 2016-04-22T22:34:39.678+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 22:33:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 22 22:34:39:1) 2016-04-22T22:34:39.678+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T22:34:44.676+0000 I NETWORK [conn153] end connection 127.0.0.1:51954 (54 connections now open) 2016-04-22T22:34:44.690+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-22T22:34:44.691+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-22T22:39:39.679+0000 I NETWORK [conn152] end connection 127.0.0.1:51953 (53 connections now open) 2016-04-22T22:39:39.679+0000 I NETWORK [conn154] end connection 127.0.0.1:51956 (52 connections now open) 2016-04-22T23:25:18.504+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 23:24:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 22 23:25:18:1) 2016-04-22T23:25:18.504+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-22T23:25:23.505+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-22T23:25:23.506+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-22T23:25:23.507+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-22T23:25:23.510+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-22T23:25:23.510+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-22T23:25:23.707+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52364 #155 (53 connections now open) 2016-04-22T23:25:23.709+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52365 #156 (54 connections now open) 2016-04-22T23:25:23.709+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52366 #157 (55 connections now open) 2016-04-22T23:25:23.710+0000 I NETWORK [conn155] end connection 127.0.0.1:52364 (54 connections now open) 2016-04-22T23:37:45.065+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52412 #158 (55 connections now open) 2016-04-23T00:00:45.022+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 22 23:59:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 23 00:00:44:2) 2016-04-23T00:00:45.022+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T00:00:46.022+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-23T00:00:46.023+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-23T00:17:24.299+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 23 00:16:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 23 00:17:24:1) 2016-04-23T00:17:24.299+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T00:17:29.301+0000 I NETWORK [conn157] end connection 127.0.0.1:52366 (54 connections now open) 2016-04-23T00:17:29.311+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-23T00:17:29.313+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-23T00:22:29.300+0000 I NETWORK [conn158] end connection 127.0.0.1:52412 (53 connections now open) 2016-04-23T00:22:29.300+0000 I NETWORK [conn156] end connection 127.0.0.1:52365 (52 connections now open) 2016-04-23T03:03:33.000+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 23 03:02:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 23 03:03:32:1) 2016-04-23T03:03:33.000+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T03:03:39.003+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-23T03:03:39.005+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-23T03:03:39.006+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-23T03:05:45.066+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T03:05:46.066+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-23T03:05:46.067+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-23T03:10:44.162+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 23 03:09:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 23 03:10:44:1) 2016-04-23T03:10:44.162+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T03:10:49.163+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-23T03:10:49.164+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-23T03:10:49.164+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-23T03:10:49.167+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-23T03:10:49.171+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-23T03:10:49.379+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53286 #159 (53 connections now open) 2016-04-23T03:10:49.380+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53287 #160 (54 connections now open) 2016-04-23T03:10:49.380+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53288 #161 (55 connections now open) 2016-04-23T03:10:49.380+0000 I NETWORK [conn159] end connection 127.0.0.1:53286 (54 connections now open) 2016-04-23T03:12:01.280+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53295 #162 (55 connections now open) 2016-04-23T03:45:45.058+0000 I NETWORK [conn161] end connection 127.0.0.1:53288 (54 connections now open) 2016-04-23T03:50:45.065+0000 I NETWORK [conn160] end connection 127.0.0.1:53287 (53 connections now open) 2016-04-23T03:50:45.065+0000 I NETWORK [conn162] end connection 127.0.0.1:53295 (52 connections now open) 2016-04-23T05:42:44.651+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 23 05:41:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 23 05:42:43:2) 2016-04-23T05:42:44.651+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T05:42:45.651+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-23T05:42:45.653+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-23T05:42:45.654+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-23T05:44:45.072+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-23T06:30:22.236+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T06:30:28.241+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-23T06:30:28.244+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-23T06:30:28.247+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-23T06:34:49.777+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-23T06:39:40.370+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 23 06:38:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 23 06:39:40:7) 2016-04-23T06:39:40.371+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T06:39:46.372+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-23T06:39:46.373+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-23T06:39:46.373+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-23T06:40:00.080+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-23T07:16:45.030+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 23 07:16:07:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 23 07:16:45:2) 2016-04-23T07:16:45.033+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-23T07:16:45.034+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-23T07:16:45.054+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-23T07:16:45.056+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-23T07:16:45.059+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54164 #163 (53 connections now open) 2016-04-23T07:16:45.069+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54165 #164 (54 connections now open) 2016-04-23T07:16:45.069+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54166 #165 (55 connections now open) 2016-04-23T07:16:45.069+0000 I NETWORK [conn163] end connection 127.0.0.1:54164 (54 connections now open) 2016-04-23T07:22:29.040+0000 I NETWORK [conn165] end connection 127.0.0.1:54166 (53 connections now open) 2016-04-23T07:22:49.043+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54188 #166 (54 connections now open) 2016-04-23T07:22:49.044+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54189 #167 (55 connections now open) 2016-04-23T07:22:49.045+0000 I NETWORK [conn166] end connection 127.0.0.1:54188 (54 connections now open) 2016-04-23T07:23:45.065+0000 I NETWORK [conn167] end connection 127.0.0.1:54189 (53 connections now open) 2016-04-23T07:28:45.066+0000 I NETWORK [conn164] end connection 127.0.0.1:54165 (52 connections now open) 2016-04-23T07:39:39.197+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54263 #168 (53 connections now open) 2016-04-23T07:39:39.198+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54264 #169 (54 connections now open) 2016-04-23T07:39:39.198+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54265 #170 (55 connections now open) 2016-04-23T07:39:39.198+0000 I NETWORK [conn168] end connection 127.0.0.1:54263 (54 connections now open) 2016-04-23T07:39:45.071+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54268 #171 (55 connections now open) 2016-04-23T07:42:31.336+0000 I NETWORK [conn170] end connection 127.0.0.1:54265 (54 connections now open) 2016-04-23T07:42:36.346+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54281 #172 (55 connections now open) 2016-04-23T07:42:36.346+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54282 #173 (56 connections now open) 2016-04-23T07:42:36.349+0000 I NETWORK [conn172] end connection 127.0.0.1:54281 (55 connections now open) 2016-04-23T09:14:31.084+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 23 09:13:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 23 09:14:30:1) 2016-04-23T09:14:31.084+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T09:14:31.094+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-23T09:14:36.080+0000 I NETWORK [conn173] end connection 127.0.0.1:54282 (54 connections now open) 2016-04-23T09:14:37.091+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-23T09:14:37.091+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-23T09:19:31.093+0000 I NETWORK [conn171] end connection 127.0.0.1:54268 (53 connections now open) 2016-04-23T09:19:31.094+0000 I NETWORK [conn169] end connection 127.0.0.1:54264 (52 connections now open) 2016-04-23T11:18:50.057+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:55296 #174 (53 connections now open) 2016-04-23T11:18:50.057+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:55297 #175 (54 connections now open) 2016-04-23T11:18:50.057+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:55298 #176 (55 connections now open) 2016-04-23T11:18:50.057+0000 I NETWORK [conn174] end connection 127.0.0.1:55296 (54 connections now open) 2016-04-23T11:22:10.413+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:55315 #177 (55 connections now open) 2016-04-23T11:29:45.067+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 23 11:29:07:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 23 11:29:45:4) 2016-04-23T11:29:45.067+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T11:29:50.077+0000 I NETWORK [conn176] end connection 127.0.0.1:55298 (54 connections now open) 2016-04-23T11:29:56.071+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-23T11:29:56.071+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-23T11:34:50.078+0000 I NETWORK [conn177] end connection 127.0.0.1:55315 (53 connections now open) 2016-04-23T11:34:50.082+0000 I NETWORK [conn175] end connection 127.0.0.1:55297 (52 connections now open) 2016-04-23T12:26:45.025+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 23 12:26:10:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 23 12:26:45:2) 2016-04-23T12:26:45.025+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T12:26:46.025+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-23T12:26:46.027+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-23T13:32:45.042+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 23 13:32:03:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 23 13:32:45:2) 2016-04-23T13:32:45.043+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T13:32:51.053+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-23T13:32:51.054+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-23T13:32:51.054+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-23T13:34:03.953+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-23T15:26:45.036+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T15:26:46.036+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-23T15:26:46.037+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-23T15:26:46.038+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-23T15:29:10.603+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-23T16:18:45.054+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 23 16:18:09:1) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 23 16:18:45:2) 2016-04-23T16:18:45.054+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T16:18:46.055+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-23T16:18:46.055+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-23T17:16:45.031+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 23 17:16:11:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 23 17:16:45:2) 2016-04-23T17:16:45.031+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T17:16:46.032+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-23T18:17:26.675+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57413 #178 (53 connections now open) 2016-04-23T18:17:26.684+0000 I NETWORK [conn178] end connection 127.0.0.1:57413 (52 connections now open) 2016-04-23T18:17:26.684+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57414 #179 (53 connections now open) 2016-04-23T18:17:26.685+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57415 #180 (54 connections now open) 2016-04-23T18:17:45.078+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57416 #181 (55 connections now open) 2016-04-23T18:59:22.342+0000 I NETWORK [conn180] end connection 127.0.0.1:57415 (54 connections now open) 2016-04-23T18:59:27.342+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57582 #182 (55 connections now open) 2016-04-23T18:59:27.342+0000 I NETWORK [conn182] end connection 127.0.0.1:57582 (54 connections now open) 2016-04-23T18:59:27.345+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57583 #183 (55 connections now open) 2016-04-23T19:46:46.070+0000 I NETWORK [conn183] end connection 127.0.0.1:57583 (54 connections now open) 2016-04-23T19:51:45.077+0000 I NETWORK [conn179] end connection 127.0.0.1:57414 (53 connections now open) 2016-04-23T19:51:45.077+0000 I NETWORK [conn181] end connection 127.0.0.1:57416 (52 connections now open) 2016-04-23T20:25:45.928+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57896 #184 (53 connections now open) 2016-04-23T20:25:45.929+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57897 #185 (54 connections now open) 2016-04-23T20:25:45.929+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57898 #186 (55 connections now open) 2016-04-23T20:25:45.929+0000 I NETWORK [conn184] end connection 127.0.0.1:57896 (54 connections now open) 2016-04-23T20:30:45.034+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 23 20:29:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 23 20:30:45:1) 2016-04-23T20:30:45.034+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T20:30:50.037+0000 I NETWORK [conn186] end connection 127.0.0.1:57898 (53 connections now open) 2016-04-23T20:30:51.038+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-23T20:30:51.040+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-23T20:30:51.040+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-23T20:32:45.066+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T20:33:45.076+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-23T20:33:45.078+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-23T20:35:50.038+0000 I NETWORK [conn185] end connection 127.0.0.1:57897 (52 connections now open) 2016-04-23T20:40:22.391+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 23 20:39:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 23 20:40:22:1) 2016-04-23T20:40:22.391+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T20:40:27.404+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-23T20:40:27.405+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-23T23:11:45.037+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 23 23:11:01:1) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 23 23:11:45:3) 2016-04-23T23:11:45.037+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T23:11:51.038+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-23T23:11:51.040+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-23T23:11:51.041+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-23T23:14:07.780+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-23T23:26:45.035+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T23:26:50.036+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-23T23:26:50.036+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-23T23:26:50.037+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-23T23:31:45.070+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-23T23:38:27.485+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 23 23:37:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 23 23:38:27:1) 2016-04-23T23:38:27.486+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-23T23:38:33.487+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-23T23:38:33.488+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-24T01:03:45.052+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 24 01:03:08:4) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 24 01:03:45:5) 2016-04-24T01:03:45.052+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T01:04:45.064+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-24T01:04:45.066+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-24T01:04:45.066+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-24T01:07:07.656+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-24T01:26:45.058+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T01:26:50.059+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-24T01:26:50.060+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-24T01:26:50.061+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-24T01:27:00.684+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-24T02:34:36.147+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59460 #187 (53 connections now open) 2016-04-24T02:34:36.148+0000 I NETWORK [conn187] end connection 127.0.0.1:59460 (52 connections now open) 2016-04-24T02:34:36.148+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59461 #188 (53 connections now open) 2016-04-24T02:34:36.160+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59462 #189 (54 connections now open) 2016-04-24T02:34:36.162+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59463 #190 (55 connections now open) 2016-04-24T02:52:16.432+0000 I NETWORK [conn12] end connection 127.0.0.1:56297 (54 connections now open) 2016-04-24T02:52:16.434+0000 I NETWORK [conn189] end connection 127.0.0.1:59462 (53 connections now open) 2016-04-24T02:52:16.434+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59527 #191 (54 connections now open) 2016-04-24T02:52:22.434+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59528 #192 (55 connections now open) 2016-04-24T02:52:22.435+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59529 #193 (56 connections now open) 2016-04-24T02:52:22.435+0000 I NETWORK [conn192] end connection 127.0.0.1:59528 (55 connections now open) 2016-04-24T03:28:50.030+0000 I NETWORK [conn193] end connection 127.0.0.1:59529 (54 connections now open) 2016-04-24T03:28:51.032+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59666 #194 (55 connections now open) 2016-04-24T03:28:51.034+0000 I NETWORK [conn194] end connection 127.0.0.1:59666 (54 connections now open) 2016-04-24T03:28:51.037+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59667 #195 (55 connections now open) 2016-04-24T05:18:45.031+0000 I NETWORK [conn195] end connection 127.0.0.1:59667 (54 connections now open) 2016-04-24T05:18:51.032+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60309 #196 (55 connections now open) 2016-04-24T05:18:51.033+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60310 #197 (56 connections now open) 2016-04-24T05:18:51.033+0000 I NETWORK [conn196] end connection 127.0.0.1:60309 (55 connections now open) 2016-04-24T05:20:45.060+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 24 05:20:07:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 24 05:20:45:5) 2016-04-24T05:20:45.060+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T05:20:50.057+0000 I NETWORK [conn197] end connection 127.0.0.1:60310 (54 connections now open) 2016-04-24T05:21:05.080+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-24T05:21:05.081+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-24T05:25:45.061+0000 I NETWORK [conn190] end connection 127.0.0.1:59463 (53 connections now open) 2016-04-24T05:25:45.061+0000 I NETWORK [conn188] end connection 127.0.0.1:59461 (52 connections now open) 2016-04-24T06:11:51.034+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60667 #198 (53 connections now open) 2016-04-24T06:11:51.035+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60668 #199 (54 connections now open) 2016-04-24T06:11:51.035+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60669 #200 (55 connections now open) 2016-04-24T06:11:51.035+0000 I NETWORK [conn198] end connection 127.0.0.1:60667 (54 connections now open) 2016-04-24T06:14:02.490+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60681 #201 (55 connections now open) 2016-04-24T06:15:45.029+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 24 06:15:05:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 24 06:15:45:2) 2016-04-24T06:15:45.029+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T06:15:50.031+0000 I NETWORK [conn200] end connection 127.0.0.1:60669 (54 connections now open) 2016-04-24T06:15:50.031+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-24T06:15:50.038+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-24T06:16:45.043+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 24 06:16:00:7) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 24 06:16:45:3) 2016-04-24T06:16:45.043+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T06:16:45.064+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-24T06:16:46.043+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-24T06:20:50.031+0000 I NETWORK [conn199] end connection 127.0.0.1:60668 (53 connections now open) 2016-04-24T06:20:50.031+0000 I NETWORK [conn201] end connection 127.0.0.1:60681 (52 connections now open) 2016-04-24T07:10:45.066+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 24 07:10:02:1) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 24 07:10:45:1) 2016-04-24T07:10:45.071+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T07:11:01.079+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-24T07:11:01.085+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-24T07:11:01.092+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-24T07:13:45.082+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-24T09:10:45.050+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 24 09:10:04:1) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 24 09:10:45:3) 2016-04-24T09:10:45.053+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-24T09:10:45.054+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-24T09:10:45.055+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-24T09:12:05.094+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-24T10:55:45.029+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 24 10:55:14:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 24 10:55:45:2) 2016-04-24T10:55:45.029+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-24T10:55:45.030+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-24T10:55:45.042+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-24T10:56:50.061+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T10:57:00.065+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-24T10:57:00.066+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-24T10:57:45.072+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 24 10:57:07:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 24 10:57:45:5) 2016-04-24T10:57:45.072+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T10:57:45.073+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-24T10:57:56.076+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-24T10:57:56.076+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-24T10:57:59.353+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-24T11:38:16.817+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 24 11:37:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 24 11:38:16:2) 2016-04-24T11:38:16.817+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T11:38:22.818+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-24T11:38:22.820+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-24T11:39:19.680+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T11:39:49.699+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-24T11:39:49.699+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-24T11:39:49.700+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-24T11:41:02.451+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-24T11:56:45.081+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 24 11:56:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 24 11:56:45:2) 2016-04-24T11:56:45.082+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T11:56:46.082+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-24T11:56:46.083+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-24T11:56:46.083+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-24T11:56:58.146+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-24T12:47:45.036+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 24 12:47:07:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 24 12:47:45:2) 2016-04-24T12:47:45.036+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T12:47:46.036+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-24T12:47:46.046+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-24T12:47:46.046+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-24T12:48:54.408+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-24T13:49:45.051+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 24 13:49:05:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 24 13:49:45:4) 2016-04-24T13:49:45.051+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-24T13:49:45.065+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-24T13:49:45.071+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-24T13:54:57.565+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-24T14:50:41.513+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-24T14:50:41.514+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-24T14:50:41.515+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-24T15:00:25.230+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-24T15:21:45.094+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35700 #202 (53 connections now open) 2016-04-24T15:21:45.095+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35701 #203 (54 connections now open) 2016-04-24T15:21:45.095+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35702 #204 (55 connections now open) 2016-04-24T15:21:45.095+0000 I NETWORK [conn202] end connection 127.0.0.1:35700 (54 connections now open) 2016-04-24T15:26:15.013+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35707 #205 (55 connections now open) 2016-04-24T16:07:45.077+0000 I NETWORK [conn204] end connection 127.0.0.1:35702 (54 connections now open) 2016-04-24T16:12:45.065+0000 I NETWORK [conn203] end connection 127.0.0.1:35701 (53 connections now open) 2016-04-24T16:12:45.065+0000 I NETWORK [conn205] end connection 127.0.0.1:35707 (52 connections now open) 2016-04-24T18:04:45.038+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 24 18:04:10:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 24 18:04:45:2) 2016-04-24T18:04:45.041+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T18:04:50.042+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-24T18:04:50.044+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-24T19:56:45.045+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 24 19:56:09:1) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 24 19:56:45:2) 2016-04-24T19:56:45.045+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T19:56:50.047+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-24T19:56:50.049+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-24T19:56:50.050+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-24T19:58:00.976+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-24T20:47:45.059+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T20:47:46.059+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-24T20:47:46.060+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-24T20:47:46.061+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-24T20:57:06.867+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-24T21:34:45.064+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 24 21:34:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 24 21:34:45:5) 2016-04-24T21:34:45.065+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T21:35:00.084+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-24T21:35:00.085+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-24T21:35:00.086+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-24T21:35:45.076+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T21:35:56.088+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-24T21:35:56.089+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-24T22:32:45.036+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 24 22:32:07:1) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 24 22:32:45:1) 2016-04-24T22:32:45.036+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T22:32:50.038+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-24T22:32:50.038+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-24T22:32:50.039+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-24T22:39:45.080+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-24T23:06:35.602+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 24 23:05:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 24 23:06:35:1) 2016-04-24T23:06:35.602+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T23:06:40.609+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-24T23:06:40.610+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-24T23:32:36.072+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 24 23:31:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 24 23:32:36:1) 2016-04-24T23:32:36.073+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T23:32:36.074+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-24T23:32:41.073+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-24T23:32:41.074+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-24T23:32:41.075+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-24T23:34:15.615+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-24T23:38:43.630+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 24 23:37:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 41, timestamp: Apr 24 23:38:42:2) 2016-04-24T23:38:43.630+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-24T23:38:48.631+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-24T23:38:48.631+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-24T23:38:48.632+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-24T23:47:07.858+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-25T01:07:45.030+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 25 01:06:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 25 01:07:45:2) 2016-04-25T01:07:45.030+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-25T01:07:46.030+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-25T01:07:46.031+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-25T02:13:45.031+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 25 02:12:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 25 02:13:45:2) 2016-04-25T02:13:45.031+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-25T02:13:45.036+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T02:13:46.032+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-25T02:13:46.032+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-25T02:49:46.474+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 25 02:48:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 25 02:49:45:5) 2016-04-25T02:49:46.511+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-25T02:49:51.515+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-25T02:49:51.517+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-25T03:10:22.376+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 41, timestamp: Apr 25 03:09:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 41, timestamp: Apr 25 03:10:21:2) 2016-04-25T03:10:22.376+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-25T03:10:47.381+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-25T03:10:47.381+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-25T03:29:45.042+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-25T03:29:50.043+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-25T03:29:50.045+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-25T03:29:50.048+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-25T03:33:28.412+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-25T03:49:49.335+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38865 #206 (53 connections now open) 2016-04-25T03:49:49.337+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38866 #207 (54 connections now open) 2016-04-25T03:49:49.337+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38867 #208 (55 connections now open) 2016-04-25T03:49:49.337+0000 I NETWORK [conn206] end connection 127.0.0.1:38865 (54 connections now open) 2016-04-25T03:53:01.268+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38885 #209 (55 connections now open) 2016-04-25T03:58:16.534+0000 I NETWORK [conn191] end connection 127.0.0.1:59527 (54 connections now open) 2016-04-25T03:58:16.534+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38911 #210 (55 connections now open) 2016-04-25T03:58:21.534+0000 I NETWORK [conn208] end connection 127.0.0.1:38867 (54 connections now open) 2016-04-25T03:58:21.546+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38912 #211 (55 connections now open) 2016-04-25T03:58:21.547+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38913 #212 (56 connections now open) 2016-04-25T03:58:21.548+0000 I NETWORK [conn211] end connection 127.0.0.1:38912 (55 connections now open) 2016-04-25T04:16:45.026+0000 I NETWORK [conn212] end connection 127.0.0.1:38913 (54 connections now open) 2016-04-25T04:21:45.026+0000 I NETWORK [conn209] end connection 127.0.0.1:38885 (53 connections now open) 2016-04-25T04:21:45.026+0000 I NETWORK [conn207] end connection 127.0.0.1:38866 (52 connections now open) 2016-04-25T05:02:47.224+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39241 #213 (53 connections now open) 2016-04-25T05:02:47.224+0000 I NETWORK [conn213] end connection 127.0.0.1:39241 (52 connections now open) 2016-04-25T05:02:47.225+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39242 #214 (53 connections now open) 2016-04-25T05:02:47.226+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39243 #215 (54 connections now open) 2016-04-25T05:06:00.081+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39258 #216 (55 connections now open) 2016-04-25T06:44:25.124+0000 I COMMAND [conn215] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1461081014000|2, t: 40 }, appliedOpTime: { ts: Timestamp 1461081014000|2, t: 40 }, memberId: 0, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1461566648000|2, t: 41 }, appliedOpTime: { ts: Timestamp 1461566648000|2, t: 41 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1461566648000|2, t: 41 }, appliedOpTime: { ts: Timestamp 1461566648000|2, t: 41 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 337ms 2016-04-25T06:44:25.124+0000 I COMMAND [conn216] command local.oplog.rs command: getMore { getMore: 13978426744, collection: "oplog.rs", maxTimeMS: 5000, term: 41, lastKnownCommittedOpTime: { ts: Timestamp 1461566648000|2, t: 41 } } cursorid:13978426744 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:0 reslen:292 locks:{ Global: { acquireCount: { r: 8 } }, Database: { acquireCount: { r: 4 } }, oplog: { acquireCount: { r: 4 } } } protocol:op_command 5983ms 2016-04-25T06:44:27.152+0000 I COMMAND [conn2] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:425 locks:{} protocol:op_command 1438ms 2016-04-25T06:44:27.152+0000 I COMMAND [conn210] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:425 locks:{} protocol:op_command 1438ms 2016-04-25T06:44:28.023+0000 I COMMAND [conn15] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 2093ms 2016-04-25T06:44:31.105+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 110, after asserts: 160, after connections: 200, after extra_info: 490, after globalLock: 560, after locks: 580, after network: 600, after opcounters: 600, after opcountersRepl: 600, after repl: 1030, after storageEngine: 1790, after tcmalloc: 2740, after wiredTiger: 4230, at end: 6350 } 2016-04-25T06:44:32.261+0000 I COMMAND [conn5] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 2459ms 2016-04-25T06:44:32.261+0000 I COMMAND [conn18] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 2459ms 2016-04-25T06:44:32.261+0000 I COMMAND [conn16] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 2459ms 2016-04-25T06:44:35.771+0000 I COMMAND [conn215] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1461081014000|2, t: 40 }, appliedOpTime: { ts: Timestamp 1461081014000|2, t: 40 }, memberId: 0, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1461566648000|2, t: 41 }, appliedOpTime: { ts: Timestamp 1461566648000|2, t: 41 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1461566648000|2, t: 41 }, appliedOpTime: { ts: Timestamp 1461566648000|2, t: 41 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 745ms 2016-04-25T06:44:36.668+0000 I COMMAND [conn10] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 2130ms 2016-04-25T06:44:36.668+0000 I COMMAND [conn13] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 2130ms 2016-04-25T06:44:36.924+0000 I COMMAND [conn210] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:425 locks:{} protocol:op_command 943ms 2016-04-25T06:44:36.924+0000 I COMMAND [conn2] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:425 locks:{} protocol:op_command 943ms 2016-04-25T06:44:39.158+0000 I COMMAND [conn9] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 1308ms 2016-04-25T06:44:39.158+0000 I COMMAND [conn3] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 1308ms 2016-04-25T06:44:39.158+0000 I COMMAND [conn6] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 1308ms 2016-04-25T06:44:41.732+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-25T06:44:45.393+0000 I NETWORK [conn215] end connection 127.0.0.1:39243 (54 connections now open) 2016-04-25T06:44:45.931+0000 I COMMAND [conn7] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 2832ms 2016-04-25T06:44:45.931+0000 I COMMAND [conn14] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 3477ms 2016-04-25T06:44:45.931+0000 I COMMAND [conn4] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 2832ms 2016-04-25T06:44:45.931+0000 I COMMAND [conn8] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 3477ms 2016-04-25T06:44:46.476+0000 I COMMAND [conn216] command local.oplog.rs command: getMore { getMore: 13978426744, collection: "oplog.rs", maxTimeMS: 5000, term: 41, lastKnownCommittedOpTime: { ts: Timestamp 1461566648000|2, t: 41 } } cursorid:13978426744 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:0 reslen:292 locks:{ Global: { acquireCount: { r: 8 } }, Database: { acquireCount: { r: 4 } }, oplog: { acquireCount: { r: 4 } } } protocol:op_command 15382ms 2016-04-25T06:44:46.481+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 3017ms 2016-04-25T06:44:48.533+0000 I NETWORK [conn216] end connection 127.0.0.1:39258 (53 connections now open) 2016-04-25T06:44:49.610+0000 I COMMAND [conn210] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:394 locks:{} protocol:op_command 1639ms 2016-04-25T06:44:49.610+0000 I COMMAND [conn19] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 2551ms 2016-04-25T06:44:54.603+0000 I COMMAND [conn2] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:394 locks:{} protocol:op_command 1604ms 2016-04-25T06:44:55.006+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 430, after asserts: 760, after connections: 950, after extra_info: 1420, after globalLock: 1720, after locks: 2220, after network: 2510, after opcounters: 2510, after opcountersRepl: 2510, after repl: 4960, after storageEngine: 5330, after tcmalloc: 5660, after wiredTiger: 5850, at end: 6940 } 2016-04-25T06:45:04.712+0000 I COMMAND [conn210] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:394 locks:{} protocol:op_command 1432ms 2016-04-25T06:45:04.712+0000 I COMMAND [conn2] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:394 locks:{} protocol:op_command 969ms 2016-04-25T06:45:07.874+0000 I COMMAND [conn18] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 2116ms 2016-04-25T06:45:07.874+0000 I COMMAND [conn16] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 2116ms 2016-04-25T06:45:08.843+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:45:09.205+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:45:13.539+0000 I COMMAND [conn10] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 2578ms 2016-04-25T06:45:13.539+0000 I COMMAND [conn5] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 2578ms 2016-04-25T06:45:15.382+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 490, after connections: 830, after extra_info: 1590, after globalLock: 2060, after locks: 2430, after network: 2690, after opcounters: 2780, after opcountersRepl: 2780, after repl: 4490, after storageEngine: 4860, after tcmalloc: 5550, after wiredTiger: 6770, at end: 8300 } 2016-04-25T06:45:15.395+0000 I COMMAND [conn3] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 2293ms 2016-04-25T06:45:15.626+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: HostUnreachable: End of file 2016-04-25T06:45:17.974+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39761 #217 (54 connections now open) 2016-04-25T06:45:21.875+0000 I COMMAND [conn2] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:394 locks:{} protocol:op_command 5759ms 2016-04-25T06:45:21.879+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T06:45:21.882+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:45:25.777+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:45:25.793+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:45:26.728+0000 I COMMAND [conn217] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 2401ms 2016-04-25T06:45:28.909+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:45:30.555+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:45:30.560+0000 I COMMAND [conn210] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 16656ms 2016-04-25T06:45:32.189+0000 I COMMAND [conn9] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 3950ms 2016-04-25T06:45:32.189+0000 I COMMAND [conn8] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 3950ms 2016-04-25T06:45:32.502+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:45:34.845+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39765 #218 (55 connections now open) 2016-04-25T06:45:35.253+0000 I NETWORK [conn210] end connection 127.0.0.1:38911 (53 connections now open) 2016-04-25T06:45:35.451+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:45:35.943+0000 I COMMAND [conn6] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1568ms 2016-04-25T06:45:36.140+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:45:37.352+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39766 #219 (55 connections now open) 2016-04-25T06:45:39.560+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:45:39.951+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:45:42.948+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T06:45:43.951+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:45:44.549+0000 I COMMAND [conn218] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4816ms 2016-04-25T06:45:46.367+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 368, after asserts: 368, after connections: 368, after extra_info: 368, after globalLock: 368, after locks: 548, after network: 918, after opcounters: 928, after opcountersRepl: 928, after repl: 1018, after storageEngine: 1018, after tcmalloc: 1828, after wiredTiger: 3958, at end: 7358 } 2016-04-25T06:45:46.962+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:45:48.393+0000 I COMMAND [conn2] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 15911ms 2016-04-25T06:45:48.494+0000 I COMMAND [conn219] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5490ms 2016-04-25T06:45:49.578+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:45:49.578+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3393ms 2016-04-25T06:45:50.226+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:45:50.844+0000 I NETWORK [conn2] end connection 127.0.0.1:56278 (54 connections now open) 2016-04-25T06:45:53.377+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T06:45:56.642+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39770 #220 (55 connections now open) 2016-04-25T06:45:56.731+0000 I COMMAND [conn219] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2244ms 2016-04-25T06:45:59.635+0000 I COMMAND [conn217] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 11559306 } } } protocol:op_command 27618ms 2016-04-25T06:45:59.844+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T06:46:01.367+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:46:03.692+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:46:04.202+0000 I NETWORK [conn217] end connection 127.0.0.1:39761 (54 connections now open) 2016-04-25T06:46:06.311+0000 I COMMAND [conn220] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5868ms 2016-04-25T06:46:08.741+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:46:10.156+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39775 #221 (55 connections now open) 2016-04-25T06:46:11.546+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:46:12.914+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:46:16.711+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 460, after asserts: 700, after connections: 960, after extra_info: 1580, after globalLock: 2090, after locks: 2670, after network: 2870, after opcounters: 2870, after opcountersRepl: 2870, after repl: 2881, after storageEngine: 2881, after tcmalloc: 2981, after wiredTiger: 4351, at end: 7281 } 2016-04-25T06:46:16.911+0000 I COMMAND [conn221] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1273ms 2016-04-25T06:46:17.001+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:46:18.657+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T06:46:18.901+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:46:18.903+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:46:20.203+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:46:20.961+0000 I NETWORK [conn221] end connection 127.0.0.1:39775 (54 connections now open) 2016-04-25T06:46:22.933+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:46:22.839+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39777 #222 (56 connections now open) 2016-04-25T06:46:23.661+0000 I COMMAND [conn218] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 10001563 } } } protocol:op_command 27995ms 2016-04-25T06:46:24.049+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:46:29.312+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T06:46:29.650+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39779 #223 (56 connections now open) 2016-04-25T06:46:29.650+0000 I NETWORK [conn218] end connection 127.0.0.1:39765 (54 connections now open) 2016-04-25T06:46:31.914+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39780 #224 (57 connections now open) 2016-04-25T06:46:33.055+0000 I COMMAND [conn222] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4905ms 2016-04-25T06:46:34.369+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T06:46:35.653+0000 I COMMAND [conn219] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 14104789 } } } protocol:op_command 27469ms 2016-04-25T06:46:36.436+0000 I COMMAND [conn223] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2712ms 2016-04-25T06:46:36.436+0000 I COMMAND [conn224] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1981ms 2016-04-25T06:46:37.452+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:46:39.260+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:46:41.117+0000 I NETWORK [conn219] end connection 127.0.0.1:39766 (55 connections now open) 2016-04-25T06:46:44.532+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39785 #225 (56 connections now open) 2016-04-25T06:46:47.514+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:46:47.516+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:46:50.190+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:46:50.192+0000 I COMMAND [conn220] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 16323991 } } } protocol:op_command 30518ms 2016-04-25T06:46:50.506+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 750, after connections: 1150, after extra_info: 1870, after globalLock: 2140, after locks: 2320, after network: 2410, after opcounters: 2410, after opcountersRepl: 2410, after repl: 2927, after storageEngine: 3397, after tcmalloc: 4237, after wiredTiger: 6117, at end: 8567 } 2016-04-25T06:46:52.411+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:46:52.420+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T06:46:53.287+0000 I COMMAND [conn225] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4703ms 2016-04-25T06:46:55.058+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:46:55.331+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:46:56.664+0000 I NETWORK [conn220] end connection 127.0.0.1:39770 (55 connections now open) 2016-04-25T06:46:58.550+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T06:46:59.634+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:47:03.071+0000 I COMMAND [conn222] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 7560170 } } } protocol:op_command 20811ms 2016-04-25T06:47:03.160+0000 I COMMAND [conn224] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 14787ms 2016-04-25T06:47:03.952+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:47:08.167+0000 I NETWORK [conn224] end connection 127.0.0.1:39780 (54 connections now open) 2016-04-25T06:47:08.166+0000 I NETWORK [conn222] end connection 127.0.0.1:39777 (54 connections now open) 2016-04-25T06:47:10.709+0000 I COMMAND [conn223] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2425ms 2016-04-25T06:47:10.709+0000 I COMMAND [conn225] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2425ms 2016-04-25T06:47:11.459+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T06:47:11.687+0000 I NETWORK [conn5] end connection 127.0.0.1:56286 (52 connections now open) 2016-04-25T06:47:16.325+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T06:47:19.091+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:47:20.417+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:47:24.555+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 330, after asserts: 620, after connections: 720, after extra_info: 1850, after globalLock: 2310, after locks: 2410, after network: 2500, after opcounters: 2610, after opcountersRepl: 2610, after repl: 8250, after storageEngine: 8430, after tcmalloc: 8910, after wiredTiger: 10630, at end: 13740 } 2016-04-25T06:47:29.237+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39791 #226 (53 connections now open) 2016-04-25T06:47:30.112+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:47:32.522+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T06:47:32.616+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39792 #227 (54 connections now open) 2016-04-25T06:47:34.441+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T06:47:34.446+0000 I COMMAND [conn225] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 12758ms 2016-04-25T06:47:34.649+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:47:34.929+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:47:35.843+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:47:36.850+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:47:36.944+0000 I NETWORK [conn225] end connection 127.0.0.1:39785 (53 connections now open) 2016-04-25T06:47:37.048+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:47:41.623+0000 I COMMAND [conn226] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6887ms 2016-04-25T06:47:41.923+0000 I COMMAND [conn227] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4572ms 2016-04-25T06:47:41.938+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39795 #228 (54 connections now open) 2016-04-25T06:47:42.840+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:47:43.439+0000 I COMMAND [conn223] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 10650183 } } } protocol:op_command 23465ms 2016-04-25T06:47:45.265+0000 I COMMAND [conn228] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1824ms 2016-04-25T06:47:46.078+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T06:47:46.167+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T06:47:46.741+0000 I NETWORK [conn223] end connection 127.0.0.1:39779 (53 connections now open) 2016-04-25T06:47:52.534+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:47:53.455+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:47:54.789+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 190, after asserts: 370, after connections: 460, after extra_info: 1240, after globalLock: 1360, after locks: 1460, after network: 1600, after opcounters: 1600, after opcountersRepl: 1600, after repl: 2340, after storageEngine: 2760, after tcmalloc: 3470, after wiredTiger: 4880, at end: 7190 } 2016-04-25T06:47:55.284+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 104ms 2016-04-25T06:47:56.580+0000 I COMMAND [conn227] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 10386ms 2016-04-25T06:47:59.156+0000 I COMMAND [conn226] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5063ms 2016-04-25T06:48:00.097+0000 I COMMAND [conn228] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3540ms 2016-04-25T06:48:00.289+0000 I NETWORK [conn227] end connection 127.0.0.1:39792 (52 connections now open) 2016-04-25T06:48:03.399+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T06:48:03.492+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39799 #229 (53 connections now open) 2016-04-25T06:48:04.509+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39800 #230 (54 connections now open) 2016-04-25T06:48:04.912+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T06:48:06.515+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:48:06.713+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:48:08.071+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:48:08.279+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:48:10.180+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:48:10.478+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:48:11.529+0000 I COMMAND [conn229] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3563ms 2016-04-25T06:48:13.659+0000 I COMMAND [conn230] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4682ms 2016-04-25T06:48:16.578+0000 I COMMAND [conn229] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2011ms 2016-04-25T06:48:16.932+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 230, after asserts: 330, after connections: 520, after extra_info: 1080, after globalLock: 1470, after locks: 1770, after network: 2200, after opcounters: 2200, after opcountersRepl: 2200, after repl: 6070, after storageEngine: 6790, after tcmalloc: 7340, after wiredTiger: 8520, at end: 10220 } 2016-04-25T06:48:18.549+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:48:20.370+0000 I COMMAND [conn226] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 6734 } } } protocol:op_command 16467ms 2016-04-25T06:48:22.206+0000 I NETWORK [conn229] end connection 127.0.0.1:39799 (53 connections now open) 2016-04-25T06:48:22.290+0000 I COMMAND [conn230] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1912ms 2016-04-25T06:48:22.403+0000 I NETWORK [conn226] end connection 127.0.0.1:39791 (53 connections now open) 2016-04-25T06:48:23.092+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T06:48:24.947+0000 I NETWORK [conn230] end connection 127.0.0.1:39800 (51 connections now open) 2016-04-25T06:48:26.195+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T06:48:27.816+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39804 #231 (52 connections now open) 2016-04-25T06:48:30.472+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39805 #232 (53 connections now open) 2016-04-25T06:48:30.472+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:48:30.474+0000 I COMMAND [conn228] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 7184546 } } } protocol:op_command 25430ms 2016-04-25T06:48:32.764+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:48:36.983+0000 I NETWORK [conn228] end connection 127.0.0.1:39795 (52 connections now open) 2016-04-25T06:48:37.288+0000 I COMMAND [conn231] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5748ms 2016-04-25T06:48:38.648+0000 I COMMAND [conn232] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2931ms 2016-04-25T06:48:40.247+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T06:48:42.156+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:48:43.306+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 180, after asserts: 260, after connections: 360, after extra_info: 1020, after globalLock: 1340, after locks: 1340, after network: 1340, after opcounters: 1340, after opcountersRepl: 1340, after repl: 2430, after storageEngine: 2820, after tcmalloc: 3510, after wiredTiger: 4440, at end: 5840 } 2016-04-25T06:48:44.600+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:48:44.604+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:48:46.181+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39810 #233 (53 connections now open) 2016-04-25T06:48:47.941+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39811 #234 (54 connections now open) 2016-04-25T06:48:47.941+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:48:48.716+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:48:49.844+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:48:50.507+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:48:52.158+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:48:54.362+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:48:55.081+0000 I COMMAND [conn231] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 12613ms 2016-04-25T06:48:55.179+0000 I COMMAND [conn233] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4165ms 2016-04-25T06:48:55.179+0000 I COMMAND [conn234] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2619ms 2016-04-25T06:48:59.311+0000 I NETWORK [conn231] end connection 127.0.0.1:39804 (53 connections now open) 2016-04-25T06:49:02.895+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:49:03.735+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:49:05.224+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:49:05.224+0000 I COMMAND [conn232] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 10560850 } } } protocol:op_command 22581ms 2016-04-25T06:49:08.101+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T06:49:09.810+0000 I COMMAND [conn233] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5163ms 2016-04-25T06:49:11.816+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39815 #235 (54 connections now open) 2016-04-25T06:49:12.989+0000 I NETWORK [conn232] end connection 127.0.0.1:39805 (52 connections now open) 2016-04-25T06:49:15.424+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:49:18.163+0000 I COMMAND [conn235] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2140ms 2016-04-25T06:49:20.144+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T06:49:20.144+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 205, after asserts: 205, after connections: 205, after extra_info: 675, after globalLock: 1145, after locks: 1335, after network: 1415, after opcounters: 1415, after opcountersRepl: 1415, after repl: 2605, after storageEngine: 3275, after tcmalloc: 3655, after wiredTiger: 5085, at end: 7175 } 2016-04-25T06:49:22.293+0000 I COMMAND [conn234] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 12928ms 2016-04-25T06:49:24.091+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T06:49:26.978+0000 I COMMAND [conn233] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5704ms 2016-04-25T06:49:26.978+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39817 #236 (54 connections now open) 2016-04-25T06:49:27.076+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:49:27.377+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:49:29.270+0000 I NETWORK [conn234] end connection 127.0.0.1:39811 (53 connections now open) 2016-04-25T06:49:32.548+0000 I COMMAND [conn236] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1966ms 2016-04-25T06:49:34.362+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39823 #237 (54 connections now open) 2016-04-25T06:49:37.809+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:49:40.173+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T06:49:40.078+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 180, after asserts: 360, after connections: 600, after extra_info: 1440, after globalLock: 1440, after locks: 1720, after network: 1820, after opcounters: 1820, after opcountersRepl: 1820, after repl: 2344, after storageEngine: 2344, after tcmalloc: 2344, after wiredTiger: 3614, at end: 6384 } 2016-04-25T06:49:40.276+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:49:42.594+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:49:42.683+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:49:43.255+0000 I COMMAND [conn237] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3964ms 2016-04-25T06:49:43.251+0000 I COMMAND [conn235] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 11641ms 2016-04-25T06:49:43.256+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:49:44.518+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:49:44.923+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:49:45.203+0000 I NETWORK [conn235] end connection 127.0.0.1:39815 (53 connections now open) 2016-04-25T06:49:45.518+0000 I NETWORK [conn214] end connection 127.0.0.1:39242 (53 connections now open) 2016-04-25T06:49:47.134+0000 I COMMAND [conn236] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 9032ms 2016-04-25T06:49:48.116+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39825 #238 (53 connections now open) 2016-04-25T06:49:49.027+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:49:49.977+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:49:50.309+0000 I NETWORK [conn236] end connection 127.0.0.1:39817 (52 connections now open) 2016-04-25T06:49:53.854+0000 I COMMAND [conn233] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 10653103 } } } protocol:op_command 22219ms 2016-04-25T06:49:54.262+0000 I COMMAND [conn237] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1846ms 2016-04-25T06:49:54.358+0000 I COMMAND [conn238] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1846ms 2016-04-25T06:49:54.759+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39827 #239 (53 connections now open) 2016-04-25T06:49:58.504+0000 I NETWORK [conn233] end connection 127.0.0.1:39810 (52 connections now open) 2016-04-25T06:49:58.504+0000 I NETWORK [conn238] end connection 127.0.0.1:39825 (52 connections now open) 2016-04-25T06:49:58.603+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T06:50:00.516+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:50:02.093+0000 I COMMAND [conn239] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3318ms 2016-04-25T06:50:03.355+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T06:50:05.416+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T06:50:05.515+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:50:06.828+0000 I COMMAND [conn237] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3108ms 2016-04-25T06:50:07.119+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39829 #240 (52 connections now open) 2016-04-25T06:50:07.938+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:50:11.244+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:50:11.540+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 410, after connections: 670, after extra_info: 1910, after globalLock: 2420, after locks: 2640, after network: 2730, after opcounters: 2730, after opcountersRepl: 2730, after repl: 6040, after storageEngine: 6591, after tcmalloc: 6591, after wiredTiger: 7591, at end: 10001 } 2016-04-25T06:50:15.447+0000 I COMMAND [conn240] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4111ms 2016-04-25T06:50:15.767+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:50:17.414+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:50:25.637+0000 I COMMAND [conn239] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 11919ms 2016-04-25T06:50:26.652+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:50:29.600+0000 I NETWORK [conn239] end connection 127.0.0.1:39827 (51 connections now open) 2016-04-25T06:50:30.196+0000 I COMMAND [conn240] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3298ms 2016-04-25T06:50:30.503+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:50:32.046+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39835 #241 (52 connections now open) 2016-04-25T06:50:32.137+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T06:50:33.598+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:50:34.243+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39836 #242 (53 connections now open) 2016-04-25T06:50:35.045+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:50:35.612+0000 I NETWORK [conn240] end connection 127.0.0.1:39829 (51 connections now open) 2016-04-25T06:50:35.701+0000 I COMMAND [conn237] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 25217ms 2016-04-25T06:50:37.106+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:50:38.149+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:50:38.160+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39838 #243 (53 connections now open) 2016-04-25T06:50:38.345+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:50:40.089+0000 I NETWORK [conn237] end connection 127.0.0.1:39823 (51 connections now open) 2016-04-25T06:50:40.532+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:50:43.153+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:50:43.679+0000 I COMMAND [conn241] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6953ms 2016-04-25T06:50:44.379+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:50:45.672+0000 I COMMAND [conn242] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6970ms 2016-04-25T06:50:45.672+0000 I COMMAND [conn243] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2584ms 2016-04-25T06:50:47.961+0000 I NETWORK [conn241] end connection 127.0.0.1:39835 (51 connections now open) 2016-04-25T06:50:48.049+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:50:51.144+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T06:50:52.019+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39843 #244 (52 connections now open) 2016-04-25T06:50:53.171+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 490, after connections: 680, after extra_info: 1610, after globalLock: 1710, after locks: 1900, after network: 1900, after opcounters: 1900, after opcountersRepl: 1900, after repl: 4530, after storageEngine: 5090, after tcmalloc: 5930, after wiredTiger: 7910, at end: 9121 } 2016-04-25T06:50:55.721+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:50:56.945+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:50:57.251+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:50:59.840+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:51:00.568+0000 I COMMAND [conn244] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3995ms 2016-04-25T06:51:01.155+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:51:01.155+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:51:03.789+0000 I COMMAND [conn243] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7459ms 2016-04-25T06:51:03.785+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:51:03.785+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:51:05.065+0000 I COMMAND [conn242] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 13668ms 2016-04-25T06:51:07.721+0000 I NETWORK [conn243] end connection 127.0.0.1:39838 (51 connections now open) 2016-04-25T06:51:07.721+0000 I NETWORK [conn242] end connection 127.0.0.1:39836 (51 connections now open) 2016-04-25T06:51:10.376+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:51:10.688+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39845 #245 (51 connections now open) 2016-04-25T06:51:13.325+0000 I COMMAND [conn244] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1545ms 2016-04-25T06:51:14.092+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T06:51:18.888+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T06:51:22.001+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 80, after locks: 80, after network: 180, after opcounters: 180, after opcountersRepl: 180, after repl: 5540, after storageEngine: 5550, after tcmalloc: 6040, after wiredTiger: 7150, at end: 9160 } 2016-04-25T06:51:24.256+0000 I COMMAND [conn245] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 8551ms 2016-04-25T06:51:24.257+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:51:25.803+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:51:28.108+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39847 #246 (52 connections now open) 2016-04-25T06:51:34.215+0000 I COMMAND [conn246] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1885ms 2016-04-25T06:51:34.228+0000 I COMMAND [conn245] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3198ms 2016-04-25T06:51:35.900+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:51:36.675+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:51:39.694+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T06:51:40.118+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T06:51:40.122+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:51:40.122+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:51:43.317+0000 I NETWORK [conn246] end connection 127.0.0.1:39847 (51 connections now open) 2016-04-25T06:51:44.348+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 310, after asserts: 310, after connections: 310, after extra_info: 950, after globalLock: 1340, after locks: 1550, after network: 1650, after opcounters: 1650, after opcountersRepl: 1650, after repl: 2540, after storageEngine: 2950, after tcmalloc: 3650, after wiredTiger: 4940, at end: 6840 } 2016-04-25T06:51:45.122+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:51:47.043+0000 I COMMAND [conn244] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 5920802 } } } protocol:op_command 17983ms 2016-04-25T06:51:47.538+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:51:49.532+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:51:50.163+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39851 #247 (52 connections now open) 2016-04-25T06:51:51.086+0000 I NETWORK [conn244] end connection 127.0.0.1:39843 (50 connections now open) 2016-04-25T06:51:52.173+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39852 #248 (53 connections now open) 2016-04-25T06:51:52.802+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T06:51:57.234+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 101ms 2016-04-25T06:51:57.234+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T06:51:57.825+0000 I COMMAND [conn247] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2597ms 2016-04-25T06:52:00.679+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:52:01.972+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:52:02.149+0000 I COMMAND [conn248] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6564ms 2016-04-25T06:52:03.804+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:52:04.655+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:52:04.657+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T06:52:04.924+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:52:12.401+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39858 #249 (53 connections now open) 2016-04-25T06:52:12.602+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 250, after asserts: 250, after connections: 850, after extra_info: 2140, after globalLock: 2380, after locks: 2700, after network: 2790, after opcounters: 2790, after opcountersRepl: 2790, after repl: 4390, after storageEngine: 4760, after tcmalloc: 5110, after wiredTiger: 5870, at end: 7233 } 2016-04-25T06:52:12.920+0000 I COMMAND [conn248] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2283ms 2016-04-25T06:52:12.922+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:52:13.522+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T06:52:16.344+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:52:18.449+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:52:19.572+0000 I COMMAND [conn245] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 1537483 } } } protocol:op_command 30171ms 2016-04-25T06:52:23.015+0000 I NETWORK [conn245] end connection 127.0.0.1:39845 (52 connections now open) 2016-04-25T06:52:26.441+0000 I COMMAND [conn249] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 10638ms 2016-04-25T06:52:26.441+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:52:29.510+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39860 #250 (53 connections now open) 2016-04-25T06:52:30.410+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T06:52:31.176+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T06:52:31.795+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:52:36.440+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:52:36.659+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:52:37.533+0000 I COMMAND [conn250] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2829ms 2016-04-25T06:52:38.620+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:52:40.060+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:52:40.799+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:52:41.760+0000 I COMMAND [conn247] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 19635484 } } } protocol:op_command 31654ms 2016-04-25T06:52:41.856+0000 I COMMAND [conn249] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6289ms 2016-04-25T06:52:41.862+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:52:45.329+0000 I COMMAND [conn7] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6108ms 2016-04-25T06:52:47.513+0000 I NETWORK [conn249] end connection 127.0.0.1:39858 (52 connections now open) 2016-04-25T06:52:47.610+0000 I COMMAND [conn19] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5076ms 2016-04-25T06:52:47.513+0000 I NETWORK [conn247] end connection 127.0.0.1:39851 (52 connections now open) 2016-04-25T06:52:48.710+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39863 #251 (54 connections now open) 2016-04-25T06:52:49.810+0000 I COMMAND [conn18] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 816ms 2016-04-25T06:52:50.108+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:52:52.504+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T06:52:54.450+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39867 #252 (53 connections now open) 2016-04-25T06:52:54.450+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T06:52:55.190+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:52:55.383+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:52:56.409+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 0, after locks: 0, after network: 0, after opcounters: 0, after opcountersRepl: 0, after repl: 730, after storageEngine: 1150, after tcmalloc: 1630, after wiredTiger: 3420, at end: 5174 } 2016-04-25T06:52:56.702+0000 I COMMAND [conn248] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 17023004 } } } protocol:op_command 29557ms 2016-04-25T06:52:57.773+0000 I COMMAND [conn10] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5538ms 2016-04-25T06:52:57.990+0000 I COMMAND [conn251] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5630ms 2016-04-25T06:52:58.082+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:52:59.467+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 109ms 2016-04-25T06:52:59.373+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:53:00.924+0000 I COMMAND [conn250] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7708ms 2016-04-25T06:53:02.063+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:53:02.653+0000 I NETWORK [conn250] end connection 127.0.0.1:39860 (52 connections now open) 2016-04-25T06:53:02.653+0000 I NETWORK [conn248] end connection 127.0.0.1:39852 (52 connections now open) 2016-04-25T06:53:02.653+0000 I COMMAND [conn252] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4318ms 2016-04-25T06:53:03.235+0000 I NETWORK [conn251] end connection 127.0.0.1:39863 (52 connections now open) 2016-04-25T06:53:04.158+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:53:10.224+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39870 #253 (51 connections now open) 2016-04-25T06:53:12.397+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39873 #254 (52 connections now open) 2016-04-25T06:53:12.691+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:53:15.412+0000 I COMMAND [conn252] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3984ms 2016-04-25T06:53:16.820+0000 I COMMAND [conn253] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1583ms 2016-04-25T06:53:18.052+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:53:19.027+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:53:19.647+0000 I COMMAND [conn254] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2270ms 2016-04-25T06:53:20.798+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 194, after asserts: 194, after connections: 194, after extra_info: 195, after globalLock: 195, after locks: 195, after network: 195, after opcounters: 195, after opcountersRepl: 195, after repl: 955, after storageEngine: 1455, after tcmalloc: 2045, after wiredTiger: 3415, at end: 6285 } 2016-04-25T06:53:22.203+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:53:23.353+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:53:25.564+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:53:27.261+0000 I NETWORK [conn253] end connection 127.0.0.1:39870 (51 connections now open) 2016-04-25T06:53:31.070+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39875 #255 (52 connections now open) 2016-04-25T06:53:34.256+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T06:53:35.528+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 780, after connections: 1070, after extra_info: 1690, after globalLock: 1920, after locks: 1930, after network: 2120, after opcounters: 2120, after opcountersRepl: 2120, after repl: 2410, after storageEngine: 2519, after tcmalloc: 2519, after wiredTiger: 3099, at end: 5039 } 2016-04-25T06:53:36.902+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:53:36.820+0000 I COMMAND [conn254] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1970ms 2016-04-25T06:53:37.303+0000 I COMMAND [conn255] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1574ms 2016-04-25T06:53:38.272+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:53:41.017+0000 I COMMAND [conn252] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 13457ms 2016-04-25T06:53:41.821+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T06:53:44.101+0000 I NETWORK [conn252] end connection 127.0.0.1:39867 (51 connections now open) 2016-04-25T06:53:48.636+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:53:51.209+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:53:52.696+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39880 #256 (52 connections now open) 2016-04-25T06:53:53.383+0000 I COMMAND [conn255] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3709ms 2016-04-25T06:53:53.380+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T06:53:53.770+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:53:55.142+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:53:55.734+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:53:56.020+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 370, after asserts: 370, after connections: 370, after extra_info: 1380, after globalLock: 1570, after locks: 1660, after network: 1750, after opcounters: 1750, after opcountersRepl: 1750, after repl: 2330, after storageEngine: 2800, after tcmalloc: 3370, after wiredTiger: 3985, at end: 5675 } 2016-04-25T06:53:56.779+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:53:58.480+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:53:58.890+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:53:58.890+0000 I COMMAND [conn254] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 105090 } } } protocol:op_command 12109ms 2016-04-25T06:54:02.097+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:54:03.996+0000 I COMMAND [conn256] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5672ms 2016-04-25T06:54:04.094+0000 I NETWORK [conn254] end connection 127.0.0.1:39873 (51 connections now open) 2016-04-25T06:54:05.739+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39882 #257 (53 connections now open) 2016-04-25T06:54:10.604+0000 I COMMAND [conn257] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 721ms 2016-04-25T06:54:14.049+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T06:54:14.731+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 180, after connections: 550, after extra_info: 1190, after globalLock: 1580, after locks: 1670, after network: 1760, after opcounters: 1770, after opcountersRepl: 1770, after repl: 2590, after storageEngine: 2970, after tcmalloc: 4000, after wiredTiger: 4970, at end: 7210 } 2016-04-25T06:54:16.034+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:54:16.934+0000 I NETWORK [conn3] end connection 127.0.0.1:56282 (51 connections now open) 2016-04-25T06:54:17.423+0000 I NETWORK [conn257] end connection 127.0.0.1:39882 (51 connections now open) 2016-04-25T06:54:17.612+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:54:17.800+0000 I COMMAND [conn255] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 16832ms 2016-04-25T06:54:17.896+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:54:19.546+0000 I COMMAND [conn256] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5408ms 2016-04-25T06:54:20.548+0000 I NETWORK [conn255] end connection 127.0.0.1:39875 (49 connections now open) 2016-04-25T06:54:20.929+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:54:21.111+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39886 #258 (51 connections now open) 2016-04-25T06:54:23.246+0000 I NETWORK [conn256] end connection 127.0.0.1:39880 (48 connections now open) 2016-04-25T06:54:25.277+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39887 #259 (51 connections now open) 2016-04-25T06:54:26.400+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39888 #260 (51 connections now open) 2016-04-25T06:54:27.112+0000 I COMMAND [conn258] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1531ms 2016-04-25T06:54:28.839+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:54:29.585+0000 I COMMAND [conn259] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1278ms 2016-04-25T06:54:29.680+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T06:54:29.680+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T06:54:29.680+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:54:29.680+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:54:31.032+0000 I NETWORK [conn258] end connection 127.0.0.1:39886 (50 connections now open) 2016-04-25T06:54:31.032+0000 I COMMAND [conn260] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1098ms 2016-04-25T06:54:32.273+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:54:32.277+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T06:54:34.086+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 560, after globalLock: 960, after locks: 1160, after network: 1260, after opcounters: 1260, after opcountersRepl: 1260, after repl: 2370, after storageEngine: 2610, after tcmalloc: 3540, after wiredTiger: 4450, at end: 5960 } 2016-04-25T06:54:34.088+0000 I COMMAND [conn259] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3197ms 2016-04-25T06:54:34.762+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:54:36.736+0000 I NETWORK [conn259] end connection 127.0.0.1:39887 (49 connections now open) 2016-04-25T06:54:36.736+0000 I NETWORK [conn260] end connection 127.0.0.1:39888 (49 connections now open) 2016-04-25T06:54:40.849+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:54:42.077+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39895 #261 (49 connections now open) 2016-04-25T06:54:44.337+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39897 #262 (50 connections now open) 2016-04-25T06:54:48.050+0000 I COMMAND [conn261] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1805ms 2016-04-25T06:54:48.067+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:54:50.783+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:54:50.785+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:54:50.783+0000 I COMMAND [conn262] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1266ms 2016-04-25T06:54:52.008+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 360, after asserts: 640, after connections: 730, after extra_info: 1410, after globalLock: 1410, after locks: 1410, after network: 1410, after opcounters: 1410, after opcountersRepl: 1410, after repl: 2640, after storageEngine: 2850, after tcmalloc: 3030, after wiredTiger: 4050, at end: 4870 } 2016-04-25T06:54:52.411+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:54:53.954+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:54:57.871+0000 I COMMAND [conn262] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6509ms 2016-04-25T06:55:01.184+0000 I NETWORK [conn262] end connection 127.0.0.1:39897 (49 connections now open) 2016-04-25T06:55:01.683+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 193ms 2016-04-25T06:55:01.879+0000 I COMMAND [conn261] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2981ms 2016-04-25T06:55:05.106+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:55:05.388+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39902 #263 (50 connections now open) 2016-04-25T06:55:05.985+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:55:07.093+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:55:09.517+0000 I COMMAND [conn263] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1199ms 2016-04-25T06:55:10.003+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:55:11.174+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T06:55:13.591+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 180, after asserts: 400, after connections: 790, after extra_info: 1390, after globalLock: 1690, after locks: 1970, after network: 2170, after opcounters: 2170, after opcountersRepl: 2170, after repl: 2750, after storageEngine: 3240, after tcmalloc: 3850, after wiredTiger: 5010, at end: 7000 } 2016-04-25T06:55:16.035+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:55:16.357+0000 I NETWORK [conn263] end connection 127.0.0.1:39902 (49 connections now open) 2016-04-25T06:55:17.608+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39905 #264 (50 connections now open) 2016-04-25T06:55:18.784+0000 I COMMAND [conn261] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4506ms 2016-04-25T06:55:21.884+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39908 #265 (51 connections now open) 2016-04-25T06:55:23.220+0000 I COMMAND [conn264] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1100ms 2016-04-25T06:55:26.080+0000 I NETWORK [conn9] end connection 127.0.0.1:56292 (50 connections now open) 2016-04-25T06:55:26.080+0000 I NETWORK [conn8] end connection 127.0.0.1:56291 (50 connections now open) 2016-04-25T06:55:26.087+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:55:27.241+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:55:27.239+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:55:28.876+0000 I COMMAND [conn265] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2237ms 2016-04-25T06:55:29.459+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:55:31.559+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:55:34.633+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 210, after asserts: 570, after connections: 870, after extra_info: 1480, after globalLock: 1780, after locks: 2200, after network: 2400, after opcounters: 2400, after opcountersRepl: 2400, after repl: 4300, after storageEngine: 4900, after tcmalloc: 5710, after wiredTiger: 7030, at end: 9110 } 2016-04-25T06:55:34.826+0000 I COMMAND [conn261] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 369280 } } } protocol:op_command 11004ms 2016-04-25T06:55:34.832+0000 I COMMAND [conn264] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3570ms 2016-04-25T06:55:38.367+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:55:41.195+0000 I NETWORK [conn261] end connection 127.0.0.1:39895 (48 connections now open) 2016-04-25T06:55:41.189+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T06:55:43.536+0000 I COMMAND [conn265] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3649ms 2016-04-25T06:55:46.238+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:55:48.121+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:55:48.549+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39914 #266 (49 connections now open) 2016-04-25T06:55:49.922+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:55:50.621+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 100, after asserts: 200, after connections: 300, after extra_info: 930, after globalLock: 1430, after locks: 1730, after network: 1830, after opcounters: 1830, after opcountersRepl: 1830, after repl: 2530, after storageEngine: 3150, after tcmalloc: 4140, after wiredTiger: 4809, at end: 6719 } 2016-04-25T06:55:50.621+0000 I NETWORK [conn16] end connection 127.0.0.1:56301 (48 connections now open) 2016-04-25T06:55:51.367+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:55:54.437+0000 I COMMAND [conn264] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 12833ms 2016-04-25T06:55:54.937+0000 I COMMAND [conn266] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2468ms 2016-04-25T06:55:57.952+0000 I COMMAND [conn265] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2705ms 2016-04-25T06:55:58.676+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39919 #267 (49 connections now open) 2016-04-25T06:56:00.396+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:56:00.496+0000 I NETWORK [conn264] end connection 127.0.0.1:39905 (47 connections now open) 2016-04-25T06:56:03.207+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:56:03.811+0000 I COMMAND [conn266] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3427ms 2016-04-25T06:56:05.822+0000 I COMMAND [conn267] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1603ms 2016-04-25T06:56:06.507+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:56:07.494+0000 I NETWORK [conn266] end connection 127.0.0.1:39914 (47 connections now open) 2016-04-25T06:56:07.485+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:56:08.959+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T06:56:09.255+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:56:09.936+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:56:10.465+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:56:12.029+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39922 #268 (48 connections now open) 2016-04-25T06:56:12.456+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:56:13.410+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:56:14.531+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 590, after connections: 790, after extra_info: 1780, after globalLock: 2050, after locks: 2370, after network: 2950, after opcounters: 3070, after opcountersRepl: 3070, after repl: 4870, after storageEngine: 5550, after tcmalloc: 6250, after wiredTiger: 7470, at end: 7960 } 2016-04-25T06:56:16.207+0000 I COMMAND [conn265] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 13160ms 2016-04-25T06:56:17.088+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T06:56:19.885+0000 I NETWORK [conn265] end connection 127.0.0.1:39908 (47 connections now open) 2016-04-25T06:56:21.573+0000 I COMMAND [conn267] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6176ms 2016-04-25T06:56:21.764+0000 I COMMAND [conn268] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5241ms 2016-04-25T06:56:22.702+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:56:23.352+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39926 #269 (48 connections now open) 2016-04-25T06:56:23.656+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:56:23.656+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:56:26.333+0000 I REPL [ReplicationExecutor] dry election run succeeded, running for election 2016-04-25T06:56:26.920+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:56:28.170+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T06:56:30.003+0000 I COMMAND [conn268] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1213ms 2016-04-25T06:56:31.364+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39928 #270 (49 connections now open) 2016-04-25T06:56:31.957+0000 I COMMAND [conn267] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 709285 } } } protocol:op_command 8014ms 2016-04-25T06:56:32.468+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T06:56:33.602+0000 I NETWORK [conn267] end connection 127.0.0.1:39919 (48 connections now open) 2016-04-25T06:56:33.901+0000 I COMMAND [conn269] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 41 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1140ms 2016-04-25T06:56:34.650+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 460, after asserts: 730, after connections: 830, after extra_info: 1310, after globalLock: 1310, after locks: 1310, after network: 1310, after opcounters: 1310, after opcountersRepl: 1310, after repl: 4150, after storageEngine: 4150, after tcmalloc: 4710, after wiredTiger: 5206, at end: 7506 } 2016-04-25T06:56:34.949+0000 I COMMAND [conn268] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 41, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:98 locks:{} protocol:op_command 1334ms 2016-04-25T06:56:36.431+0000 I COMMAND [conn270] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 910ms 2016-04-25T06:56:38.534+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:56:45.110+0000 I COMMAND [conn270] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2133ms 2016-04-25T06:56:45.110+0000 I COMMAND [conn269] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2133ms 2016-04-25T06:56:47.235+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:56:50.246+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:56:50.551+0000 I NETWORK [conn4] end connection 127.0.0.1:56283 (47 connections now open) 2016-04-25T06:56:52.846+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:56:53.976+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T06:56:55.492+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:56:57.425+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:56:57.806+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39935 #271 (48 connections now open) 2016-04-25T06:56:58.414+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 770, after asserts: 790, after connections: 990, after extra_info: 1810, after globalLock: 2180, after locks: 2520, after network: 2810, after opcounters: 2820, after opcountersRepl: 2820, after repl: 5900, after storageEngine: 6420, after tcmalloc: 7140, after wiredTiger: 8450, at end: 10346 } 2016-04-25T06:56:58.613+0000 I REPL [ReplicationExecutor] not becoming primary, we received insufficient votes 2016-04-25T06:57:00.196+0000 I COMMAND [conn270] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1984ms 2016-04-25T06:57:02.834+0000 I COMMAND [conn271] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1571ms 2016-04-25T06:57:03.132+0000 I COMMAND [conn268] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 932740 } } } protocol:op_command 14546ms 2016-04-25T06:57:04.182+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:57:05.083+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:57:05.724+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:57:06.190+0000 I NETWORK [conn268] end connection 127.0.0.1:39922 (47 connections now open) 2016-04-25T06:57:09.461+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39937 #272 (48 connections now open) 2016-04-25T06:57:11.012+0000 I NETWORK [conn271] end connection 127.0.0.1:39935 (47 connections now open) 2016-04-25T06:57:11.198+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:57:13.185+0000 I COMMAND [conn270] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4725ms 2016-04-25T06:57:13.926+0000 I COMMAND [conn269] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 9439724 } } } protocol:op_command 22334ms 2016-04-25T06:57:14.456+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39942 #273 (48 connections now open) 2016-04-25T06:57:15.813+0000 I COMMAND [conn272] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2035ms 2016-04-25T06:57:16.410+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:57:17.240+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:57:19.766+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:57:19.664+0000 I NETWORK [conn269] end connection 127.0.0.1:39926 (47 connections now open) 2016-04-25T06:57:21.229+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T06:57:22.523+0000 I COMMAND [conn273] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3159ms 2016-04-25T06:57:22.669+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:57:26.865+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:57:27.233+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:57:27.324+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 480, after connections: 930, after extra_info: 2220, after globalLock: 2460, after locks: 2810, after network: 2900, after opcounters: 2900, after opcountersRepl: 2900, after repl: 3570, after storageEngine: 4050, after tcmalloc: 4600, after wiredTiger: 5960, at end: 7660 } 2016-04-25T06:57:27.513+0000 I COMMAND [conn272] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2607ms 2016-04-25T06:57:28.389+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:57:28.838+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:57:30.885+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:57:30.898+0000 I COMMAND [conn270] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 13255ms 2016-04-25T06:57:32.676+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39946 #274 (48 connections now open) 2016-04-25T06:57:33.663+0000 I NETWORK [conn272] end connection 127.0.0.1:39937 (46 connections now open) 2016-04-25T06:57:35.323+0000 I NETWORK [conn270] end connection 127.0.0.1:39928 (47 connections now open) 2016-04-25T06:57:35.414+0000 I COMMAND [conn273] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1763ms 2016-04-25T06:57:37.930+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:57:38.033+0000 I COMMAND [conn274] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1795ms 2016-04-25T06:57:42.044+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T06:57:45.074+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T06:57:45.164+0000 I NETWORK [conn274] end connection 127.0.0.1:39946 (45 connections now open) 2016-04-25T06:57:48.926+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:57:49.405+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 670, after connections: 840, after extra_info: 1680, after globalLock: 2030, after locks: 2390, after network: 2850, after opcounters: 2950, after opcountersRepl: 2950, after repl: 6060, after storageEngine: 6810, after tcmalloc: 7830, after wiredTiger: 8840, at end: 10850 } 2016-04-25T06:57:49.774+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39949 #275 (46 connections now open) 2016-04-25T06:57:49.780+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:57:55.190+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39952 #276 (47 connections now open) 2016-04-25T06:57:56.447+0000 I COMMAND [conn275] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3123ms 2016-04-25T06:58:00.472+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:58:00.960+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:58:03.507+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T06:58:03.507+0000 I COMMAND [conn276] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3299ms 2016-04-25T06:58:04.580+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:58:04.758+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T06:58:05.903+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:58:08.575+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:58:09.684+0000 I COMMAND [conn273] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 4736580 } } } protocol:op_command 19997ms 2016-04-25T06:58:11.322+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:58:11.681+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 550, after asserts: 560, after connections: 740, after extra_info: 1170, after globalLock: 1450, after locks: 1540, after network: 1720, after opcounters: 1730, after opcountersRepl: 1730, after repl: 6520, after storageEngine: 6860, after tcmalloc: 7700, after wiredTiger: 8490, at end: 10000 } 2016-04-25T06:58:12.427+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:58:15.685+0000 I NETWORK [conn273] end connection 127.0.0.1:39942 (46 connections now open) 2016-04-25T06:58:20.793+0000 I COMMAND [conn275] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6434ms 2016-04-25T06:58:22.327+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:58:26.093+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:58:26.768+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:58:29.136+0000 I NETWORK [conn275] end connection 127.0.0.1:39949 (45 connections now open) 2016-04-25T06:58:29.136+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T06:58:29.882+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:58:29.882+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:58:30.784+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39959 #277 (46 connections now open) 2016-04-25T06:58:30.982+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T06:58:33.437+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:58:35.106+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:58:36.200+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 400, after connections: 500, after extra_info: 830, after globalLock: 1120, after locks: 1600, after network: 1710, after opcounters: 1710, after opcountersRepl: 1710, after repl: 3320, after storageEngine: 3425, after tcmalloc: 4105, after wiredTiger: 5685, at end: 8005 } 2016-04-25T06:58:37.843+0000 I COMMAND [conn276] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 4311866 } } } protocol:op_command 17964ms 2016-04-25T06:58:39.227+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:58:39.825+0000 I COMMAND [conn277] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7048ms 2016-04-25T06:58:41.057+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:58:42.856+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39961 #278 (47 connections now open) 2016-04-25T06:58:44.002+0000 I NETWORK [conn276] end connection 127.0.0.1:39952 (45 connections now open) 2016-04-25T06:58:44.002+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:58:46.303+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39963 #279 (48 connections now open) 2016-04-25T06:58:48.771+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T06:58:50.467+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T06:58:51.767+0000 I COMMAND [conn278] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2744ms 2016-04-25T06:58:52.202+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:58:55.482+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:58:55.942+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:58:56.130+0000 I COMMAND [conn279] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5251ms 2016-04-25T06:58:57.522+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T06:58:58.942+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:59:00.695+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 280, after connections: 280, after extra_info: 1070, after globalLock: 1390, after locks: 1690, after network: 1890, after opcounters: 1890, after opcountersRepl: 1890, after repl: 5600, after storageEngine: 6300, after tcmalloc: 7010, after wiredTiger: 8600, at end: 10990 } 2016-04-25T06:59:01.630+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:59:02.470+0000 I COMMAND [conn278] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3533ms 2016-04-25T06:59:02.894+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39966 #280 (48 connections now open) 2016-04-25T06:59:07.869+0000 I COMMAND [conn277] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 18679ms 2016-04-25T06:59:08.271+0000 I COMMAND [conn280] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1063ms 2016-04-25T06:59:08.271+0000 I NETWORK [conn278] end connection 127.0.0.1:39961 (47 connections now open) 2016-04-25T06:59:08.871+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39968 #281 (49 connections now open) 2016-04-25T06:59:09.863+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:59:11.619+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T06:59:12.883+0000 I NETWORK [conn277] end connection 127.0.0.1:39959 (47 connections now open) 2016-04-25T06:59:14.880+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T06:59:17.502+0000 I NETWORK [conn280] end connection 127.0.0.1:39966 (46 connections now open) 2016-04-25T06:59:18.319+0000 I COMMAND [conn281] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5354ms 2016-04-25T06:59:20.407+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:59:21.132+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 300, after connections: 300, after extra_info: 930, after globalLock: 1210, after locks: 1350, after network: 1810, after opcounters: 2120, after opcountersRepl: 2120, after repl: 3320, after storageEngine: 3800, after tcmalloc: 4010, after wiredTiger: 4980, at end: 7200 } 2016-04-25T06:59:21.581+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:59:24.259+0000 I COMMAND [conn279] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 4003186 } } } protocol:op_command 16765ms 2016-04-25T06:59:27.445+0000 I NETWORK [conn279] end connection 127.0.0.1:39963 (45 connections now open) 2016-04-25T06:59:27.917+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39971 #282 (47 connections now open) 2016-04-25T06:59:29.457+0000 I COMMAND [conn281] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1718ms 2016-04-25T06:59:30.690+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T06:59:33.460+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:59:34.279+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:59:36.523+0000 I COMMAND [conn282] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3897ms 2016-04-25T06:59:37.108+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:59:37.209+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T06:59:38.664+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T06:59:38.867+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:59:41.095+0000 I COMMAND [conn281] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1069ms 2016-04-25T06:59:41.095+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 360, after asserts: 540, after connections: 980, after extra_info: 1770, after globalLock: 2160, after locks: 2540, after network: 2690, after opcounters: 2690, after opcountersRepl: 2690, after repl: 5030, after storageEngine: 5320, after tcmalloc: 5430, after wiredTiger: 6130, at end: 7720 } 2016-04-25T06:59:43.423+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:59:44.206+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T06:59:45.348+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T06:59:48.481+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T06:59:50.292+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39979 #283 (47 connections now open) 2016-04-25T06:59:55.009+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T06:59:55.635+0000 I COMMAND [conn283] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1153ms 2016-04-25T06:59:56.444+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T06:59:57.651+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 90, after locks: 90, after network: 90, after opcounters: 90, after opcountersRepl: 90, after repl: 1090, after storageEngine: 1680, after tcmalloc: 2510, after wiredTiger: 3930, at end: 5470 } 2016-04-25T06:59:58.239+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T06:59:58.340+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T06:59:58.632+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T06:59:59.874+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:00:00.930+0000 I COMMAND [conn281] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 16833ms 2016-04-25T07:00:02.473+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:00:02.384+0000 I COMMAND [conn283] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3563ms 2016-04-25T07:00:04.487+0000 I NETWORK [conn281] end connection 127.0.0.1:39968 (46 connections now open) 2016-04-25T07:00:05.010+0000 I NETWORK [conn283] end connection 127.0.0.1:39979 (46 connections now open) 2016-04-25T07:00:05.010+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:00:05.149+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:00:07.075+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:00:08.633+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39985 #284 (46 connections now open) 2016-04-25T07:00:12.405+0000 I COMMAND [conn282] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 8495587 } } } protocol:op_command 22461ms 2016-04-25T07:00:12.607+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39987 #285 (47 connections now open) 2016-04-25T07:00:14.014+0000 I COMMAND [conn284] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1700ms 2016-04-25T07:00:17.596+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:00:17.593+0000 I NETWORK [conn282] end connection 127.0.0.1:39971 (46 connections now open) 2016-04-25T07:00:18.418+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:00:19.179+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:00:19.859+0000 I COMMAND [conn285] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1869ms 2016-04-25T07:00:20.539+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:00:23.372+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:00:29.535+0000 I COMMAND [conn284] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2059ms 2016-04-25T07:00:29.535+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:00:30.681+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 630, after connections: 870, after extra_info: 1430, after globalLock: 1720, after locks: 1820, after network: 1820, after opcounters: 1820, after opcountersRepl: 1820, after repl: 7410, after storageEngine: 7800, after tcmalloc: 8470, after wiredTiger: 9570, at end: 11910 } 2016-04-25T07:00:31.864+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:00:35.121+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:00:37.822+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:00:38.229+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:00:40.159+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:00:42.159+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:00:42.259+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:00:44.147+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:00:44.824+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39995 #286 (47 connections now open) 2016-04-25T07:00:45.518+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:00:48.689+0000 I COMMAND [conn285] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 4521304 } } } protocol:op_command 15482ms 2016-04-25T07:00:48.688+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 590, after asserts: 600, after connections: 790, after extra_info: 890, after globalLock: 890, after locks: 890, after network: 890, after opcounters: 890, after opcountersRepl: 890, after repl: 3630, after storageEngine: 3923, after tcmalloc: 3923, after wiredTiger: 4203, at end: 5963 } 2016-04-25T07:00:50.485+0000 I COMMAND [conn286] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1005ms 2016-04-25T07:00:54.345+0000 I NETWORK [conn285] end connection 127.0.0.1:39987 (46 connections now open) 2016-04-25T07:00:55.074+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:00:56.456+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39998 #287 (47 connections now open) 2016-04-25T07:00:58.153+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:00:58.615+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:00:58.701+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:01:01.364+0000 I COMMAND [conn284] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 185034 } } } protocol:op_command 16579ms 2016-04-25T07:01:01.658+0000 I NETWORK [conn286] end connection 127.0.0.1:39995 (46 connections now open) 2016-04-25T07:01:02.289+0000 I COMMAND [conn287] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2564ms 2016-04-25T07:01:02.385+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:01:06.118+0000 I NETWORK [conn284] end connection 127.0.0.1:39985 (45 connections now open) 2016-04-25T07:01:08.467+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40003 #288 (46 connections now open) 2016-04-25T07:01:08.684+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:01:10.687+0000 I NETWORK [conn287] end connection 127.0.0.1:39998 (45 connections now open) 2016-04-25T07:01:12.609+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:01:13.413+0000 I COMMAND [conn288] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1521ms 2016-04-25T07:01:14.040+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:01:14.040+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:01:15.208+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:01:15.648+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:01:16.857+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 190, after asserts: 520, after connections: 616, after extra_info: 1506, after globalLock: 1876, after locks: 2056, after network: 2066, after opcounters: 2066, after opcountersRepl: 2066, after repl: 3546, after storageEngine: 4036, after tcmalloc: 4676, after wiredTiger: 6276, at end: 8476 } 2016-04-25T07:01:17.455+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:01:19.988+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:01:20.256+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40005 #289 (46 connections now open) 2016-04-25T07:01:20.703+0000 I NETWORK [conn288] end connection 127.0.0.1:40003 (44 connections now open) 2016-04-25T07:01:22.105+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:01:23.410+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:01:26.834+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40007 #290 (46 connections now open) 2016-04-25T07:01:26.846+0000 I COMMAND [conn289] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3640ms 2016-04-25T07:01:31.412+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:01:31.504+0000 I COMMAND [conn290] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1765ms 2016-04-25T07:01:33.872+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:01:36.762+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:01:37.994+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:01:38.139+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 310, after asserts: 490, after connections: 580, after extra_info: 1380, after globalLock: 1740, after locks: 1960, after network: 2150, after opcounters: 2150, after opcountersRepl: 2150, after repl: 3270, after storageEngine: 3900, after tcmalloc: 5250, after wiredTiger: 6450, at end: 8250 } 2016-04-25T07:01:38.699+0000 I COMMAND [conn289] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 906676 } } } protocol:op_command 11202ms 2016-04-25T07:01:39.334+0000 I NETWORK [conn290] end connection 127.0.0.1:40007 (45 connections now open) 2016-04-25T07:01:42.469+0000 I NETWORK [conn289] end connection 127.0.0.1:40005 (44 connections now open) 2016-04-25T07:01:42.970+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40010 #291 (46 connections now open) 2016-04-25T07:01:46.358+0000 I COMMAND [conn17] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2290ms 2016-04-25T07:01:46.550+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40014 #292 (46 connections now open) 2016-04-25T07:01:47.479+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:01:51.158+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:01:51.904+0000 I COMMAND [conn291] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4506ms 2016-04-25T07:01:53.096+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:01:53.394+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:01:54.524+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:01:54.926+0000 I COMMAND [conn292] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3909ms 2016-04-25T07:01:55.948+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:01:56.645+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:01:59.991+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:02:02.845+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:02:03.909+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 220, after asserts: 710, after connections: 1040, after extra_info: 1850, after globalLock: 2150, after locks: 2250, after network: 2340, after opcounters: 2340, after opcountersRepl: 2340, after repl: 7170, after storageEngine: 7660, after tcmalloc: 8390, after wiredTiger: 9530, at end: 11280 } 2016-04-25T07:02:10.345+0000 I COMMAND [conn292] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4009ms 2016-04-25T07:02:12.707+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:02:13.234+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40018 #293 (47 connections now open) 2016-04-25T07:02:15.556+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:02:19.927+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:02:20.126+0000 I COMMAND [conn291] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 13896ms 2016-04-25T07:02:21.201+0000 I NETWORK [conn292] end connection 127.0.0.1:40014 (46 connections now open) 2016-04-25T07:02:22.699+0000 I COMMAND [conn293] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3573ms 2016-04-25T07:02:23.933+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:02:25.675+0000 I NETWORK [conn291] end connection 127.0.0.1:40010 (45 connections now open) 2016-04-25T07:02:25.703+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:02:32.691+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40021 #294 (46 connections now open) 2016-04-25T07:02:32.691+0000 I COMMAND [conn293] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2560ms 2016-04-25T07:02:32.889+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:02:34.158+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:02:35.702+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 660, after connections: 770, after extra_info: 1400, after globalLock: 1820, after locks: 1830, after network: 1920, after opcounters: 1920, after opcountersRepl: 1920, after repl: 3090, after storageEngine: 3470, after tcmalloc: 3671, after wiredTiger: 4661, at end: 6071 } 2016-04-25T07:02:37.010+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40025 #295 (47 connections now open) 2016-04-25T07:02:37.993+0000 I COMMAND [conn294] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1705ms 2016-04-25T07:02:38.904+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:02:38.905+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:02:41.566+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:02:41.566+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:02:41.577+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:02:41.577+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:02:43.587+0000 I COMMAND [conn295] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2282ms 2016-04-25T07:02:45.153+0000 I NETWORK [conn294] end connection 127.0.0.1:40021 (46 connections now open) 2016-04-25T07:02:45.479+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:02:47.456+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:02:52.659+0000 I COMMAND [conn293] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 4370624 } } } protocol:op_command 16624ms 2016-04-25T07:02:52.664+0000 I COMMAND [conn295] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4673ms 2016-04-25T07:02:55.233+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40027 #296 (47 connections now open) 2016-04-25T07:02:56.711+0000 I NETWORK [conn293] end connection 127.0.0.1:40018 (45 connections now open) 2016-04-25T07:02:56.715+0000 I NETWORK [conn295] end connection 127.0.0.1:40025 (45 connections now open) 2016-04-25T07:02:57.112+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:02:57.732+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:03:02.136+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40028 #297 (46 connections now open) 2016-04-25T07:03:03.944+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:03:04.322+0000 I COMMAND [conn296] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4860ms 2016-04-25T07:03:05.160+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 101ms 2016-04-25T07:03:07.513+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:03:08.602+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 770, after asserts: 860, after connections: 1050, after extra_info: 1780, after globalLock: 2170, after locks: 2560, after network: 2650, after opcounters: 2650, after opcountersRepl: 2650, after repl: 2851, after storageEngine: 3411, after tcmalloc: 3901, after wiredTiger: 6421, at end: 7521 } 2016-04-25T07:03:09.073+0000 I COMMAND [conn297] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2586ms 2016-04-25T07:03:12.147+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:03:13.754+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:03:15.399+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:03:16.659+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:03:18.724+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:03:19.987+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:03:22.608+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:03:23.010+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:03:26.223+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:03:26.228+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:03:30.925+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:03:31.027+0000 I COMMAND [conn297] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 11138ms 2016-04-25T07:03:34.579+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 500, after asserts: 830, after connections: 1010, after extra_info: 1620, after globalLock: 1870, after locks: 2190, after network: 2690, after opcounters: 3130, after opcountersRepl: 3240, after repl: 8620, after storageEngine: 9200, after tcmalloc: 10290, after wiredTiger: 11720, at end: 13910 } 2016-04-25T07:03:34.915+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:03:37.373+0000 I NETWORK [conn297] end connection 127.0.0.1:40028 (45 connections now open) 2016-04-25T07:03:37.373+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:03:38.862+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40036 #298 (47 connections now open) 2016-04-25T07:03:39.591+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:03:41.898+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:03:43.196+0000 I COMMAND [conn296] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 23026ms 2016-04-25T07:03:43.494+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:03:46.744+0000 I NETWORK [conn296] end connection 127.0.0.1:40027 (45 connections now open) 2016-04-25T07:03:46.744+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40037 #299 (47 connections now open) 2016-04-25T07:03:46.744+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:03:47.640+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:03:48.629+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:03:49.782+0000 I COMMAND [conn298] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6727ms 2016-04-25T07:03:53.854+0000 I COMMAND [conn299] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1721ms 2016-04-25T07:03:58.853+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:04:00.538+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 190, after asserts: 520, after connections: 950, after extra_info: 1990, after globalLock: 2510, after locks: 2690, after network: 2980, after opcounters: 2980, after opcountersRepl: 2980, after repl: 4290, after storageEngine: 5050, after tcmalloc: 6040, after wiredTiger: 7230, at end: 10320 } 2016-04-25T07:04:01.975+0000 I COMMAND [conn298] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4650ms 2016-04-25T07:04:02.558+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:04:08.186+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:04:11.849+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:04:13.247+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:04:19.435+0000 I COMMAND [conn298] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3253ms 2016-04-25T07:04:21.761+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:04:22.973+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40045 #300 (47 connections now open) 2016-04-25T07:04:23.557+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 430, after asserts: 620, after connections: 900, after extra_info: 1830, after globalLock: 2030, after locks: 2030, after network: 2120, after opcounters: 2120, after opcountersRepl: 2120, after repl: 3020, after storageEngine: 3750, after tcmalloc: 3950, after wiredTiger: 5300, at end: 6303 } 2016-04-25T07:04:23.885+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:04:25.223+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:04:27.999+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:04:30.773+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:04:31.274+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:04:32.311+0000 I COMMAND [conn299] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 507022 } } } protocol:op_command 18781ms 2016-04-25T07:04:32.871+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:04:34.979+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:04:36.342+0000 I COMMAND [conn300] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7471ms 2016-04-25T07:04:37.817+0000 I NETWORK [conn299] end connection 127.0.0.1:40037 (46 connections now open) 2016-04-25T07:04:38.825+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:04:40.198+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:04:41.318+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:04:42.008+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40047 #301 (47 connections now open) 2016-04-25T07:04:45.525+0000 I COMMAND [conn298] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 6040677 } } } protocol:op_command 21762ms 2016-04-25T07:04:49.756+0000 I COMMAND [conn301] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1579ms 2016-04-25T07:04:50.171+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:04:51.601+0000 I NETWORK [conn298] end connection 127.0.0.1:40036 (46 connections now open) 2016-04-25T07:04:52.745+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:04:54.249+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40049 #302 (47 connections now open) 2016-04-25T07:04:55.027+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:05:01.849+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:05:01.961+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 200, after asserts: 300, after connections: 490, after extra_info: 1460, after globalLock: 1607, after locks: 1607, after network: 1607, after opcounters: 1607, after opcountersRepl: 1607, after repl: 2457, after storageEngine: 3167, after tcmalloc: 3557, after wiredTiger: 5067, at end: 7097 } 2016-04-25T07:05:02.293+0000 I COMMAND [conn302] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1527ms 2016-04-25T07:05:03.108+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:05:03.965+0000 I COMMAND [conn300] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 6661714 } } } protocol:op_command 19272ms 2016-04-25T07:05:11.714+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:05:12.191+0000 I NETWORK [conn300] end connection 127.0.0.1:40045 (46 connections now open) 2016-04-25T07:05:12.469+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:05:13.513+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:05:16.190+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:05:17.534+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:05:17.539+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40054 #303 (47 connections now open) 2016-04-25T07:05:18.477+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:05:20.902+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:05:23.971+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:05:25.264+0000 I COMMAND [conn302] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 11992ms 2016-04-25T07:05:25.257+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:05:26.786+0000 I COMMAND [conn303] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3078ms 2016-04-25T07:05:28.084+0000 I NETWORK [conn7] end connection 127.0.0.1:56289 (46 connections now open) 2016-04-25T07:05:28.424+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:05:30.128+0000 I NETWORK [conn302] end connection 127.0.0.1:40049 (45 connections now open) 2016-04-25T07:05:30.128+0000 I NETWORK [conn19] end connection 127.0.0.1:56307 (45 connections now open) 2016-04-25T07:05:30.128+0000 I COMMAND [conn301] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 4190715 } } } protocol:op_command 26137ms 2016-04-25T07:05:30.128+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40056 #304 (47 connections now open) 2016-04-25T07:05:31.263+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:05:32.001+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2, after asserts: 2, after connections: 2, after extra_info: 92, after globalLock: 292, after locks: 592, after network: 772, after opcounters: 772, after opcountersRepl: 772, after repl: 4202, after storageEngine: 4842, after tcmalloc: 5972, after wiredTiger: 8022, at end: 9595 } 2016-04-25T07:05:36.013+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:05:38.377+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:05:38.573+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:05:38.778+0000 I NETWORK [conn301] end connection 127.0.0.1:40047 (44 connections now open) 2016-04-25T07:05:39.081+0000 I COMMAND [conn304] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3732ms 2016-04-25T07:05:41.101+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:05:43.560+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:05:43.777+0000 I COMMAND [conn303] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4028ms 2016-04-25T07:05:44.091+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:05:44.093+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:05:50.012+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:05:52.713+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:05:54.139+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:05:56.105+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:06:01.542+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:06:02.190+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40062 #305 (45 connections now open) 2016-04-25T07:06:02.722+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 530, after asserts: 920, after connections: 1150, after extra_info: 1930, after globalLock: 2200, after locks: 2200, after network: 2300, after opcounters: 2300, after opcountersRepl: 2300, after repl: 7230, after storageEngine: 7900, after tcmalloc: 8740, after wiredTiger: 10480, at end: 13206 } 2016-04-25T07:06:03.023+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:06:08.590+0000 I COMMAND [conn304] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 18509ms 2016-04-25T07:06:11.279+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:06:11.280+0000 I COMMAND [conn305] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4786ms 2016-04-25T07:06:13.053+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:06:14.802+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40066 #306 (46 connections now open) 2016-04-25T07:06:14.802+0000 I NETWORK [conn304] end connection 127.0.0.1:40056 (44 connections now open) 2016-04-25T07:06:14.937+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:06:16.900+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:06:18.722+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:06:19.819+0000 I COMMAND [conn303] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 7275914 } } } protocol:op_command 21717ms 2016-04-25T07:06:21.331+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:06:22.215+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:06:23.885+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:06:24.270+0000 I NETWORK [conn10] end connection 127.0.0.1:56293 (44 connections now open) 2016-04-25T07:06:24.270+0000 I NETWORK [conn303] end connection 127.0.0.1:40054 (44 connections now open) 2016-04-25T07:06:25.680+0000 I COMMAND [conn306] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5441ms 2016-04-25T07:06:26.279+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40068 #307 (46 connections now open) 2016-04-25T07:06:27.167+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:06:31.006+0000 I NETWORK [conn18] end connection 127.0.0.1:56306 (43 connections now open) 2016-04-25T07:06:33.176+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:06:34.042+0000 I COMMAND [conn307] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2356ms 2016-04-25T07:06:35.099+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:06:36.390+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 1230, after globalLock: 1630, after locks: 1760, after network: 1850, after opcounters: 1850, after opcountersRepl: 1850, after repl: 2870, after storageEngine: 2970, after tcmalloc: 3510, after wiredTiger: 5940, at end: 7970 } 2016-04-25T07:06:38.039+0000 I COMMAND [conn305] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 17461ms 2016-04-25T07:06:39.561+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:06:42.538+0000 I NETWORK [conn305] end connection 127.0.0.1:40062 (42 connections now open) 2016-04-25T07:06:45.869+0000 I COMMAND [conn307] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1304ms 2016-04-25T07:06:46.692+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:06:47.859+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:06:47.957+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:06:48.059+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:06:55.396+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:06:58.037+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:06:59.087+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40075 #308 (43 connections now open) 2016-04-25T07:06:59.422+0000 I COMMAND [conn306] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 4913510 } } } protocol:op_command 19586ms 2016-04-25T07:06:59.423+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 590, after connections: 1080, after extra_info: 2390, after globalLock: 2890, after locks: 3120, after network: 3210, after opcounters: 3210, after opcountersRepl: 3210, after repl: 4850, after storageEngine: 5350, after tcmalloc: 6140, after wiredTiger: 7860, at end: 9137 } 2016-04-25T07:07:01.505+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40076 #309 (44 connections now open) 2016-04-25T07:07:03.959+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:07:05.302+0000 I NETWORK [conn306] end connection 127.0.0.1:40066 (43 connections now open) 2016-04-25T07:07:07.050+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:07:07.061+0000 I COMMAND [conn308] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2083ms 2016-04-25T07:07:08.341+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:07:08.585+0000 I COMMAND [conn309] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2148ms 2016-04-25T07:07:11.136+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:07:12.476+0000 I COMMAND [conn307] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 142885 } } } protocol:op_command 15991ms 2016-04-25T07:07:13.600+0000 I NETWORK [conn308] end connection 127.0.0.1:40075 (42 connections now open) 2016-04-25T07:07:14.456+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:07:18.789+0000 I NETWORK [conn307] end connection 127.0.0.1:40068 (41 connections now open) 2016-04-25T07:07:19.485+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:07:22.120+0000 I COMMAND [conn309] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2321ms 2016-04-25T07:07:22.818+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40082 #310 (42 connections now open) 2016-04-25T07:07:23.622+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:07:26.160+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:07:27.214+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 770, after connections: 1070, after extra_info: 2490, after globalLock: 2790, after locks: 2980, after network: 2990, after opcounters: 2990, after opcountersRepl: 2990, after repl: 4000, after storageEngine: 4950, after tcmalloc: 5504, after wiredTiger: 5504, at end: 7744 } 2016-04-25T07:07:28.317+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:07:30.283+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:07:30.985+0000 I COMMAND [conn310] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2509ms 2016-04-25T07:07:31.264+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:07:39.578+0000 I COMMAND [conn309] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6318ms 2016-04-25T07:07:40.253+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:07:42.483+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:07:44.910+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40086 #311 (43 connections now open) 2016-04-25T07:07:44.910+0000 I NETWORK [conn309] end connection 127.0.0.1:40076 (41 connections now open) 2016-04-25T07:07:45.488+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:07:48.145+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:07:48.972+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:07:49.520+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:07:50.428+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:07:51.809+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40088 #312 (43 connections now open) 2016-04-25T07:07:52.781+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:07:53.891+0000 I COMMAND [conn311] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5049ms 2016-04-25T07:07:54.193+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:07:57.646+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 480, after connections: 710, after extra_info: 2010, after globalLock: 2340, after locks: 2540, after network: 2630, after opcounters: 2630, after opcountersRepl: 2630, after repl: 4110, after storageEngine: 4110, after tcmalloc: 4390, after wiredTiger: 5540, at end: 7160 } 2016-04-25T07:07:58.147+0000 I COMMAND [conn312] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1249ms 2016-04-25T07:07:58.851+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:08:03.424+0000 I COMMAND [conn311] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3676ms 2016-04-25T07:08:05.113+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:08:07.617+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:08:07.617+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:08:08.255+0000 I NETWORK [conn311] end connection 127.0.0.1:40086 (42 connections now open) 2016-04-25T07:08:11.721+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40091 #313 (43 connections now open) 2016-04-25T07:08:12.376+0000 I COMMAND [conn312] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3470ms 2016-04-25T07:08:16.348+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:08:16.896+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:08:18.298+0000 I COMMAND [conn310] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 10338953 } } } protocol:op_command 28041ms 2016-04-25T07:08:18.739+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:08:19.316+0000 I COMMAND [conn313] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1649ms 2016-04-25T07:08:20.345+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:08:21.723+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:08:22.192+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:08:22.282+0000 I NETWORK [conn310] end connection 127.0.0.1:40082 (42 connections now open) 2016-04-25T07:08:23.223+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:08:23.763+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:08:24.966+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:08:26.525+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40096 #314 (43 connections now open) 2016-04-25T07:08:30.449+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:08:32.167+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 190, after asserts: 380, after connections: 684, after extra_info: 684, after globalLock: 684, after locks: 684, after network: 684, after opcounters: 684, after opcountersRepl: 684, after repl: 684, after storageEngine: 994, after tcmalloc: 1604, after wiredTiger: 2624, at end: 4094 } 2016-04-25T07:08:34.016+0000 I COMMAND [conn314] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2952ms 2016-04-25T07:08:34.336+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:08:34.336+0000 I COMMAND [conn312] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 1 } } } protocol:op_command 9520ms 2016-04-25T07:08:35.791+0000 I NETWORK [conn312] end connection 127.0.0.1:40088 (42 connections now open) 2016-04-25T07:08:35.791+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:08:41.278+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:08:42.299+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:08:46.548+0000 I COMMAND [conn314] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2508ms 2016-04-25T07:08:49.500+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40101 #315 (43 connections now open) 2016-04-25T07:08:49.801+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 80, after asserts: 80, after connections: 270, after extra_info: 1490, after globalLock: 1970, after locks: 2300, after network: 2310, after opcounters: 2310, after opcountersRepl: 2310, after repl: 3670, after storageEngine: 3970, after tcmalloc: 4580, after wiredTiger: 5590, at end: 6582 } 2016-04-25T07:08:50.213+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:08:51.074+0000 I COMMAND [conn313] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 3840721 } } } protocol:op_command 16946ms 2016-04-25T07:08:51.571+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:08:53.273+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:08:54.660+0000 I NETWORK [conn313] end connection 127.0.0.1:40091 (42 connections now open) 2016-04-25T07:08:55.437+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40104 #316 (44 connections now open) 2016-04-25T07:08:55.544+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:08:55.822+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:08:56.738+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:08:56.741+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:08:57.511+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:08:58.226+0000 I COMMAND [conn315] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5080ms 2016-04-25T07:09:00.403+0000 I COMMAND [conn316] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2488ms 2016-04-25T07:09:02.105+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:09:04.080+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:09:07.198+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:09:07.765+0000 I NETWORK [conn6] end connection 127.0.0.1:56288 (42 connections now open) 2016-04-25T07:09:08.095+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:09:10.177+0000 I COMMAND [conn314] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 1496701 } } } protocol:op_command 16792ms 2016-04-25T07:09:10.367+0000 I COMMAND [conn315] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 8161ms 2016-04-25T07:09:11.503+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40108 #317 (43 connections now open) 2016-04-25T07:09:13.782+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:09:14.187+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 340, after asserts: 650, after connections: 840, after extra_info: 1690, after globalLock: 2260, after locks: 2270, after network: 2360, after opcounters: 2590, after opcountersRepl: 2590, after repl: 6600, after storageEngine: 6900, after tcmalloc: 7570, after wiredTiger: 7871, at end: 8981 } 2016-04-25T07:09:14.578+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40110 #318 (44 connections now open) 2016-04-25T07:09:15.294+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:09:15.434+0000 I NETWORK [conn315] end connection 127.0.0.1:40101 (42 connections now open) 2016-04-25T07:09:15.434+0000 I NETWORK [conn314] end connection 127.0.0.1:40096 (42 connections now open) 2016-04-25T07:09:17.234+0000 I COMMAND [conn317] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2250ms 2016-04-25T07:09:17.328+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:09:19.140+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:09:20.159+0000 I COMMAND [conn316] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 188161 } } } protocol:op_command 15664ms 2016-04-25T07:09:21.339+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:09:21.778+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40113 #319 (43 connections now open) 2016-04-25T07:09:24.688+0000 I COMMAND [conn318] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5501ms 2016-04-25T07:09:24.492+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:09:24.795+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:09:25.937+0000 I NETWORK [conn316] end connection 127.0.0.1:40104 (42 connections now open) 2016-04-25T07:09:26.626+0000 I NETWORK [conn317] end connection 127.0.0.1:40108 (41 connections now open) 2016-04-25T07:09:26.912+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:09:27.393+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:09:29.618+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:09:33.207+0000 I COMMAND [conn319] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6168ms 2016-04-25T07:09:37.135+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 220, after asserts: 360, after connections: 460, after extra_info: 960, after globalLock: 1340, after locks: 1740, after network: 1950, after opcounters: 2140, after opcountersRepl: 2140, after repl: 5040, after storageEngine: 5760, after tcmalloc: 6440, after wiredTiger: 7450, at end: 8510 } 2016-04-25T07:09:39.755+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:09:42.358+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:09:43.729+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:09:47.208+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:09:49.082+0000 I COMMAND [conn318] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 10179ms 2016-04-25T07:09:53.409+0000 I NETWORK [conn318] end connection 127.0.0.1:40110 (40 connections now open) 2016-04-25T07:09:54.006+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:09:54.973+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 570, after connections: 670, after extra_info: 1530, after globalLock: 1610, after locks: 1620, after network: 1700, after opcounters: 1700, after opcountersRepl: 1700, after repl: 1890, after storageEngine: 2180, after tcmalloc: 2870, after wiredTiger: 4480, at end: 6340 } 2016-04-25T07:09:56.458+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40119 #320 (41 connections now open) 2016-04-25T07:09:56.460+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:09:59.716+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:10:01.244+0000 I COMMAND [conn319] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 16035ms 2016-04-25T07:10:01.447+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:10:03.142+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:10:03.274+0000 I NETWORK [conn319] end connection 127.0.0.1:40113 (40 connections now open) 2016-04-25T07:10:05.493+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:10:05.966+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:10:07.409+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:10:07.409+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:10:07.895+0000 I COMMAND [conn320] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6685ms 2016-04-25T07:10:08.535+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40120 #321 (41 connections now open) 2016-04-25T07:10:11.865+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:10:14.102+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 610, after connections: 794, after extra_info: 794, after globalLock: 934, after locks: 934, after network: 1014, after opcounters: 1014, after opcountersRepl: 1014, after repl: 1304, after storageEngine: 1314, after tcmalloc: 2164, after wiredTiger: 3024, at end: 4974 } 2016-04-25T07:10:16.073+0000 I COMMAND [conn320] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2760ms 2016-04-25T07:10:18.257+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:10:19.314+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:10:24.903+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:10:26.458+0000 I COMMAND [conn321] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 3894 } } } protocol:op_command 13194ms 2016-04-25T07:10:28.671+0000 I NETWORK [conn321] end connection 127.0.0.1:40120 (40 connections now open) 2016-04-25T07:10:29.292+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:10:29.389+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40126 #322 (42 connections now open) 2016-04-25T07:10:30.831+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40127 #323 (43 connections now open) 2016-04-25T07:10:31.424+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:10:34.140+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:10:35.053+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:10:35.053+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:10:36.534+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:10:40.283+0000 I COMMAND [conn322] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6099ms 2016-04-25T07:10:40.709+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:10:40.812+0000 I COMMAND [conn323] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4256ms 2016-04-25T07:10:40.914+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:10:43.338+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:10:44.272+0000 I COMMAND [conn320] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 4011855 } } } protocol:op_command 17535ms 2016-04-25T07:10:45.064+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 210, after asserts: 490, after connections: 600, after extra_info: 990, after globalLock: 990, after locks: 990, after network: 990, after opcounters: 990, after opcountersRepl: 990, after repl: 4480, after storageEngine: 4860, after tcmalloc: 5850, after wiredTiger: 7760, at end: 9660 } 2016-04-25T07:10:45.354+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:10:49.559+0000 I COMMAND [conn322] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1365ms 2016-04-25T07:10:50.397+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:10:51.773+0000 I NETWORK [conn320] end connection 127.0.0.1:40119 (41 connections now open) 2016-04-25T07:10:51.766+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:10:53.332+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:10:53.252+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:10:54.557+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:10:55.294+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:10:59.138+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:10:59.534+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:11:02.366+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:11:03.423+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:11:04.865+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 720, after connections: 1040, after extra_info: 2200, after globalLock: 2440, after locks: 2440, after network: 2440, after opcounters: 2440, after opcountersRepl: 2440, after repl: 4060, after storageEngine: 4490, after tcmalloc: 5180, after wiredTiger: 5960, at end: 8550 } 2016-04-25T07:11:06.183+0000 I COMMAND [conn323] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 12912ms 2016-04-25T07:11:07.911+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40135 #324 (42 connections now open) 2016-04-25T07:11:09.175+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:11:09.182+0000 I NETWORK [conn323] end connection 127.0.0.1:40127 (41 connections now open) 2016-04-25T07:11:12.922+0000 I COMMAND [conn324] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1360ms 2016-04-25T07:11:13.834+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:11:15.802+0000 I COMMAND [conn322] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 12193ms 2016-04-25T07:11:16.961+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:11:16.961+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40137 #325 (42 connections now open) 2016-04-25T07:11:18.115+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:11:18.325+0000 I NETWORK [conn324] end connection 127.0.0.1:40135 (41 connections now open) 2016-04-25T07:11:18.340+0000 I NETWORK [conn322] end connection 127.0.0.1:40126 (41 connections now open) 2016-04-25T07:11:21.026+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:11:24.936+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40141 #326 (41 connections now open) 2016-04-25T07:11:25.282+0000 I COMMAND [conn325] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3824ms 2016-04-25T07:11:28.793+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:11:30.359+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 310, after asserts: 580, after connections: 810, after extra_info: 1540, after globalLock: 1900, after locks: 2350, after network: 2700, after opcounters: 2710, after opcountersRepl: 2710, after repl: 3187, after storageEngine: 3187, after tcmalloc: 3287, after wiredTiger: 4457, at end: 6517 } 2016-04-25T07:11:30.671+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:11:31.026+0000 I COMMAND [conn326] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1896ms 2016-04-25T07:11:33.602+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:11:33.602+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:11:34.039+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:11:34.698+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:11:35.820+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:11:36.313+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:11:37.142+0000 I NETWORK [conn326] end connection 127.0.0.1:40141 (40 connections now open) 2016-04-25T07:11:38.948+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:11:41.210+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:11:42.507+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40145 #327 (41 connections now open) 2016-04-25T07:11:48.901+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 500, after asserts: 760, after connections: 771, after extra_info: 771, after globalLock: 771, after locks: 771, after network: 771, after opcounters: 771, after opcountersRepl: 771, after repl: 1201, after storageEngine: 1691, after tcmalloc: 2381, after wiredTiger: 3401, at end: 5251 } 2016-04-25T07:11:49.182+0000 I COMMAND [conn327] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1530ms 2016-04-25T07:11:52.665+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:11:55.320+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:11:55.420+0000 I COMMAND [conn325] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 18310ms 2016-04-25T07:11:56.188+0000 I NETWORK [conn327] end connection 127.0.0.1:40145 (40 connections now open) 2016-04-25T07:11:56.452+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:11:57.268+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:11:58.009+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:11:58.661+0000 I NETWORK [conn325] end connection 127.0.0.1:40137 (39 connections now open) 2016-04-25T07:12:02.427+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40149 #328 (40 connections now open) 2016-04-25T07:12:03.764+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:12:04.725+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40150 #329 (41 connections now open) 2016-04-25T07:12:08.731+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:12:09.177+0000 I COMMAND [conn328] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1429ms 2016-04-25T07:12:11.374+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 190, after asserts: 290, after connections: 388, after extra_info: 388, after globalLock: 388, after locks: 388, after network: 388, after opcounters: 388, after opcountersRepl: 388, after repl: 389, after storageEngine: 389, after tcmalloc: 489, after wiredTiger: 2399, at end: 4419 } 2016-04-25T07:12:11.879+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:12:12.915+0000 I COMMAND [conn329] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3140ms 2016-04-25T07:12:16.009+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:12:17.498+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:12:26.691+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:12:27.120+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40157 #330 (42 connections now open) 2016-04-25T07:12:27.324+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:12:28.095+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:12:29.790+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 360, after asserts: 490, after connections: 500, after extra_info: 920, after globalLock: 1290, after locks: 1290, after network: 1380, after opcounters: 1380, after opcountersRepl: 1380, after repl: 2430, after storageEngine: 2731, after tcmalloc: 2731, after wiredTiger: 2931, at end: 4611 } 2016-04-25T07:12:30.847+0000 I COMMAND [conn330] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 525ms 2016-04-25T07:12:31.412+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:12:32.296+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:12:34.569+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:12:35.464+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:12:36.492+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:12:36.499+0000 I NETWORK [conn330] end connection 127.0.0.1:40157 (41 connections now open) 2016-04-25T07:12:37.560+0000 I COMMAND [conn328] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 3497050 } } } protocol:op_command 13082ms 2016-04-25T07:12:38.414+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:12:39.671+0000 I NETWORK [conn17] end connection 127.0.0.1:56302 (40 connections now open) 2016-04-25T07:12:39.671+0000 I NETWORK [conn328] end connection 127.0.0.1:40149 (40 connections now open) 2016-04-25T07:12:43.132+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:12:43.229+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40160 #331 (40 connections now open) 2016-04-25T07:12:43.966+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:12:44.564+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40163 #332 (41 connections now open) 2016-04-25T07:12:47.189+0000 I COMMAND [conn329] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 11997725 } } } protocol:op_command 22703ms 2016-04-25T07:12:48.140+0000 I COMMAND [conn331] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1736ms 2016-04-25T07:12:49.720+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:12:50.513+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:12:50.711+0000 I COMMAND [conn332] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1752ms 2016-04-25T07:12:52.825+0000 I NETWORK [conn329] end connection 127.0.0.1:40150 (40 connections now open) 2016-04-25T07:12:53.328+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:12:56.459+0000 I NETWORK [conn331] end connection 127.0.0.1:40160 (39 connections now open) 2016-04-25T07:12:56.459+0000 I NETWORK [conn332] end connection 127.0.0.1:40163 (39 connections now open) 2016-04-25T07:13:00.535+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:13:02.139+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40167 #333 (39 connections now open) 2016-04-25T07:13:03.400+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:13:04.186+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 420, after asserts: 530, after connections: 620, after extra_info: 1740, after globalLock: 2510, after locks: 3100, after network: 3460, after opcounters: 3470, after opcountersRepl: 3470, after repl: 5530, after storageEngine: 5720, after tcmalloc: 6210, after wiredTiger: 7333, at end: 7703 } 2016-04-25T07:13:07.117+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:13:09.550+0000 I COMMAND [conn333] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2453ms 2016-04-25T07:13:10.322+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:13:11.020+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40170 #334 (40 connections now open) 2016-04-25T07:13:12.374+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:13:13.011+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:13:16.809+0000 I COMMAND [conn334] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2127ms 2016-04-25T07:13:18.702+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:13:24.409+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:13:25.859+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:13:27.011+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 310, after asserts: 570, after connections: 1050, after extra_info: 2020, after globalLock: 2410, after locks: 2760, after network: 3000, after opcounters: 3000, after opcountersRepl: 3000, after repl: 5010, after storageEngine: 5690, after tcmalloc: 6470, after wiredTiger: 7470, at end: 8880 } 2016-04-25T07:13:29.757+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:13:32.863+0000 I COMMAND [conn333] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 8951ms 2016-04-25T07:13:35.443+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:13:39.319+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:13:41.596+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:13:41.597+0000 I NETWORK [conn333] end connection 127.0.0.1:40167 (39 connections now open) 2016-04-25T07:13:42.844+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:13:42.833+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:13:44.174+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40175 #335 (40 connections now open) 2016-04-25T07:13:46.426+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:13:46.966+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:13:46.968+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40177 #336 (41 connections now open) 2016-04-25T07:13:47.782+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:13:48.960+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 580, after asserts: 750, after connections: 890, after extra_info: 1780, after globalLock: 1980, after locks: 2160, after network: 2170, after opcounters: 2170, after opcountersRepl: 2170, after repl: 5025, after storageEngine: 5025, after tcmalloc: 5025, after wiredTiger: 5375, at end: 5962 } 2016-04-25T07:13:50.040+0000 I COMMAND [conn334] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 12052ms 2016-04-25T07:13:52.329+0000 I COMMAND [conn335] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4139ms 2016-04-25T07:13:52.330+0000 I NETWORK [conn334] end connection 127.0.0.1:40170 (40 connections now open) 2016-04-25T07:13:52.983+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:13:57.172+0000 I COMMAND [conn336] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4503ms 2016-04-25T07:13:57.480+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:14:00.004+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40181 #337 (41 connections now open) 2016-04-25T07:14:00.404+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:14:00.707+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:14:02.892+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:14:02.898+0000 I COMMAND [conn335] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1990ms 2016-04-25T07:14:03.320+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:14:03.324+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:14:05.657+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:14:06.098+0000 I COMMAND [conn337] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2867ms 2016-04-25T07:14:06.481+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 400, after connections: 403, after extra_info: 403, after globalLock: 403, after locks: 403, after network: 403, after opcounters: 403, after opcountersRepl: 403, after repl: 1183, after storageEngine: 1763, after tcmalloc: 2573, after wiredTiger: 3493, at end: 5503 } 2016-04-25T07:14:08.904+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 101ms 2016-04-25T07:14:09.287+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:14:10.236+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:14:12.231+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:14:19.481+0000 I COMMAND [conn336] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6329ms 2016-04-25T07:14:20.457+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:14:24.408+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:14:24.879+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:14:24.882+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:14:24.882+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:14:26.671+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:14:27.871+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:14:28.073+0000 I COMMAND [conn335] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 1622146 } } } protocol:op_command 17745ms 2016-04-25T07:14:28.210+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:14:29.028+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 750, after connections: 900, after extra_info: 1340, after globalLock: 1730, after locks: 1930, after network: 1930, after opcounters: 1930, after opcountersRepl: 1930, after repl: 4080, after storageEngine: 4730, after tcmalloc: 5100, after wiredTiger: 6080, at end: 7310 } 2016-04-25T07:14:30.507+0000 I NETWORK [conn335] end connection 127.0.0.1:40175 (40 connections now open) 2016-04-25T07:14:31.260+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:14:31.942+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40190 #338 (42 connections now open) 2016-04-25T07:14:37.998+0000 I COMMAND [conn337] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 1646879 } } } protocol:op_command 13866ms 2016-04-25T07:14:38.004+0000 I COMMAND [conn338] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2684ms 2016-04-25T07:14:41.828+0000 I NETWORK [conn337] end connection 127.0.0.1:40181 (40 connections now open) 2016-04-25T07:14:42.216+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:14:45.944+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:14:48.928+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:14:49.656+0000 I COMMAND [conn336] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 7302079 } } } protocol:op_command 19555ms 2016-04-25T07:14:50.029+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40192 #339 (41 connections now open) 2016-04-25T07:14:50.907+0000 I NETWORK [conn338] end connection 127.0.0.1:40190 (39 connections now open) 2016-04-25T07:14:52.402+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:14:53.163+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:14:55.478+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:14:55.872+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40195 #340 (41 connections now open) 2016-04-25T07:14:57.936+0000 I NETWORK [conn336] end connection 127.0.0.1:40177 (40 connections now open) 2016-04-25T07:15:00.995+0000 I COMMAND [conn339] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6264ms 2016-04-25T07:15:02.089+0000 I COMMAND [conn340] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1458ms 2016-04-25T07:15:03.983+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:15:05.115+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 307, after asserts: 307, after connections: 307, after extra_info: 307, after globalLock: 307, after locks: 307, after network: 307, after opcounters: 307, after opcountersRepl: 307, after repl: 1947, after storageEngine: 2417, after tcmalloc: 2827, after wiredTiger: 4097, at end: 6847 } 2016-04-25T07:15:05.609+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:15:08.730+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:15:09.683+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-25T07:15:09.679+0000 I NETWORK [conn340] end connection 127.0.0.1:40195 (39 connections now open) 2016-04-25T07:15:10.178+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:15:10.275+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:15:10.380+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 182ms 2016-04-25T07:15:11.105+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:15:12.930+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:15:13.026+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:15:13.934+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40199 #341 (40 connections now open) 2016-04-25T07:15:16.818+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:15:17.428+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:15:23.641+0000 I COMMAND [conn341] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6321ms 2016-04-25T07:15:25.149+0000 I COMMAND [conn339] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 11305ms 2016-04-25T07:15:27.097+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 380, after connections: 580, after extra_info: 880, after globalLock: 1050, after locks: 1150, after network: 1240, after opcounters: 1240, after opcountersRepl: 1240, after repl: 5650, after storageEngine: 6170, after tcmalloc: 6640, after wiredTiger: 8330, at end: 9860 } 2016-04-25T07:15:28.533+0000 I NETWORK [conn339] end connection 127.0.0.1:40192 (39 connections now open) 2016-04-25T07:15:29.420+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:15:33.382+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:15:34.890+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:15:35.286+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:15:35.680+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40205 #342 (40 connections now open) 2016-04-25T07:15:35.954+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:15:37.665+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40206 #343 (41 connections now open) 2016-04-25T07:15:38.234+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:15:40.533+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:15:41.954+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:15:42.720+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:15:44.217+0000 I COMMAND [conn342] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4385ms 2016-04-25T07:15:45.934+0000 I COMMAND [conn343] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4088ms 2016-04-25T07:15:50.150+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 550, after connections: 1030, after extra_info: 1710, after globalLock: 2160, after locks: 2180, after network: 2180, after opcounters: 2180, after opcountersRepl: 2180, after repl: 4120, after storageEngine: 4420, after tcmalloc: 4810, after wiredTiger: 6080, at end: 9040 } 2016-04-25T07:15:54.082+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:15:54.279+0000 I COMMAND [conn341] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 20602ms 2016-04-25T07:15:55.237+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:15:56.516+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:15:58.300+0000 I NETWORK [conn341] end connection 127.0.0.1:40199 (40 connections now open) 2016-04-25T07:15:58.495+0000 I COMMAND [conn342] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2171ms 2016-04-25T07:16:05.357+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:16:05.656+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 790, after connections: 1060, after extra_info: 1880, after globalLock: 1970, after locks: 2070, after network: 2070, after opcounters: 2070, after opcountersRepl: 2070, after repl: 2550, after storageEngine: 2640, after tcmalloc: 3070, after wiredTiger: 4270, at end: 6170 } 2016-04-25T07:16:06.946+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:16:10.834+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40211 #344 (41 connections now open) 2016-04-25T07:16:11.734+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:16:11.832+0000 I COMMAND [conn343] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 12424ms 2016-04-25T07:16:12.285+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:16:15.671+0000 I COMMAND [conn344] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1480ms 2016-04-25T07:16:16.930+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:16:17.407+0000 I NETWORK [conn343] end connection 127.0.0.1:40206 (40 connections now open) 2016-04-25T07:16:18.794+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:16:20.352+0000 I COMMAND [conn342] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 271214 } } } protocol:op_command 10207ms 2016-04-25T07:16:21.120+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40214 #345 (41 connections now open) 2016-04-25T07:16:21.417+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:16:22.951+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:16:23.971+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:16:25.028+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:16:26.211+0000 I NETWORK [conn342] end connection 127.0.0.1:40205 (40 connections now open) 2016-04-25T07:16:26.395+0000 I COMMAND [conn344] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6271ms 2016-04-25T07:16:26.478+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:16:28.609+0000 I NETWORK [conn344] end connection 127.0.0.1:40211 (39 connections now open) 2016-04-25T07:16:30.035+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:16:30.179+0000 I COMMAND [conn345] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4516ms 2016-04-25T07:16:31.703+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:16:34.393+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40217 #346 (40 connections now open) 2016-04-25T07:16:38.960+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 430, after asserts: 600, after connections: 690, after extra_info: 1280, after globalLock: 1380, after locks: 1580, after network: 1700, after opcounters: 1700, after opcountersRepl: 1700, after repl: 5510, after storageEngine: 6100, after tcmalloc: 6406, after wiredTiger: 7286, at end: 9926 } 2016-04-25T07:16:40.416+0000 I COMMAND [conn346] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1801ms 2016-04-25T07:16:42.464+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:16:42.858+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:16:44.880+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:16:47.465+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:16:47.475+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:16:54.244+0000 I COMMAND [conn346] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2280ms 2016-04-25T07:16:54.345+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:16:56.528+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 600, after connections: 700, after extra_info: 1860, after globalLock: 2230, after locks: 2320, after network: 2320, after opcounters: 2320, after opcountersRepl: 2320, after repl: 3100, after storageEngine: 3690, after tcmalloc: 4850, after wiredTiger: 6140, at end: 7620 } 2016-04-25T07:16:57.046+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40222 #347 (41 connections now open) 2016-04-25T07:16:57.178+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:16:59.345+0000 I COMMAND [conn345] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 14820ms 2016-04-25T07:17:00.369+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:17:01.874+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:17:03.514+0000 I COMMAND [conn347] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2760ms 2016-04-25T07:17:04.715+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:17:05.522+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:17:05.615+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40223 #348 (42 connections now open) 2016-04-25T07:17:05.615+0000 I NETWORK [conn345] end connection 127.0.0.1:40214 (40 connections now open) 2016-04-25T07:17:10.075+0000 I COMMAND [conn347] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1227ms 2016-04-25T07:17:10.275+0000 I COMMAND [conn348] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 694ms 2016-04-25T07:17:16.246+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:17:17.594+0000 I COMMAND [conn346] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 8255622 } } } protocol:op_command 18825ms 2016-04-25T07:17:18.478+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:17:19.543+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:17:20.520+0000 I NETWORK [conn346] end connection 127.0.0.1:40217 (40 connections now open) 2016-04-25T07:17:20.520+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:17:21.017+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:17:23.713+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:17:23.839+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40228 #349 (41 connections now open) 2016-04-25T07:17:25.227+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:17:27.098+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:17:27.103+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:17:28.063+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40230 #350 (42 connections now open) 2016-04-25T07:17:30.679+0000 I COMMAND [conn349] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1800ms 2016-04-25T07:17:32.627+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:17:33.074+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 340, after connections: 520, after extra_info: 980, after globalLock: 1560, after locks: 1810, after network: 1820, after opcounters: 1820, after opcountersRepl: 1820, after repl: 2884, after storageEngine: 3354, after tcmalloc: 3954, after wiredTiger: 5764, at end: 6474 } 2016-04-25T07:17:34.336+0000 I COMMAND [conn348] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 3001522 } } } protocol:op_command 19186ms 2016-04-25T07:17:34.336+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:17:35.348+0000 I COMMAND [conn350] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3054ms 2016-04-25T07:17:35.353+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:17:36.282+0000 I NETWORK [conn348] end connection 127.0.0.1:40223 (41 connections now open) 2016-04-25T07:17:37.547+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:17:39.164+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:17:39.989+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40235 #351 (42 connections now open) 2016-04-25T07:17:40.329+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:17:41.874+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:17:42.944+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:17:43.233+0000 I NETWORK [conn350] end connection 127.0.0.1:40230 (41 connections now open) 2016-04-25T07:17:44.026+0000 I COMMAND [conn347] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 12702014 } } } protocol:op_command 24944ms 2016-04-25T07:17:47.125+0000 I COMMAND [conn351] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3322ms 2016-04-25T07:17:47.123+0000 I NETWORK [conn347] end connection 127.0.0.1:40222 (40 connections now open) 2016-04-25T07:17:48.938+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:17:49.032+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:17:50.100+0000 I NETWORK [conn351] end connection 127.0.0.1:40235 (39 connections now open) 2016-04-25T07:17:50.563+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40237 #352 (41 connections now open) 2016-04-25T07:17:51.713+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:17:57.068+0000 I COMMAND [conn352] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2623ms 2016-04-25T07:17:57.576+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40241 #353 (41 connections now open) 2016-04-25T07:17:58.780+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:17:59.686+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:18:00.689+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 190, after asserts: 290, after connections: 390, after extra_info: 1090, after globalLock: 1290, after locks: 1290, after network: 1290, after opcounters: 1290, after opcountersRepl: 1290, after repl: 3210, after storageEngine: 3870, after tcmalloc: 4700, after wiredTiger: 5836, at end: 7946 } 2016-04-25T07:18:01.158+0000 I COMMAND [conn349] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 7449404 } } } protocol:op_command 23734ms 2016-04-25T07:18:02.817+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:18:03.462+0000 I COMMAND [conn353] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2115ms 2016-04-25T07:18:04.648+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:18:04.750+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:18:05.019+0000 I NETWORK [conn349] end connection 127.0.0.1:40228 (40 connections now open) 2016-04-25T07:18:06.011+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:18:07.502+0000 I NETWORK [conn352] end connection 127.0.0.1:40237 (40 connections now open) 2016-04-25T07:18:07.502+0000 I NETWORK [conn353] end connection 127.0.0.1:40241 (40 connections now open) 2016-04-25T07:18:10.188+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:18:12.556+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:18:12.651+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:18:15.701+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40244 #354 (39 connections now open) 2016-04-25T07:18:18.411+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40246 #355 (40 connections now open) 2016-04-25T07:18:23.098+0000 I COMMAND [conn354] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2228ms 2016-04-25T07:18:23.683+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:18:24.091+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 420, after asserts: 430, after connections: 430, after extra_info: 992, after globalLock: 992, after locks: 992, after network: 992, after opcounters: 992, after opcountersRepl: 992, after repl: 993, after storageEngine: 993, after tcmalloc: 993, after wiredTiger: 993, at end: 3593 } 2016-04-25T07:18:25.037+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:18:25.233+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:18:26.008+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:18:26.937+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40250 #356 (41 connections now open) 2016-04-25T07:18:27.910+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:18:29.924+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:18:30.885+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:18:30.891+0000 I COMMAND [conn355] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6928ms 2016-04-25T07:18:32.076+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:18:33.763+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:18:35.997+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:18:37.614+0000 I COMMAND [conn356] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6095ms 2016-04-25T07:18:40.443+0000 I NETWORK [conn355] end connection 127.0.0.1:40246 (40 connections now open) 2016-04-25T07:18:45.164+0000 I NETWORK [conn356] end connection 127.0.0.1:40250 (39 connections now open) 2016-04-25T07:18:46.523+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 330, after asserts: 790, after connections: 1310, after extra_info: 2300, after globalLock: 2500, after locks: 2510, after network: 2600, after opcounters: 2600, after opcountersRepl: 2600, after repl: 4040, after storageEngine: 4660, after tcmalloc: 4840, after wiredTiger: 4840, at end: 5700 } 2016-04-25T07:18:47.372+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:18:49.110+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40252 #357 (40 connections now open) 2016-04-25T07:18:49.110+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:18:54.330+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:18:55.074+0000 I COMMAND [conn354] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 2366801 } } } protocol:op_command 12555ms 2016-04-25T07:18:55.370+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40253 #358 (41 connections now open) 2016-04-25T07:18:58.541+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:18:58.652+0000 I COMMAND [conn357] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5712ms 2016-04-25T07:18:59.777+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:19:01.432+0000 I NETWORK [conn354] end connection 127.0.0.1:40244 (40 connections now open) 2016-04-25T07:19:02.890+0000 I COMMAND [conn358] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3544ms 2016-04-25T07:19:04.991+0000 I NETWORK [conn357] end connection 127.0.0.1:40252 (39 connections now open) 2016-04-25T07:19:05.713+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40258 #359 (41 connections now open) 2016-04-25T07:19:09.716+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 540, after connections: 750, after extra_info: 1393, after globalLock: 1393, after locks: 1393, after network: 1393, after opcounters: 1393, after opcountersRepl: 1393, after repl: 1393, after storageEngine: 1763, after tcmalloc: 2353, after wiredTiger: 3633, at end: 4733 } 2016-04-25T07:19:11.085+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:19:11.085+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:19:11.085+0000 I COMMAND [conn359] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2664ms 2016-04-25T07:19:13.578+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:19:15.863+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:19:15.960+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:19:19.199+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:19:21.739+0000 I NETWORK [conn359] end connection 127.0.0.1:40258 (39 connections now open) 2016-04-25T07:19:23.106+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:19:23.708+0000 I COMMAND [conn358] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 11141ms 2016-04-25T07:19:24.759+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:19:26.340+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:19:26.632+0000 I NETWORK [conn358] end connection 127.0.0.1:40253 (38 connections now open) 2016-04-25T07:19:27.193+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:19:29.079+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40261 #360 (39 connections now open) 2016-04-25T07:19:31.024+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40262 #361 (40 connections now open) 2016-04-25T07:19:33.971+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 720, after connections: 1110, after extra_info: 2090, after globalLock: 2280, after locks: 2280, after network: 2280, after opcounters: 2280, after opcountersRepl: 2280, after repl: 4141, after storageEngine: 4141, after tcmalloc: 4141, after wiredTiger: 4142, at end: 4942 } 2016-04-25T07:19:34.789+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:19:35.550+0000 I COMMAND [conn360] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1850ms 2016-04-25T07:19:35.839+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:19:37.330+0000 I COMMAND [conn361] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2407ms 2016-04-25T07:19:37.989+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:19:39.743+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:19:42.111+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40266 #362 (41 connections now open) 2016-04-25T07:19:42.111+0000 I NETWORK [conn360] end connection 127.0.0.1:40261 (39 connections now open) 2016-04-25T07:19:42.310+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:19:43.221+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:19:48.772+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40267 #363 (41 connections now open) 2016-04-25T07:19:49.098+0000 I COMMAND [conn362] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2273ms 2016-04-25T07:19:49.713+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:19:50.810+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:19:54.538+0000 I COMMAND [conn363] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1125ms 2016-04-25T07:19:57.899+0000 I NETWORK [conn362] end connection 127.0.0.1:40266 (40 connections now open) 2016-04-25T07:19:57.994+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 1170, after globalLock: 1570, after locks: 2050, after network: 2430, after opcounters: 2730, after opcountersRepl: 2730, after repl: 3170, after storageEngine: 3360, after tcmalloc: 4080, after wiredTiger: 5410, at end: 7730 } 2016-04-25T07:19:58.486+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:20:00.341+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:20:02.415+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:20:02.744+0000 I COMMAND [conn361] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 10149ms 2016-04-25T07:20:03.310+0000 I NETWORK [conn361] end connection 127.0.0.1:40262 (39 connections now open) 2016-04-25T07:20:04.451+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:20:05.059+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:20:05.594+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:20:06.867+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:20:08.353+0000 I COMMAND [conn363] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5141ms 2016-04-25T07:20:11.033+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:20:12.131+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:20:13.905+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:20:14.239+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:20:15.123+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40273 #364 (40 connections now open) 2016-04-25T07:20:17.631+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 600, after connections: 1090, after extra_info: 2310, after globalLock: 2510, after locks: 2640, after network: 2640, after opcounters: 2640, after opcountersRepl: 2640, after repl: 5040, after storageEngine: 5270, after tcmalloc: 6070, after wiredTiger: 6479, at end: 7509 } 2016-04-25T07:20:21.142+0000 I COMMAND [conn364] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1712ms 2016-04-25T07:20:22.324+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:20:22.608+0000 I COMMAND [conn363] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2186ms 2016-04-25T07:20:24.131+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:20:25.456+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:20:25.847+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:20:28.239+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:20:28.662+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40278 #365 (41 connections now open) 2016-04-25T07:20:32.448+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:20:33.050+0000 I NETWORK [conn15] end connection 127.0.0.1:56300 (40 connections now open) 2016-04-25T07:20:34.092+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:20:37.979+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:20:38.362+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 140, after asserts: 460, after connections: 650, after extra_info: 1150, after globalLock: 1377, after locks: 1377, after network: 1377, after opcounters: 1377, after opcountersRepl: 1377, after repl: 4517, after storageEngine: 4937, after tcmalloc: 5077, after wiredTiger: 6447, at end: 8767 } 2016-04-25T07:20:41.386+0000 I COMMAND [conn365] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7040ms 2016-04-25T07:20:46.435+0000 I COMMAND [conn363] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 20187ms 2016-04-25T07:20:49.438+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:20:50.188+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40282 #366 (41 connections now open) 2016-04-25T07:20:50.188+0000 I NETWORK [conn363] end connection 127.0.0.1:40267 (39 connections now open) 2016-04-25T07:20:51.243+0000 I NETWORK [conn365] end connection 127.0.0.1:40278 (39 connections now open) 2016-04-25T07:20:51.547+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:20:53.185+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:20:53.665+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:20:54.723+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:20:56.814+0000 I COMMAND [conn366] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1213ms 2016-04-25T07:20:58.247+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40283 #367 (40 connections now open) 2016-04-25T07:20:59.729+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:20:59.730+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 350, after asserts: 540, after connections: 740, after extra_info: 1120, after globalLock: 1480, after locks: 1980, after network: 2160, after opcounters: 2160, after opcountersRepl: 2160, after repl: 3170, after storageEngine: 3560, after tcmalloc: 4140, after wiredTiger: 5230, at end: 5325 } 2016-04-25T07:21:01.629+0000 I COMMAND [conn364] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 8030665 } } } protocol:op_command 20305ms 2016-04-25T07:21:02.393+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40284 #368 (41 connections now open) 2016-04-25T07:21:03.674+0000 I NETWORK [conn366] end connection 127.0.0.1:40282 (40 connections now open) 2016-04-25T07:21:03.881+0000 I COMMAND [conn367] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1881ms 2016-04-25T07:21:04.516+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:21:04.710+0000 I NETWORK [conn364] end connection 127.0.0.1:40273 (39 connections now open) 2016-04-25T07:21:08.190+0000 I COMMAND [conn368] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2730ms 2016-04-25T07:21:09.269+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:21:11.981+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:21:12.179+0000 I NETWORK [conn367] end connection 127.0.0.1:40283 (38 connections now open) 2016-04-25T07:21:13.467+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:21:17.229+0000 I NETWORK [conn368] end connection 127.0.0.1:40284 (37 connections now open) 2016-04-25T07:21:19.964+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40289 #369 (38 connections now open) 2016-04-25T07:21:22.829+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:21:23.603+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 460, after asserts: 760, after connections: 1030, after extra_info: 1640, after globalLock: 1840, after locks: 1840, after network: 1930, after opcounters: 1930, after opcountersRepl: 1930, after repl: 9160, after storageEngine: 9740, after tcmalloc: 10271, after wiredTiger: 10851, at end: 12551 } 2016-04-25T07:21:25.122+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:21:25.125+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40291 #370 (39 connections now open) 2016-04-25T07:21:26.145+0000 I COMMAND [conn369] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2303ms 2016-04-25T07:21:27.722+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:21:28.276+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:21:30.320+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:21:31.873+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:21:31.873+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:21:33.510+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:21:33.796+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:21:34.524+0000 I COMMAND [conn370] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4892ms 2016-04-25T07:21:34.884+0000 I NETWORK [conn369] end connection 127.0.0.1:40289 (38 connections now open) 2016-04-25T07:21:36.258+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:21:40.049+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:21:40.564+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40294 #371 (39 connections now open) 2016-04-25T07:21:42.378+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 620, after asserts: 800, after connections: 980, after extra_info: 1790, after globalLock: 1990, after locks: 2080, after network: 2090, after opcounters: 2090, after opcountersRepl: 2090, after repl: 3740, after storageEngine: 4300, after tcmalloc: 5340, after wiredTiger: 5869, at end: 5869 } 2016-04-25T07:21:47.142+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:21:48.286+0000 I COMMAND [conn371] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2013ms 2016-04-25T07:21:49.738+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:21:58.138+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:21:58.138+0000 I COMMAND [conn371] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2205ms 2016-04-25T07:21:58.534+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 690, after connections: 780, after extra_info: 1070, after globalLock: 1160, after locks: 1160, after network: 1160, after opcounters: 1160, after opcountersRepl: 1160, after repl: 1680, after storageEngine: 2170, after tcmalloc: 3000, after wiredTiger: 4040, at end: 5760 } 2016-04-25T07:21:58.625+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:22:00.176+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:22:02.675+0000 I COMMAND [conn370] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 1273759 } } } protocol:op_command 13370ms 2016-04-25T07:22:02.675+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:22:07.853+0000 I NETWORK [conn13] end connection 127.0.0.1:56298 (38 connections now open) 2016-04-25T07:22:07.853+0000 I NETWORK [conn370] end connection 127.0.0.1:40291 (38 connections now open) 2016-04-25T07:22:09.777+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:22:11.939+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40301 #372 (38 connections now open) 2016-04-25T07:22:12.558+0000 I COMMAND [conn371] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1275ms 2016-04-25T07:22:13.157+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:22:14.809+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:22:15.085+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:22:15.921+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:22:19.236+0000 I COMMAND [conn372] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2920ms 2016-04-25T07:22:19.933+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40305 #373 (39 connections now open) 2016-04-25T07:22:20.060+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:22:20.992+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:22:21.084+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:22:22.076+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:22:22.906+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 640, after connections: 740, after extra_info: 1220, after globalLock: 1580, after locks: 1780, after network: 1790, after opcounters: 1790, after opcountersRepl: 1790, after repl: 2500, after storageEngine: 2870, after tcmalloc: 3270, after wiredTiger: 3520, at end: 4920 } 2016-04-25T07:22:24.383+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:22:26.307+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:22:27.098+0000 I COMMAND [conn373] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2809ms 2016-04-25T07:22:29.518+0000 I COMMAND [conn371] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 10476ms 2016-04-25T07:22:31.221+0000 I NETWORK [conn371] end connection 127.0.0.1:40294 (38 connections now open) 2016-04-25T07:22:32.079+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:22:35.105+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:22:35.816+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:22:36.583+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:22:37.526+0000 I COMMAND [conn373] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5901ms 2016-04-25T07:22:37.920+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:22:37.927+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:22:39.920+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:22:41.569+0000 I NETWORK [conn373] end connection 127.0.0.1:40305 (37 connections now open) 2016-04-25T07:22:41.766+0000 I COMMAND [conn372] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 958067 } } } protocol:op_command 10118ms 2016-04-25T07:22:42.066+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:22:42.756+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 670, after connections: 680, after extra_info: 1190, after globalLock: 1190, after locks: 1360, after network: 1470, after opcounters: 1470, after opcountersRepl: 1470, after repl: 4360, after storageEngine: 4460, after tcmalloc: 4950, after wiredTiger: 6360, at end: 7800 } 2016-04-25T07:22:43.907+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40311 #374 (38 connections now open) 2016-04-25T07:22:44.886+0000 I NETWORK [conn372] end connection 127.0.0.1:40301 (36 connections now open) 2016-04-25T07:22:44.999+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:22:48.766+0000 I NETWORK [conn14] end connection 127.0.0.1:56299 (36 connections now open) 2016-04-25T07:22:49.192+0000 I COMMAND [conn374] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2738ms 2016-04-25T07:22:51.360+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:22:54.650+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40315 #375 (37 connections now open) 2016-04-25T07:22:56.354+0000 I NETWORK [conn374] end connection 127.0.0.1:40311 (35 connections now open) 2016-04-25T07:22:56.453+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:22:57.568+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:22:57.573+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:22:57.662+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:22:58.971+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 520, after connections: 750, after extra_info: 1510, after globalLock: 1820, after locks: 2110, after network: 2477, after opcounters: 2477, after opcountersRepl: 2477, after repl: 2477, after storageEngine: 2667, after tcmalloc: 3227, after wiredTiger: 3647, at end: 4557 } 2016-04-25T07:23:01.134+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40318 #376 (37 connections now open) 2016-04-25T07:23:07.564+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40321 #377 (38 connections now open) 2016-04-25T07:23:07.869+0000 I COMMAND [conn375] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 9610ms 2016-04-25T07:23:07.864+0000 I COMMAND [conn376] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1554ms 2016-04-25T07:23:10.123+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:23:12.266+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:23:12.469+0000 I COMMAND [conn377] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1250ms 2016-04-25T07:23:12.475+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:23:13.325+0000 I NETWORK [conn375] end connection 127.0.0.1:40315 (37 connections now open) 2016-04-25T07:23:13.652+0000 I NETWORK [conn376] end connection 127.0.0.1:40318 (37 connections now open) 2016-04-25T07:23:15.694+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:23:15.788+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:23:19.204+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40323 #378 (37 connections now open) 2016-04-25T07:23:20.428+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:23:20.726+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40324 #379 (38 connections now open) 2016-04-25T07:23:22.494+0000 I NETWORK [conn377] end connection 127.0.0.1:40321 (37 connections now open) 2016-04-25T07:23:24.319+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 220, after asserts: 410, after connections: 590, after extra_info: 1190, after globalLock: 1400, after locks: 1510, after network: 1600, after opcounters: 1600, after opcountersRepl: 1600, after repl: 1938, after storageEngine: 1938, after tcmalloc: 1939, after wiredTiger: 2609, at end: 4789 } 2016-04-25T07:23:25.114+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:23:25.424+0000 I COMMAND [conn378] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1864ms 2016-04-25T07:23:25.424+0000 I COMMAND [conn379] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1864ms 2016-04-25T07:23:27.902+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:23:30.584+0000 I NETWORK [conn379] end connection 127.0.0.1:40324 (36 connections now open) 2016-04-25T07:23:30.584+0000 I NETWORK [conn378] end connection 127.0.0.1:40323 (36 connections now open) 2016-04-25T07:23:31.412+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:23:32.198+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:23:36.169+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40327 #380 (36 connections now open) 2016-04-25T07:23:38.453+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:23:39.807+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40329 #381 (37 connections now open) 2016-04-25T07:23:42.364+0000 I COMMAND [conn380] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2086ms 2016-04-25T07:23:42.368+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 680, after connections: 1480, after extra_info: 1742, after globalLock: 1922, after locks: 2422, after network: 2752, after opcounters: 2852, after opcountersRepl: 2852, after repl: 3252, after storageEngine: 3802, after tcmalloc: 4305, after wiredTiger: 4305, at end: 5155 } 2016-04-25T07:23:43.027+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:23:44.670+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:23:45.071+0000 I COMMAND [conn381] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1307ms 2016-04-25T07:23:45.751+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:23:47.172+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:23:48.446+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:23:49.940+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:23:54.004+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:23:55.926+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:23:56.065+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40332 #382 (38 connections now open) 2016-04-25T07:23:57.227+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 540, after connections: 540, after extra_info: 830, after globalLock: 1020, after locks: 1250, after network: 1370, after opcounters: 1370, after opcountersRepl: 1370, after repl: 5080, after storageEngine: 5410, after tcmalloc: 5890, after wiredTiger: 7107, at end: 7107 } 2016-04-25T07:24:02.465+0000 I COMMAND [conn381] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 16329ms 2016-04-25T07:24:04.457+0000 I COMMAND [conn382] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4099ms 2016-04-25T07:24:04.553+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40338 #383 (39 connections now open) 2016-04-25T07:24:05.045+0000 I NETWORK [conn381] end connection 127.0.0.1:40329 (37 connections now open) 2016-04-25T07:24:05.045+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:24:06.405+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:24:08.427+0000 I COMMAND [conn383] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1897ms 2016-04-25T07:24:09.724+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:24:09.813+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:24:09.819+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:24:09.820+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:24:09.820+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:24:09.820+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:24:09.820+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:24:11.655+0000 I NETWORK [conn382] end connection 127.0.0.1:40332 (37 connections now open) 2016-04-25T07:24:12.533+0000 I COMMAND [conn380] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 2093710 } } } protocol:op_command 16231ms 2016-04-25T07:24:16.248+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40340 #384 (38 connections now open) 2016-04-25T07:24:17.253+0000 I NETWORK [conn380] end connection 127.0.0.1:40327 (37 connections now open) 2016-04-25T07:24:17.395+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:24:21.449+0000 I COMMAND [conn384] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1663ms 2016-04-25T07:24:22.353+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:24:24.592+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 210, after asserts: 590, after connections: 790, after extra_info: 1370, after globalLock: 1560, after locks: 1560, after network: 1560, after opcounters: 1560, after opcountersRepl: 1560, after repl: 2240, after storageEngine: 2440, after tcmalloc: 3020, after wiredTiger: 4580, at end: 6080 } 2016-04-25T07:24:25.787+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:24:26.680+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40342 #385 (38 connections now open) 2016-04-25T07:24:28.272+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:24:28.993+0000 I NETWORK [conn384] end connection 127.0.0.1:40340 (37 connections now open) 2016-04-25T07:24:31.288+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:24:32.273+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:24:32.706+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40344 #386 (38 connections now open) 2016-04-25T07:24:33.844+0000 I COMMAND [conn383] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 10154781 } } } protocol:op_command 22538ms 2016-04-25T07:24:36.462+0000 I COMMAND [conn385] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5038ms 2016-04-25T07:24:37.376+0000 I COMMAND [conn386] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1800ms 2016-04-25T07:24:39.650+0000 I COMMAND [conn386] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1869ms 2016-04-25T07:24:39.741+0000 I NETWORK [conn383] end connection 127.0.0.1:40338 (37 connections now open) 2016-04-25T07:24:41.621+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:24:42.609+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:24:43.888+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:24:43.885+0000 I NETWORK [conn386] end connection 127.0.0.1:40344 (36 connections now open) 2016-04-25T07:24:46.173+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:24:48.947+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:24:49.918+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40350 #387 (37 connections now open) 2016-04-25T07:24:50.563+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:24:51.791+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 600, after asserts: 960, after connections: 1250, after extra_info: 2000, after globalLock: 2840, after locks: 3240, after network: 3470, after opcounters: 3720, after opcountersRepl: 3860, after repl: 5920, after storageEngine: 6490, after tcmalloc: 6770, after wiredTiger: 8040, at end: 8803 } 2016-04-25T07:24:52.911+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:24:54.671+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:24:59.007+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:25:00.317+0000 I COMMAND [conn387] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5745ms 2016-04-25T07:25:00.947+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:25:08.270+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:25:10.272+0000 I COMMAND [conn387] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1325ms 2016-04-25T07:25:12.039+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:25:12.143+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40355 #388 (38 connections now open) 2016-04-25T07:25:13.641+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:25:13.838+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:25:14.326+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 740, after connections: 1330, after extra_info: 2070, after globalLock: 2070, after locks: 2070, after network: 2250, after opcounters: 2350, after opcountersRepl: 2350, after repl: 3210, after storageEngine: 3860, after tcmalloc: 4320, after wiredTiger: 4604, at end: 4884 } 2016-04-25T07:25:15.225+0000 I COMMAND [conn385] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 3415028 } } } protocol:op_command 25574ms 2016-04-25T07:25:15.995+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:25:16.800+0000 I NETWORK [conn385] end connection 127.0.0.1:40342 (37 connections now open) 2016-04-25T07:25:20.561+0000 I COMMAND [conn388] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3825ms 2016-04-25T07:25:23.910+0000 I COMMAND [conn387] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2372ms 2016-04-25T07:25:24.389+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:25:26.938+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40360 #389 (38 connections now open) 2016-04-25T07:25:30.481+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:25:31.475+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 480, after connections: 840, after extra_info: 1410, after globalLock: 1660, after locks: 1760, after network: 1850, after opcounters: 1930, after opcountersRepl: 1930, after repl: 2383, after storageEngine: 2383, after tcmalloc: 2383, after wiredTiger: 2553, at end: 4263 } 2016-04-25T07:25:31.471+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:25:33.495+0000 I COMMAND [conn389] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 911ms 2016-04-25T07:25:33.801+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:25:35.698+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:25:37.908+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:25:38.082+0000 I COMMAND [conn387] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 9415ms 2016-04-25T07:25:41.746+0000 I NETWORK [conn387] end connection 127.0.0.1:40350 (37 connections now open) 2016-04-25T07:25:44.153+0000 I COMMAND [conn389] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1999ms 2016-04-25T07:25:46.638+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:25:48.603+0000 I NETWORK [conn389] end connection 127.0.0.1:40360 (36 connections now open) 2016-04-25T07:25:49.080+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40363 #390 (38 connections now open) 2016-04-25T07:25:51.747+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:25:53.216+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 790, after connections: 1380, after extra_info: 2360, after globalLock: 2750, after locks: 2930, after network: 3330, after opcounters: 3440, after opcountersRepl: 3440, after repl: 4109, after storageEngine: 4109, after tcmalloc: 4109, after wiredTiger: 4379, at end: 6749 } 2016-04-25T07:25:53.326+0000 I COMMAND [conn388] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 8715403 } } } protocol:op_command 19819ms 2016-04-25T07:25:53.712+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:25:54.849+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:25:54.945+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40365 #391 (38 connections now open) 2016-04-25T07:25:54.945+0000 I NETWORK [conn388] end connection 127.0.0.1:40355 (36 connections now open) 2016-04-25T07:25:55.367+0000 I COMMAND [conn390] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1872ms 2016-04-25T07:25:57.950+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:25:59.294+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40367 #392 (38 connections now open) 2016-04-25T07:26:01.707+0000 I COMMAND [conn391] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3115ms 2016-04-25T07:26:04.493+0000 I NETWORK [conn390] end connection 127.0.0.1:40363 (37 connections now open) 2016-04-25T07:26:04.494+0000 I COMMAND [conn392] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1315ms 2016-04-25T07:26:08.238+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:26:08.422+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:26:08.531+0000 I NETWORK [conn392] end connection 127.0.0.1:40367 (36 connections now open) 2016-04-25T07:26:10.743+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:26:13.720+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:26:14.590+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 980, after connections: 1290, after extra_info: 2030, after globalLock: 2610, after locks: 2720, after network: 3010, after opcounters: 3010, after opcountersRepl: 3010, after repl: 5690, after storageEngine: 5980, after tcmalloc: 6490, after wiredTiger: 8260, at end: 9450 } 2016-04-25T07:26:19.798+0000 I COMMAND [conn391] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5258ms 2016-04-25T07:26:21.227+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:26:22.472+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:26:24.680+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40370 #393 (37 connections now open) 2016-04-25T07:26:26.500+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:26:26.807+0000 I NETWORK [conn391] end connection 127.0.0.1:40365 (36 connections now open) 2016-04-25T07:26:29.799+0000 I COMMAND [conn393] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 929ms 2016-04-25T07:26:30.865+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40375 #394 (37 connections now open) 2016-04-25T07:26:32.601+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:26:33.721+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:26:34.700+0000 I NETWORK [conn393] end connection 127.0.0.1:40370 (36 connections now open) 2016-04-25T07:26:35.728+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 350, after asserts: 450, after connections: 750, after extra_info: 1370, after globalLock: 1473, after locks: 1473, after network: 1473, after opcounters: 1473, after opcountersRepl: 1473, after repl: 1473, after storageEngine: 1653, after tcmalloc: 2353, after wiredTiger: 2723, at end: 4463 } 2016-04-25T07:26:36.418+0000 I COMMAND [conn394] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1993ms 2016-04-25T07:26:36.618+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:26:37.582+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:26:40.159+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:26:40.516+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:26:41.680+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:26:44.709+0000 I NETWORK [conn394] end connection 127.0.0.1:40375 (35 connections now open) 2016-04-25T07:26:45.470+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:26:46.675+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40377 #395 (36 connections now open) 2016-04-25T07:26:48.530+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:26:49.604+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:26:50.007+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40381 #396 (37 connections now open) 2016-04-25T07:26:51.291+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40382 #397 (38 connections now open) 2016-04-25T07:26:52.229+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:26:55.271+0000 I COMMAND [conn395] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3675ms 2016-04-25T07:26:56.432+0000 I COMMAND [conn396] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4652ms 2016-04-25T07:26:56.432+0000 I COMMAND [conn397] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1052ms 2016-04-25T07:26:59.333+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 370, after asserts: 860, after connections: 1560, after extra_info: 2600, after globalLock: 2700, after locks: 2790, after network: 2800, after opcounters: 2800, after opcountersRepl: 2800, after repl: 5375, after storageEngine: 6335, after tcmalloc: 7265, after wiredTiger: 8335, at end: 11095 } 2016-04-25T07:27:00.089+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:27:02.879+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:27:03.636+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:27:04.972+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:27:05.446+0000 I NETWORK [conn396] end connection 127.0.0.1:40381 (37 connections now open) 2016-04-25T07:27:05.722+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:27:06.229+0000 I NETWORK [conn397] end connection 127.0.0.1:40382 (37 connections now open) 2016-04-25T07:27:06.971+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:27:08.016+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:27:08.293+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:27:10.595+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:27:10.599+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:27:12.238+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:27:16.123+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40388 #398 (37 connections now open) 2016-04-25T07:27:18.799+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40389 #399 (38 connections now open) 2016-04-25T07:27:19.364+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 590, after asserts: 800, after connections: 1000, after extra_info: 1820, after globalLock: 1960, after locks: 2100, after network: 2180, after opcounters: 2180, after opcountersRepl: 2180, after repl: 3140, after storageEngine: 3710, after tcmalloc: 3920, after wiredTiger: 4054, at end: 4055 } 2016-04-25T07:27:23.470+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:27:24.680+0000 I COMMAND [conn398] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2383ms 2016-04-25T07:27:26.665+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:27:27.715+0000 I COMMAND [conn395] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 1861659 } } } protocol:op_command 16868ms 2016-04-25T07:27:29.910+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:27:31.074+0000 I COMMAND [conn399] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6282ms 2016-04-25T07:27:31.791+0000 I NETWORK [conn395] end connection 127.0.0.1:40377 (37 connections now open) 2016-04-25T07:27:34.113+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40391 #400 (38 connections now open) 2016-04-25T07:27:35.111+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:27:36.200+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:27:39.877+0000 I COMMAND [conn400] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1639ms 2016-04-25T07:27:41.311+0000 I COMMAND [conn399] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2235ms 2016-04-25T07:27:42.784+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 100, after asserts: 400, after connections: 798, after extra_info: 798, after globalLock: 798, after locks: 798, after network: 888, after opcounters: 988, after opcountersRepl: 988, after repl: 3658, after storageEngine: 3868, after tcmalloc: 4858, after wiredTiger: 6478, at end: 7748 } 2016-04-25T07:27:45.486+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:27:48.322+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:27:50.781+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:27:51.448+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:27:52.040+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:27:54.271+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:27:56.603+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:27:57.723+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:27:59.587+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:28:00.818+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:28:04.290+0000 I COMMAND [conn398] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6290ms 2016-04-25T07:28:07.019+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 780, after asserts: 980, after connections: 1280, after extra_info: 1710, after globalLock: 2080, after locks: 2170, after network: 2180, after opcounters: 2180, after opcountersRepl: 2180, after repl: 5060, after storageEngine: 5450, after tcmalloc: 6020, after wiredTiger: 7710, at end: 10980 } 2016-04-25T07:28:11.702+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:28:13.860+0000 I COMMAND [conn399] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 15823ms 2016-04-25T07:28:14.656+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:28:15.344+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:28:15.729+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:28:18.003+0000 I NETWORK [conn399] end connection 127.0.0.1:40389 (37 connections now open) 2016-04-25T07:28:18.287+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40399 #401 (39 connections now open) 2016-04-25T07:28:19.013+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:28:21.248+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:28:22.115+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:28:22.260+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40403 #402 (39 connections now open) 2016-04-25T07:28:22.401+0000 I COMMAND [conn400] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 8593655 } } } protocol:op_command 25442ms 2016-04-25T07:28:22.932+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:28:23.427+0000 I COMMAND [conn401] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1404ms 2016-04-25T07:28:23.925+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:28:26.704+0000 I NETWORK [conn400] end connection 127.0.0.1:40391 (38 connections now open) 2016-04-25T07:28:29.710+0000 I COMMAND [conn402] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1953ms 2016-04-25T07:28:33.250+0000 I NETWORK [conn401] end connection 127.0.0.1:40399 (37 connections now open) 2016-04-25T07:28:33.637+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:28:36.236+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:28:38.405+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:28:40.065+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 900, after connections: 1560, after extra_info: 2800, after globalLock: 3320, after locks: 3890, after network: 4180, after opcounters: 4280, after opcountersRepl: 4280, after repl: 5530, after storageEngine: 5800, after tcmalloc: 6110, after wiredTiger: 7680, at end: 9350 } 2016-04-25T07:28:40.569+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:28:41.667+0000 I COMMAND [conn398] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 6308219 } } } protocol:op_command 20029ms 2016-04-25T07:28:42.372+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:28:42.741+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:28:44.253+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40407 #403 (38 connections now open) 2016-04-25T07:28:44.705+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:28:46.197+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:28:48.322+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:28:48.510+0000 I NETWORK [conn398] end connection 127.0.0.1:40388 (37 connections now open) 2016-04-25T07:28:52.161+0000 I COMMAND [conn402] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4924ms 2016-04-25T07:28:52.447+0000 I COMMAND [conn403] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4823ms 2016-04-25T07:28:56.746+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:28:59.529+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:29:01.280+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:29:05.160+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 720, after asserts: 930, after connections: 1310, after extra_info: 1630, after globalLock: 2180, after locks: 2360, after network: 2370, after opcounters: 2370, after opcountersRepl: 2370, after repl: 4020, after storageEngine: 4790, after tcmalloc: 5520, after wiredTiger: 6780, at end: 9650 } 2016-04-25T07:29:05.350+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:29:08.423+0000 I COMMAND [conn402] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2392ms 2016-04-25T07:29:09.415+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40412 #404 (38 connections now open) 2016-04-25T07:29:10.158+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:29:12.827+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 104ms 2016-04-25T07:29:15.176+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:29:16.163+0000 I COMMAND [conn404] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2067ms 2016-04-25T07:29:16.754+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:29:17.226+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:29:17.597+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:29:19.923+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:29:20.729+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:29:21.716+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:29:23.539+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:29:23.545+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:29:23.929+0000 I COMMAND [conn403] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 1779435 } } } protocol:op_command 14948ms 2016-04-25T07:29:24.853+0000 I COMMAND [conn404] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2692ms 2016-04-25T07:29:26.318+0000 I NETWORK [conn403] end connection 127.0.0.1:40407 (37 connections now open) 2016-04-25T07:29:27.478+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 310, after asserts: 530, after connections: 980, after extra_info: 2390, after globalLock: 2780, after locks: 2890, after network: 2890, after opcounters: 2890, after opcountersRepl: 2890, after repl: 4540, after storageEngine: 4960, after tcmalloc: 5760, after wiredTiger: 7140, at end: 9470 } 2016-04-25T07:29:32.534+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:29:32.826+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40417 #405 (38 connections now open) 2016-04-25T07:29:33.833+0000 I COMMAND [conn402] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 4506315 } } } protocol:op_command 18939ms 2016-04-25T07:29:35.913+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:29:36.958+0000 I NETWORK [conn402] end connection 127.0.0.1:40403 (37 connections now open) 2016-04-25T07:29:38.443+0000 I COMMAND [conn405] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1006ms 2016-04-25T07:29:39.671+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40421 #406 (38 connections now open) 2016-04-25T07:29:40.057+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:29:42.392+0000 I NETWORK [conn405] end connection 127.0.0.1:40417 (37 connections now open) 2016-04-25T07:29:44.190+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:29:45.382+0000 I COMMAND [conn406] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2277ms 2016-04-25T07:29:46.292+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 400, after connections: 540, after extra_info: 1136, after globalLock: 1136, after locks: 1136, after network: 1136, after opcounters: 1136, after opcountersRepl: 1136, after repl: 2866, after storageEngine: 3416, after tcmalloc: 4016, after wiredTiger: 4996, at end: 6876 } 2016-04-25T07:29:47.797+0000 I COMMAND [conn404] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 11236ms 2016-04-25T07:29:51.449+0000 I NETWORK [conn404] end connection 127.0.0.1:40412 (36 connections now open) 2016-04-25T07:29:52.853+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:29:55.287+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:29:57.213+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:29:57.702+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40424 #407 (37 connections now open) 2016-04-25T07:29:58.520+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 630, after connections: 720, after extra_info: 1100, after globalLock: 1480, after locks: 1680, after network: 1780, after opcounters: 1780, after opcountersRepl: 1780, after repl: 3180, after storageEngine: 3590, after tcmalloc: 4340, after wiredTiger: 5584, at end: 5584 } 2016-04-25T07:29:58.919+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:30:01.043+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:30:03.254+0000 I COMMAND [conn407] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2164ms 2016-04-25T07:30:04.986+0000 I COMMAND [conn406] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2329ms 2016-04-25T07:30:06.641+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:30:09.896+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:30:14.183+0000 I NETWORK [conn407] end connection 127.0.0.1:40424 (36 connections now open) 2016-04-25T07:30:14.185+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:30:17.404+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:30:17.562+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 430, after asserts: 700, after connections: 980, after extra_info: 1380, after globalLock: 1740, after locks: 1890, after network: 1890, after opcounters: 1890, after opcountersRepl: 1890, after repl: 3060, after storageEngine: 3360, after tcmalloc: 4440, after wiredTiger: 5890, at end: 7650 } 2016-04-25T07:30:18.229+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40428 #408 (37 connections now open) 2016-04-25T07:30:18.728+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:30:19.397+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40429 #409 (38 connections now open) 2016-04-25T07:30:24.439+0000 I COMMAND [conn408] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2736ms 2016-04-25T07:30:24.439+0000 I COMMAND [conn409] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1097ms 2016-04-25T07:30:27.302+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:30:28.790+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:30:30.833+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:30:32.525+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:30:33.803+0000 I COMMAND [conn406] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 1202509 } } } protocol:op_command 17560ms 2016-04-25T07:30:34.519+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:30:34.514+0000 I NETWORK [conn409] end connection 127.0.0.1:40429 (37 connections now open) 2016-04-25T07:30:35.331+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:30:36.526+0000 I NETWORK [conn406] end connection 127.0.0.1:40421 (36 connections now open) 2016-04-25T07:30:36.929+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:30:37.862+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:30:39.828+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:30:40.905+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:30:42.603+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40436 #410 (37 connections now open) 2016-04-25T07:30:42.608+0000 I COMMAND [conn408] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2646ms 2016-04-25T07:30:46.102+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 860, after connections: 1190, after extra_info: 1205, after globalLock: 1205, after locks: 1205, after network: 1205, after opcounters: 1205, after opcountersRepl: 1205, after repl: 1205, after storageEngine: 1205, after tcmalloc: 1205, after wiredTiger: 1855, at end: 4505 } 2016-04-25T07:30:46.200+0000 I COMMAND [conn410] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1047ms 2016-04-25T07:30:50.288+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:30:50.662+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:30:51.239+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40441 #411 (38 connections now open) 2016-04-25T07:30:52.284+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:30:54.402+0000 I NETWORK [conn410] end connection 127.0.0.1:40436 (37 connections now open) 2016-04-25T07:30:54.502+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:30:56.222+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:30:58.610+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:30:58.963+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:31:00.718+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:31:00.715+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:31:00.722+0000 I COMMAND [conn408] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 12021ms 2016-04-25T07:31:02.573+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:31:03.111+0000 I NETWORK [conn408] end connection 127.0.0.1:40428 (36 connections now open) 2016-04-25T07:31:03.570+0000 I COMMAND [conn411] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7485ms 2016-04-25T07:31:04.715+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40443 #412 (38 connections now open) 2016-04-25T07:31:09.717+0000 I COMMAND [conn411] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2615ms 2016-04-25T07:31:09.823+0000 I COMMAND [conn412] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2008ms 2016-04-25T07:31:11.333+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 100, after globalLock: 190, after locks: 190, after network: 190, after opcounters: 190, after opcountersRepl: 190, after repl: 980, after storageEngine: 1380, after tcmalloc: 2440, after wiredTiger: 3320, at end: 5000 } 2016-04-25T07:31:13.112+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:31:14.691+0000 I NETWORK [conn412] end connection 127.0.0.1:40443 (36 connections now open) 2016-04-25T07:31:14.887+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:31:16.086+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:31:18.709+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:31:19.272+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:31:25.333+0000 I COMMAND [conn411] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4825ms 2016-04-25T07:31:25.430+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40448 #413 (37 connections now open) 2016-04-25T07:31:27.406+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40450 #414 (38 connections now open) 2016-04-25T07:31:29.016+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:31:29.892+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 460, after asserts: 650, after connections: 760, after extra_info: 1330, after globalLock: 1522, after locks: 1522, after network: 1522, after opcounters: 1522, after opcountersRepl: 1522, after repl: 1522, after storageEngine: 1522, after tcmalloc: 1787, after wiredTiger: 1787, at end: 2407 } 2016-04-25T07:31:31.091+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:31:31.292+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:31:31.471+0000 I COMMAND [conn413] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2162ms 2016-04-25T07:31:34.714+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:31:35.275+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:31:35.605+0000 I COMMAND [conn414] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3530ms 2016-04-25T07:31:36.159+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:31:37.582+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:31:38.844+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:31:41.147+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:31:45.624+0000 I COMMAND [conn413] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5813ms 2016-04-25T07:31:49.172+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40458 #415 (39 connections now open) 2016-04-25T07:31:50.250+0000 I NETWORK [conn413] end connection 127.0.0.1:40448 (38 connections now open) 2016-04-25T07:31:51.548+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:31:51.547+0000 I COMMAND [conn415] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 691ms 2016-04-25T07:31:52.049+0000 I COMMAND [conn411] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 8100999 } } } protocol:op_command 22730ms 2016-04-25T07:31:53.944+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:31:55.879+0000 I NETWORK [conn411] end connection 127.0.0.1:40441 (37 connections now open) 2016-04-25T07:31:56.323+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:31:56.414+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:31:59.431+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:31:59.439+0000 I NETWORK [conn415] end connection 127.0.0.1:40458 (36 connections now open) 2016-04-25T07:32:00.013+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40460 #416 (38 connections now open) 2016-04-25T07:32:03.926+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:32:05.841+0000 I COMMAND [conn414] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 6903601 } } } protocol:op_command 17875ms 2016-04-25T07:32:05.938+0000 I COMMAND [conn416] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2093ms 2016-04-25T07:32:06.236+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 740, after connections: 1030, after extra_info: 1620, after globalLock: 2080, after locks: 2086, after network: 2086, after opcounters: 2086, after opcountersRepl: 2086, after repl: 2526, after storageEngine: 3136, after tcmalloc: 3716, after wiredTiger: 4126, at end: 6486 } 2016-04-25T07:32:08.103+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40463 #417 (38 connections now open) 2016-04-25T07:32:09.951+0000 I NETWORK [conn414] end connection 127.0.0.1:40450 (37 connections now open) 2016-04-25T07:32:11.594+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:32:13.145+0000 I COMMAND [conn417] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1088ms 2016-04-25T07:32:13.832+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:32:14.191+0000 I NETWORK [conn416] end connection 127.0.0.1:40460 (36 connections now open) 2016-04-25T07:32:14.576+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:32:14.576+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:32:16.753+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:32:18.582+0000 I NETWORK [conn417] end connection 127.0.0.1:40463 (35 connections now open) 2016-04-25T07:32:20.373+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40467 #418 (37 connections now open) 2016-04-25T07:32:23.341+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40468 #419 (37 connections now open) 2016-04-25T07:32:25.823+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 620, after connections: 1001, after extra_info: 1001, after globalLock: 1081, after locks: 1371, after network: 1591, after opcounters: 1871, after opcountersRepl: 1871, after repl: 2261, after storageEngine: 2651, after tcmalloc: 2662, after wiredTiger: 2762, at end: 4432 } 2016-04-25T07:32:25.928+0000 I COMMAND [conn418] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1416ms 2016-04-25T07:32:26.328+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:32:27.584+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:32:28.458+0000 I COMMAND [conn419] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2430ms 2016-04-25T07:32:30.597+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:32:30.994+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:32:32.469+0000 I NETWORK [conn418] end connection 127.0.0.1:40467 (36 connections now open) 2016-04-25T07:32:32.997+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:32:34.860+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40471 #420 (37 connections now open) 2016-04-25T07:32:38.108+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:32:42.272+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40475 #421 (38 connections now open) 2016-04-25T07:32:42.272+0000 I COMMAND [conn420] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2197ms 2016-04-25T07:32:45.472+0000 I COMMAND [conn419] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 393438 } } } protocol:op_command 11614ms 2016-04-25T07:32:45.976+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 490, after connections: 1240, after extra_info: 2170, after globalLock: 2680, after locks: 3110, after network: 3400, after opcounters: 3410, after opcountersRepl: 3410, after repl: 4270, after storageEngine: 4720, after tcmalloc: 5205, after wiredTiger: 5475, at end: 7425 } 2016-04-25T07:32:46.480+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:32:47.626+0000 I COMMAND [conn421] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1476ms 2016-04-25T07:32:48.229+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:32:50.072+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:32:50.178+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:32:50.798+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:32:53.802+0000 I NETWORK [conn419] end connection 127.0.0.1:40468 (37 connections now open) 2016-04-25T07:32:54.890+0000 I NETWORK [conn421] end connection 127.0.0.1:40475 (37 connections now open) 2016-04-25T07:33:00.764+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:33:01.350+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40477 #422 (37 connections now open) 2016-04-25T07:33:02.589+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:33:03.933+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:33:04.633+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40479 #423 (38 connections now open) 2016-04-25T07:33:08.350+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:33:08.350+0000 I COMMAND [conn420] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 2564693 } } } protocol:op_command 14922ms 2016-04-25T07:33:11.811+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 590, after connections: 980, after extra_info: 1580, after globalLock: 1779, after locks: 1779, after network: 1779, after opcounters: 1959, after opcountersRepl: 2259, after repl: 5404, after storageEngine: 5894, after tcmalloc: 6374, after wiredTiger: 7784, at end: 9514 } 2016-04-25T07:33:12.228+0000 I COMMAND [conn422] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6987ms 2016-04-25T07:33:13.363+0000 I COMMAND [conn423] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5211ms 2016-04-25T07:33:13.455+0000 I NETWORK [conn420] end connection 127.0.0.1:40471 (37 connections now open) 2016-04-25T07:33:15.149+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 191ms 2016-04-25T07:33:16.761+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:33:18.414+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:33:18.807+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40483 #424 (38 connections now open) 2016-04-25T07:33:19.840+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:33:21.319+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:33:24.342+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:33:24.522+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:33:27.827+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:33:27.834+0000 I COMMAND [conn424] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3086ms 2016-04-25T07:33:29.000+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:33:30.727+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:33:30.964+0000 I COMMAND [conn423] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4260ms 2016-04-25T07:33:35.036+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 590, after connections: 690, after extra_info: 1670, after globalLock: 2170, after locks: 2500, after network: 2990, after opcounters: 3220, after opcountersRepl: 3230, after repl: 4640, after storageEngine: 5260, after tcmalloc: 5970, after wiredTiger: 7030, at end: 9220 } 2016-04-25T07:33:42.175+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:33:44.048+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:33:46.706+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:33:51.069+0000 I COMMAND [conn423] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6739ms 2016-04-25T07:33:52.857+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:33:53.759+0000 I COMMAND [conn424] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 12238ms 2016-04-25T07:33:54.168+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:33:54.362+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 10, after asserts: 10, after connections: 10, after extra_info: 670, after globalLock: 940, after locks: 1340, after network: 1520, after opcounters: 1520, after opcountersRepl: 1520, after repl: 5630, after storageEngine: 6320, after tcmalloc: 7130, after wiredTiger: 8510, at end: 9950 } 2016-04-25T07:33:55.722+0000 I NETWORK [conn424] end connection 127.0.0.1:40483 (37 connections now open) 2016-04-25T07:33:55.722+0000 I NETWORK [conn423] end connection 127.0.0.1:40479 (37 connections now open) 2016-04-25T07:33:57.235+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:33:57.235+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:33:57.236+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:33:58.179+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:34:00.365+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40491 #425 (37 connections now open) 2016-04-25T07:34:04.679+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:34:05.777+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40492 #426 (38 connections now open) 2016-04-25T07:34:06.250+0000 I COMMAND [conn425] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1579ms 2016-04-25T07:34:06.253+0000 I COMMAND [conn422] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 42, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 15092ms 2016-04-25T07:34:06.256+0000 I REPL [ReplicationExecutor] dry election run succeeded, running for election 2016-04-25T07:34:09.350+0000 I NETWORK [conn422] end connection 127.0.0.1:40477 (37 connections now open) 2016-04-25T07:34:11.524+0000 I COMMAND [conn425] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3312ms 2016-04-25T07:34:12.275+0000 I COMMAND [conn426] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2945ms 2016-04-25T07:34:16.907+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:34:17.708+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40494 #427 (38 connections now open) 2016-04-25T07:34:18.235+0000 I NETWORK [conn425] end connection 127.0.0.1:40491 (36 connections now open) 2016-04-25T07:34:21.978+0000 I NETWORK [conn426] end connection 127.0.0.1:40492 (36 connections now open) 2016-04-25T07:34:24.408+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:34:24.816+0000 I COMMAND [conn427] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2123ms 2016-04-25T07:34:25.815+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40496 #428 (37 connections now open) 2016-04-25T07:34:27.521+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 840, after connections: 1260, after extra_info: 2040, after globalLock: 2521, after locks: 2521, after network: 2521, after opcounters: 2611, after opcountersRepl: 2611, after repl: 5731, after storageEngine: 6611, after tcmalloc: 7431, after wiredTiger: 8751, at end: 10956 } 2016-04-25T07:34:29.187+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40497 #429 (38 connections now open) 2016-04-25T07:34:29.479+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:34:33.475+0000 I COMMAND [conn428] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2342ms 2016-04-25T07:34:34.435+0000 I COMMAND [conn427] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 42 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3359ms 2016-04-25T07:34:36.257+0000 I COMMAND [conn429] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1961ms 2016-04-25T07:34:37.285+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:34:39.560+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:34:39.565+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:34:39.965+0000 I REPL [ReplicationExecutor] not becoming primary, we received insufficient votes 2016-04-25T07:34:41.746+0000 I NETWORK [conn427] end connection 127.0.0.1:40494 (37 connections now open) 2016-04-25T07:34:42.105+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:34:43.065+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:34:43.403+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:34:44.836+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:34:47.945+0000 I COMMAND [conn428] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1451ms 2016-04-25T07:34:51.746+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 600, after connections: 710, after extra_info: 1550, after globalLock: 1960, after locks: 2320, after network: 2720, after opcounters: 2990, after opcountersRepl: 2990, after repl: 4200, after storageEngine: 4620, after tcmalloc: 5300, after wiredTiger: 6250, at end: 8860 } 2016-04-25T07:34:54.533+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:35:02.695+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:35:04.729+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:35:07.149+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40503 #430 (38 connections now open) 2016-04-25T07:35:08.511+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:35:13.027+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40506 #431 (39 connections now open) 2016-04-25T07:35:13.428+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:35:13.428+0000 I COMMAND [conn429] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 10134619 } } } protocol:op_command 24902ms 2016-04-25T07:35:14.801+0000 I COMMAND [conn430] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2266ms 2016-04-25T07:35:17.504+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 222ms 2016-04-25T07:35:18.255+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:35:21.562+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:35:21.983+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:35:24.135+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:35:24.705+0000 I NETWORK [conn429] end connection 127.0.0.1:40497 (38 connections now open) 2016-04-25T07:35:24.813+0000 I COMMAND [conn431] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5483ms 2016-04-25T07:35:26.654+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:35:26.746+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:35:29.672+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:35:31.604+0000 I COMMAND [conn428] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 7765725 } } } protocol:op_command 26942ms 2016-04-25T07:35:32.471+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 430, after asserts: 860, after connections: 1330, after extra_info: 2990, after globalLock: 3520, after locks: 3830, after network: 4010, after opcounters: 4030, after opcountersRepl: 4030, after repl: 7520, after storageEngine: 8580, after tcmalloc: 10370, after wiredTiger: 11620, at end: 12880 } 2016-04-25T07:35:33.652+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:35:34.707+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:35:38.388+0000 I NETWORK [conn428] end connection 127.0.0.1:40496 (37 connections now open) 2016-04-25T07:35:38.693+0000 I COMMAND [conn430] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5232ms 2016-04-25T07:35:40.061+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:35:41.583+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:35:44.203+0000 I NETWORK [conn430] end connection 127.0.0.1:40503 (36 connections now open) 2016-04-25T07:35:48.851+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40512 #432 (37 connections now open) 2016-04-25T07:35:50.160+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:35:51.469+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:35:52.390+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 650, after connections: 740, after extra_info: 1630, after globalLock: 1990, after locks: 2180, after network: 2480, after opcounters: 2610, after opcountersRepl: 2610, after repl: 3086, after storageEngine: 3086, after tcmalloc: 3086, after wiredTiger: 3576, at end: 4766 } 2016-04-25T07:35:52.393+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:35:54.138+0000 I COMMAND [conn431] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 13241ms 2016-04-25T07:35:58.366+0000 I COMMAND [conn432] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5153ms 2016-04-25T07:35:59.091+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:35:59.850+0000 I NETWORK [conn431] end connection 127.0.0.1:40506 (36 connections now open) 2016-04-25T07:36:02.355+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:36:02.653+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:36:05.954+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:36:06.341+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40515 #433 (37 connections now open) 2016-04-25T07:36:07.785+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:36:08.875+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:36:09.473+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:36:11.566+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:36:11.841+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:36:14.523+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:36:14.629+0000 I COMMAND [conn432] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7192ms 2016-04-25T07:36:15.040+0000 I COMMAND [conn433] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2650ms 2016-04-25T07:36:16.533+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:36:17.945+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 140, after globalLock: 470, after locks: 570, after network: 570, after opcounters: 570, after opcountersRepl: 570, after repl: 5100, after storageEngine: 5690, after tcmalloc: 6590, after wiredTiger: 7950, at end: 9070 } 2016-04-25T07:36:17.947+0000 I NETWORK [conn432] end connection 127.0.0.1:40512 (36 connections now open) 2016-04-25T07:36:23.705+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40519 #434 (37 connections now open) 2016-04-25T07:36:25.117+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:36:27.971+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:36:33.174+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:36:34.431+0000 I COMMAND [conn434] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5319ms 2016-04-25T07:36:34.673+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:36:36.924+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:36:37.952+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 390, after connections: 490, after extra_info: 1130, after globalLock: 1400, after locks: 1650, after network: 1940, after opcounters: 2050, after opcountersRepl: 2050, after repl: 4070, after storageEngine: 4500, after tcmalloc: 5380, after wiredTiger: 7350, at end: 9030 } 2016-04-25T07:36:39.225+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:36:48.480+0000 I COMMAND [conn433] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 18569ms 2016-04-25T07:36:48.985+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:36:51.969+0000 I NETWORK [conn433] end connection 127.0.0.1:40515 (36 connections now open) 2016-04-25T07:36:52.483+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:36:53.057+0000 I COMMAND [conn434] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 8633ms 2016-04-25T07:36:54.874+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:36:56.008+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40524 #435 (37 connections now open) 2016-04-25T07:36:57.099+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:36:59.038+0000 I NETWORK [conn434] end connection 127.0.0.1:40519 (36 connections now open) 2016-04-25T07:36:59.139+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:37:00.444+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:37:02.283+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:37:03.251+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40526 #436 (37 connections now open) 2016-04-25T07:37:03.251+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:37:07.589+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:37:08.368+0000 I COMMAND [conn435] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7825ms 2016-04-25T07:37:10.621+0000 I COMMAND [conn436] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2958ms 2016-04-25T07:37:12.301+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:37:13.222+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 720, after connections: 860, after extra_info: 2200, after globalLock: 2400, after locks: 2740, after network: 2930, after opcounters: 3030, after opcountersRepl: 3030, after repl: 7765, after storageEngine: 8205, after tcmalloc: 8995, after wiredTiger: 11115, at end: 14485 } 2016-04-25T07:37:18.791+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 191ms 2016-04-25T07:37:19.832+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:37:22.160+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:37:26.934+0000 I COMMAND [conn436] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1977ms 2016-04-25T07:37:30.178+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:37:32.590+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:37:38.150+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:37:38.796+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:37:40.603+0000 I COMMAND [conn435] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 4489193 } } } protocol:op_command 21883ms 2016-04-25T07:37:40.603+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 680, after connections: 1060, after extra_info: 1870, after globalLock: 2240, after locks: 2440, after network: 2540, after opcounters: 2540, after opcountersRepl: 2540, after repl: 4970, after storageEngine: 5260, after tcmalloc: 5780, after wiredTiger: 7780, at end: 9500 } 2016-04-25T07:37:42.223+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:37:45.311+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40531 #437 (38 connections now open) 2016-04-25T07:37:47.840+0000 I NETWORK [conn435] end connection 127.0.0.1:40524 (37 connections now open) 2016-04-25T07:37:47.847+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:37:47.849+0000 I COMMAND [conn436] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6146ms 2016-04-25T07:37:48.984+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40534 #438 (39 connections now open) 2016-04-25T07:37:49.088+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:37:52.334+0000 I COMMAND [conn437] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1714ms 2016-04-25T07:37:54.216+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:37:55.494+0000 I NETWORK [conn436] end connection 127.0.0.1:40526 (37 connections now open) 2016-04-25T07:37:57.640+0000 I COMMAND [conn438] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2913ms 2016-04-25T07:37:57.751+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:38:05.085+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:38:07.291+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:38:07.476+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 680, after connections: 1160, after extra_info: 1600, after globalLock: 1770, after locks: 1770, after network: 1780, after opcounters: 1780, after opcountersRepl: 1780, after repl: 3120, after storageEngine: 3710, after tcmalloc: 4320, after wiredTiger: 6760, at end: 9880 } 2016-04-25T07:38:08.600+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:38:09.004+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:38:16.767+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:38:17.091+0000 I COMMAND [conn438] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 12640ms 2016-04-25T07:38:20.715+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 223ms 2016-04-25T07:38:20.715+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40540 #439 (38 connections now open) 2016-04-25T07:38:20.715+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:38:24.599+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:38:24.901+0000 I NETWORK [conn438] end connection 127.0.0.1:40534 (37 connections now open) 2016-04-25T07:38:29.220+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:38:30.833+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:38:31.482+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:38:33.979+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:38:34.759+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:38:36.853+0000 I COMMAND [conn437] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 5672710 } } } protocol:op_command 25372ms 2016-04-25T07:38:37.464+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40541 #440 (38 connections now open) 2016-04-25T07:38:38.717+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:38:39.644+0000 I COMMAND [conn439] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 10961ms 2016-04-25T07:38:40.810+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:38:42.119+0000 I NETWORK [conn437] end connection 127.0.0.1:40531 (37 connections now open) 2016-04-25T07:38:45.313+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 480, after connections: 900, after extra_info: 2090, after globalLock: 2440, after locks: 2790, after network: 2900, after opcounters: 2900, after opcountersRepl: 2900, after repl: 11033, after storageEngine: 11033, after tcmalloc: 11033, after wiredTiger: 12743, at end: 16123 } 2016-04-25T07:38:46.737+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40544 #441 (38 connections now open) 2016-04-25T07:38:47.225+0000 I COMMAND [conn440] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3246ms 2016-04-25T07:38:50.333+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:38:51.870+0000 I COMMAND [conn441] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 702ms 2016-04-25T07:38:54.354+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:38:57.801+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:39:03.816+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:39:04.419+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:39:04.710+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:39:08.530+0000 I COMMAND [conn439] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 3987616 } } } protocol:op_command 19513ms 2016-04-25T07:39:09.036+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 350, after asserts: 350, after connections: 550, after extra_info: 1860, after globalLock: 2120, after locks: 2220, after network: 2230, after opcounters: 2230, after opcountersRepl: 2230, after repl: 3730, after storageEngine: 4110, after tcmalloc: 4920, after wiredTiger: 6260, at end: 11720 } 2016-04-25T07:39:10.244+0000 I COMMAND [conn441] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 8875ms 2016-04-25T07:39:15.449+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:39:19.262+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:39:20.181+0000 I NETWORK [conn439] end connection 127.0.0.1:40540 (37 connections now open) 2016-04-25T07:39:21.846+0000 I NETWORK [conn441] end connection 127.0.0.1:40544 (37 connections now open) 2016-04-25T07:39:22.048+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:39:22.342+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 107ms 2016-04-25T07:39:23.884+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40550 #442 (37 connections now open) 2016-04-25T07:39:23.884+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:39:24.439+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:39:24.646+0000 I COMMAND [conn440] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 23802ms 2016-04-25T07:39:25.954+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40551 #443 (38 connections now open) 2016-04-25T07:39:26.899+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:39:28.657+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:39:28.658+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:39:29.841+0000 I NETWORK [conn440] end connection 127.0.0.1:40541 (37 connections now open) 2016-04-25T07:39:33.187+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:39:34.309+0000 I COMMAND [conn442] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4424ms 2016-04-25T07:39:35.867+0000 I COMMAND [conn443] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4120ms 2016-04-25T07:39:42.486+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 660, after connections: 1200, after extra_info: 1480, after globalLock: 1660, after locks: 1750, after network: 1760, after opcounters: 1760, after opcountersRepl: 1760, after repl: 3130, after storageEngine: 3660, after tcmalloc: 5160, after wiredTiger: 6350, at end: 8800 } 2016-04-25T07:39:44.081+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:39:47.779+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:39:51.874+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:39:52.732+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:39:56.445+0000 I COMMAND [conn442] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 13744ms 2016-04-25T07:39:59.273+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40556 #444 (38 connections now open) 2016-04-25T07:40:03.555+0000 I NETWORK [conn442] end connection 127.0.0.1:40550 (37 connections now open) 2016-04-25T07:40:03.914+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:40:07.123+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:40:08.817+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:40:10.477+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:40:11.199+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:40:12.023+0000 I COMMAND [conn443] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 429480 } } } protocol:op_command 20358ms 2016-04-25T07:40:12.626+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:40:12.959+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:40:13.064+0000 I COMMAND [conn444] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 8154ms 2016-04-25T07:40:13.156+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:40:13.159+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 200, after connections: 390, after extra_info: 1480, after globalLock: 2030, after locks: 2520, after network: 2890, after opcounters: 2980, after opcountersRepl: 2980, after repl: 7510, after storageEngine: 8230, after tcmalloc: 8980, after wiredTiger: 10190, at end: 11890 } 2016-04-25T07:40:14.783+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:40:15.865+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40560 #445 (38 connections now open) 2016-04-25T07:40:16.835+0000 I NETWORK [conn443] end connection 127.0.0.1:40551 (36 connections now open) 2016-04-25T07:40:17.028+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:40:21.604+0000 I COMMAND [conn444] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5306ms 2016-04-25T07:40:22.830+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-25T07:40:22.738+0000 I COMMAND [conn445] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1917ms 2016-04-25T07:40:25.497+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:40:29.694+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:40:32.964+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:40:38.931+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:40:41.927+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 820, after connections: 1170, after extra_info: 2200, after globalLock: 2770, after locks: 3140, after network: 3480, after opcounters: 3480, after opcountersRepl: 3480, after repl: 6830, after storageEngine: 7440, after tcmalloc: 8140, after wiredTiger: 10090, at end: 12310 } 2016-04-25T07:40:41.925+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:40:44.702+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40563 #446 (38 connections now open) 2016-04-25T07:40:50.088+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:40:50.089+0000 I COMMAND [conn444] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 14557ms 2016-04-25T07:40:51.903+0000 I NETWORK [conn444] end connection 127.0.0.1:40556 (37 connections now open) 2016-04-25T07:40:51.906+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:40:54.458+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:40:55.902+0000 I COMMAND [conn446] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4459ms 2016-04-25T07:40:56.953+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40568 #447 (38 connections now open) 2016-04-25T07:40:57.174+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:40:57.445+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:40:57.538+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:41:02.314+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:41:04.431+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:41:06.920+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:41:09.072+0000 I COMMAND [conn447] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7405ms 2016-04-25T07:41:11.592+0000 I COMMAND [conn445] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 2079415 } } } protocol:op_command 24198ms 2016-04-25T07:41:12.188+0000 I COMMAND [conn446] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7032ms 2016-04-25T07:41:12.760+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:41:14.088+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40569 #448 (39 connections now open) 2016-04-25T07:41:14.205+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 370, after asserts: 730, after connections: 1440, after extra_info: 2250, after globalLock: 3010, after locks: 3680, after network: 4130, after opcounters: 4390, after opcountersRepl: 4390, after repl: 8090, after storageEngine: 9490, after tcmalloc: 10860, after wiredTiger: 12500, at end: 14687 } 2016-04-25T07:41:15.506+0000 I NETWORK [conn445] end connection 127.0.0.1:40560 (37 connections now open) 2016-04-25T07:41:15.510+0000 I NETWORK [conn446] end connection 127.0.0.1:40563 (37 connections now open) 2016-04-25T07:41:20.501+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:41:22.733+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:41:22.924+0000 I COMMAND [conn447] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6744ms 2016-04-25T07:41:23.032+0000 I COMMAND [conn448] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4441ms 2016-04-25T07:41:27.888+0000 I NETWORK [conn447] end connection 127.0.0.1:40568 (36 connections now open) 2016-04-25T07:41:31.408+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:41:31.501+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:41:31.501+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 550, after connections: 820, after extra_info: 1300, after globalLock: 1540, after locks: 1630, after network: 1640, after opcounters: 1640, after opcountersRepl: 1640, after repl: 3080, after storageEngine: 3370, after tcmalloc: 3690, after wiredTiger: 4190, at end: 6140 } 2016-04-25T07:41:31.586+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40573 #449 (37 connections now open) 2016-04-25T07:41:31.596+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:41:34.021+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:41:41.427+0000 I COMMAND [conn449] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6874ms 2016-04-25T07:41:42.113+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:41:45.724+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:41:47.619+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:41:48.988+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:41:51.272+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:41:51.753+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:41:54.154+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:41:55.683+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:41:57.077+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40578 #450 (38 connections now open) 2016-04-25T07:41:57.982+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 630, after connections: 1140, after extra_info: 2040, after globalLock: 2230, after locks: 2240, after network: 2340, after opcounters: 2340, after opcountersRepl: 2340, after repl: 4770, after storageEngine: 5160, after tcmalloc: 5680, after wiredTiger: 7070, at end: 7672 } 2016-04-25T07:41:59.183+0000 I COMMAND [conn448] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 6655722 } } } protocol:op_command 26998ms 2016-04-25T07:41:59.763+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:41:59.775+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:41:59.764+0000 I COMMAND [conn449] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7804ms 2016-04-25T07:42:02.623+0000 I NETWORK [conn449] end connection 127.0.0.1:40573 (37 connections now open) 2016-04-25T07:42:02.623+0000 I NETWORK [conn448] end connection 127.0.0.1:40569 (37 connections now open) 2016-04-25T07:42:06.457+0000 I COMMAND [conn450] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4829ms 2016-04-25T07:42:06.724+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:42:07.866+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40581 #451 (37 connections now open) 2016-04-25T07:42:08.612+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:42:10.456+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:42:11.442+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:42:12.701+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:42:14.196+0000 I COMMAND [conn451] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2650ms 2016-04-25T07:42:15.592+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:42:16.295+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:42:18.402+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:42:19.637+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:42:22.639+0000 I NETWORK [conn451] end connection 127.0.0.1:40581 (36 connections now open) 2016-04-25T07:42:23.875+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 600, after connections: 1340, after extra_info: 2310, after globalLock: 2710, after locks: 3100, after network: 3500, after opcounters: 3500, after opcountersRepl: 3500, after repl: 6860, after storageEngine: 7670, after tcmalloc: 8570, after wiredTiger: 10000, at end: 12340 } 2016-04-25T07:42:27.775+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40588 #452 (37 connections now open) 2016-04-25T07:42:29.254+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40589 #453 (38 connections now open) 2016-04-25T07:42:30.332+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:42:30.332+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:42:33.810+0000 I COMMAND [conn450] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 14268ms 2016-04-25T07:42:33.988+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:42:34.385+0000 I COMMAND [conn452] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3281ms 2016-04-25T07:42:35.612+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:42:35.793+0000 I NETWORK [conn450] end connection 127.0.0.1:40578 (37 connections now open) 2016-04-25T07:42:36.571+0000 I COMMAND [conn453] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4083ms 2016-04-25T07:42:37.299+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:42:39.170+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40591 #454 (38 connections now open) 2016-04-25T07:42:42.057+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:42:44.902+0000 I COMMAND [conn454] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2027ms 2016-04-25T07:42:46.899+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:42:47.523+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 190, after globalLock: 350, after locks: 530, after network: 820, after opcounters: 830, after opcountersRepl: 830, after repl: 2030, after storageEngine: 2480, after tcmalloc: 3010, after wiredTiger: 4240, at end: 6880 } 2016-04-25T07:42:49.830+0000 I COMMAND [conn453] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1924ms 2016-04-25T07:42:50.041+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:42:54.216+0000 I NETWORK [conn454] end connection 127.0.0.1:40591 (37 connections now open) 2016-04-25T07:42:54.634+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:42:56.730+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:42:57.864+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:43:04.485+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40597 #455 (38 connections now open) 2016-04-25T07:43:07.120+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:43:07.122+0000 I COMMAND [conn452] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1231ms 2016-04-25T07:43:09.197+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:43:11.553+0000 I COMMAND [conn455] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1751ms 2016-04-25T07:43:11.562+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:43:13.214+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 280, after locks: 480, after network: 580, after opcounters: 670, after opcountersRepl: 670, after repl: 2700, after storageEngine: 3290, after tcmalloc: 4320, after wiredTiger: 5110, at end: 6580 } 2016-04-25T07:43:14.166+0000 I COMMAND [conn453] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 2450 } } } protocol:op_command 11083ms 2016-04-25T07:43:14.465+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:43:15.280+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:43:16.650+0000 I NETWORK [conn453] end connection 127.0.0.1:40589 (37 connections now open) 2016-04-25T07:43:17.000+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:43:18.039+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:43:21.798+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:43:24.038+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:43:25.520+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 107ms 2016-04-25T07:43:26.877+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:43:30.497+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40601 #456 (38 connections now open) 2016-04-25T07:43:30.916+0000 I COMMAND [conn452] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5665ms 2016-04-25T07:43:36.578+0000 I COMMAND [conn456] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1679ms 2016-04-25T07:43:36.879+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:43:38.591+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:43:39.000+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 90, after connections: 370, after extra_info: 1420, after globalLock: 1830, after locks: 2030, after network: 2220, after opcounters: 2220, after opcountersRepl: 2220, after repl: 3010, after storageEngine: 3420, after tcmalloc: 4190, after wiredTiger: 5070, at end: 7360 } 2016-04-25T07:43:41.100+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:43:41.092+0000 I COMMAND [conn455] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 12117ms 2016-04-25T07:43:43.762+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:43:47.051+0000 I NETWORK [conn455] end connection 127.0.0.1:40597 (37 connections now open) 2016-04-25T07:43:50.612+0000 I COMMAND [conn456] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7571ms 2016-04-25T07:43:51.374+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40605 #457 (38 connections now open) 2016-04-25T07:43:51.873+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:43:52.612+0000 I COMMAND [conn452] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 5720273 } } } protocol:op_command 17799ms 2016-04-25T07:43:52.911+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:43:53.598+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40608 #458 (39 connections now open) 2016-04-25T07:43:56.918+0000 I NETWORK [conn456] end connection 127.0.0.1:40601 (38 connections now open) 2016-04-25T07:43:58.703+0000 I COMMAND [conn457] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2259ms 2016-04-25T07:43:59.174+0000 I NETWORK [conn452] end connection 127.0.0.1:40588 (37 connections now open) 2016-04-25T07:43:59.881+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:44:00.168+0000 I COMMAND [conn458] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1266ms 2016-04-25T07:44:01.180+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:44:03.427+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:44:04.318+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:44:04.319+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:44:05.309+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:44:05.411+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 480, after connections: 630, after extra_info: 1340, after globalLock: 1820, after locks: 1920, after network: 2010, after opcounters: 2010, after opcountersRepl: 2010, after repl: 3390, after storageEngine: 3690, after tcmalloc: 4180, after wiredTiger: 5220, at end: 7396 } 2016-04-25T07:44:05.504+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40612 #459 (38 connections now open) 2016-04-25T07:44:08.212+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:44:09.351+0000 I NETWORK [conn458] end connection 127.0.0.1:40608 (37 connections now open) 2016-04-25T07:44:11.441+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:44:12.900+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:44:16.901+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:44:18.369+0000 I COMMAND [conn459] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7343ms 2016-04-25T07:44:18.789+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:44:24.124+0000 I COMMAND [conn459] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1174ms 2016-04-25T07:44:25.406+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:44:25.506+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:44:28.036+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 980, after connections: 1220, after extra_info: 2340, after globalLock: 2700, after locks: 2700, after network: 2940, after opcounters: 3030, after opcountersRepl: 3030, after repl: 4050, after storageEngine: 4150, after tcmalloc: 4630, after wiredTiger: 5400, at end: 7890 } 2016-04-25T07:44:29.073+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:44:30.895+0000 I COMMAND [conn457] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 16679ms 2016-04-25T07:44:35.582+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:44:36.080+0000 I NETWORK [conn457] end connection 127.0.0.1:40605 (36 connections now open) 2016-04-25T07:44:36.689+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40616 #460 (38 connections now open) 2016-04-25T07:44:39.458+0000 I COMMAND [conn459] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4489ms 2016-04-25T07:44:40.302+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:44:40.507+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:44:42.952+0000 I COMMAND [conn460] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1949ms 2016-04-25T07:44:43.058+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:44:44.579+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40619 #461 (38 connections now open) 2016-04-25T07:44:46.623+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 330, after asserts: 330, after connections: 420, after extra_info: 1170, after globalLock: 1370, after locks: 1370, after network: 1470, after opcounters: 1470, after opcountersRepl: 1470, after repl: 2220, after storageEngine: 2630, after tcmalloc: 3050, after wiredTiger: 3649, at end: 4069 } 2016-04-25T07:44:48.386+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:44:54.496+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:44:54.498+0000 I COMMAND [conn461] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4980ms 2016-04-25T07:44:55.388+0000 I COMMAND [conn459] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 11298ms 2016-04-25T07:44:55.879+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:45:01.248+0000 I NETWORK [conn459] end connection 127.0.0.1:40612 (37 connections now open) 2016-04-25T07:45:01.353+0000 I COMMAND [conn461] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2083ms 2016-04-25T07:45:04.439+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:45:06.488+0000 I NETWORK [conn461] end connection 127.0.0.1:40619 (36 connections now open) 2016-04-25T07:45:06.877+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:45:08.855+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:45:09.150+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 580, after connections: 580, after extra_info: 1260, after globalLock: 1690, after locks: 2240, after network: 2540, after opcounters: 2540, after opcountersRepl: 2540, after repl: 3030, after storageEngine: 3630, after tcmalloc: 4530, after wiredTiger: 5950, at end: 8490 } 2016-04-25T07:45:10.352+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:45:10.655+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:45:11.000+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:45:11.677+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:45:11.587+0000 I COMMAND [conn460] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 12311ms 2016-04-25T07:45:13.079+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:45:13.737+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:45:14.037+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40624 #462 (37 connections now open) 2016-04-25T07:45:15.897+0000 I NETWORK [conn460] end connection 127.0.0.1:40616 (36 connections now open) 2016-04-25T07:45:18.927+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:45:19.887+0000 I COMMAND [conn462] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2632ms 2016-04-25T07:45:22.659+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40625 #463 (37 connections now open) 2016-04-25T07:45:23.831+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:45:26.822+0000 I NETWORK [conn462] end connection 127.0.0.1:40624 (36 connections now open) 2016-04-25T07:45:27.025+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:45:30.862+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:45:30.862+0000 I COMMAND [conn463] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3790ms 2016-04-25T07:45:31.967+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:45:32.261+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40629 #464 (37 connections now open) 2016-04-25T07:45:35.191+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 490, after connections: 590, after extra_info: 1470, after globalLock: 1710, after locks: 1910, after network: 2000, after opcounters: 2000, after opcountersRepl: 2000, after repl: 3640, after storageEngine: 3920, after tcmalloc: 4220, after wiredTiger: 5468, at end: 6548 } 2016-04-25T07:45:38.545+0000 I COMMAND [conn464] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1804ms 2016-04-25T07:45:42.013+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:45:43.907+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:45:45.660+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:45:46.285+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:45:46.853+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:45:47.029+0000 I NETWORK [conn464] end connection 127.0.0.1:40629 (36 connections now open) 2016-04-25T07:45:47.345+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:45:50.295+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40631 #465 (37 connections now open) 2016-04-25T07:45:54.077+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:45:54.862+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 340, after asserts: 560, after connections: 750, after extra_info: 1150, after globalLock: 1250, after locks: 1250, after network: 1250, after opcounters: 1250, after opcountersRepl: 1250, after repl: 1460, after storageEngine: 1780, after tcmalloc: 2354, after wiredTiger: 2354, at end: 4714 } 2016-04-25T07:45:55.405+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:45:57.768+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40633 #466 (38 connections now open) 2016-04-25T07:45:58.818+0000 I COMMAND [conn463] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 13277ms 2016-04-25T07:45:58.951+0000 I COMMAND [conn465] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3582ms 2016-04-25T07:46:01.583+0000 I NETWORK [conn463] end connection 127.0.0.1:40625 (37 connections now open) 2016-04-25T07:46:03.705+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:46:04.330+0000 I COMMAND [conn466] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1603ms 2016-04-25T07:46:05.575+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:46:06.581+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:46:06.693+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:46:06.695+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:46:06.695+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:46:06.695+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:46:08.085+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40636 #467 (38 connections now open) 2016-04-25T07:46:08.846+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:46:12.007+0000 I COMMAND [conn466] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 43 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4523ms 2016-04-25T07:46:12.907+0000 I COMMAND [conn467] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 552ms 2016-04-25T07:46:13.689+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 110, after asserts: 110, after connections: 400, after extra_info: 500, after globalLock: 780, after locks: 966, after network: 966, after opcounters: 966, after opcountersRepl: 966, after repl: 2206, after storageEngine: 2486, after tcmalloc: 3266, after wiredTiger: 3616, at end: 5206 } 2016-04-25T07:46:16.626+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:46:16.735+0000 I COMMAND [conn465] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 11868ms 2016-04-25T07:46:18.336+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:46:19.601+0000 I NETWORK [conn465] end connection 127.0.0.1:40631 (37 connections now open) 2016-04-25T07:46:19.602+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:46:20.515+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40642 #468 (38 connections now open) 2016-04-25T07:46:20.515+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:46:25.043+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:46:27.937+0000 I COMMAND [conn467] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 307130 } } } protocol:op_command 12256ms 2016-04-25T07:46:27.945+0000 I COMMAND [conn468] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3703ms 2016-04-25T07:46:28.594+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:46:28.603+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5, after asserts: 5, after connections: 5, after extra_info: 105, after globalLock: 185, after locks: 185, after network: 185, after opcounters: 185, after opcountersRepl: 185, after repl: 1255, after storageEngine: 1825, after tcmalloc: 2525, after wiredTiger: 4645, at end: 6075 } 2016-04-25T07:46:29.815+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:46:30.749+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40644 #469 (39 connections now open) 2016-04-25T07:46:31.869+0000 I NETWORK [conn468] end connection 127.0.0.1:40642 (37 connections now open) 2016-04-25T07:46:31.869+0000 I NETWORK [conn467] end connection 127.0.0.1:40636 (37 connections now open) 2016-04-25T07:46:35.185+0000 I COMMAND [conn469] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1011ms 2016-04-25T07:46:35.896+0000 I COMMAND [conn466] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 8899811 } } } protocol:op_command 16852ms 2016-04-25T07:46:37.567+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:46:39.584+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:46:39.583+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:46:39.926+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40649 #470 (38 connections now open) 2016-04-25T07:46:41.474+0000 I NETWORK [conn466] end connection 127.0.0.1:40633 (36 connections now open) 2016-04-25T07:46:41.474+0000 I NETWORK [conn469] end connection 127.0.0.1:40644 (36 connections now open) 2016-04-25T07:46:43.034+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:46:44.253+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:46:46.507+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:46:46.714+0000 I COMMAND [conn470] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1539ms 2016-04-25T07:46:46.812+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:46:46.815+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:46:47.544+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 370, after globalLock: 380, after locks: 380, after network: 380, after opcounters: 380, after opcountersRepl: 380, after repl: 1420, after storageEngine: 1720, after tcmalloc: 2070, after wiredTiger: 2920, at end: 4320 } 2016-04-25T07:46:49.947+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40651 #471 (37 connections now open) 2016-04-25T07:46:51.423+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:46:53.158+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:46:54.316+0000 I NETWORK [conn470] end connection 127.0.0.1:40649 (36 connections now open) 2016-04-25T07:46:57.480+0000 I COMMAND [conn471] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3524ms 2016-04-25T07:46:58.206+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40654 #472 (37 connections now open) 2016-04-25T07:46:58.749+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:46:58.750+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:46:58.750+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:46:58.750+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:47:00.541+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 730, after connections: 941, after extra_info: 941, after globalLock: 941, after locks: 941, after network: 941, after opcounters: 941, after opcountersRepl: 941, after repl: 941, after storageEngine: 941, after tcmalloc: 941, after wiredTiger: 941, at end: 2531 } 2016-04-25T07:47:02.237+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:47:05.502+0000 I COMMAND [conn471] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 6338ms 2016-04-25T07:47:06.192+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:47:07.450+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:47:08.410+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:47:12.339+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40660 #473 (38 connections now open) 2016-04-25T07:47:12.340+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:47:12.342+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:47:15.285+0000 I COMMAND [conn473] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1540ms 2016-04-25T07:47:17.394+0000 I REPL [ReplicationExecutor] VoteRequester: Got no vote from localhost:27017 because: candidate's term is lower than mine, resp:{ term: 44, voteGranted: false, reason: "candidate's term is lower than mine", ok: 1.0 } 2016-04-25T07:47:19.481+0000 I REPL [ReplicationExecutor] not running for primary, we have been superceded already 2016-04-25T07:47:21.196+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 600, after asserts: 700, after connections: 1060, after extra_info: 2170, after globalLock: 2460, after locks: 2860, after network: 2960, after opcounters: 2960, after opcountersRepl: 2960, after repl: 3530, after storageEngine: 3720, after tcmalloc: 4310, after wiredTiger: 5000, at end: 7350 } 2016-04-25T07:47:22.005+0000 I COMMAND [conn472] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 43, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 10752ms 2016-04-25T07:47:22.403+0000 I NETWORK [conn473] end connection 127.0.0.1:40660 (37 connections now open) 2016-04-25T07:47:23.182+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:47:23.192+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:47:26.417+0000 I NETWORK [conn472] end connection 127.0.0.1:40654 (36 connections now open) 2016-04-25T07:47:27.351+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 103ms 2016-04-25T07:47:27.862+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40666 #474 (38 connections now open) 2016-04-25T07:47:28.994+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:47:33.703+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:47:34.157+0000 I COMMAND [conn471] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: false, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 337416 } } } protocol:op_command 11869ms 2016-04-25T07:47:34.163+0000 I COMMAND [conn474] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2058ms 2016-04-25T07:47:35.065+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:47:35.065+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:47:36.982+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:47:37.868+0000 I NETWORK [conn471] end connection 127.0.0.1:40651 (36 connections now open) 2016-04-25T07:47:38.369+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:47:39.611+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:47:39.817+0000 I NETWORK [conn474] end connection 127.0.0.1:40666 (35 connections now open) 2016-04-25T07:47:40.726+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:47:42.534+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40667 #475 (36 connections now open) 2016-04-25T07:47:45.072+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40669 #476 (37 connections now open) 2016-04-25T07:47:46.481+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:47:48.271+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:47:50.889+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 0, after locks: 97, after network: 97, after opcounters: 97, after opcountersRepl: 97, after repl: 97, after storageEngine: 187, after tcmalloc: 1037, after wiredTiger: 2167, at end: 4347 } 2016-04-25T07:47:52.754+0000 I COMMAND [conn475] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5368ms 2016-04-25T07:47:53.564+0000 I COMMAND [conn476] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5181ms 2016-04-25T07:47:54.228+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:47:58.478+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:47:59.471+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:48:02.966+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:48:05.138+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:48:07.051+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:48:10.349+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:48:10.975+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:48:11.181+0000 I COMMAND [conn476] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6324ms 2016-04-25T07:48:12.102+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:48:15.109+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:48:16.012+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 210, after asserts: 320, after connections: 410, after extra_info: 960, after globalLock: 1230, after locks: 1370, after network: 1380, after opcounters: 1380, after opcountersRepl: 1380, after repl: 2100, after storageEngine: 2560, after tcmalloc: 3060, after wiredTiger: 5530, at end: 8350 } 2016-04-25T07:48:17.474+0000 I NETWORK [conn476] end connection 127.0.0.1:40669 (36 connections now open) 2016-04-25T07:48:20.971+0000 I COMMAND [conn475] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 14874ms 2016-04-25T07:48:22.071+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:48:24.192+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:48:25.306+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:48:25.298+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:48:25.310+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40678 #477 (37 connections now open) 2016-04-25T07:48:27.390+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:48:27.536+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:48:27.537+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40680 #478 (38 connections now open) 2016-04-25T07:48:28.043+0000 I NETWORK [conn475] end connection 127.0.0.1:40667 (36 connections now open) 2016-04-25T07:48:29.562+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40681 #479 (39 connections now open) 2016-04-25T07:48:30.362+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:48:30.992+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:48:33.595+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:48:34.705+0000 I COMMAND [conn478] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2571ms 2016-04-25T07:48:34.705+0000 I COMMAND [conn477] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4391ms 2016-04-25T07:48:35.708+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:48:37.928+0000 I COMMAND [conn479] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4490ms 2016-04-25T07:48:39.375+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1, after asserts: 1, after connections: 1, after extra_info: 1, after globalLock: 1, after locks: 91, after network: 101, after opcounters: 101, after opcountersRepl: 101, after repl: 2341, after storageEngine: 2911, after tcmalloc: 3491, after wiredTiger: 5101, at end: 8121 } 2016-04-25T07:48:46.835+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:48:48.081+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:48:49.413+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:48:50.793+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:48:51.802+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:48:54.253+0000 I COMMAND [conn478] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4581ms 2016-04-25T07:48:57.125+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 340, after asserts: 630, after connections: 1110, after extra_info: 1800, after globalLock: 2190, after locks: 2480, after network: 2660, after opcounters: 2660, after opcountersRepl: 2660, after repl: 3040, after storageEngine: 3350, after tcmalloc: 4260, after wiredTiger: 5580, at end: 7360 } 2016-04-25T07:48:57.219+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:48:57.220+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:49:01.186+0000 I COMMAND [conn477] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 11322ms 2016-04-25T07:49:02.124+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:49:04.104+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:49:04.631+0000 I NETWORK [conn477] end connection 127.0.0.1:40678 (37 connections now open) 2016-04-25T07:49:06.360+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:49:08.451+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:49:09.147+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40689 #480 (38 connections now open) 2016-04-25T07:49:09.545+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:49:10.168+0000 I COMMAND [conn479] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 6930253 } } } protocol:op_command 22130ms 2016-04-25T07:49:11.349+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:49:12.755+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40691 #481 (39 connections now open) 2016-04-25T07:49:14.898+0000 I COMMAND [conn478] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 9132ms 2016-04-25T07:49:14.998+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:49:15.198+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:49:16.481+0000 I COMMAND [conn480] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2642ms 2016-04-25T07:49:16.890+0000 I NETWORK [conn479] end connection 127.0.0.1:40681 (38 connections now open) 2016-04-25T07:49:18.783+0000 I COMMAND [conn481] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1835ms 2016-04-25T07:49:19.614+0000 I NETWORK [conn478] end connection 127.0.0.1:40680 (37 connections now open) 2016-04-25T07:49:21.042+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 190, after asserts: 200, after connections: 490, after extra_info: 1380, after globalLock: 1670, after locks: 2070, after network: 2260, after opcounters: 2260, after opcountersRepl: 2260, after repl: 3730, after storageEngine: 4210, after tcmalloc: 4450, after wiredTiger: 4750, at end: 5760 } 2016-04-25T07:49:25.097+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:49:27.446+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:49:29.222+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 137ms 2016-04-25T07:49:29.216+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:49:30.098+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:49:30.804+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:49:31.253+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:49:32.586+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:49:33.271+0000 I COMMAND [conn480] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 8225ms 2016-04-25T07:49:33.371+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:49:34.997+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:49:35.700+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40696 #482 (38 connections now open) 2016-04-25T07:49:37.986+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40698 #483 (39 connections now open) 2016-04-25T07:49:37.986+0000 I NETWORK [conn480] end connection 127.0.0.1:40689 (37 connections now open) 2016-04-25T07:49:39.842+0000 I COMMAND [conn482] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1245ms 2016-04-25T07:49:39.850+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 550, after connections: 800, after extra_info: 1230, after globalLock: 1520, after locks: 1720, after network: 1810, after opcounters: 1810, after opcountersRepl: 1810, after repl: 2113, after storageEngine: 2303, after tcmalloc: 2841, after wiredTiger: 3151, at end: 3501 } 2016-04-25T07:49:39.851+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:49:39.852+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:49:40.324+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40699 #484 (39 connections now open) 2016-04-25T07:49:40.912+0000 I COMMAND [conn481] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 3957659 } } } protocol:op_command 17501ms 2016-04-25T07:49:41.008+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:49:42.597+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:49:46.491+0000 I NETWORK [conn481] end connection 127.0.0.1:40691 (38 connections now open) 2016-04-25T07:49:47.594+0000 I COMMAND [conn484] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3929ms 2016-04-25T07:49:50.167+0000 I COMMAND [conn483] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 8976ms 2016-04-25T07:49:51.909+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:49:54.129+0000 I NETWORK [conn483] end connection 127.0.0.1:40698 (37 connections now open) 2016-04-25T07:49:54.129+0000 I NETWORK [conn484] end connection 127.0.0.1:40699 (37 connections now open) 2016-04-25T07:49:55.740+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:49:55.759+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:49:55.759+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:49:57.479+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40702 #485 (37 connections now open) 2016-04-25T07:49:58.565+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:49:59.069+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:49:59.071+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40703 #486 (38 connections now open) 2016-04-25T07:50:01.344+0000 I COMMAND [conn482] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 3271358 } } } protocol:op_command 20527ms 2016-04-25T07:50:02.062+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 220, after asserts: 420, after connections: 890, after extra_info: 1260, after globalLock: 1470, after locks: 1570, after network: 1570, after opcounters: 1570, after opcountersRepl: 1570, after repl: 2318, after storageEngine: 2318, after tcmalloc: 2318, after wiredTiger: 3159, at end: 4989 } 2016-04-25T07:50:03.454+0000 I COMMAND [conn485] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1811ms 2016-04-25T07:50:03.454+0000 I COMMAND [conn486] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1811ms 2016-04-25T07:50:03.559+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:50:04.852+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:50:05.705+0000 I NETWORK [conn482] end connection 127.0.0.1:40696 (37 connections now open) 2016-04-25T07:50:09.934+0000 I NETWORK [conn485] end connection 127.0.0.1:40702 (36 connections now open) 2016-04-25T07:50:09.934+0000 I NETWORK [conn486] end connection 127.0.0.1:40703 (36 connections now open) 2016-04-25T07:50:14.793+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:50:16.303+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40708 #487 (36 connections now open) 2016-04-25T07:50:16.508+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:50:17.930+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:50:19.257+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:50:20.129+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40710 #488 (37 connections now open) 2016-04-25T07:50:20.229+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:50:21.612+0000 I COMMAND [conn487] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1921ms 2016-04-25T07:50:22.353+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:50:23.108+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 90, after asserts: 470, after connections: 760, after extra_info: 1470, after globalLock: 1570, after locks: 1800, after network: 1800, after opcounters: 1800, after opcountersRepl: 1800, after repl: 2591, after storageEngine: 2591, after tcmalloc: 2591, after wiredTiger: 3081, at end: 4261 } 2016-04-25T07:50:23.906+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:50:28.238+0000 I COMMAND [conn488] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3914ms 2016-04-25T07:50:28.826+0000 I NETWORK [conn487] end connection 127.0.0.1:40708 (36 connections now open) 2016-04-25T07:50:28.828+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:50:30.724+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:50:34.657+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:50:34.850+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40714 #489 (37 connections now open) 2016-04-25T07:50:40.209+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:50:41.008+0000 I COMMAND [conn489] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1710ms 2016-04-25T07:50:41.946+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:50:41.948+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:50:43.669+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:50:45.725+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:50:45.725+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 310, after asserts: 480, after connections: 760, after extra_info: 1400, after globalLock: 1770, after locks: 1970, after network: 2100, after opcounters: 2100, after opcountersRepl: 2100, after repl: 3860, after storageEngine: 4290, after tcmalloc: 4590, after wiredTiger: 6200, at end: 7920 } 2016-04-25T07:50:46.121+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:50:47.336+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:50:49.156+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:50:50.955+0000 I COMMAND [conn489] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7606ms 2016-04-25T07:50:51.559+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:50:55.797+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:50:56.974+0000 I NETWORK [conn489] end connection 127.0.0.1:40714 (36 connections now open) 2016-04-25T07:50:57.618+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:51:01.464+0000 I COMMAND [conn488] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 17959ms 2016-04-25T07:51:01.778+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40719 #490 (37 connections now open) 2016-04-25T07:51:03.403+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40721 #491 (38 connections now open) 2016-04-25T07:51:05.876+0000 I NETWORK [conn488] end connection 127.0.0.1:40710 (37 connections now open) 2016-04-25T07:51:07.145+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:51:08.573+0000 I COMMAND [conn490] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1231ms 2016-04-25T07:51:08.684+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:51:08.770+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40724 #492 (38 connections now open) 2016-04-25T07:51:10.234+0000 I COMMAND [conn491] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1273ms 2016-04-25T07:51:10.798+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:51:11.697+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:51:12.870+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 330, after asserts: 430, after connections: 524, after extra_info: 524, after globalLock: 524, after locks: 524, after network: 644, after opcounters: 644, after opcountersRepl: 644, after repl: 924, after storageEngine: 1224, after tcmalloc: 1644, after wiredTiger: 2544, at end: 3904 } 2016-04-25T07:51:13.315+0000 I COMMAND [conn492] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1485ms 2016-04-25T07:51:14.409+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:51:19.137+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:51:20.266+0000 I NETWORK [conn492] end connection 127.0.0.1:40724 (37 connections now open) 2016-04-25T07:51:22.183+0000 I COMMAND [conn490] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 11644ms 2016-04-25T07:51:24.756+0000 I NETWORK [conn490] end connection 127.0.0.1:40719 (36 connections now open) 2016-04-25T07:51:25.922+0000 I COMMAND [conn491] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2152ms 2016-04-25T07:51:26.787+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:51:28.742+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40728 #493 (37 connections now open) 2016-04-25T07:51:28.935+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:51:30.915+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 134ms 2016-04-25T07:51:30.915+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:51:33.277+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:51:33.880+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:51:35.621+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 680, after connections: 780, after extra_info: 909, after globalLock: 909, after locks: 909, after network: 909, after opcounters: 909, after opcountersRepl: 909, after repl: 1829, after storageEngine: 1829, after tcmalloc: 2219, after wiredTiger: 3749, at end: 5909 } 2016-04-25T07:51:37.472+0000 I COMMAND [conn493] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3389ms 2016-04-25T07:51:42.528+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40731 #494 (38 connections now open) 2016-04-25T07:51:42.903+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:51:47.104+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:51:49.105+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:51:50.755+0000 I COMMAND [conn494] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2603ms 2016-04-25T07:51:51.863+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:51:52.725+0000 I COMMAND [conn491] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 15338ms 2016-04-25T07:51:54.030+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:51:57.302+0000 I NETWORK [conn491] end connection 127.0.0.1:40721 (37 connections now open) 2016-04-25T07:52:04.664+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40735 #495 (38 connections now open) 2016-04-25T07:52:04.763+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:52:06.856+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:52:07.230+0000 I COMMAND [conn493] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 685921 } } } protocol:op_command 12921ms 2016-04-25T07:52:07.709+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 660, after connections: 760, after extra_info: 1150, after globalLock: 1320, after locks: 1580, after network: 1920, after opcounters: 2010, after opcountersRepl: 2010, after repl: 2730, after storageEngine: 3300, after tcmalloc: 3890, after wiredTiger: 4715, at end: 6235 } 2016-04-25T07:52:08.515+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:52:10.150+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:52:12.625+0000 I COMMAND [conn495] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3197ms 2016-04-25T07:52:12.900+0000 I NETWORK [conn493] end connection 127.0.0.1:40728 (37 connections now open) 2016-04-25T07:52:14.946+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40738 #496 (38 connections now open) 2016-04-25T07:52:15.733+0000 I COMMAND [conn494] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 5088800 } } } protocol:op_command 15388ms 2016-04-25T07:52:17.777+0000 I NETWORK [conn494] end connection 127.0.0.1:40731 (37 connections now open) 2016-04-25T07:52:18.392+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:52:20.868+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:52:21.175+0000 I COMMAND [conn496] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2607ms 2016-04-25T07:52:24.097+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:52:25.212+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:52:26.271+0000 I NETWORK [conn496] end connection 127.0.0.1:40738 (36 connections now open) 2016-04-25T07:52:27.281+0000 I COMMAND [conn495] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3189ms 2016-04-25T07:52:28.933+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:52:30.460+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:52:30.744+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 420, after asserts: 910, after connections: 1030, after extra_info: 1730, after globalLock: 2070, after locks: 2360, after network: 2730, after opcounters: 2730, after opcountersRepl: 2730, after repl: 3960, after storageEngine: 4070, after tcmalloc: 4590, after wiredTiger: 6000, at end: 7980 } 2016-04-25T07:52:32.652+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 142ms 2016-04-25T07:52:39.314+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:52:42.576+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40742 #497 (37 connections now open) 2016-04-25T07:52:42.585+0000 I COMMAND [conn495] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1109ms 2016-04-25T07:52:43.285+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:52:43.834+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:52:45.444+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:52:46.921+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:52:48.737+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:52:48.724+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:52:49.591+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40745 #498 (38 connections now open) 2016-04-25T07:52:50.944+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:52:50.944+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:52:51.039+0000 I COMMAND [conn497] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4912ms 2016-04-25T07:52:54.414+0000 I COMMAND [conn498] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1838ms 2016-04-25T07:52:57.214+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 100, after locks: 200, after network: 290, after opcounters: 290, after opcountersRepl: 290, after repl: 5424, after storageEngine: 5524, after tcmalloc: 6144, after wiredTiger: 8364, at end: 11104 } 2016-04-25T07:53:02.701+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:53:03.745+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:53:04.701+0000 I COMMAND [conn495] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 16087ms 2016-04-25T07:53:05.602+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:53:06.809+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:53:08.067+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:53:08.568+0000 I NETWORK [conn495] end connection 127.0.0.1:40735 (37 connections now open) 2016-04-25T07:53:08.663+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:53:09.498+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40750 #499 (39 connections now open) 2016-04-25T07:53:10.437+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:53:11.630+0000 I COMMAND [conn498] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 8967ms 2016-04-25T07:53:11.736+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:53:13.593+0000 I COMMAND [conn499] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1224ms 2016-04-25T07:53:14.824+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40752 #500 (39 connections now open) 2016-04-25T07:53:15.444+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:53:15.444+0000 I NETWORK [conn498] end connection 127.0.0.1:40745 (37 connections now open) 2016-04-25T07:53:18.696+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 310, after asserts: 400, after connections: 490, after extra_info: 490, after globalLock: 500, after locks: 500, after network: 500, after opcounters: 500, after opcountersRepl: 500, after repl: 2030, after storageEngine: 2400, after tcmalloc: 3110, after wiredTiger: 3767, at end: 6137 } 2016-04-25T07:53:21.250+0000 I COMMAND [conn500] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1923ms 2016-04-25T07:53:22.189+0000 I NETWORK [conn499] end connection 127.0.0.1:40750 (37 connections now open) 2016-04-25T07:53:22.782+0000 I COMMAND [conn497] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 20699ms 2016-04-25T07:53:23.074+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:53:23.617+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40753 #501 (38 connections now open) 2016-04-25T07:53:26.022+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:53:27.403+0000 I NETWORK [conn497] end connection 127.0.0.1:40742 (37 connections now open) 2016-04-25T07:53:29.031+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:53:29.472+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:53:29.468+0000 I COMMAND [conn501] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2983ms 2016-04-25T07:53:35.499+0000 I COMMAND [conn500] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2376ms 2016-04-25T07:53:38.471+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 100, after asserts: 270, after connections: 360, after extra_info: 1830, after globalLock: 2120, after locks: 2230, after network: 2320, after opcounters: 2320, after opcountersRepl: 2320, after repl: 3980, after storageEngine: 4180, after tcmalloc: 4810, after wiredTiger: 6220, at end: 8250 } 2016-04-25T07:53:39.785+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:53:42.592+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:53:43.881+0000 I COMMAND [conn501] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 10524ms 2016-04-25T07:53:43.986+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:53:43.986+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:53:43.986+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:53:44.962+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:53:45.241+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:53:47.719+0000 I NETWORK [conn501] end connection 127.0.0.1:40753 (36 connections now open) 2016-04-25T07:53:50.458+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:53:51.355+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:53:51.603+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40759 #502 (37 connections now open) 2016-04-25T07:53:53.075+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40760 #503 (38 connections now open) 2016-04-25T07:53:56.752+0000 I COMMAND [conn502] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1200ms 2016-04-25T07:53:58.708+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:53:59.121+0000 I COMMAND [conn500] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 1204009 } } } protocol:op_command 11414ms 2016-04-25T07:54:00.862+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:54:01.198+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1, after asserts: 1, after connections: 1, after extra_info: 1, after globalLock: 1, after locks: 1, after network: 91, after opcounters: 91, after opcountersRepl: 91, after repl: 681, after storageEngine: 991, after tcmalloc: 1421, after wiredTiger: 3151, at end: 5361 } 2016-04-25T07:54:01.701+0000 I COMMAND [conn503] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3709ms 2016-04-25T07:54:02.532+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:54:02.539+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:54:02.536+0000 I NETWORK [conn500] end connection 127.0.0.1:40752 (37 connections now open) 2016-04-25T07:54:02.537+0000 I NETWORK [conn502] end connection 127.0.0.1:40759 (37 connections now open) 2016-04-25T07:54:13.001+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40767 #504 (37 connections now open) 2016-04-25T07:54:13.098+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:54:14.238+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:54:14.634+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:54:17.552+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:54:18.562+0000 I COMMAND [conn504] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1778ms 2016-04-25T07:54:19.629+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:54:19.629+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:54:20.611+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 200, after asserts: 490, after connections: 700, after extra_info: 899, after globalLock: 899, after locks: 1089, after network: 1289, after opcounters: 1289, after opcountersRepl: 1289, after repl: 3139, after storageEngine: 3429, after tcmalloc: 4129, after wiredTiger: 5339, at end: 6969 } 2016-04-25T07:54:21.465+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:54:22.041+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:54:22.173+0000 I NETWORK [conn504] end connection 127.0.0.1:40767 (36 connections now open) 2016-04-25T07:54:23.124+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:54:27.437+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:54:29.765+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40768 #505 (37 connections now open) 2016-04-25T07:54:35.851+0000 I COMMAND [conn505] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1977ms 2016-04-25T07:54:36.561+0000 I COMMAND [conn503] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 19210ms 2016-04-25T07:54:38.154+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40769 #506 (38 connections now open) 2016-04-25T07:54:38.939+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:54:39.830+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:54:39.839+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:54:39.840+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40771 #507 (39 connections now open) 2016-04-25T07:54:40.709+0000 I NETWORK [conn503] end connection 127.0.0.1:40760 (38 connections now open) 2016-04-25T07:54:40.710+0000 I NETWORK [conn505] end connection 127.0.0.1:40768 (38 connections now open) 2016-04-25T07:54:43.807+0000 I COMMAND [conn507] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1669ms 2016-04-25T07:54:43.807+0000 I COMMAND [conn506] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1669ms 2016-04-25T07:54:49.030+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 400, after connections: 660, after extra_info: 1550, after globalLock: 1850, after locks: 2240, after network: 2460, after opcounters: 2470, after opcountersRepl: 2470, after repl: 3400, after storageEngine: 3780, after tcmalloc: 4720, after wiredTiger: 5730, at end: 7810 } 2016-04-25T07:54:50.162+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:54:51.779+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:54:52.864+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40774 #508 (38 connections now open) 2016-04-25T07:54:53.869+0000 I NETWORK [conn507] end connection 127.0.0.1:40771 (36 connections now open) 2016-04-25T07:54:59.936+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:55:01.099+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:55:01.299+0000 I COMMAND [conn508] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4189ms 2016-04-25T07:55:01.884+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:55:05.107+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:55:08.614+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:55:09.328+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:55:10.790+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:55:11.961+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:55:14.018+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:55:14.671+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:55:19.277+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:55:20.349+0000 I COMMAND [conn508] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 11965ms 2016-04-25T07:55:20.349+0000 I COMMAND [conn506] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 16140ms 2016-04-25T07:55:20.441+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 780, after connections: 1400, after extra_info: 2890, after globalLock: 3170, after locks: 3560, after network: 3860, after opcounters: 3960, after opcountersRepl: 3960, after repl: 7350, after storageEngine: 7920, after tcmalloc: 8710, after wiredTiger: 9970, at end: 11330 } 2016-04-25T07:55:22.709+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:55:27.383+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:55:27.696+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40783 #509 (38 connections now open) 2016-04-25T07:55:28.840+0000 I NETWORK [conn508] end connection 127.0.0.1:40774 (36 connections now open) 2016-04-25T07:55:28.840+0000 I NETWORK [conn506] end connection 127.0.0.1:40769 (36 connections now open) 2016-04-25T07:55:29.218+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:55:29.877+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40785 #510 (39 connections now open) 2016-04-25T07:55:30.697+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:55:31.133+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:55:31.873+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:55:32.061+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:55:34.010+0000 I COMMAND [conn509] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1450ms 2016-04-25T07:55:34.797+0000 I COMMAND [conn510] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 577ms 2016-04-25T07:55:35.076+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:55:35.745+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:55:35.843+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 200, after globalLock: 500, after locks: 700, after network: 700, after opcounters: 700, after opcountersRepl: 700, after repl: 1180, after storageEngine: 1320, after tcmalloc: 1980, after wiredTiger: 2660, at end: 3200 } 2016-04-25T07:55:38.295+0000 I NETWORK [conn509] end connection 127.0.0.1:40783 (36 connections now open) 2016-04-25T07:55:38.295+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:55:42.786+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:55:44.394+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:55:46.111+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40787 #511 (37 connections now open) 2016-04-25T07:55:50.749+0000 I COMMAND [conn510] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 13574ms 2016-04-25T07:55:52.619+0000 I COMMAND [conn511] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1218ms 2016-04-25T07:55:52.918+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40789 #512 (38 connections now open) 2016-04-25T07:55:53.504+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:55:57.168+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:55:57.789+0000 I NETWORK [conn510] end connection 127.0.0.1:40785 (37 connections now open) 2016-04-25T07:55:59.476+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:56:00.761+0000 I COMMAND [conn512] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3594ms 2016-04-25T07:56:00.949+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:56:01.761+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:56:01.958+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:56:05.918+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:56:06.558+0000 I COMMAND [conn511] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4055ms 2016-04-25T07:56:07.373+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:56:08.228+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 430, after asserts: 710, after connections: 900, after extra_info: 1730, after globalLock: 1930, after locks: 2070, after network: 2070, after opcounters: 2070, after opcountersRepl: 2070, after repl: 4250, after storageEngine: 4910, after tcmalloc: 6410, after wiredTiger: 7510, at end: 9770 } 2016-04-25T07:56:13.457+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:56:17.379+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:56:17.465+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:56:20.309+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40794 #513 (38 connections now open) 2016-04-25T07:56:20.857+0000 I COMMAND [conn511] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4955ms 2016-04-25T07:56:21.244+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:56:21.573+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:56:22.127+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:56:25.535+0000 I COMMAND [conn513] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1616ms 2016-04-25T07:56:26.363+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:56:28.425+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 270, after globalLock: 370, after locks: 370, after network: 370, after opcounters: 370, after opcountersRepl: 370, after repl: 2740, after storageEngine: 3220, after tcmalloc: 3810, after wiredTiger: 5000, at end: 6550 } 2016-04-25T07:56:29.582+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:56:31.273+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:56:33.917+0000 I COMMAND [conn512] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 19496ms 2016-04-25T07:56:39.628+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40799 #514 (39 connections now open) 2016-04-25T07:56:39.637+0000 I COMMAND [conn513] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2318ms 2016-04-25T07:56:39.836+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:56:40.729+0000 I NETWORK [conn512] end connection 127.0.0.1:40789 (37 connections now open) 2016-04-25T07:56:44.898+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:56:44.905+0000 I COMMAND [conn514] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1179ms 2016-04-25T07:56:45.507+0000 I COMMAND [conn511] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 7914265 } } } protocol:op_command 21297ms 2016-04-25T07:56:47.122+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:56:47.447+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:56:47.785+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:56:48.692+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:56:49.327+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:56:51.243+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:56:51.240+0000 I NETWORK [conn511] end connection 127.0.0.1:40787 (37 connections now open) 2016-04-25T07:56:51.731+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40802 #515 (39 connections now open) 2016-04-25T07:56:53.637+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:57:00.017+0000 I COMMAND [conn515] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2333ms 2016-04-25T07:57:01.868+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 0, after locks: 290, after network: 480, after opcounters: 480, after opcountersRepl: 480, after repl: 2300, after storageEngine: 3040, after tcmalloc: 3330, after wiredTiger: 4420, at end: 7100 } 2016-04-25T07:57:01.968+0000 I COMMAND [conn513] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 8704707 } } } protocol:op_command 18827ms 2016-04-25T07:57:03.346+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:57:05.458+0000 I NETWORK [conn513] end connection 127.0.0.1:40794 (37 connections now open) 2016-04-25T07:57:07.518+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:57:09.529+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:57:09.810+0000 I COMMAND [conn514] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 8132ms 2016-04-25T07:57:10.977+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:57:12.696+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40804 #516 (38 connections now open) 2016-04-25T07:57:12.696+0000 I NETWORK [conn514] end connection 127.0.0.1:40799 (36 connections now open) 2016-04-25T07:57:18.720+0000 I COMMAND [conn516] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1780ms 2016-04-25T07:57:20.083+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:57:21.479+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40808 #517 (38 connections now open) 2016-04-25T07:57:23.395+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 480, after connections: 620, after extra_info: 1250, after globalLock: 1630, after locks: 1830, after network: 1930, after opcounters: 1930, after opcountersRepl: 1930, after repl: 2030, after storageEngine: 2030, after tcmalloc: 2990, after wiredTiger: 4201, at end: 4531 } 2016-04-25T07:57:23.507+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:57:24.697+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:57:25.688+0000 I COMMAND [conn515] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 19539ms 2016-04-25T07:57:25.795+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:57:25.990+0000 I COMMAND [conn516] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4019ms 2016-04-25T07:57:26.076+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:57:26.353+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:57:27.423+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40811 #518 (39 connections now open) 2016-04-25T07:57:27.932+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:57:28.210+0000 I NETWORK [conn515] end connection 127.0.0.1:40802 (37 connections now open) 2016-04-25T07:57:28.210+0000 I NETWORK [conn516] end connection 127.0.0.1:40804 (37 connections now open) 2016-04-25T07:57:28.506+0000 I COMMAND [conn517] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2919ms 2016-04-25T07:57:30.063+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:57:31.390+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:57:35.489+0000 I COMMAND [conn518] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2453ms 2016-04-25T07:57:36.600+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:57:36.602+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:57:36.603+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:57:36.608+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 260, after asserts: 570, after connections: 1030, after extra_info: 1410, after globalLock: 1590, after locks: 1590, after network: 1590, after opcounters: 1590, after opcountersRepl: 1590, after repl: 1690, after storageEngine: 1690, after tcmalloc: 1690, after wiredTiger: 1690, at end: 1700 } 2016-04-25T07:57:42.025+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:57:42.932+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:57:47.896+0000 I COMMAND [conn518] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2835ms 2016-04-25T07:57:49.488+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 330, after asserts: 610, after connections: 980, after extra_info: 1960, after globalLock: 2290, after locks: 2670, after network: 2850, after opcounters: 2850, after opcountersRepl: 2850, after repl: 4710, after storageEngine: 4910, after tcmalloc: 5560, after wiredTiger: 6610, at end: 7640 } 2016-04-25T07:57:52.713+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:57:53.821+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40816 #519 (38 connections now open) 2016-04-25T07:57:56.014+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:57:57.980+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:57:58.234+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:57:58.335+0000 I COMMAND [conn517] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 13074ms 2016-04-25T07:57:59.248+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:58:00.396+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:58:01.266+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:58:03.294+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:58:03.290+0000 I NETWORK [conn517] end connection 127.0.0.1:40808 (37 connections now open) 2016-04-25T07:58:06.353+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:58:07.563+0000 I COMMAND [conn519] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 8313ms 2016-04-25T07:58:08.208+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40818 #520 (38 connections now open) 2016-04-25T07:58:09.012+0000 I COMMAND [conn518] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 2514361 } } } protocol:op_command 14602ms 2016-04-25T07:58:15.017+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:58:15.998+0000 I COMMAND [conn520] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2711ms 2016-04-25T07:58:16.707+0000 I NETWORK [conn518] end connection 127.0.0.1:40811 (37 connections now open) 2016-04-25T07:58:17.608+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:58:18.247+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:58:19.043+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40821 #521 (38 connections now open) 2016-04-25T07:58:21.388+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T07:58:24.672+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 300, after connections: 400, after extra_info: 410, after globalLock: 420, after locks: 520, after network: 610, after opcounters: 610, after opcountersRepl: 610, after repl: 3510, after storageEngine: 3923, after tcmalloc: 4653, after wiredTiger: 6613, at end: 9223 } 2016-04-25T07:58:26.341+0000 I COMMAND [conn519] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 8854ms 2016-04-25T07:58:27.048+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40824 #522 (39 connections now open) 2016-04-25T07:58:27.152+0000 I COMMAND [conn521] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5555ms 2016-04-25T07:58:29.123+0000 I NETWORK [conn519] end connection 127.0.0.1:40816 (38 connections now open) 2016-04-25T07:58:30.048+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:58:31.557+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:58:33.127+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:58:34.935+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:58:36.601+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:58:37.006+0000 I COMMAND [conn522] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5239ms 2016-04-25T07:58:37.094+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:58:37.399+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:58:37.915+0000 I COMMAND [conn521] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3780ms 2016-04-25T07:58:39.089+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:58:40.451+0000 I NETWORK [conn521] end connection 127.0.0.1:40821 (37 connections now open) 2016-04-25T07:58:41.044+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:58:41.143+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 390, after connections: 490, after extra_info: 1420, after globalLock: 1990, after locks: 2330, after network: 2340, after opcounters: 2340, after opcountersRepl: 2340, after repl: 3620, after storageEngine: 4110, after tcmalloc: 4490, after wiredTiger: 5730, at end: 6600 } 2016-04-25T07:58:42.702+0000 I COMMAND [conn520] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 1883801 } } } protocol:op_command 14763ms 2016-04-25T07:58:47.447+0000 I COMMAND [conn522] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3109ms 2016-04-25T07:58:47.948+0000 I NETWORK [conn520] end connection 127.0.0.1:40818 (36 connections now open) 2016-04-25T07:58:53.533+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:58:54.034+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40828 #523 (37 connections now open) 2016-04-25T07:58:55.151+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T07:58:57.873+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:58:59.046+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:59:00.087+0000 I COMMAND [conn523] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1889ms 2016-04-25T07:59:01.120+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40832 #524 (38 connections now open) 2016-04-25T07:59:03.661+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 152, after asserts: 152, after connections: 442, after extra_info: 1332, after globalLock: 1772, after locks: 2162, after network: 2362, after opcounters: 2362, after opcountersRepl: 2362, after repl: 4192, after storageEngine: 4682, after tcmalloc: 5122, after wiredTiger: 5941, at end: 6621 } 2016-04-25T07:59:04.941+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:59:09.041+0000 I COMMAND [conn524] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3078ms 2016-04-25T07:59:11.214+0000 I COMMAND [conn522] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 17250ms 2016-04-25T07:59:11.515+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:59:13.703+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T07:59:14.403+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:59:15.452+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:59:17.803+0000 I NETWORK [conn522] end connection 127.0.0.1:40824 (37 connections now open) 2016-04-25T07:59:22.502+0000 I COMMAND [conn524] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1817ms 2016-04-25T07:59:25.550+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 580, after connections: 1300, after extra_info: 2310, after globalLock: 2600, after locks: 2900, after network: 3330, after opcounters: 3430, after opcountersRepl: 3430, after repl: 4470, after storageEngine: 5190, after tcmalloc: 5970, after wiredTiger: 7310, at end: 9240 } 2016-04-25T07:59:25.559+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T07:59:28.772+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T07:59:30.281+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T07:59:31.255+0000 I COMMAND [conn523] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 15973ms 2016-04-25T07:59:32.702+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:59:35.414+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 130ms 2016-04-25T07:59:36.141+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:59:36.232+0000 I NETWORK [conn523] end connection 127.0.0.1:40828 (36 connections now open) 2016-04-25T07:59:36.939+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40837 #525 (38 connections now open) 2016-04-25T07:59:39.582+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40839 #526 (38 connections now open) 2016-04-25T07:59:39.582+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:59:42.897+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T07:59:42.900+0000 I COMMAND [conn525] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1554ms 2016-04-25T07:59:44.221+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 340, after asserts: 642, after connections: 642, after extra_info: 642, after globalLock: 642, after locks: 642, after network: 642, after opcounters: 642, after opcountersRepl: 642, after repl: 939, after storageEngine: 939, after tcmalloc: 939, after wiredTiger: 2569, at end: 3999 } 2016-04-25T07:59:44.395+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T07:59:44.587+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T07:59:45.253+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T07:59:46.460+0000 I COMMAND [conn526] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3285ms 2016-04-25T07:59:46.461+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T07:59:47.885+0000 I COMMAND [conn524] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 13951ms 2016-04-25T07:59:48.865+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T07:59:50.468+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T07:59:51.312+0000 I NETWORK [conn524] end connection 127.0.0.1:40832 (37 connections now open) 2016-04-25T07:59:51.509+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T07:59:58.843+0000 I COMMAND [conn525] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2499ms 2016-04-25T07:59:59.957+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 330, after asserts: 430, after connections: 910, after extra_info: 1840, after globalLock: 2210, after locks: 2310, after network: 2440, after opcounters: 2440, after opcountersRepl: 2440, after repl: 2980, after storageEngine: 3670, after tcmalloc: 3760, after wiredTiger: 5230, at end: 6040 } 2016-04-25T08:00:01.093+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T08:00:01.582+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40845 #527 (38 connections now open) 2016-04-25T08:00:01.582+0000 I COMMAND [conn526] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 3527741 } } } protocol:op_command 14076ms 2016-04-25T08:00:03.257+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:00:04.054+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:00:05.891+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:00:06.596+0000 I NETWORK [conn526] end connection 127.0.0.1:40839 (37 connections now open) 2016-04-25T08:00:07.117+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:00:11.561+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40847 #528 (38 connections now open) 2016-04-25T08:00:12.131+0000 I COMMAND [conn527] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6469ms 2016-04-25T08:00:12.237+0000 I COMMAND [conn525] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5228ms 2016-04-25T08:00:14.257+0000 I COMMAND [conn528] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1505ms 2016-04-25T08:00:16.340+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:00:17.306+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:00:18.603+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:00:21.429+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T08:00:21.439+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T08:00:21.431+0000 I COMMAND [conn525] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 8674ms 2016-04-25T08:00:21.448+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:00:21.448+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:00:22.776+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 190, after asserts: 380, after connections: 490, after extra_info: 1450, after globalLock: 1840, after locks: 2130, after network: 2330, after opcounters: 2330, after opcountersRepl: 2330, after repl: 3600, after storageEngine: 4070, after tcmalloc: 4670, after wiredTiger: 6280, at end: 8940 } 2016-04-25T08:00:23.395+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:00:26.521+0000 I NETWORK [conn525] end connection 127.0.0.1:40837 (37 connections now open) 2016-04-25T08:00:27.957+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:00:28.461+0000 I COMMAND [conn528] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5998ms 2016-04-25T08:00:32.330+0000 I NETWORK [conn528] end connection 127.0.0.1:40847 (36 connections now open) 2016-04-25T08:00:33.065+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40857 #529 (38 connections now open) 2016-04-25T08:00:34.697+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:00:34.699+0000 I COMMAND [conn527] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 11014ms 2016-04-25T08:00:34.700+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:00:36.828+0000 I NETWORK [conn527] end connection 127.0.0.1:40845 (36 connections now open) 2016-04-25T08:00:37.909+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:00:38.559+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:00:38.563+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T08:00:38.568+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40858 #530 (37 connections now open) 2016-04-25T08:00:43.460+0000 I COMMAND [conn530] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2040ms 2016-04-25T08:00:45.258+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 91, after asserts: 91, after connections: 91, after extra_info: 91, after globalLock: 411, after locks: 621, after network: 751, after opcounters: 751, after opcountersRepl: 751, after repl: 1821, after storageEngine: 2271, after tcmalloc: 3081, after wiredTiger: 4631, at end: 6201 } 2016-04-25T08:00:46.193+0000 I COMMAND [conn529] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 1889174 } } } protocol:op_command 10652ms 2016-04-25T08:00:46.968+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40861 #531 (38 connections now open) 2016-04-25T08:00:49.768+0000 I COMMAND [conn530] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2735ms 2016-04-25T08:00:50.172+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:00:50.271+0000 I NETWORK [conn529] end connection 127.0.0.1:40857 (37 connections now open) 2016-04-25T08:00:51.700+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:00:54.748+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:00:54.748+0000 I NETWORK [conn530] end connection 127.0.0.1:40858 (36 connections now open) 2016-04-25T08:00:54.748+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:00:54.749+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40863 #532 (38 connections now open) 2016-04-25T08:00:55.539+0000 I COMMAND [conn531] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2711ms 2016-04-25T08:00:55.897+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 590, after connections: 980, after extra_info: 1180, after globalLock: 1180, after locks: 1180, after network: 1180, after opcounters: 1180, after opcountersRepl: 1180, after repl: 1188, after storageEngine: 1588, after tcmalloc: 2068, after wiredTiger: 2078, at end: 2128 } 2016-04-25T08:00:57.785+0000 I COMMAND [conn532] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1055ms 2016-04-25T08:01:02.838+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:01:03.527+0000 I COMMAND [conn531] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 7126ms 2016-04-25T08:01:04.828+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T08:01:05.474+0000 I COMMAND [conn532] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2993ms 2016-04-25T08:01:05.865+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T08:01:07.312+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40867 #533 (38 connections now open) 2016-04-25T08:01:07.311+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:01:07.888+0000 I NETWORK [conn531] end connection 127.0.0.1:40861 (36 connections now open) 2016-04-25T08:01:09.567+0000 I NETWORK [conn532] end connection 127.0.0.1:40863 (36 connections now open) 2016-04-25T08:01:10.653+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40869 #534 (38 connections now open) 2016-04-25T08:01:10.764+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:01:13.150+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:01:13.630+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:01:15.272+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:01:16.472+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:01:19.566+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:01:21.507+0000 I COMMAND [conn534] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6177ms 2016-04-25T08:01:22.305+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 0, after locks: 0, after network: 0, after opcounters: 0, after opcountersRepl: 0, after repl: 5000, after storageEngine: 5410, after tcmalloc: 6000, after wiredTiger: 8530, at end: 9220 } 2016-04-25T08:01:26.455+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:01:28.617+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:01:31.048+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:01:32.494+0000 I COMMAND [conn533] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 19018ms 2016-04-25T08:01:32.898+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:01:33.642+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:01:34.156+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:01:34.500+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40875 #535 (38 connections now open) 2016-04-25T08:01:35.136+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:01:36.493+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:01:37.536+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:01:39.105+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:01:39.229+0000 I NETWORK [conn533] end connection 127.0.0.1:40867 (37 connections now open) 2016-04-25T08:01:39.965+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:01:42.087+0000 I COMMAND [conn534] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 9388ms 2016-04-25T08:01:42.088+0000 I COMMAND [conn535] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4546ms 2016-04-25T08:01:47.047+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T08:01:47.330+0000 I NETWORK [conn534] end connection 127.0.0.1:40869 (36 connections now open) 2016-04-25T08:01:47.830+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 330, after asserts: 540, after connections: 840, after extra_info: 1230, after globalLock: 1440, after locks: 1740, after network: 1980, after opcounters: 2070, after opcountersRepl: 2070, after repl: 2800, after storageEngine: 2900, after tcmalloc: 3280, after wiredTiger: 4980, at end: 7410 } 2016-04-25T08:01:49.251+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40878 #536 (37 connections now open) 2016-04-25T08:01:49.337+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T08:01:50.595+0000 I COMMAND [conn536] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1244ms 2016-04-25T08:01:51.931+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:01:53.507+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:01:59.176+0000 I COMMAND [conn535] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 115786 } } } protocol:op_command 9271ms 2016-04-25T08:01:59.566+0000 I COMMAND [conn536] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3507ms 2016-04-25T08:02:01.484+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 490, after connections: 980, after extra_info: 1530, after globalLock: 2010, after locks: 2480, after network: 2660, after opcounters: 2660, after opcountersRepl: 2660, after repl: 4910, after storageEngine: 5210, after tcmalloc: 5620, after wiredTiger: 6920, at end: 9000 } 2016-04-25T08:02:02.883+0000 I NETWORK [conn535] end connection 127.0.0.1:40875 (36 connections now open) 2016-04-25T08:02:02.883+0000 I NETWORK [conn536] end connection 127.0.0.1:40878 (36 connections now open) 2016-04-25T08:02:04.255+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:02:06.716+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40882 #537 (36 connections now open) 2016-04-25T08:02:06.807+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T08:02:06.807+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T08:02:06.807+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:02:06.825+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:02:15.494+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:02:16.615+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:02:17.384+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40883 #538 (37 connections now open) 2016-04-25T08:02:17.382+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 820, after connections: 1270, after extra_info: 2070, after globalLock: 2540, after locks: 2730, after network: 2930, after opcounters: 3020, after opcountersRepl: 3020, after repl: 4550, after storageEngine: 4890, after tcmalloc: 5570, after wiredTiger: 7190, at end: 8473 } 2016-04-25T08:02:18.445+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40885 #539 (38 connections now open) 2016-04-25T08:02:24.052+0000 I COMMAND [conn539] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2645ms 2016-04-25T08:02:24.052+0000 I COMMAND [conn538] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2645ms 2016-04-25T08:02:26.786+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:02:29.644+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T08:02:31.625+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T08:02:32.346+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:02:33.244+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:02:35.104+0000 I NETWORK [conn539] end connection 127.0.0.1:40885 (37 connections now open) 2016-04-25T08:02:35.815+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:02:37.173+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 230, after asserts: 470, after connections: 470, after extra_info: 1070, after globalLock: 1270, after locks: 1270, after network: 1270, after opcounters: 1270, after opcountersRepl: 1270, after repl: 1690, after storageEngine: 1980, after tcmalloc: 2670, after wiredTiger: 4620, at end: 6130 } 2016-04-25T08:02:37.381+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 191ms 2016-04-25T08:02:37.836+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:02:39.083+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:02:39.176+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40889 #540 (38 connections now open) 2016-04-25T08:02:41.524+0000 I COMMAND [conn537] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 5818240 } } } protocol:op_command 23519ms 2016-04-25T08:02:42.037+0000 I NETWORK [conn537] end connection 127.0.0.1:40882 (37 connections now open) 2016-04-25T08:02:42.035+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40891 #541 (39 connections now open) 2016-04-25T08:02:42.238+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:02:44.833+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:02:48.872+0000 I COMMAND [conn540] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5058ms 2016-04-25T08:02:48.872+0000 I COMMAND [conn541] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2329ms 2016-04-25T08:02:48.874+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:02:49.562+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:02:52.244+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:02:53.224+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:02:55.703+0000 I NETWORK [conn540] end connection 127.0.0.1:40889 (37 connections now open) 2016-04-25T08:02:56.528+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:02:56.534+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:02:56.624+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:02:56.633+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:02:58.237+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40897 #542 (38 connections now open) 2016-04-25T08:02:58.965+0000 I COMMAND [conn538] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 2172498 } } } protocol:op_command 18939ms 2016-04-25T08:02:59.200+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:03:01.610+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 680, after connections: 970, after extra_info: 1700, after globalLock: 1830, after locks: 1830, after network: 1830, after opcounters: 1830, after opcountersRepl: 1830, after repl: 3030, after storageEngine: 3130, after tcmalloc: 3140, after wiredTiger: 4202, at end: 5572 } 2016-04-25T08:03:01.932+0000 I NETWORK [conn538] end connection 127.0.0.1:40883 (37 connections now open) 2016-04-25T08:03:02.341+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:03:03.700+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:03:07.445+0000 I COMMAND [conn542] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4625ms 2016-04-25T08:03:08.314+0000 I COMMAND [conn541] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5988ms 2016-04-25T08:03:14.117+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:03:14.637+0000 I NETWORK [conn541] end connection 127.0.0.1:40891 (36 connections now open) 2016-04-25T08:03:18.839+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:03:21.113+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:03:21.949+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40903 #543 (37 connections now open) 2016-04-25T08:03:22.141+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:03:25.698+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:03:26.039+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:03:26.831+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 230, after asserts: 620, after connections: 1110, after extra_info: 1930, after globalLock: 2540, after locks: 2840, after network: 3060, after opcounters: 3070, after opcountersRepl: 3070, after repl: 6892, after storageEngine: 6892, after tcmalloc: 7172, after wiredTiger: 8852, at end: 11032 } 2016-04-25T08:03:26.955+0000 I COMMAND [conn543] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2032ms 2016-04-25T08:03:34.873+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:03:35.185+0000 I COMMAND [conn542] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 13850ms 2016-04-25T08:03:37.416+0000 I NETWORK [conn543] end connection 127.0.0.1:40903 (36 connections now open) 2016-04-25T08:03:38.019+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T08:03:39.063+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 197ms 2016-04-25T08:03:39.730+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:03:40.163+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:03:40.177+0000 I NETWORK [conn542] end connection 127.0.0.1:40897 (35 connections now open) 2016-04-25T08:03:41.105+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40905 #544 (37 connections now open) 2016-04-25T08:03:43.523+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40906 #545 (37 connections now open) 2016-04-25T08:03:47.434+0000 I COMMAND [conn544] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1683ms 2016-04-25T08:03:48.614+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 0, after locks: 0, after network: 0, after opcounters: 0, after opcountersRepl: 0, after repl: 91, after storageEngine: 431, after tcmalloc: 781, after wiredTiger: 2051, at end: 3251 } 2016-04-25T08:03:48.622+0000 I COMMAND [conn545] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1582ms 2016-04-25T08:03:49.422+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:03:51.423+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:03:52.282+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:03:53.395+0000 I COMMAND [conn544] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2264ms 2016-04-25T08:03:54.398+0000 I NETWORK [conn545] end connection 127.0.0.1:40906 (36 connections now open) 2016-04-25T08:03:54.592+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:03:54.783+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:03:56.887+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T08:03:56.996+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T08:03:57.185+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:03:57.289+0000 I NETWORK [conn544] end connection 127.0.0.1:40905 (35 connections now open) 2016-04-25T08:03:58.952+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:04:00.429+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40912 #546 (36 connections now open) 2016-04-25T08:04:02.300+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:04:06.566+0000 I COMMAND [conn546] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1759ms 2016-04-25T08:04:06.914+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40915 #547 (37 connections now open) 2016-04-25T08:04:09.732+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 299, after asserts: 299, after connections: 299, after extra_info: 299, after globalLock: 299, after locks: 299, after network: 299, after opcounters: 299, after opcountersRepl: 299, after repl: 3329, after storageEngine: 4019, after tcmalloc: 4589, after wiredTiger: 4795, at end: 5565 } 2016-04-25T08:04:10.334+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T08:04:10.768+0000 I NETWORK [conn546] end connection 127.0.0.1:40912 (36 connections now open) 2016-04-25T08:04:13.952+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:04:15.359+0000 I COMMAND [conn547] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2780ms 2016-04-25T08:04:15.656+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:04:18.965+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:04:20.017+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40917 #548 (37 connections now open) 2016-04-25T08:04:21.775+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:04:21.871+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40918 #549 (38 connections now open) 2016-04-25T08:04:24.750+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:04:26.648+0000 I COMMAND [conn549] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 896ms 2016-04-25T08:04:26.648+0000 I COMMAND [conn548] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1288ms 2016-04-25T08:04:27.739+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1, after asserts: 1, after connections: 1, after extra_info: 1, after globalLock: 1, after locks: 1, after network: 1, after opcounters: 1, after opcountersRepl: 1, after repl: 801, after storageEngine: 1351, after tcmalloc: 1891, after wiredTiger: 3451, at end: 4631 } 2016-04-25T08:04:28.340+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T08:04:30.651+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T08:04:30.654+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:04:31.787+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:04:34.844+0000 I NETWORK [conn548] end connection 127.0.0.1:40917 (37 connections now open) 2016-04-25T08:04:34.844+0000 I NETWORK [conn549] end connection 127.0.0.1:40918 (37 connections now open) 2016-04-25T08:04:35.936+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:04:36.316+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:04:39.203+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:04:40.577+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:04:42.372+0000 I COMMAND [conn547] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 14134ms 2016-04-25T08:04:43.995+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40924 #550 (37 connections now open) 2016-04-25T08:04:47.991+0000 I NETWORK [conn547] end connection 127.0.0.1:40915 (36 connections now open) 2016-04-25T08:04:50.305+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T08:04:50.898+0000 I COMMAND [conn550] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2336ms 2016-04-25T08:04:51.002+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40925 #551 (37 connections now open) 2016-04-25T08:04:53.296+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:04:54.383+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:04:54.911+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:04:57.098+0000 I NETWORK [conn550] end connection 127.0.0.1:40924 (36 connections now open) 2016-04-25T08:04:57.700+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 300, after connections: 700, after extra_info: 1260, after globalLock: 1460, after locks: 1550, after network: 1650, after opcounters: 1650, after opcountersRepl: 1650, after repl: 3095, after storageEngine: 3705, after tcmalloc: 4485, after wiredTiger: 5825, at end: 7685 } 2016-04-25T08:04:57.922+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:05:01.017+0000 I COMMAND [conn551] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5032ms 2016-04-25T08:05:02.227+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40929 #552 (37 connections now open) 2016-04-25T08:05:05.017+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:05:08.021+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T08:05:09.870+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40931 #553 (38 connections now open) 2016-04-25T08:05:10.898+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T08:05:11.828+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:05:13.235+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:05:14.411+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:05:14.996+0000 I COMMAND [conn552] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7254ms 2016-04-25T08:05:16.833+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:05:17.850+0000 I COMMAND [conn553] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3012ms 2016-04-25T08:05:18.694+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:05:18.683+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:05:20.929+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 0, after locks: 0, after network: 0, after opcounters: 0, after opcountersRepl: 0, after repl: 4840, after storageEngine: 5320, after tcmalloc: 6030, after wiredTiger: 7730, at end: 9330 } 2016-04-25T08:05:21.551+0000 I NETWORK [conn552] end connection 127.0.0.1:40929 (37 connections now open) 2016-04-25T08:05:28.532+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T08:05:29.442+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:05:29.932+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:05:32.348+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40935 #554 (38 connections now open) 2016-04-25T08:05:33.636+0000 I COMMAND [conn551] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 16996ms 2016-04-25T08:05:34.437+0000 I COMMAND [conn553] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5267ms 2016-04-25T08:05:34.444+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:05:35.771+0000 I NETWORK [conn551] end connection 127.0.0.1:40925 (37 connections now open) 2016-04-25T08:05:35.771+0000 I NETWORK [conn553] end connection 127.0.0.1:40931 (37 connections now open) 2016-04-25T08:05:36.169+0000 I COMMAND [conn554] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1131ms 2016-04-25T08:05:36.671+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40939 #555 (39 connections now open) 2016-04-25T08:05:39.425+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:05:40.605+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:05:42.186+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40941 #556 (38 connections now open) 2016-04-25T08:05:43.387+0000 I COMMAND [conn555] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2490ms 2016-04-25T08:05:43.389+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T08:05:44.748+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:05:47.472+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:05:48.759+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 330, after asserts: 620, after connections: 820, after extra_info: 1680, after globalLock: 2080, after locks: 2380, after network: 2475, after opcounters: 2475, after opcountersRepl: 2475, after repl: 2475, after storageEngine: 2475, after tcmalloc: 2475, after wiredTiger: 4465, at end: 6935 } 2016-04-25T08:05:50.544+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T08:05:50.952+0000 I COMMAND [conn556] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3751ms 2016-04-25T08:05:52.557+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:05:52.752+0000 I NETWORK [conn555] end connection 127.0.0.1:40939 (37 connections now open) 2016-04-25T08:05:53.551+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:05:53.551+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:05:53.454+0000 I COMMAND [conn554] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 12644ms 2016-04-25T08:05:57.742+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:05:59.146+0000 I NETWORK [conn554] end connection 127.0.0.1:40935 (36 connections now open) 2016-04-25T08:06:02.207+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40946 #557 (37 connections now open) 2016-04-25T08:06:04.567+0000 I COMMAND [conn556] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3824ms 2016-04-25T08:06:06.312+0000 I COMMAND [conn557] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 425ms 2016-04-25T08:06:06.313+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:06:08.834+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 200, after locks: 490, after network: 490, after opcounters: 490, after opcountersRepl: 490, after repl: 1480, after storageEngine: 1870, after tcmalloc: 2190, after wiredTiger: 2900, at end: 4320 } 2016-04-25T08:06:08.929+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T08:06:11.572+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:06:13.047+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:06:16.348+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:06:19.758+0000 I COMMAND [conn556] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6833ms 2016-04-25T08:06:22.912+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:06:23.215+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40953 #558 (38 connections now open) 2016-04-25T08:06:25.720+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T08:06:25.811+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40955 #559 (39 connections now open) 2016-04-25T08:06:26.773+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:06:28.962+0000 I COMMAND [conn557] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 19550ms 2016-04-25T08:06:29.540+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:06:30.669+0000 I COMMAND [conn558] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2111ms 2016-04-25T08:06:30.760+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:06:30.845+0000 I NETWORK [conn557] end connection 127.0.0.1:40946 (38 connections now open) 2016-04-25T08:06:30.847+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:06:30.849+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:06:30.849+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:06:30.850+0000 I COMMAND [conn559] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1986ms 2016-04-25T08:06:30.853+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T08:06:34.124+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:06:34.877+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:06:39.872+0000 I COMMAND [conn556] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 4174774 } } } protocol:op_command 14663ms 2016-04-25T08:06:40.604+0000 I COMMAND [conn558] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 950ms 2016-04-25T08:06:42.141+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 180, after asserts: 360, after connections: 450, after extra_info: 820, after globalLock: 960, after locks: 1150, after network: 1440, after opcounters: 1530, after opcountersRepl: 1530, after repl: 5210, after storageEngine: 5560, after tcmalloc: 6170, after wiredTiger: 7540, at end: 9230 } 2016-04-25T08:06:42.657+0000 I NETWORK [conn556] end connection 127.0.0.1:40941 (37 connections now open) 2016-04-25T08:06:44.674+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:06:46.966+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40960 #560 (38 connections now open) 2016-04-25T08:06:47.464+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T08:06:48.180+0000 I COMMAND [conn559] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 15228ms 2016-04-25T08:06:48.379+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40961 #561 (39 connections now open) 2016-04-25T08:06:48.571+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T08:06:49.578+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:06:50.617+0000 I NETWORK [conn559] end connection 127.0.0.1:40955 (38 connections now open) 2016-04-25T08:06:50.723+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:06:52.790+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:06:53.999+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:06:55.625+0000 I COMMAND [conn560] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3889ms 2016-04-25T08:06:55.624+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:06:56.716+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:06:57.830+0000 I COMMAND [conn561] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5065ms 2016-04-25T08:07:02.531+0000 I COMMAND [conn560] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1876ms 2016-04-25T08:07:02.731+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 600, after connections: 1170, after extra_info: 1520, after globalLock: 1690, after locks: 1790, after network: 1790, after opcounters: 1790, after opcountersRepl: 1790, after repl: 2670, after storageEngine: 3060, after tcmalloc: 3710, after wiredTiger: 4650, at end: 6350 } 2016-04-25T08:07:05.308+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T08:07:07.322+0000 I COMMAND [conn558] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 10697067 } } } protocol:op_command 20948ms 2016-04-25T08:07:07.843+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40965 #562 (39 connections now open) 2016-04-25T08:07:07.843+0000 I NETWORK [conn560] end connection 127.0.0.1:40960 (37 connections now open) 2016-04-25T08:07:08.848+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:07:10.176+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:07:10.770+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:07:11.170+0000 I NETWORK [conn558] end connection 127.0.0.1:40953 (37 connections now open) 2016-04-25T08:07:13.321+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40967 #563 (38 connections now open) 2016-04-25T08:07:13.433+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:07:14.782+0000 I COMMAND [conn562] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2758ms 2016-04-25T08:07:18.773+0000 I COMMAND [conn563] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2174ms 2016-04-25T08:07:18.793+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:07:18.793+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:07:20.059+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:07:22.384+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T08:07:22.869+0000 I COMMAND [conn561] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 14328ms 2016-04-25T08:07:22.970+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T08:07:22.972+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 690, after connections: 1120, after extra_info: 1630, after globalLock: 1920, after locks: 1930, after network: 1930, after opcounters: 1930, after opcountersRepl: 1930, after repl: 2030, after storageEngine: 2490, after tcmalloc: 3270, after wiredTiger: 4740, at end: 5910 } 2016-04-25T08:07:23.061+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:07:23.067+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:07:25.277+0000 I NETWORK [conn561] end connection 127.0.0.1:40961 (37 connections now open) 2016-04-25T08:07:29.994+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:07:31.648+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40974 #564 (38 connections now open) 2016-04-25T08:07:32.489+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:07:33.489+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:07:37.401+0000 I COMMAND [conn563] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6375ms 2016-04-25T08:07:38.933+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 580, after asserts: 780, after connections: 1220, after extra_info: 2290, after globalLock: 2720, after locks: 3010, after network: 3400, after opcounters: 3410, after opcountersRepl: 3410, after repl: 5731, after storageEngine: 6091, after tcmalloc: 6661, after wiredTiger: 8491, at end: 9201 } 2016-04-25T08:07:39.704+0000 I COMMAND [conn564] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3908ms 2016-04-25T08:07:44.669+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:07:46.767+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T08:07:47.050+0000 I COMMAND [conn562] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 16669ms 2016-04-25T08:07:48.241+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:07:48.640+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:07:49.485+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:07:50.843+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:07:50.948+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:07:51.544+0000 I NETWORK [conn562] end connection 127.0.0.1:40965 (37 connections now open) 2016-04-25T08:07:52.792+0000 I COMMAND [conn563] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2708ms 2016-04-25T08:07:54.199+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40981 #565 (38 connections now open) 2016-04-25T08:07:54.727+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:07:54.817+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:07:58.197+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:08:01.158+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 334, after asserts: 334, after connections: 334, after extra_info: 334, after globalLock: 334, after locks: 334, after network: 334, after opcounters: 334, after opcountersRepl: 334, after repl: 1784, after storageEngine: 2294, after tcmalloc: 2894, after wiredTiger: 3574, at end: 5794 } 2016-04-25T08:08:01.158+0000 I COMMAND [conn565] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2642ms 2016-04-25T08:08:04.194+0000 I COMMAND [conn564] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 11210ms 2016-04-25T08:08:05.717+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T08:08:07.227+0000 I NETWORK [conn564] end connection 127.0.0.1:40974 (37 connections now open) 2016-04-25T08:08:09.887+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:08:11.903+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:08:14.560+0000 I COMMAND [conn563] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 3252285 } } } protocol:op_command 16804ms 2016-04-25T08:08:14.658+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:08:15.857+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40984 #566 (38 connections now open) 2016-04-25T08:08:17.655+0000 I COMMAND [conn565] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7140ms 2016-04-25T08:08:18.012+0000 I NETWORK [conn563] end connection 127.0.0.1:40967 (37 connections now open) 2016-04-25T08:08:19.787+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40989 #567 (39 connections now open) 2016-04-25T08:08:20.711+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:08:20.803+0000 I COMMAND [conn566] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1687ms 2016-04-25T08:08:21.973+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:08:22.615+0000 I NETWORK [conn565] end connection 127.0.0.1:40981 (37 connections now open) 2016-04-25T08:08:23.432+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 490, after connections: 780, after extra_info: 1560, after globalLock: 1930, after locks: 1930, after network: 1940, after opcounters: 1940, after opcountersRepl: 1940, after repl: 2047, after storageEngine: 2047, after tcmalloc: 2047, after wiredTiger: 2597, at end: 4117 } 2016-04-25T08:08:24.122+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:08:24.124+0000 I COMMAND [conn567] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1195ms 2016-04-25T08:08:25.074+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:08:26.286+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T08:08:27.449+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:08:29.115+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:08:29.214+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:08:29.586+0000 I NETWORK [conn566] end connection 127.0.0.1:40984 (36 connections now open) 2016-04-25T08:08:30.917+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:08:33.203+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:08:33.484+0000 I COMMAND [conn567] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7471ms 2016-04-25T08:08:35.510+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40994 #568 (37 connections now open) 2016-04-25T08:08:36.875+0000 I NETWORK [conn567] end connection 127.0.0.1:40989 (35 connections now open) 2016-04-25T08:08:37.073+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40995 #569 (38 connections now open) 2016-04-25T08:08:38.509+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 270, after asserts: 370, after connections: 460, after extra_info: 1160, after globalLock: 1550, after locks: 1640, after network: 1640, after opcounters: 1640, after opcountersRepl: 1640, after repl: 2630, after storageEngine: 3045, after tcmalloc: 3045, after wiredTiger: 3046, at end: 3846 } 2016-04-25T08:08:40.004+0000 I COMMAND [conn568] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1134ms 2016-04-25T08:08:40.230+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:08:40.231+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:08:40.237+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T08:08:40.237+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T08:08:40.237+0000 I COMMAND [conn569] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 912ms 2016-04-25T08:08:44.325+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:08:45.104+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:08:46.515+0000 I COMMAND [conn568] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 5874ms 2016-04-25T08:08:46.997+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 300, after connections: 640, after extra_info: 910, after globalLock: 1120, after locks: 1220, after network: 1220, after opcounters: 1220, after opcountersRepl: 1220, after repl: 3330, after storageEngine: 3560, after tcmalloc: 3670, after wiredTiger: 3670, at end: 4740 } 2016-04-25T08:08:50.840+0000 I COMMAND [conn569] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1488ms 2016-04-25T08:08:50.933+0000 I NETWORK [conn568] end connection 127.0.0.1:40994 (36 connections now open) 2016-04-25T08:08:54.837+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:08:55.448+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41001 #570 (37 connections now open) 2016-04-25T08:08:56.380+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T08:08:57.219+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:08:58.174+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T08:08:59.158+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:08:59.457+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:09:00.892+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41002 #571 (38 connections now open) 2016-04-25T08:09:00.999+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:09:03.513+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:09:05.000+0000 I COMMAND [conn570] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5343ms 2016-04-25T08:09:05.210+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:09:06.140+0000 I COMMAND [conn571] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1242ms 2016-04-25T08:09:07.710+0000 I COMMAND [conn569] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 12140ms 2016-04-25T08:09:09.371+0000 I COMMAND [conn570] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1555ms 2016-04-25T08:09:09.467+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 210, after asserts: 510, after connections: 1180, after extra_info: 2165, after globalLock: 2165, after locks: 2165, after network: 2165, after opcounters: 2255, after opcountersRepl: 2255, after repl: 4665, after storageEngine: 5045, after tcmalloc: 5485, after wiredTiger: 7215, at end: 9015 } 2016-04-25T08:09:10.677+0000 I NETWORK [conn569] end connection 127.0.0.1:40995 (37 connections now open) 2016-04-25T08:09:10.677+0000 I NETWORK [conn571] end connection 127.0.0.1:41002 (37 connections now open) 2016-04-25T08:09:12.329+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T08:09:16.075+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T08:09:18.371+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:09:18.844+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41005 #572 (37 connections now open) 2016-04-25T08:09:19.348+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:09:22.246+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41007 #573 (38 connections now open) 2016-04-25T08:09:22.979+0000 I COMMAND [conn572] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 629ms 2016-04-25T08:09:25.501+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 0, after locks: 0, after network: 0, after opcounters: 0, after opcountersRepl: 0, after repl: 2002, after storageEngine: 2002, after tcmalloc: 2392, after wiredTiger: 3032, at end: 4982 } 2016-04-25T08:09:26.537+0000 I COMMAND [conn573] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1691ms 2016-04-25T08:09:28.341+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:09:29.361+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:09:29.983+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:09:31.486+0000 I COMMAND [conn570] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 1031225 } } } protocol:op_command 18751ms 2016-04-25T08:09:31.495+0000 I NETWORK [conn572] end connection 127.0.0.1:41005 (37 connections now open) 2016-04-25T08:09:32.493+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T08:09:33.477+0000 I NETWORK [conn570] end connection 127.0.0.1:41001 (36 connections now open) 2016-04-25T08:09:34.513+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T08:09:35.865+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:09:36.071+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:09:36.076+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41011 #574 (37 connections now open) 2016-04-25T08:09:36.076+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:09:38.412+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 270, after asserts: 270, after connections: 280, after extra_info: 370, after globalLock: 370, after locks: 370, after network: 370, after opcounters: 370, after opcountersRepl: 370, after repl: 381, after storageEngine: 381, after tcmalloc: 381, after wiredTiger: 831, at end: 2081 } 2016-04-25T08:09:40.013+0000 I COMMAND [conn574] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1378ms 2016-04-25T08:09:40.404+0000 I COMMAND [conn573] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 2781172 } } } protocol:op_command 9429ms 2016-04-25T08:09:41.215+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 101ms 2016-04-25T08:09:41.752+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:09:43.160+0000 I NETWORK [conn573] end connection 127.0.0.1:41007 (36 connections now open) 2016-04-25T08:09:45.734+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41014 #575 (37 connections now open) 2016-04-25T08:09:47.708+0000 I COMMAND [conn574] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2986ms 2016-04-25T08:09:51.348+0000 I NETWORK [conn574] end connection 127.0.0.1:41011 (36 connections now open) 2016-04-25T08:09:51.542+0000 I COMMAND [conn575] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1258ms 2016-04-25T08:09:52.675+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:09:53.635+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:09:54.324+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41018 #576 (37 connections now open) 2016-04-25T08:09:56.626+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:09:57.127+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:09:58.537+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:09:59.262+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 200, after asserts: 570, after connections: 660, after extra_info: 1470, after globalLock: 1820, after locks: 2110, after network: 2410, after opcounters: 2500, after opcountersRepl: 2500, after repl: 2698, after storageEngine: 2698, after tcmalloc: 2798, after wiredTiger: 4238, at end: 5488 } 2016-04-25T08:10:00.373+0000 I NETWORK [conn575] end connection 127.0.0.1:41014 (36 connections now open) 2016-04-25T08:10:01.568+0000 I COMMAND [conn576] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2345ms 2016-04-25T08:10:04.009+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:10:05.044+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41021 #577 (37 connections now open) 2016-04-25T08:10:05.161+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:10:05.161+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T08:10:12.769+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T08:10:15.690+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 700, after connections: 1020, after extra_info: 1690, after globalLock: 2010, after locks: 2270, after network: 2490, after opcounters: 2680, after opcountersRepl: 2680, after repl: 3750, after storageEngine: 4360, after tcmalloc: 5200, after wiredTiger: 6990, at end: 9060 } 2016-04-25T08:10:15.696+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:10:16.281+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:10:17.782+0000 I COMMAND [conn577] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 11074ms 2016-04-25T08:10:19.228+0000 I COMMAND [conn576] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7111ms 2016-04-25T08:10:22.869+0000 I NETWORK [conn576] end connection 127.0.0.1:41018 (36 connections now open) 2016-04-25T08:10:22.864+0000 I NETWORK [conn577] end connection 127.0.0.1:41021 (36 connections now open) 2016-04-25T08:10:27.715+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:10:28.934+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41025 #578 (36 connections now open) 2016-04-25T08:10:29.354+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T08:10:31.027+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T08:10:31.721+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41026 #579 (37 connections now open) 2016-04-25T08:10:32.620+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:10:33.251+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:10:34.239+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:10:37.475+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:10:37.774+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:10:38.518+0000 I COMMAND [conn578] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4298ms 2016-04-25T08:10:38.518+0000 I COMMAND [conn579] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2829ms 2016-04-25T08:10:39.973+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:10:42.433+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 187ms 2016-04-25T08:10:42.742+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 0, after locks: 0, after network: 0, after opcounters: 0, after opcountersRepl: 0, after repl: 4201, after storageEngine: 4661, after tcmalloc: 5671, after wiredTiger: 7001, at end: 9621 } 2016-04-25T08:10:48.546+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41029 #580 (38 connections now open) 2016-04-25T08:10:49.465+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T08:10:54.818+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T08:10:57.270+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:10:58.312+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:10:58.418+0000 I COMMAND [conn578] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 12958ms 2016-04-25T08:11:01.364+0000 I COMMAND [conn580] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 8115ms 2016-04-25T08:11:01.661+0000 I NETWORK [conn578] end connection 127.0.0.1:41025 (37 connections now open) 2016-04-25T08:11:08.534+0000 I COMMAND [conn580] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1281ms 2016-04-25T08:11:08.538+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:11:10.507+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T08:11:11.108+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:11:12.219+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 670, after connections: 1060, after extra_info: 1940, after globalLock: 2130, after locks: 2140, after network: 2230, after opcounters: 2230, after opcountersRepl: 2230, after repl: 2730, after storageEngine: 3010, after tcmalloc: 3970, after wiredTiger: 4980, at end: 6270 } 2016-04-25T08:11:15.152+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:11:15.632+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41035 #581 (38 connections now open) 2016-04-25T08:11:15.632+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:11:15.632+0000 I COMMAND [conn579] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 1593030 } } } protocol:op_command 22467ms 2016-04-25T08:11:16.773+0000 I NETWORK [conn579] end connection 127.0.0.1:41026 (37 connections now open) 2016-04-25T08:11:17.358+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T08:11:19.083+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:11:20.706+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:11:21.734+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41038 #582 (38 connections now open) 2016-04-25T08:11:21.917+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:11:22.812+0000 I COMMAND [conn581] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3035ms 2016-04-25T08:11:27.824+0000 I COMMAND [conn582] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1787ms 2016-04-25T08:11:28.399+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 110, after globalLock: 380, after locks: 390, after network: 390, after opcounters: 390, after opcountersRepl: 390, after repl: 1060, after storageEngine: 1360, after tcmalloc: 2030, after wiredTiger: 3420, at end: 4570 } 2016-04-25T08:11:29.092+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:11:32.711+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:11:32.826+0000 I COMMAND [conn580] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 13223ms 2016-04-25T08:11:33.328+0000 I NETWORK [conn582] end connection 127.0.0.1:41038 (37 connections now open) 2016-04-25T08:11:36.512+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T08:11:37.254+0000 I NETWORK [conn580] end connection 127.0.0.1:41029 (36 connections now open) 2016-04-25T08:11:37.792+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:11:42.202+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41043 #583 (37 connections now open) 2016-04-25T08:11:43.188+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 121ms 2016-04-25T08:11:44.834+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:11:45.694+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:11:49.272+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 730, after connections: 820, after extra_info: 1740, after globalLock: 2030, after locks: 2120, after network: 2134, after opcounters: 2134, after opcountersRepl: 2134, after repl: 2134, after storageEngine: 2134, after tcmalloc: 2404, after wiredTiger: 4114, at end: 6794 } 2016-04-25T08:11:50.403+0000 I COMMAND [conn583] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2744ms 2016-04-25T08:11:54.201+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:11:54.193+0000 I COMMAND [conn581] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 14605ms 2016-04-25T08:11:57.275+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:11:58.478+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:12:00.110+0000 I NETWORK [conn581] end connection 127.0.0.1:41035 (36 connections now open) 2016-04-25T08:12:00.838+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:12:00.839+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:12:03.212+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T08:12:03.354+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41048 #584 (37 connections now open) 2016-04-25T08:12:04.559+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:12:04.761+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:12:06.792+0000 I COMMAND [conn583] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5268ms 2016-04-25T08:12:09.192+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:12:09.984+0000 I COMMAND [conn584] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1734ms 2016-04-25T08:12:11.850+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 340, after asserts: 530, after connections: 1390, after extra_info: 2020, after globalLock: 2500, after locks: 2740, after network: 3240, after opcounters: 3540, after opcountersRepl: 3640, after repl: 5161, after storageEngine: 5561, after tcmalloc: 6031, after wiredTiger: 7711, at end: 10791 } 2016-04-25T08:12:12.415+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:12:14.610+0000 I NETWORK [conn583] end connection 127.0.0.1:41043 (36 connections now open) 2016-04-25T08:12:14.714+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:12:21.216+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41052 #585 (37 connections now open) 2016-04-25T08:12:26.376+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:12:27.525+0000 I COMMAND [conn585] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1787ms 2016-04-25T08:12:28.994+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:12:32.225+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:12:32.919+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:12:34.379+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 640, after connections: 1120, after extra_info: 2150, after globalLock: 2270, after locks: 2270, after network: 2270, after opcounters: 2270, after opcountersRepl: 2270, after repl: 3610, after storageEngine: 4550, after tcmalloc: 5310, after wiredTiger: 6590, at end: 8890 } 2016-04-25T08:12:35.571+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:12:36.114+0000 I NETWORK [conn585] end connection 127.0.0.1:41052 (36 connections now open) 2016-04-25T08:12:41.156+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:12:42.208+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41056 #586 (37 connections now open) 2016-04-25T08:12:43.334+0000 I COMMAND [conn584] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 13861ms 2016-04-25T08:12:45.238+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 198ms 2016-04-25T08:12:49.389+0000 I NETWORK [conn584] end connection 127.0.0.1:41048 (36 connections now open) 2016-04-25T08:12:49.389+0000 I COMMAND [conn586] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2371ms 2016-04-25T08:12:50.436+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:12:51.836+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:12:52.336+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:12:53.929+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41058 #587 (37 connections now open) 2016-04-25T08:12:55.321+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:13:01.263+0000 I COMMAND [conn587] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1555ms 2016-04-25T08:13:02.349+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:13:03.902+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 620, after asserts: 1190, after connections: 1890, after extra_info: 1893, after globalLock: 1893, after locks: 1893, after network: 1893, after opcounters: 1893, after opcountersRepl: 1893, after repl: 3823, after storageEngine: 4553, after tcmalloc: 5803, after wiredTiger: 7713, at end: 9393 } 2016-04-25T08:13:04.375+0000 I COMMAND [conn586] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3663ms 2016-04-25T08:13:04.936+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T08:13:10.934+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:13:13.886+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:13:14.874+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:13:19.806+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41064 #588 (38 connections now open) 2016-04-25T08:13:21.059+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:13:25.632+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:13:28.125+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:13:31.100+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:13:31.503+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T08:13:32.621+0000 I COMMAND [conn587] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 15564ms 2016-04-25T08:13:33.249+0000 I COMMAND [conn588] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6241ms 2016-04-25T08:13:33.811+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 360, after extra_info: 1300, after globalLock: 1590, after locks: 1700, after network: 1800, after opcounters: 1800, after opcountersRepl: 1800, after repl: 2960, after storageEngine: 3700, after tcmalloc: 5160, after wiredTiger: 6810, at end: 11050 } 2016-04-25T08:13:34.346+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:13:35.504+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:13:36.954+0000 I NETWORK [conn587] end connection 127.0.0.1:41058 (37 connections now open) 2016-04-25T08:13:38.667+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:13:43.078+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:13:43.735+0000 I COMMAND [conn586] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 10859396 } } } protocol:op_command 23486ms 2016-04-25T08:13:45.119+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:13:48.681+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41068 #589 (38 connections now open) 2016-04-25T08:13:49.216+0000 I COMMAND [conn588] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2204ms 2016-04-25T08:13:52.443+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T08:13:53.281+0000 I NETWORK [conn586] end connection 127.0.0.1:41056 (37 connections now open) 2016-04-25T08:13:56.675+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:13:57.822+0000 I COMMAND [conn589] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3795ms 2016-04-25T08:13:58.556+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:14:02.846+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:14:07.446+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:14:09.291+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41073 #590 (38 connections now open) 2016-04-25T08:14:11.438+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 290, after connections: 580, after extra_info: 2230, after globalLock: 2810, after locks: 3250, after network: 3560, after opcounters: 3680, after opcountersRepl: 3680, after repl: 10220, after storageEngine: 10820, after tcmalloc: 11890, after wiredTiger: 13840, at end: 14234 } 2016-04-25T08:14:12.271+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:14:15.474+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-04-25T08:14:17.142+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:14:17.909+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:14:22.074+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:14:22.396+0000 I COMMAND [conn590] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7618ms 2016-04-25T08:14:22.395+0000 I COMMAND [conn588] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 15751ms 2016-04-25T08:14:22.396+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:14:24.496+0000 I NETWORK [conn588] end connection 127.0.0.1:41064 (37 connections now open) 2016-04-25T08:14:24.395+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:14:25.615+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:14:27.108+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:14:38.958+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:14:38.966+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41076 #591 (38 connections now open) 2016-04-25T08:14:41.785+0000 I COMMAND [conn589] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 487363 } } } protocol:op_command 24708ms 2016-04-25T08:14:41.785+0000 I COMMAND [conn590] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3184ms 2016-04-25T08:14:42.493+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T08:14:43.817+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 310, after asserts: 500, after connections: 580, after extra_info: 1250, after globalLock: 1700, after locks: 1980, after network: 1980, after opcounters: 1980, after opcountersRepl: 1980, after repl: 3020, after storageEngine: 3800, after tcmalloc: 4590, after wiredTiger: 5460, at end: 7300 } 2016-04-25T08:14:46.795+0000 I NETWORK [conn589] end connection 127.0.0.1:41068 (37 connections now open) 2016-04-25T08:14:47.549+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 186ms 2016-04-25T08:14:48.633+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-04-25T08:14:54.093+0000 I COMMAND [conn591] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7489ms 2016-04-25T08:14:58.467+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-04-25T08:15:00.852+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-04-25T08:15:05.042+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:15:06.489+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41081 #592 (38 connections now open) 2016-04-25T08:15:09.865+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:15:15.404+0000 I COMMAND [conn592] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4175ms 2016-04-25T08:15:15.409+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Operation timed out 2016-04-25T08:15:20.055+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 90, after connections: 280, after extra_info: 1660, after globalLock: 2220, after locks: 2550, after network: 2630, after opcounters: 2630, after opcountersRepl: 2630, after repl: 5800, after storageEngine: 6520, after tcmalloc: 7430, after wiredTiger: 9550, at end: 11600 } 2016-04-25T08:15:20.197+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:15:20.501+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:15:21.030+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-04-25T08:15:22.072+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:15:24.119+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:15:25.093+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:15:27.026+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:15:30.187+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:15:30.187+0000 I COMMAND [conn590] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 5822052 } } } protocol:op_command 23764ms 2016-04-25T08:15:34.833+0000 I COMMAND [conn592] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2718ms 2016-04-25T08:15:35.242+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41084 #593 (39 connections now open) 2016-04-25T08:15:36.382+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:15:37.242+0000 I NETWORK [conn590] end connection 127.0.0.1:41073 (37 connections now open) 2016-04-25T08:15:42.262+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:15:44.396+0000 I COMMAND [conn591] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 13998375 } } } protocol:op_command 32746ms 2016-04-25T08:15:46.752+0000 I COMMAND [conn593] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4723ms 2016-04-25T08:15:46.856+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:15:49.212+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 102ms 2016-04-25T08:15:49.219+0000 I NETWORK [conn591] end connection 127.0.0.1:41076 (37 connections now open) 2016-04-25T08:15:51.123+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 234ms 2016-04-25T08:15:53.042+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:15:53.379+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41088 #594 (38 connections now open) 2016-04-25T08:15:54.165+0000 I COMMAND [conn592] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5799ms 2016-04-25T08:15:57.938+0000 I COMMAND [conn594] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1751ms 2016-04-25T08:16:01.314+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:16:02.305+0000 I NETWORK [conn592] end connection 127.0.0.1:41081 (37 connections now open) 2016-04-25T08:16:03.809+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:16:04.001+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 200, after asserts: 690, after connections: 1090, after extra_info: 1660, after globalLock: 1830, after locks: 1930, after network: 2020, after opcounters: 2020, after opcountersRepl: 2020, after repl: 3500, after storageEngine: 4330, after tcmalloc: 4820, after wiredTiger: 6920, at end: 9280 } 2016-04-25T08:16:04.590+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:16:05.802+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:16:06.339+0000 I NETWORK [conn594] end connection 127.0.0.1:41088 (36 connections now open) 2016-04-25T08:16:07.115+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:16:08.087+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41092 #595 (38 connections now open) 2016-04-25T08:16:10.695+0000 I COMMAND [conn593] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 14433ms 2016-04-25T08:16:14.516+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:16:16.473+0000 I COMMAND [conn595] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4052ms 2016-04-25T08:16:17.949+0000 I NETWORK [conn593] end connection 127.0.0.1:41084 (36 connections now open) 2016-04-25T08:16:22.323+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:16:24.024+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41096 #596 (37 connections now open) 2016-04-25T08:16:26.457+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:16:28.170+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:16:29.530+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:16:32.447+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:16:36.194+0000 I COMMAND [conn596] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6880ms 2016-04-25T08:16:37.228+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 960, after connections: 1250, after extra_info: 1522, after globalLock: 1522, after locks: 1522, after network: 1522, after opcounters: 1522, after opcountersRepl: 1522, after repl: 4832, after storageEngine: 5422, after tcmalloc: 6332, after wiredTiger: 7912, at end: 11972 } 2016-04-25T08:16:38.035+0000 I COMMAND [conn595] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 9266ms 2016-04-25T08:16:40.429+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:16:43.757+0000 I NETWORK [conn595] end connection 127.0.0.1:41092 (36 connections now open) 2016-04-25T08:16:45.933+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:16:50.727+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:16:51.526+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41098 #597 (37 connections now open) 2016-04-25T08:16:53.417+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 122ms 2016-04-25T08:16:55.990+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 193ms 2016-04-25T08:16:56.481+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:17:02.851+0000 I COMMAND [conn597] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4718ms 2016-04-25T08:17:06.232+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:17:08.736+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 830, after connections: 1030, after extra_info: 1720, after globalLock: 2190, after locks: 2620, after network: 3150, after opcounters: 3350, after opcountersRepl: 3350, after repl: 5820, after storageEngine: 6510, after tcmalloc: 7400, after wiredTiger: 9740, at end: 12300 } 2016-04-25T08:17:08.860+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:17:11.821+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:17:14.008+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:17:16.578+0000 I COMMAND [conn596] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 23255ms 2016-04-25T08:17:16.671+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:17:19.289+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:17:19.295+0000 I COMMAND [conn597] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3034ms 2016-04-25T08:17:20.190+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41104 #598 (38 connections now open) 2016-04-25T08:17:26.109+0000 I NETWORK [conn596] end connection 127.0.0.1:41096 (37 connections now open) 2016-04-25T08:17:27.078+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:17:29.019+0000 I NETWORK [conn597] end connection 127.0.0.1:41098 (37 connections now open) 2016-04-25T08:17:30.422+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:17:31.476+0000 I COMMAND [conn598] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4809ms 2016-04-25T08:17:31.476+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41106 #599 (37 connections now open) 2016-04-25T08:17:32.244+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:17:32.454+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 490, after globalLock: 980, after locks: 1400, after network: 1490, after opcounters: 1490, after opcountersRepl: 1490, after repl: 2280, after storageEngine: 3080, after tcmalloc: 4420, after wiredTiger: 5930, at end: 8011 } 2016-04-25T08:17:38.564+0000 I COMMAND [conn599] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1912ms 2016-04-25T08:17:43.575+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:17:46.509+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:17:47.888+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:17:49.303+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:17:50.978+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:17:55.187+0000 I COMMAND [conn599] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6159ms 2016-04-25T08:17:55.187+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:17:57.512+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 110ms 2016-04-25T08:17:57.508+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 590, after connections: 890, after extra_info: 1840, after globalLock: 2040, after locks: 2330, after network: 2340, after opcounters: 2340, after opcountersRepl: 2340, after repl: 6730, after storageEngine: 7160, after tcmalloc: 7690, after wiredTiger: 9170, at end: 10790 } 2016-04-25T08:18:00.675+0000 I COMMAND [conn598] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 17392ms 2016-04-25T08:18:04.654+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41111 #600 (38 connections now open) 2016-04-25T08:18:05.644+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:18:06.178+0000 I NETWORK [conn598] end connection 127.0.0.1:41104 (36 connections now open) 2016-04-25T08:18:08.542+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:18:11.285+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:18:13.865+0000 I COMMAND [conn599] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7207ms 2016-04-25T08:18:14.265+0000 I COMMAND [conn600] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4126ms 2016-04-25T08:18:15.288+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41116 #601 (38 connections now open) 2016-04-25T08:18:20.046+0000 I NETWORK [conn599] end connection 127.0.0.1:41106 (37 connections now open) 2016-04-25T08:18:20.837+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 560, after asserts: 760, after connections: 760, after extra_info: 1570, after globalLock: 1860, after locks: 2280, after network: 2570, after opcounters: 2570, after opcountersRepl: 2570, after repl: 3480, after storageEngine: 3942, after tcmalloc: 4302, after wiredTiger: 5602, at end: 8542 } 2016-04-25T08:18:21.812+0000 I COMMAND [conn601] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1809ms 2016-04-25T08:18:22.204+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:18:23.783+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41118 #602 (38 connections now open) 2016-04-25T08:18:24.263+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:18:25.047+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:18:25.721+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:18:29.023+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:18:31.795+0000 I COMMAND [conn601] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1509ms 2016-04-25T08:18:31.892+0000 I COMMAND [conn602] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1311ms 2016-04-25T08:18:33.167+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:18:37.513+0000 I NETWORK [conn601] end connection 127.0.0.1:41116 (37 connections now open) 2016-04-25T08:18:39.785+0000 I COMMAND [conn600] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 14525ms 2016-04-25T08:18:40.279+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:18:42.674+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:18:43.673+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:18:45.187+0000 I NETWORK [conn600] end connection 127.0.0.1:41111 (36 connections now open) 2016-04-25T08:18:45.894+0000 I COMMAND [conn602] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3346ms 2016-04-25T08:18:52.666+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41123 #603 (37 connections now open) 2016-04-25T08:18:53.262+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 370, after asserts: 740, after connections: 1240, after extra_info: 1840, after globalLock: 2360, after locks: 2720, after network: 3000, after opcounters: 3010, after opcountersRepl: 3010, after repl: 4310, after storageEngine: 4930, after tcmalloc: 5330, after wiredTiger: 6320, at end: 7592 } 2016-04-25T08:18:55.045+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:19:03.408+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 563ms 2016-04-25T08:19:07.009+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 165ms 2016-04-25T08:19:10.383+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:19:11.900+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 142ms 2016-04-25T08:19:15.438+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:19:25.488+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:19:25.161+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:19:30.398+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41125 #604 (38 connections now open) 2016-04-25T08:19:42.870+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:20:17.884+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 145ms 2016-04-25T08:20:25.030+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2228ms 2016-04-25T08:20:25.574+0000 I COMMAND [conn603] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 67111ms 2016-04-25T08:20:37.426+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1027ms 2016-04-25T08:20:51.057+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:21:14.679+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:21:14.679+0000 I COMMAND [conn604] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 46716ms 2016-04-25T08:21:45.012+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 854ms 2016-04-25T08:21:49.807+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 309ms 2016-04-25T08:21:51.880+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:22:03.441+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:22:29.323+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:22:51.873+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 296ms 2016-04-25T08:22:52.719+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:23:04.127+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 488ms 2016-04-25T08:23:08.340+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 200ms 2016-04-25T08:23:08.634+0000 I COMMAND [conn602] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 200003ms 2016-04-25T08:23:23.874+0000 I NETWORK [conn602] end connection 127.0.0.1:41118 (37 connections now open) 2016-04-25T08:23:23.892+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3420, after asserts: 4890, after connections: 5040, after extra_info: 9750, after globalLock: 12680, after locks: 15110, after network: 15450, after opcounters: 15450, after opcountersRepl: 15450, after repl: 60740, after storageEngine: 63680, after tcmalloc: 69720, after wiredTiger: 91170, at end: 111920 } 2016-04-25T08:23:29.021+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:23:44.330+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:23:49.843+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41129 #605 (38 connections now open) 2016-04-25T08:24:25.623+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41130 #606 (39 connections now open) 2016-04-25T08:24:33.575+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:24:34.217+0000 I COMMAND [conn603] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 1118900 } } } protocol:op_command 187425ms 2016-04-25T08:24:48.018+0000 I NETWORK [conn603] end connection 127.0.0.1:41123 (38 connections now open) 2016-04-25T08:24:57.400+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:25:08.456+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:25:10.521+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 402ms 2016-04-25T08:25:16.226+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:25:16.087+0000 I COMMAND [conn604] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 149964ms 2016-04-25T08:25:16.708+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 293ms 2016-04-25T08:25:32.711+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:25:38.748+0000 I NETWORK [conn604] end connection 127.0.0.1:41125 (37 connections now open) 2016-04-25T08:25:38.700+0000 I COMMAND [conn605] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 32415ms 2016-04-25T08:25:38.700+0000 I COMMAND [conn606] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 32162ms 2016-04-25T08:25:53.428+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:26:11.660+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:26:18.805+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 138ms 2016-04-25T08:26:29.713+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 398ms 2016-04-25T08:26:37.178+0000 I NETWORK [conn605] end connection 127.0.0.1:41129 (36 connections now open) 2016-04-25T08:27:04.748+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:27:16.879+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1230, after asserts: 3020, after connections: 5000, after extra_info: 9170, after globalLock: 11120, after locks: 11950, after network: 11950, after opcounters: 11950, after opcountersRepl: 11950, after repl: 46290, after storageEngine: 49770, after tcmalloc: 55930, after wiredTiger: 66390, at end: 77720 } 2016-04-25T08:27:22.207+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:27:33.889+0000 I NETWORK [conn606] end connection 127.0.0.1:41130 (35 connections now open) 2016-04-25T08:27:33.831+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 313ms 2016-04-25T08:27:46.189+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:27:47.648+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 539ms 2016-04-25T08:28:00.269+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:28:14.477+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:28:36.854+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41136 #607 (36 connections now open) 2016-04-25T08:28:41.071+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:28:59.045+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:29:05.731+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1078ms 2016-04-25T08:29:09.340+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:29:11.261+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1055ms 2016-04-25T08:29:16.098+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:29:16.628+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41138 #608 (37 connections now open) 2016-04-25T08:29:19.554+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:29:38.612+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:29:45.037+0000 I COMMAND [conn607] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 37796ms 2016-04-25T08:29:49.780+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:30:07.843+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:30:09.596+0000 I COMMAND [conn608] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 28665ms 2016-04-25T08:30:09.676+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:30:17.268+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 624ms 2016-04-25T08:30:31.313+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 963ms 2016-04-25T08:30:42.629+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:30:45.715+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 737ms 2016-04-25T08:30:54.350+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:31:04.222+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2380, after asserts: 2610, after connections: 14090, after extra_info: 15410, after globalLock: 17920, after locks: 18370, after network: 18470, after opcounters: 18470, after opcountersRepl: 18470, after repl: 44350, after storageEngine: 51010, after tcmalloc: 57220, after wiredTiger: 65370, at end: 75040 } 2016-04-25T08:31:21.213+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:31:25.405+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:31:38.383+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:31:48.201+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 249ms 2016-04-25T08:32:13.680+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 353ms 2016-04-25T08:32:19.396+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 242ms 2016-04-25T08:32:25.362+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:32:27.067+0000 I COMMAND [conn607] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 92670ms 2016-04-25T08:32:34.494+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41142 #609 (38 connections now open) 2016-04-25T08:32:37.592+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:32:46.225+0000 I NETWORK [conn607] end connection 127.0.0.1:41136 (36 connections now open) 2016-04-25T08:33:03.556+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41143 #610 (39 connections now open) 2016-04-25T08:33:23.551+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:33:31.076+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 378ms 2016-04-25T08:33:35.984+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 335ms 2016-04-25T08:33:40.480+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:33:55.263+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:34:15.709+0000 I COMMAND [conn609] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 58188ms 2016-04-25T08:34:27.597+0000 I COMMAND [conn608] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 33089982 } } } protocol:op_command 207803ms 2016-04-25T08:34:26.090+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:34:41.038+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:34:48.896+0000 I COMMAND [conn610] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 49282ms 2016-04-25T08:34:50.757+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 281ms 2016-04-25T08:34:50.913+0000 I NETWORK [conn608] end connection 127.0.0.1:41138 (37 connections now open) 2016-04-25T08:34:51.822+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 595ms 2016-04-25T08:34:52.197+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 374ms 2016-04-25T08:34:56.874+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2280, after asserts: 6920, after connections: 7430, after extra_info: 9610, after globalLock: 10320, after locks: 16390, after network: 18110, after opcounters: 18550, after opcountersRepl: 18550, after repl: 63620, after storageEngine: 65210, after tcmalloc: 69140, after wiredTiger: 81760, at end: 91590 } 2016-04-25T08:35:01.355+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:35:13.544+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:35:48.551+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:35:51.433+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:35:52.744+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 274ms 2016-04-25T08:36:04.693+0000 I NETWORK [conn610] end connection 127.0.0.1:41143 (36 connections now open) 2016-04-25T08:36:14.698+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:36:24.182+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 8671ms 2016-04-25T08:36:30.607+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:36:34.129+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 428ms 2016-04-25T08:36:45.055+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41149 #611 (37 connections now open) 2016-04-25T08:36:48.289+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41150 #612 (38 connections now open) 2016-04-25T08:36:50.486+0000 I COMMAND [conn609] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 75389ms 2016-04-25T08:36:51.766+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:37:03.626+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:37:16.630+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:37:22.788+0000 I NETWORK [conn609] end connection 127.0.0.1:41142 (37 connections now open) 2016-04-25T08:37:45.940+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 128ms 2016-04-25T08:37:48.843+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:38:05.438+0000 I COMMAND [conn611] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 56226ms 2016-04-25T08:38:05.438+0000 I COMMAND [conn612] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 49275ms 2016-04-25T08:38:11.510+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 433ms 2016-04-25T08:38:13.200+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 320ms 2016-04-25T08:38:19.870+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:38:29.875+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:38:42.406+0000 I NETWORK [conn612] end connection 127.0.0.1:41150 (36 connections now open) 2016-04-25T08:38:44.711+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:38:54.296+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:38:58.925+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 9510, after asserts: 10740, after connections: 20810, after extra_info: 28640, after globalLock: 34720, after locks: 38660, after network: 41290, after opcounters: 42030, after opcountersRepl: 42030, after repl: 72870, after storageEngine: 75360, after tcmalloc: 79510, after wiredTiger: 99560, at end: 111840 } 2016-04-25T08:39:19.234+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:39:54.765+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:40:15.654+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41154 #613 (37 connections now open) 2016-04-25T08:40:16.426+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:40:26.218+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 115ms 2016-04-25T08:40:30.982+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:40:34.404+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:40:48.371+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 7109ms 2016-04-25T08:40:53.686+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 379ms 2016-04-25T08:40:53.288+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:41:31.975+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:41:30.782+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41156 #614 (38 connections now open) 2016-04-25T08:41:35.858+0000 I COMMAND [conn613] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 39250ms 2016-04-25T08:41:43.055+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:42:07.268+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:42:14.049+0000 I COMMAND [conn611] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 21343882 } } } protocol:op_command 185290ms 2016-04-25T08:42:21.950+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:42:39.828+0000 I NETWORK [conn611] end connection 127.0.0.1:41149 (37 connections now open) 2016-04-25T08:42:39.828+0000 I NETWORK [conn613] end connection 127.0.0.1:41154 (37 connections now open) 2016-04-25T08:42:56.547+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4060, after asserts: 5520, after connections: 5750, after extra_info: 13880, after globalLock: 15300, after locks: 15410, after network: 15690, after opcounters: 15690, after opcountersRepl: 15690, after repl: 51955, after storageEngine: 56185, after tcmalloc: 59425, after wiredTiger: 77545, at end: 95935 } 2016-04-25T08:42:57.400+0000 I COMMAND [conn614] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 44677ms 2016-04-25T08:42:57.580+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:43:06.144+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 401ms 2016-04-25T08:43:08.590+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 447ms 2016-04-25T08:43:09.221+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 138ms 2016-04-25T08:43:17.821+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:43:21.493+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:43:53.695+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:44:08.524+0000 I NETWORK [conn614] end connection 127.0.0.1:41156 (35 connections now open) 2016-04-25T08:44:11.633+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 485ms 2016-04-25T08:44:16.298+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41160 #615 (37 connections now open) 2016-04-25T08:44:25.204+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:44:29.318+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 6378ms 2016-04-25T08:44:37.365+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 149ms 2016-04-25T08:44:37.581+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:44:52.439+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:45:22.325+0000 I COMMAND [conn615] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 40194ms 2016-04-25T08:45:25.645+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:45:36.858+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:45:46.102+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 866ms 2016-04-25T08:45:47.152+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41161 #616 (37 connections now open) 2016-04-25T08:45:59.220+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 498ms 2016-04-25T08:46:11.518+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 111ms 2016-04-25T08:46:16.306+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:46:32.967+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:46:43.640+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:47:06.554+0000 I COMMAND [conn616] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 37252ms 2016-04-25T08:47:07.674+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:47:19.035+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:47:19.115+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1170, after asserts: 3510, after connections: 7350, after extra_info: 7350, after globalLock: 7350, after locks: 7350, after network: 9140, after opcounters: 9870, after opcountersRepl: 9870, after repl: 29710, after storageEngine: 38550, after tcmalloc: 46510, after wiredTiger: 58650, at end: 73750 } 2016-04-25T08:47:20.449+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 186ms 2016-04-25T08:47:46.586+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:47:48.774+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1183ms 2016-04-25T08:47:57.545+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3266ms 2016-04-25T08:48:08.205+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:48:11.098+0000 I COMMAND [conn615] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 86866ms 2016-04-25T08:48:22.670+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:48:31.816+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41166 #617 (38 connections now open) 2016-04-25T08:48:54.716+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:49:02.344+0000 I NETWORK [conn616] end connection 127.0.0.1:41161 (37 connections now open) 2016-04-25T08:49:02.344+0000 I NETWORK [conn615] end connection 127.0.0.1:41160 (37 connections now open) 2016-04-25T08:49:07.892+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:49:11.170+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:49:40.218+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:49:53.946+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:50:00.713+0000 I COMMAND [conn617] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 33020ms 2016-04-25T08:50:12.385+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 324ms 2016-04-25T08:50:12.665+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:50:23.047+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1945ms 2016-04-25T08:50:25.328+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:50:36.597+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41168 #618 (37 connections now open) 2016-04-25T08:50:36.699+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:50:47.171+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:51:04.070+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:51:34.271+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 443ms 2016-04-25T08:51:35.308+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:51:45.797+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2740, after asserts: 6690, after connections: 12970, after extra_info: 19490, after globalLock: 28850, after locks: 31700, after network: 33070, after opcounters: 33070, after opcountersRepl: 33070, after repl: 38774, after storageEngine: 45824, after tcmalloc: 53774, after wiredTiger: 66564, at end: 83894 } 2016-04-25T08:51:53.872+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1014ms 2016-04-25T08:52:08.682+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 226ms 2016-04-25T08:52:21.468+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:52:40.712+0000 I COMMAND [conn618] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 63723ms 2016-04-25T08:52:45.729+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41172 #619 (38 connections now open) 2016-04-25T08:52:46.562+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:52:46.702+0000 I COMMAND [conn617] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 106336ms 2016-04-25T08:52:48.070+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:52:53.567+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:52:59.938+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:53:13.938+0000 I NETWORK [conn617] end connection 127.0.0.1:41166 (37 connections now open) 2016-04-25T08:53:21.490+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:53:24.327+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 333ms 2016-04-25T08:53:35.367+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3278ms 2016-04-25T08:53:38.694+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:53:49.733+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 115ms 2016-04-25T08:54:01.140+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T08:54:00.982+0000 I COMMAND [conn619] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 33475ms 2016-04-25T08:54:38.539+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T08:54:55.057+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:55:02.640+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 350ms 2016-04-25T08:55:22.302+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 311ms 2016-04-25T08:55:24.339+0000 I NETWORK [conn619] end connection 127.0.0.1:41172 (36 connections now open) 2016-04-25T08:55:38.388+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 382ms 2016-04-25T08:56:00.745+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:56:19.822+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3620, after asserts: 5070, after connections: 5950, after extra_info: 10780, after globalLock: 18150, after locks: 20230, after network: 23040, after opcounters: 23140, after opcountersRepl: 23140, after repl: 89250, after storageEngine: 96370, after tcmalloc: 102050, after wiredTiger: 123300, at end: 137330 } 2016-04-25T08:56:36.658+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:56:44.290+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41177 #620 (37 connections now open) 2016-04-25T08:56:44.166+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 738ms 2016-04-25T08:57:02.796+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41178 #621 (38 connections now open) 2016-04-25T08:57:04.829+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 343ms 2016-04-25T08:57:08.737+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1936ms 2016-04-25T08:57:14.304+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T08:57:19.573+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:58:15.862+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 195ms 2016-04-25T08:58:24.106+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T08:58:31.358+0000 I COMMAND [conn621] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 63871ms 2016-04-25T08:58:31.358+0000 I COMMAND [conn620] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 63871ms 2016-04-25T08:58:37.887+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:58:37.039+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 499ms 2016-04-25T08:58:57.684+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:59:04.617+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T08:59:08.908+0000 I NETWORK [conn620] end connection 127.0.0.1:41177 (37 connections now open) 2016-04-25T08:59:18.228+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T08:59:45.863+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T08:59:49.951+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 238ms 2016-04-25T08:59:50.191+0000 I COMMAND [conn618] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 69115892 } } } protocol:op_command 332811ms 2016-04-25T08:59:50.413+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 125ms 2016-04-25T09:00:06.283+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:00:30.835+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:00:30.940+0000 I NETWORK [conn618] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:41168] 2016-04-25T09:00:53.558+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1169ms 2016-04-25T09:00:58.940+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:00:59.525+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41181 #622 (37 connections now open) 2016-04-25T09:01:00.495+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 664ms 2016-04-25T09:01:01.077+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 431ms 2016-04-25T09:01:15.076+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:01:36.792+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:01:52.034+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41184 #623 (38 connections now open) 2016-04-25T09:01:51.721+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 7670, after asserts: 14010, after connections: 20000, after extra_info: 23710, after globalLock: 26550, after locks: 28400, after network: 29490, after opcounters: 30080, after opcountersRepl: 30080, after repl: 55652, after storageEngine: 61492, after tcmalloc: 64162, after wiredTiger: 82732, at end: 93828 } 2016-04-25T09:01:53.770+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:02:05.540+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3411ms 2016-04-25T09:02:08.306+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T09:02:15.324+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3374ms 2016-04-25T09:02:31.134+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:02:36.681+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2714ms 2016-04-25T09:02:39.926+0000 I COMMAND [conn622] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 62601ms 2016-04-25T09:02:51.556+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:02:55.134+0000 I COMMAND [conn621] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 12615124 } } } protocol:op_command 195475ms 2016-04-25T09:03:11.673+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:03:16.989+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T09:03:33.264+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T09:03:36.385+0000 I NETWORK [conn621] end connection 127.0.0.1:41178 (37 connections now open) 2016-04-25T09:03:41.377+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 312ms 2016-04-25T09:03:50.307+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 373ms 2016-04-25T09:03:54.335+0000 I COMMAND [conn623] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 54471ms 2016-04-25T09:03:54.862+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:04:01.097+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 373ms 2016-04-25T09:04:19.753+0000 I NETWORK [conn622] end connection 127.0.0.1:41181 (36 connections now open) 2016-04-25T09:04:28.578+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:04:45.419+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T09:05:03.826+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 153ms 2016-04-25T09:05:06.784+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:05:21.254+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1027ms 2016-04-25T09:05:43.795+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:05:47.941+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 132ms 2016-04-25T09:06:10.915+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41188 #624 (37 connections now open) 2016-04-25T09:06:38.030+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:06:44.878+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T09:07:01.740+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:07:12.924+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 208ms 2016-04-25T09:07:26.610+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3340, after asserts: 8800, after connections: 12850, after extra_info: 27050, after globalLock: 30480, after locks: 34310, after network: 39470, after opcounters: 41030, after opcountersRepl: 41570, after repl: 96351, after storageEngine: 96351, after tcmalloc: 99431, after wiredTiger: 111171, at end: 149521 } 2016-04-25T09:07:34.255+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:07:47.144+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2024ms 2016-04-25T09:07:50.546+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 381ms 2016-04-25T09:08:11.439+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:08:24.079+0000 I COMMAND [conn623] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 203443ms 2016-04-25T09:08:25.029+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41191 #625 (38 connections now open) 2016-04-25T09:08:43.225+0000 I COMMAND [conn624] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 89903ms 2016-04-25T09:08:52.228+0000 I NETWORK [conn623] end connection 127.0.0.1:41184 (37 connections now open) 2016-04-25T09:08:53.893+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:08:56.268+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 165ms 2016-04-25T09:08:56.763+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 224ms 2016-04-25T09:08:57.770+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:09:18.192+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T09:09:29.759+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T09:09:58.883+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 141ms 2016-04-25T09:10:21.255+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:10:30.410+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 9941ms 2016-04-25T09:10:40.693+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 137ms 2016-04-25T09:10:42.013+0000 I COMMAND [conn625] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 80671ms 2016-04-25T09:10:42.337+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T09:10:51.463+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:11:18.155+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:11:35.789+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:11:44.531+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 367ms 2016-04-25T09:11:46.463+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 849ms 2016-04-25T09:11:57.714+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41197 #626 (38 connections now open) 2016-04-25T09:11:57.714+0000 I NETWORK [conn625] end connection 127.0.0.1:41191 (36 connections now open) 2016-04-25T09:11:58.574+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6050, after asserts: 9490, after connections: 10550, after extra_info: 14490, after globalLock: 16870, after locks: 25460, after network: 33130, after opcounters: 34370, after opcountersRepl: 34370, after repl: 58430, after storageEngine: 61600, after tcmalloc: 70350, after wiredTiger: 83270, at end: 92489 } 2016-04-25T09:12:02.638+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:12:05.527+0000 I COMMAND [conn624] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 94990ms 2016-04-25T09:12:12.886+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 473ms 2016-04-25T09:12:36.667+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T09:12:58.107+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:13:02.333+0000 I NETWORK [conn624] end connection 127.0.0.1:41188 (36 connections now open) 2016-04-25T09:13:24.932+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 385ms 2016-04-25T09:13:44.217+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T09:13:46.061+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 219ms 2016-04-25T09:13:47.015+0000 I COMMAND [conn626] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 56994ms 2016-04-25T09:14:01.977+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:14:02.590+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T09:14:34.015+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:14:49.274+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 342ms 2016-04-25T09:14:56.525+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:15:04.366+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 861ms 2016-04-25T09:15:26.491+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 652ms 2016-04-25T09:15:40.224+0000 I NETWORK [conn626] end connection 127.0.0.1:41197 (35 connections now open) 2016-04-25T09:15:40.224+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41199 #627 (37 connections now open) 2016-04-25T09:15:46.432+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:16:16.348+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:16:44.919+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 476ms 2016-04-25T09:17:00.590+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 754ms 2016-04-25T09:17:03.790+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41200 #628 (37 connections now open) 2016-04-25T09:17:07.258+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T09:17:16.842+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 772ms 2016-04-25T09:17:27.953+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4040, after asserts: 5270, after connections: 11400, after extra_info: 30400, after globalLock: 32690, after locks: 36460, after network: 38590, after opcounters: 39120, after opcountersRepl: 39120, after repl: 62708, after storageEngine: 64498, after tcmalloc: 73798, after wiredTiger: 99532, at end: 106852 } 2016-04-25T09:17:48.649+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:17:56.554+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T09:18:29.720+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 613ms 2016-04-25T09:18:40.101+0000 I COMMAND [conn627] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 104897ms 2016-04-25T09:18:49.052+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:18:46.721+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3155ms 2016-04-25T09:19:25.930+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T09:19:44.080+0000 I COMMAND [conn628] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 81607ms 2016-04-25T09:20:02.524+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:20:26.773+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 5138ms 2016-04-25T09:20:47.936+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 559ms 2016-04-25T09:20:53.991+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:21:30.025+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 429ms 2016-04-25T09:21:59.826+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:22:35.702+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:22:41.076+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 774ms 2016-04-25T09:22:55.662+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 706ms 2016-04-25T09:23:03.467+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T09:23:12.174+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 5094ms 2016-04-25T09:23:20.729+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:23:33.220+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:24:26.085+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 822ms 2016-04-25T09:24:42.183+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 695ms 2016-04-25T09:24:50.359+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:24:55.235+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41205 #629 (38 connections now open) 2016-04-25T09:25:24.488+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:25:26.294+0000 I COMMAND [conn628] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 160582ms 2016-04-25T09:25:48.223+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 428ms 2016-04-25T09:25:45.368+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T09:25:46.866+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T09:26:09.937+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1940, after asserts: 4110, after connections: 9120, after extra_info: 18400, after globalLock: 21740, after locks: 34810, after network: 36860, after opcounters: 37330, after opcountersRepl: 37330, after repl: 121560, after storageEngine: 123898, after tcmalloc: 123898, after wiredTiger: 123898, at end: 153578 } 2016-04-25T09:26:11.751+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 5835ms 2016-04-25T09:26:34.182+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:26:39.820+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41207 #630 (39 connections now open) 2016-04-25T09:26:41.594+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 469ms 2016-04-25T09:27:05.976+0000 I NETWORK [conn628] end connection 127.0.0.1:41200 (37 connections now open) 2016-04-25T09:27:50.202+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 432ms 2016-04-25T09:28:05.612+0000 I COMMAND [conn627] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 308845ms 2016-04-25T09:28:10.531+0000 I COMMAND [conn629] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 102247ms 2016-04-25T09:28:19.786+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 504ms 2016-04-25T09:28:24.921+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:28:40.410+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 418ms 2016-04-25T09:28:48.286+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T09:28:50.849+0000 I NETWORK [conn627] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:41199] 2016-04-25T09:29:38.324+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:29:41.990+0000 I COMMAND [conn630] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 120683ms 2016-04-25T09:30:02.973+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 395ms 2016-04-25T09:30:08.743+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:30:21.474+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2261ms 2016-04-25T09:30:28.798+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 192ms 2016-04-25T09:31:36.288+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 669ms 2016-04-25T09:31:37.181+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:32:05.356+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 772ms 2016-04-25T09:32:12.558+0000 I NETWORK [conn629] end connection 127.0.0.1:41205 (36 connections now open) 2016-04-25T09:32:18.042+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 147ms 2016-04-25T09:32:36.843+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:33:06.641+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:33:22.075+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1340, after asserts: 8720, after connections: 13560, after extra_info: 28910, after globalLock: 32060, after locks: 39210, after network: 41960, after opcounters: 44200, after opcountersRepl: 45960, after repl: 152190, after storageEngine: 157030, after tcmalloc: 167410, after wiredTiger: 178810, at end: 208880 } 2016-04-25T09:33:43.213+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T09:33:43.213+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 263ms 2016-04-25T09:33:43.504+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:34:02.421+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 6873ms 2016-04-25T09:34:02.185+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:34:08.599+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41211 #631 (37 connections now open) 2016-04-25T09:34:12.607+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 132ms 2016-04-25T09:34:43.147+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T09:34:53.425+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:35:07.005+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41213 #632 (38 connections now open) 2016-04-25T09:35:04.917+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:35:44.078+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 425ms 2016-04-25T09:35:54.305+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 476ms 2016-04-25T09:35:56.265+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T09:36:18.137+0000 I COMMAND [conn631] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 60487ms 2016-04-25T09:36:31.367+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 336ms 2016-04-25T09:36:42.690+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:36:52.180+0000 I COMMAND [conn630] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 67124834 } } } protocol:op_command 353660ms 2016-04-25T09:37:09.858+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T09:37:31.667+0000 I NETWORK [conn630] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:41207] 2016-04-25T09:37:46.135+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 355ms 2016-04-25T09:37:48.439+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:37:51.497+0000 I COMMAND [conn632] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 113611ms 2016-04-25T09:37:54.069+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 300ms 2016-04-25T09:38:02.239+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 368ms 2016-04-25T09:38:04.406+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:38:45.840+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:38:58.020+0000 I NETWORK [conn632] end connection 127.0.0.1:41213 (36 connections now open) 2016-04-25T09:39:19.316+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 421ms 2016-04-25T09:39:28.217+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1580, after asserts: 3000, after connections: 4230, after extra_info: 7330, after globalLock: 9710, after locks: 11220, after network: 11700, after opcounters: 11700, after opcountersRepl: 11700, after repl: 32470, after storageEngine: 36340, after tcmalloc: 49980, after wiredTiger: 63500, at end: 81460 } 2016-04-25T09:39:36.941+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1311ms 2016-04-25T09:39:41.398+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:39:58.082+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 364ms 2016-04-25T09:40:00.271+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:40:41.341+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:41:06.352+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41218 #633 (37 connections now open) 2016-04-25T09:41:11.196+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T09:41:11.196+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 207ms 2016-04-25T09:41:18.472+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 225ms 2016-04-25T09:41:20.863+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:41:32.105+0000 I COMMAND [conn631] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 163867ms 2016-04-25T09:41:56.653+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T09:41:59.925+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41219 #634 (38 connections now open) 2016-04-25T09:42:01.621+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:42:20.079+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 326ms 2016-04-25T09:42:26.445+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T09:42:32.251+0000 I NETWORK [conn631] end connection 127.0.0.1:41211 (37 connections now open) 2016-04-25T09:42:33.918+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 585ms 2016-04-25T09:42:34.754+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 290ms 2016-04-25T09:43:10.115+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:43:16.584+0000 I COMMAND [conn633] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 90536ms 2016-04-25T09:43:36.163+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 156ms 2016-04-25T09:43:42.952+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1266ms 2016-04-25T09:43:44.851+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T09:43:49.189+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:43:57.447+0000 I COMMAND [conn634] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 43154ms 2016-04-25T09:44:05.654+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:44:20.288+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 70, after asserts: 1020, after connections: 2480, after extra_info: 8650, after globalLock: 10930, after locks: 13790, after network: 14230, after opcounters: 14230, after opcountersRepl: 14230, after repl: 65650, after storageEngine: 68220, after tcmalloc: 72750, after wiredTiger: 77890, at end: 100050 } 2016-04-25T09:44:29.262+0000 I NETWORK [conn633] end connection 127.0.0.1:41218 (36 connections now open) 2016-04-25T09:44:39.573+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:44:47.889+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 382ms 2016-04-25T09:45:12.955+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 304ms 2016-04-25T09:45:18.721+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 166ms 2016-04-25T09:45:24.834+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:45:47.448+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:46:06.016+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T09:46:06.620+0000 I NETWORK [conn634] end connection 127.0.0.1:41219 (35 connections now open) 2016-04-25T09:46:06.620+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41224 #635 (37 connections now open) 2016-04-25T09:46:07.948+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:46:27.227+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 277ms 2016-04-25T09:46:36.728+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 316ms 2016-04-25T09:46:37.847+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:46:43.625+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-04-25T09:47:00.258+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:47:08.073+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:47:13.896+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T09:47:23.643+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41226 #636 (37 connections now open) 2016-04-25T09:47:37.282+0000 I COMMAND [conn635] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 35894ms 2016-04-25T09:47:47.829+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T09:47:48.006+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 244ms 2016-04-25T09:47:49.586+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 291ms 2016-04-25T09:47:49.733+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 147ms 2016-04-25T09:47:57.257+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:48:15.452+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T09:48:49.179+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:48:51.652+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 958ms 2016-04-25T09:48:54.551+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 246ms 2016-04-25T09:48:58.240+0000 I COMMAND [conn636] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 62292ms 2016-04-25T09:48:58.240+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:49:02.386+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1510, after asserts: 2920, after connections: 4330, after extra_info: 7150, after globalLock: 7891, after locks: 7891, after network: 7891, after opcounters: 7891, after opcountersRepl: 7891, after repl: 44921, after storageEngine: 49731, after tcmalloc: 58991, after wiredTiger: 72571, at end: 88161 } 2016-04-25T09:49:02.833+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:49:46.750+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:49:59.544+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 188ms 2016-04-25T09:50:01.953+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:50:11.737+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 154ms 2016-04-25T09:50:20.251+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:50:26.403+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 306ms 2016-04-25T09:50:40.753+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:50:54.265+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T09:50:54.265+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41231 #637 (38 connections now open) 2016-04-25T09:50:58.307+0000 I COMMAND [conn635] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 89597ms 2016-04-25T09:51:03.056+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:51:26.200+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T09:51:38.756+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T09:51:41.815+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:51:44.597+0000 I NETWORK [conn635] end connection 127.0.0.1:41224 (37 connections now open) 2016-04-25T09:51:44.673+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 5486ms 2016-04-25T09:51:54.307+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41232 #638 (39 connections now open) 2016-04-25T09:52:00.091+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 6442ms 2016-04-25T09:52:10.795+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:52:27.031+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4600, after asserts: 6000, after connections: 8510, after extra_info: 9323, after globalLock: 9323, after locks: 10803, after network: 11483, after opcounters: 11483, after opcountersRepl: 11483, after repl: 49674, after storageEngine: 50764, after tcmalloc: 54374, after wiredTiger: 62644, at end: 72194 } 2016-04-25T09:53:06.334+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:53:10.009+0000 I COMMAND [conn637] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 90465ms 2016-04-25T09:53:10.327+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 441ms 2016-04-25T09:53:17.170+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 495ms 2016-04-25T09:53:18.507+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 194ms 2016-04-25T09:53:27.013+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:53:35.941+0000 I COMMAND [conn638] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 50332ms 2016-04-25T09:53:58.569+0000 I COMMAND [conn636] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 83528611 } } } protocol:op_command 268271ms 2016-04-25T09:53:59.598+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T09:54:11.790+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:54:21.363+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1386ms 2016-04-25T09:54:46.295+0000 I NETWORK [conn636] end connection 127.0.0.1:41226 (37 connections now open) 2016-04-25T09:54:46.295+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 456ms 2016-04-25T09:54:48.313+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:55:13.867+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 363ms 2016-04-25T09:55:17.198+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T09:55:26.732+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:55:39.884+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:55:41.983+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41238 #639 (38 connections now open) 2016-04-25T09:55:49.021+0000 I COMMAND [conn637] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 95835ms 2016-04-25T09:56:00.814+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:56:26.093+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 346ms 2016-04-25T09:56:28.956+0000 I NETWORK [conn637] end connection 127.0.0.1:41231 (37 connections now open) 2016-04-25T09:56:48.240+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 397ms 2016-04-25T09:56:48.240+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:57:00.264+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3150, after asserts: 5990, after connections: 6570, after extra_info: 8130, after globalLock: 8910, after locks: 9420, after network: 9420, after opcounters: 9420, after opcountersRepl: 9420, after repl: 39844, after storageEngine: 40794, after tcmalloc: 51574, after wiredTiger: 75424, at end: 89774 } 2016-04-25T09:57:00.214+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 387ms 2016-04-25T09:57:20.158+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T09:57:46.169+0000 I COMMAND [conn639] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 65321ms 2016-04-25T09:57:46.318+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T09:58:02.617+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41240 #640 (38 connections now open) 2016-04-25T09:58:06.796+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 449ms 2016-04-25T09:58:09.672+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 452ms 2016-04-25T09:58:11.913+0000 I COMMAND [conn638] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 221386ms 2016-04-25T09:58:19.813+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:58:20.900+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 377ms 2016-04-25T09:58:24.344+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T09:58:41.216+0000 I NETWORK [conn638] end connection 127.0.0.1:41232 (37 connections now open) 2016-04-25T09:59:29.378+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T09:59:29.971+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 784ms 2016-04-25T09:59:50.500+0000 I NETWORK [conn639] end connection 127.0.0.1:41238 (36 connections now open) 2016-04-25T09:59:58.121+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1724ms 2016-04-25T10:00:14.486+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 635ms 2016-04-25T10:00:26.874+0000 I COMMAND [conn640] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 78358ms 2016-04-25T10:00:26.347+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T10:00:54.373+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:01:16.855+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:01:30.418+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 527ms 2016-04-25T10:02:11.348+0000 I NETWORK [conn640] end connection 127.0.0.1:41240 (35 connections now open) 2016-04-25T10:02:11.672+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3332ms 2016-04-25T10:02:18.007+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:02:19.450+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-04-25T10:03:03.375+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:03:30.488+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 622ms 2016-04-25T10:03:31.353+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:03:31.525+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3930, after asserts: 6700, after connections: 10040, after extra_info: 26140, after globalLock: 31360, after locks: 34110, after network: 36700, after opcounters: 37080, after opcountersRepl: 37080, after repl: 115170, after storageEngine: 121760, after tcmalloc: 131430, after wiredTiger: 144800, at end: 169060 } 2016-04-25T10:03:50.151+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 532ms 2016-04-25T10:04:00.694+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 6538ms 2016-04-25T10:04:06.062+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T10:04:06.427+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:04:06.111+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41244 #641 (36 connections now open) 2016-04-25T10:05:02.887+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:05:30.897+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 422ms 2016-04-25T10:05:57.783+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 148ms 2016-04-25T10:06:10.097+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:06:09.976+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 295ms 2016-04-25T10:06:36.985+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:06:36.985+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T10:07:18.020+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41246 #642 (37 connections now open) 2016-04-25T10:07:18.020+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 188ms 2016-04-25T10:07:19.375+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T10:07:39.197+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1765ms 2016-04-25T10:07:39.804+0000 I COMMAND [conn641] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 126524ms 2016-04-25T10:08:28.949+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:08:55.783+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 200ms 2016-04-25T10:09:10.159+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 820ms 2016-04-25T10:09:31.278+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T10:09:38.757+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 294ms 2016-04-25T10:09:43.947+0000 I COMMAND [conn642] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 82962ms 2016-04-25T10:09:54.020+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:10:23.549+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:10:40.226+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 0, after locks: 0, after network: 1470, after opcounters: 3220, after opcountersRepl: 3710, after repl: 76290, after storageEngine: 103170, after tcmalloc: 112890, after wiredTiger: 131010, at end: 179320 } 2016-04-25T10:10:48.247+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 211ms 2016-04-25T10:11:07.358+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:11:14.104+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 633ms 2016-04-25T10:11:32.505+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 349ms 2016-04-25T10:11:46.763+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:12:16.645+0000 I NETWORK [conn642] end connection 127.0.0.1:41246 (36 connections now open) 2016-04-25T10:12:33.482+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:12:40.621+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 800ms 2016-04-25T10:12:54.432+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 614ms 2016-04-25T10:12:57.263+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:13:01.533+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T10:13:22.722+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 409ms 2016-04-25T10:14:15.407+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:14:19.113+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41250 #643 (37 connections now open) 2016-04-25T10:14:45.992+0000 I COMMAND [conn641] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 190962ms 2016-04-25T10:14:46.688+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 413ms 2016-04-25T10:15:05.198+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 841ms 2016-04-25T10:15:07.578+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:15:18.330+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 280ms 2016-04-25T10:15:45.821+0000 I NETWORK [conn641] end connection 127.0.0.1:41244 (36 connections now open) 2016-04-25T10:15:58.675+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:16:10.541+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T10:16:56.690+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 332ms 2016-04-25T10:16:57.140+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T10:16:56.851+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41251 #644 (37 connections now open) 2016-04-25T10:17:22.087+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1681ms 2016-04-25T10:17:44.869+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 326ms 2016-04-25T10:18:07.596+0000 I COMMAND [conn643] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 151247ms 2016-04-25T10:18:07.515+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2040, after asserts: 3720, after connections: 7020, after extra_info: 11730, after globalLock: 11730, after locks: 14090, after network: 16240, after opcounters: 17760, after opcountersRepl: 19000, after repl: 142031, after storageEngine: 142031, after tcmalloc: 142031, after wiredTiger: 154111, at end: 178131 } 2016-04-25T10:18:06.467+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:19:09.666+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 368ms 2016-04-25T10:19:34.618+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 491ms 2016-04-25T10:19:47.502+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T10:19:54.656+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 459ms 2016-04-25T10:20:37.513+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:20:58.238+0000 I NETWORK [conn643] end connection 127.0.0.1:41250 (36 connections now open) 2016-04-25T10:21:03.257+0000 I COMMAND [conn644] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 150829ms 2016-04-25T10:21:17.110+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2467ms 2016-04-25T10:21:40.777+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:21:42.597+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 578ms 2016-04-25T10:22:46.782+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:22:57.346+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 113ms 2016-04-25T10:23:29.095+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1210ms 2016-04-25T10:23:40.923+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 365ms 2016-04-25T10:23:44.421+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41256 #645 (37 connections now open) 2016-04-25T10:23:51.468+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:24:24.525+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T10:24:35.787+0000 I NETWORK [conn644] end connection 127.0.0.1:41251 (36 connections now open) 2016-04-25T10:24:50.567+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:25:09.454+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3865ms 2016-04-25T10:26:10.928+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 412ms 2016-04-25T10:26:17.238+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T10:26:22.097+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 174ms 2016-04-25T10:26:37.727+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:26:58.909+0000 I COMMAND [conn645] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 99871ms 2016-04-25T10:27:18.995+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 4350, after globalLock: 7290, after locks: 9780, after network: 11110, after opcounters: 12200, after opcountersRepl: 12200, after repl: 95430, after storageEngine: 100340, after tcmalloc: 116390, after wiredTiger: 130030, at end: 170980 } 2016-04-25T10:27:23.235+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:27:45.265+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 286ms 2016-04-25T10:28:15.781+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1072ms 2016-04-25T10:28:33.057+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:29:37.690+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 538ms 2016-04-25T10:29:52.296+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T10:30:10.811+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:30:15.750+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 849ms 2016-04-25T10:30:36.526+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:30:51.571+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 574ms 2016-04-25T10:31:15.270+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41259 #646 (37 connections now open) 2016-04-25T10:31:36.085+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T10:32:05.236+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:32:28.054+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 512ms 2016-04-25T10:33:04.867+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1622ms 2016-04-25T10:33:19.471+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T10:33:19.695+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 550ms 2016-04-25T10:33:22.151+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:34:31.567+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:34:45.602+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1028ms 2016-04-25T10:35:00.723+0000 I COMMAND [conn646] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 152755ms 2016-04-25T10:35:11.586+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 313ms 2016-04-25T10:35:36.326+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 465ms 2016-04-25T10:36:06.038+0000 I COMMAND [conn645] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 218693ms 2016-04-25T10:36:09.581+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41262 #647 (38 connections now open) 2016-04-25T10:36:12.160+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:36:56.783+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 6629ms 2016-04-25T10:37:08.505+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 806ms 2016-04-25T10:37:39.312+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6840, after asserts: 13130, after connections: 18390, after extra_info: 31140, after globalLock: 34690, after locks: 47940, after network: 49680, after opcounters: 51680, after opcountersRepl: 56740, after repl: 220290, after storageEngine: 220711, after tcmalloc: 220711, after wiredTiger: 231451, at end: 279181 } 2016-04-25T10:38:01.557+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 550ms 2016-04-25T10:38:11.057+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:38:12.273+0000 I NETWORK [conn646] end connection 127.0.0.1:41259 (37 connections now open) 2016-04-25T10:38:12.274+0000 I NETWORK [conn645] end connection 127.0.0.1:41256 (37 connections now open) 2016-04-25T10:39:27.291+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:39:32.928+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 452ms 2016-04-25T10:39:35.950+0000 I COMMAND [conn647] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 92108ms 2016-04-25T10:39:52.274+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 896ms 2016-04-25T10:40:00.518+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T10:40:13.683+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 635ms 2016-04-25T10:41:06.214+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:41:23.449+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 344ms 2016-04-25T10:41:32.239+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:41:39.411+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 568ms 2016-04-25T10:41:56.143+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 273ms 2016-04-25T10:42:26.386+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:42:26.386+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T10:42:35.845+0000 I NETWORK [conn647] end connection 127.0.0.1:41262 (35 connections now open) 2016-04-25T10:43:13.661+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3173ms 2016-04-25T10:43:21.264+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:43:52.723+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41265 #648 (36 connections now open) 2016-04-25T10:43:52.723+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2556ms 2016-04-25T10:44:07.834+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T10:44:36.955+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 383ms 2016-04-25T10:44:49.667+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41266 #649 (37 connections now open) 2016-04-25T10:44:54.337+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T10:45:53.342+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:46:26.740+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 411ms 2016-04-25T10:47:21.125+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 6914ms 2016-04-25T10:47:30.601+0000 I COMMAND [conn648] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 111720ms 2016-04-25T10:47:45.406+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:47:53.035+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 172ms 2016-04-25T10:47:55.655+0000 I COMMAND [conn649] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 113351ms 2016-04-25T10:48:08.320+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:48:25.482+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 0, after locks: 2350, after network: 7683, after opcounters: 7683, after opcountersRepl: 7683, after repl: 97123, after storageEngine: 101493, after tcmalloc: 112643, after wiredTiger: 145153, at end: 178123 } 2016-04-25T10:49:00.306+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:49:13.544+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 258ms 2016-04-25T10:49:30.152+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1551ms 2016-04-25T10:49:41.580+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:49:43.153+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 294ms 2016-04-25T10:49:55.949+0000 I NETWORK [conn649] end connection 127.0.0.1:41266 (36 connections now open) 2016-04-25T10:49:55.949+0000 I NETWORK [conn648] end connection 127.0.0.1:41265 (36 connections now open) 2016-04-25T10:50:58.177+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:50:58.760+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 219ms 2016-04-25T10:51:02.877+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41271 #650 (36 connections now open) 2016-04-25T10:51:14.164+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T10:51:25.063+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2793ms 2016-04-25T10:51:34.387+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:51:37.749+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 347ms 2016-04-25T10:51:59.361+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:52:37.198+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:52:46.628+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41272 #651 (37 connections now open) 2016-04-25T10:52:57.171+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3667ms 2016-04-25T10:53:05.313+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T10:53:09.367+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 728ms 2016-04-25T10:53:21.286+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 518ms 2016-04-25T10:53:43.697+0000 I COMMAND [conn650] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 89226ms 2016-04-25T10:53:50.328+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:54:36.106+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 706ms 2016-04-25T10:54:43.509+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T10:54:59.188+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2495ms 2016-04-25T10:55:31.796+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T10:55:38.056+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 585ms 2016-04-25T10:55:41.999+0000 I COMMAND [conn651] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 113164ms 2016-04-25T10:56:07.251+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:56:48.595+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 270ms 2016-04-25T10:57:20.555+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 746ms 2016-04-25T10:57:51.887+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 288ms 2016-04-25T10:57:59.131+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T10:58:30.950+0000 I NETWORK [conn651] end connection 127.0.0.1:41272 (36 connections now open) 2016-04-25T10:58:45.019+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:59:04.984+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3370, after asserts: 6020, after connections: 10220, after extra_info: 24580, after globalLock: 27260, after locks: 30070, after network: 33220, after opcounters: 35220, after opcountersRepl: 43060, after repl: 175650, after storageEngine: 178770, after tcmalloc: 187360, after wiredTiger: 297820, at end: 334160 } 2016-04-25T10:59:29.739+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 148ms 2016-04-25T10:59:42.616+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T10:59:56.164+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1005ms 2016-04-25T11:00:15.847+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 447ms 2016-04-25T11:00:21.061+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:00:57.391+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41277 #652 (37 connections now open) 2016-04-25T11:01:19.930+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:01:19.996+0000 I COMMAND [conn650] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 332762ms 2016-04-25T11:01:25.704+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:01:29.940+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1174ms 2016-04-25T11:01:30.871+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41278 #653 (38 connections now open) 2016-04-25T11:01:39.362+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 174ms 2016-04-25T11:01:39.197+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T11:01:49.523+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:01:56.075+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 375ms 2016-04-25T11:02:02.403+0000 I NETWORK [conn650] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:41271] 2016-04-25T11:02:37.850+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:02:38.809+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T11:02:41.397+0000 I COMMAND [conn652] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 50503ms 2016-04-25T11:02:49.657+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:03:04.972+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T11:03:08.490+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 652ms 2016-04-25T11:03:36.446+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1083ms 2016-04-25T11:03:59.243+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3478ms 2016-04-25T11:04:00.795+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:04:02.614+0000 I COMMAND [conn653] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 90802ms 2016-04-25T11:04:26.453+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T11:04:30.670+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 630, after asserts: 5530, after connections: 6060, after extra_info: 9470, after globalLock: 12280, after locks: 13440, after network: 14420, after opcounters: 14420, after opcountersRepl: 14420, after repl: 86640, after storageEngine: 89660, after tcmalloc: 100280, after wiredTiger: 115700, at end: 132230 } 2016-04-25T11:04:57.008+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:05:17.336+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 708ms 2016-04-25T11:05:32.333+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 307ms 2016-04-25T11:05:37.336+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 640ms 2016-04-25T11:05:39.988+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:05:41.578+0000 I NETWORK [conn653] end connection 127.0.0.1:41278 (36 connections now open) 2016-04-25T11:06:15.162+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:06:43.657+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41284 #654 (37 connections now open) 2016-04-25T11:06:43.657+0000 I COMMAND [conn652] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 147905ms 2016-04-25T11:06:43.657+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 350ms 2016-04-25T11:06:44.557+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:07:05.690+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 858ms 2016-04-25T11:07:12.938+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:07:21.240+0000 I NETWORK [conn652] end connection 127.0.0.1:41277 (36 connections now open) 2016-04-25T11:07:14.435+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T11:07:38.251+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:08:05.618+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:08:09.109+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 337ms 2016-04-25T11:08:16.105+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1664ms 2016-04-25T11:08:25.982+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:08:29.588+0000 I COMMAND [conn654] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 34501ms 2016-04-25T11:08:36.996+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 210ms 2016-04-25T11:08:37.143+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41285 #655 (37 connections now open) 2016-04-25T11:08:43.751+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:08:48.978+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T11:09:11.764+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T11:09:26.382+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1540, after asserts: 6850, after connections: 9250, after extra_info: 17910, after globalLock: 19180, after locks: 19480, after network: 19860, after opcounters: 19860, after opcountersRepl: 19860, after repl: 48110, after storageEngine: 51010, after tcmalloc: 57920, after wiredTiger: 66932, at end: 92382 } 2016-04-25T11:09:43.077+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 273ms 2016-04-25T11:09:48.518+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:10:09.849+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1206ms 2016-04-25T11:10:33.833+0000 I COMMAND [conn655] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 60584ms 2016-04-25T11:10:49.719+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 379ms 2016-04-25T11:11:10.899+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T11:11:32.884+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:11:47.258+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:11:54.531+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 138ms 2016-04-25T11:12:12.267+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:12:14.664+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 13837ms 2016-04-25T11:12:29.547+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 342ms 2016-04-25T11:13:07.696+0000 I COMMAND [conn654] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 114268ms 2016-04-25T11:13:10.172+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:13:13.819+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41291 #656 (38 connections now open) 2016-04-25T11:13:15.060+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T11:13:28.306+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:13:32.414+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 408ms 2016-04-25T11:13:42.456+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1784ms 2016-04-25T11:13:42.456+0000 I NETWORK [conn654] end connection 127.0.0.1:41284 (37 connections now open) 2016-04-25T11:13:51.853+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:13:55.754+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 155ms 2016-04-25T11:14:25.465+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:14:36.886+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 7890, after asserts: 9100, after connections: 9860, after extra_info: 20930, after globalLock: 23730, after locks: 24450, after network: 24760, after opcounters: 24760, after opcountersRepl: 24760, after repl: 90621, after storageEngine: 93951, after tcmalloc: 102361, after wiredTiger: 120011, at end: 134391 } 2016-04-25T11:14:48.549+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:15:01.631+0000 I COMMAND [conn656] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 61769ms 2016-04-25T11:15:23.908+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 4142ms 2016-04-25T11:15:23.908+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:15:37.908+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41292 #657 (38 connections now open) 2016-04-25T11:15:54.043+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1873ms 2016-04-25T11:16:06.092+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 458ms 2016-04-25T11:16:13.516+0000 I COMMAND [conn655] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 229225ms 2016-04-25T11:16:34.512+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T11:16:44.157+0000 I NETWORK [conn655] end connection 127.0.0.1:41285 (37 connections now open) 2016-04-25T11:16:56.568+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:17:12.458+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T11:17:26.929+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 489ms 2016-04-25T11:17:33.397+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 281ms 2016-04-25T11:17:34.886+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:17:40.073+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 623ms 2016-04-25T11:17:39.995+0000 I COMMAND [conn657] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 56189ms 2016-04-25T11:18:05.038+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T11:18:19.210+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:19:04.827+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:19:07.737+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 282ms 2016-04-25T11:19:25.408+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 408ms 2016-04-25T11:19:33.080+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 167ms 2016-04-25T11:19:37.022+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:20:16.970+0000 I NETWORK [conn657] end connection 127.0.0.1:41292 (36 connections now open) 2016-04-25T11:20:20.186+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:20:28.022+0000 I COMMAND [conn656] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 131055ms 2016-04-25T11:20:27.638+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1490, after asserts: 3070, after connections: 5510, after extra_info: 14220, after globalLock: 16140, after locks: 16730, after network: 17430, after opcounters: 18010, after opcountersRepl: 18010, after repl: 87690, after storageEngine: 95620, after tcmalloc: 98820, after wiredTiger: 106660, at end: 130360 } 2016-04-25T11:20:55.259+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:21:04.062+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 265ms 2016-04-25T11:21:14.653+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41298 #658 (37 connections now open) 2016-04-25T11:21:16.961+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 5104ms 2016-04-25T11:21:16.807+0000 I NETWORK [conn656] end connection 127.0.0.1:41291 (35 connections now open) 2016-04-25T11:21:31.210+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T11:21:31.210+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 312ms 2016-04-25T11:21:47.435+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:22:01.658+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41299 #659 (37 connections now open) 2016-04-25T11:22:11.081+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:22:44.093+0000 I COMMAND [conn658] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 44304ms 2016-04-25T11:22:55.507+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 288ms 2016-04-25T11:23:02.053+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:23:16.190+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3409ms 2016-04-25T11:23:23.843+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:23:25.477+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T11:23:28.596+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 397ms 2016-04-25T11:23:49.936+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T11:24:13.861+0000 I COMMAND [conn659] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 69039ms 2016-04-25T11:24:30.780+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:24:43.805+0000 I NETWORK [conn658] end connection 127.0.0.1:41298 (36 connections now open) 2016-04-25T11:24:54.584+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 352ms 2016-04-25T11:25:07.606+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T11:25:14.166+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 282ms 2016-04-25T11:25:26.953+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:25:28.122+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 324ms 2016-04-25T11:25:48.089+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:26:29.858+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:26:53.124+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2754ms 2016-04-25T11:26:53.061+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41302 #660 (37 connections now open) 2016-04-25T11:26:54.458+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1420, after asserts: 2450, after connections: 3840, after extra_info: 18830, after globalLock: 28010, after locks: 30210, after network: 30680, after opcounters: 30680, after opcountersRepl: 30680, after repl: 69980, after storageEngine: 90600, after tcmalloc: 97940, after wiredTiger: 118100, at end: 168175 } 2016-04-25T11:27:03.420+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 741ms 2016-04-25T11:27:08.065+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1080ms 2016-04-25T11:27:29.958+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:27:37.704+0000 I NETWORK [conn659] end connection 127.0.0.1:41299 (36 connections now open) 2016-04-25T11:27:55.291+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41303 #661 (38 connections now open) 2016-04-25T11:28:01.863+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:28:18.304+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T11:28:25.913+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 337ms 2016-04-25T11:28:30.497+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 268ms 2016-04-25T11:28:46.057+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T11:28:45.611+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 627ms 2016-04-25T11:29:07.524+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:29:48.192+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:30:07.513+0000 I COMMAND [conn660] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 143453ms 2016-04-25T11:30:26.059+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 502ms 2016-04-25T11:30:56.786+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 828ms 2016-04-25T11:31:13.605+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3517ms 2016-04-25T11:31:36.553+0000 I COMMAND [conn661] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 142447ms 2016-04-25T11:31:37.028+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T11:32:23.323+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:32:44.663+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 5032ms 2016-04-25T11:32:52.631+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T11:32:58.971+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 733ms 2016-04-25T11:33:23.963+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2054ms 2016-04-25T11:34:52.857+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:34:53.086+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 427ms 2016-04-25T11:35:27.978+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1930ms 2016-04-25T11:35:52.124+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 600ms 2016-04-25T11:36:14.710+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 14620, after asserts: 16830, after connections: 19390, after extra_info: 24000, after globalLock: 28190, after locks: 31270, after network: 34000, after opcounters: 40860, after opcountersRepl: 42450, after repl: 183180, after storageEngine: 200760, after tcmalloc: 211890, after wiredTiger: 239280, at end: 295220 } 2016-04-25T11:36:14.710+0000 I NETWORK [conn660] end connection 127.0.0.1:41302 (36 connections now open) 2016-04-25T11:36:17.998+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:37:14.805+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:37:14.574+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 475ms 2016-04-25T11:37:24.822+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 331ms 2016-04-25T11:37:29.340+0000 I NETWORK [conn661] end connection 127.0.0.1:41303 (35 connections now open) 2016-04-25T11:37:46.026+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 253ms 2016-04-25T11:37:47.909+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:39:04.242+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41309 #662 (36 connections now open) 2016-04-25T11:39:04.242+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 581ms 2016-04-25T11:39:20.824+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:39:45.813+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41310 #663 (37 connections now open) 2016-04-25T11:40:11.586+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2383ms 2016-04-25T11:40:33.794+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1005ms 2016-04-25T11:40:45.854+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T11:41:22.283+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T11:41:30.800+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:42:00.100+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 403ms 2016-04-25T11:42:04.647+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:42:16.889+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2767ms 2016-04-25T11:42:44.596+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1899ms 2016-04-25T11:42:50.796+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T11:42:49.878+0000 I COMMAND [conn662] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 134721ms 2016-04-25T11:42:49.878+0000 I COMMAND [conn663] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 94850ms 2016-04-25T11:43:59.274+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:44:15.534+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 297ms 2016-04-25T11:45:00.722+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3709ms 2016-04-25T11:45:05.198+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T11:45:27.290+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 379ms 2016-04-25T11:45:40.268+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:45:47.031+0000 I NETWORK [conn662] end connection 127.0.0.1:41309 (36 connections now open) 2016-04-25T11:45:54.281+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4050, after asserts: 6240, after connections: 13530, after extra_info: 27600, after globalLock: 30140, after locks: 44890, after network: 52560, after opcounters: 54440, after opcountersRepl: 58530, after repl: 181540, after storageEngine: 188790, after tcmalloc: 202830, after wiredTiger: 222980, at end: 256580 } 2016-04-25T11:46:14.152+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:46:37.039+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 471ms 2016-04-25T11:47:12.472+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:47:12.824+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 644ms 2016-04-25T11:47:33.166+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 516ms 2016-04-25T11:48:03.112+0000 I NETWORK [conn663] end connection 127.0.0.1:41310 (35 connections now open) 2016-04-25T11:48:43.604+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 263ms 2016-04-25T11:48:46.007+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:48:47.357+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 685ms 2016-04-25T11:48:48.514+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 482ms 2016-04-25T11:48:55.040+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:49:15.047+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T11:49:54.908+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:50:01.057+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 423ms 2016-04-25T11:50:18.307+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41315 #664 (36 connections now open) 2016-04-25T11:50:21.670+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 423ms 2016-04-25T11:50:42.835+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 6489ms 2016-04-25T11:50:54.485+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T11:50:51.866+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41316 #665 (37 connections now open) 2016-04-25T11:51:10.122+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:51:23.983+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:52:14.222+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 362ms 2016-04-25T11:52:28.000+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1056ms 2016-04-25T11:52:30.245+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:52:42.190+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 359ms 2016-04-25T11:52:58.128+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T11:53:13.861+0000 I COMMAND [conn664] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 66767ms 2016-04-25T11:53:13.861+0000 I COMMAND [conn665] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 66767ms 2016-04-25T11:53:58.914+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:53:59.490+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 4318ms 2016-04-25T11:54:16.101+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 732ms 2016-04-25T11:54:32.560+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4700, after asserts: 10260, after connections: 12600, after extra_info: 21140, after globalLock: 26010, after locks: 30820, after network: 36620, after opcounters: 37680, after opcountersRepl: 37680, after repl: 82290, after storageEngine: 88640, after tcmalloc: 100530, after wiredTiger: 139440, at end: 168770 } 2016-04-25T11:54:37.098+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T11:54:38.844+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 180ms 2016-04-25T11:54:41.255+0000 I NETWORK [conn664] end connection 127.0.0.1:41315 (36 connections now open) 2016-04-25T11:54:41.255+0000 I NETWORK [conn665] end connection 127.0.0.1:41316 (36 connections now open) 2016-04-25T11:55:15.470+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:55:54.234+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 4512ms 2016-04-25T11:56:05.704+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 268ms 2016-04-25T11:56:38.344+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:57:02.635+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41322 #666 (36 connections now open) 2016-04-25T11:57:20.495+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:57:22.265+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 158ms 2016-04-25T11:57:56.476+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:58:00.521+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 701ms 2016-04-25T11:58:27.453+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 418ms 2016-04-25T11:58:48.573+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T11:59:19.399+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T11:59:30.209+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T11:59:31.434+0000 I COMMAND [conn666] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 59398ms 2016-04-25T11:59:36.869+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41323 #667 (37 connections now open) 2016-04-25T11:59:42.593+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:00:04.591+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 5611ms 2016-04-25T12:00:10.945+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T12:00:20.735+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2890, after asserts: 4660, after connections: 8000, after extra_info: 18860, after globalLock: 22740, after locks: 27280, after network: 31370, after opcounters: 34070, after opcountersRepl: 37050, after repl: 64211, after storageEngine: 64211, after tcmalloc: 64211, after wiredTiger: 64211, at end: 72231 } 2016-04-25T12:00:25.043+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 11467ms 2016-04-25T12:00:28.477+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T12:00:51.218+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 314ms 2016-04-25T12:00:58.957+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:01:44.678+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T12:01:51.923+0000 I COMMAND [conn667] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 53012ms 2016-04-25T12:02:04.653+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:02:11.232+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 160ms 2016-04-25T12:02:23.434+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 468ms 2016-04-25T12:02:41.396+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3745ms 2016-04-25T12:02:46.677+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T12:03:07.770+0000 I NETWORK [conn667] end connection 127.0.0.1:41323 (36 connections now open) 2016-04-25T12:03:42.569+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:03:59.692+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1243ms 2016-04-25T12:04:15.544+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 808ms 2016-04-25T12:04:31.717+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 332ms 2016-04-25T12:04:57.203+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T12:05:40.925+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:06:02.376+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 504ms 2016-04-25T12:06:03.095+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T12:06:08.122+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41328 #668 (37 connections now open) 2016-04-25T12:06:08.311+0000 I COMMAND [conn666] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 225571ms 2016-04-25T12:06:40.388+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3104ms 2016-04-25T12:07:01.803+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:07:31.102+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 132ms 2016-04-25T12:07:55.957+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3750, after asserts: 5640, after connections: 8510, after extra_info: 15720, after globalLock: 18500, after locks: 21250, after network: 23120, after opcounters: 24910, after opcountersRepl: 24910, after repl: 118660, after storageEngine: 125440, after tcmalloc: 141598, after wiredTiger: 148408, at end: 198248 } 2016-04-25T12:08:07.768+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41329 #669 (38 connections now open) 2016-04-25T12:08:07.962+0000 I NETWORK [conn666] end connection 127.0.0.1:41322 (36 connections now open) 2016-04-25T12:08:09.326+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T12:08:20.965+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:08:48.244+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T12:09:02.474+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 299ms 2016-04-25T12:09:22.547+0000 I COMMAND [conn668] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 78872ms 2016-04-25T12:09:40.451+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 895ms 2016-04-25T12:09:43.280+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T12:09:43.252+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T12:09:50.734+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 280ms 2016-04-25T12:10:32.090+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:11:14.518+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 531ms 2016-04-25T12:11:35.285+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1331ms 2016-04-25T12:11:49.433+0000 I COMMAND [conn669] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 147412ms 2016-04-25T12:11:54.024+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T12:11:58.752+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 646ms 2016-04-25T12:13:07.990+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:13:41.753+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T12:13:46.334+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2576ms 2016-04-25T12:14:22.779+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 10123ms 2016-04-25T12:14:50.988+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 5354ms 2016-04-25T12:15:17.453+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:16:23.037+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 223ms 2016-04-25T12:16:36.916+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 580ms 2016-04-25T12:16:36.421+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T12:16:48.384+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 122ms 2016-04-25T12:17:25.545+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:17:34.174+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4970, after asserts: 15490, after connections: 25450, after extra_info: 39690, after globalLock: 43590, after locks: 47220, after network: 52050, after opcounters: 53570, after opcountersRepl: 55860, after repl: 190330, after storageEngine: 196380, after tcmalloc: 204080, after wiredTiger: 277690, at end: 321060 } 2016-04-25T12:18:04.535+0000 I NETWORK [conn669] end connection 127.0.0.1:41329 (36 connections now open) 2016-04-25T12:18:17.818+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 627ms 2016-04-25T12:18:26.016+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T12:18:25.954+0000 I COMMAND [conn668] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 262841ms 2016-04-25T12:18:29.659+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 614ms 2016-04-25T12:18:46.364+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 200ms 2016-04-25T12:19:03.408+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:19:27.797+0000 I NETWORK [conn668] end connection 127.0.0.1:41328 (35 connections now open) 2016-04-25T12:19:39.618+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T12:19:40.324+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41334 #670 (37 connections now open) 2016-04-25T12:20:05.877+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41335 #671 (37 connections now open) 2016-04-25T12:20:12.168+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 885ms 2016-04-25T12:20:35.486+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T12:20:40.186+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 963ms 2016-04-25T12:21:04.964+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 819ms 2016-04-25T12:21:26.606+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:21:39.775+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T12:22:21.154+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T12:22:29.480+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 507ms 2016-04-25T12:22:42.466+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2158ms 2016-04-25T12:23:09.687+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 399ms 2016-04-25T12:23:39.720+0000 I COMMAND [conn670] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 157777ms 2016-04-25T12:23:39.720+0000 I COMMAND [conn671] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 124912ms 2016-04-25T12:23:47.304+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:24:38.254+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T12:24:49.195+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 411ms 2016-04-25T12:25:01.929+0000 I NETWORK [conn671] end connection 127.0.0.1:41335 (36 connections now open) 2016-04-25T12:25:21.584+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3541ms 2016-04-25T12:25:35.732+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:25:39.423+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 196ms 2016-04-25T12:25:54.607+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41338 #672 (37 connections now open) 2016-04-25T12:26:08.051+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T12:26:29.868+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 7700, after asserts: 11280, after connections: 15210, after extra_info: 36910, after globalLock: 42150, after locks: 51310, after network: 54840, after opcounters: 56410, after opcountersRepl: 57240, after repl: 142980, after storageEngine: 148420, after tcmalloc: 158965, after wiredTiger: 158965, at end: 174975 } 2016-04-25T12:26:37.819+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:26:59.812+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 609ms 2016-04-25T12:27:26.110+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T12:27:38.356+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 251ms 2016-04-25T12:28:08.561+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 550ms 2016-04-25T12:28:29.466+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:28:42.557+0000 I COMMAND [conn672] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 105133ms 2016-04-25T12:29:09.804+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T12:29:14.260+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 479ms 2016-04-25T12:29:19.582+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 101ms 2016-04-25T12:29:19.582+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41342 #673 (38 connections now open) 2016-04-25T12:29:42.140+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:29:42.140+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 746ms 2016-04-25T12:29:51.740+0000 I COMMAND [conn670] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 164289ms 2016-04-25T12:29:51.775+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T12:30:32.057+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:31:03.811+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:31:14.502+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T12:31:18.251+0000 I NETWORK [conn670] end connection 127.0.0.1:41334 (37 connections now open) 2016-04-25T12:31:19.988+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T12:31:30.831+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-04-25T12:31:32.023+0000 I COMMAND [conn673] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 52979ms 2016-04-25T12:31:40.969+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 882ms 2016-04-25T12:31:50.187+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:31:53.433+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 382ms 2016-04-25T12:32:22.087+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T12:32:57.186+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 312ms 2016-04-25T12:32:57.186+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1960, after asserts: 3100, after connections: 5360, after extra_info: 20590, after globalLock: 24110, after locks: 37530, after network: 40060, after opcounters: 44390, after opcountersRepl: 46730, after repl: 106610, after storageEngine: 111160, after tcmalloc: 114730, after wiredTiger: 136000, at end: 161640 } 2016-04-25T12:33:04.057+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 183ms 2016-04-25T12:33:08.557+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:33:43.317+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T12:34:37.711+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 360ms 2016-04-25T12:34:49.748+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:34:52.102+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 313ms 2016-04-25T12:35:06.908+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 354ms 2016-04-25T12:35:53.526+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T12:35:54.390+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T12:36:28.850+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:36:31.973+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 308ms 2016-04-25T12:36:46.160+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1204ms 2016-04-25T12:37:04.940+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 406ms 2016-04-25T12:37:25.892+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T12:37:45.381+0000 I COMMAND [conn673] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 168741ms 2016-04-25T12:38:13.899+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41347 #674 (38 connections now open) 2016-04-25T12:38:16.720+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 577ms 2016-04-25T12:38:18.520+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 552ms 2016-04-25T12:38:39.041+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:39:13.135+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T12:39:12.999+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41348 #675 (39 connections now open) 2016-04-25T12:39:23.090+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 158ms 2016-04-25T12:39:27.436+0000 I COMMAND [conn672] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 54535335 } } } protocol:op_command 394805ms 2016-04-25T12:39:36.093+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T12:39:37.727+0000 I NETWORK [conn673] end connection 127.0.0.1:41342 (37 connections now open) 2016-04-25T12:40:19.098+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2713ms 2016-04-25T12:40:52.133+0000 I NETWORK [conn672] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:41338] 2016-04-25T12:40:54.142+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:40:57.471+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 11667ms 2016-04-25T12:41:51.804+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4960, after asserts: 14690, after connections: 18170, after extra_info: 27190, after globalLock: 30560, after locks: 32780, after network: 32980, after opcounters: 32980, after opcountersRepl: 32980, after repl: 96375, after storageEngine: 113525, after tcmalloc: 123975, after wiredTiger: 153645, at end: 202155 } 2016-04-25T12:42:16.316+0000 I COMMAND [conn674] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 189771ms 2016-04-25T12:42:25.762+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T12:42:48.376+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 553ms 2016-04-25T12:43:03.193+0000 I COMMAND [conn675] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 104442ms 2016-04-25T12:43:02.936+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 370ms 2016-04-25T12:43:19.884+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:43:22.861+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 419ms 2016-04-25T12:43:54.672+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T12:44:40.020+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T12:45:01.287+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 548ms 2016-04-25T12:45:19.827+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 795ms 2016-04-25T12:45:40.084+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 287ms 2016-04-25T12:45:49.588+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:46:55.170+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T12:47:06.758+0000 I NETWORK [conn675] end connection 127.0.0.1:41348 (36 connections now open) 2016-04-25T12:47:07.527+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 474ms 2016-04-25T12:47:35.631+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:47:44.947+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 16278ms 2016-04-25T12:48:03.034+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 487ms 2016-04-25T12:48:07.288+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T12:48:52.028+0000 I NETWORK [conn674] end connection 127.0.0.1:41347 (35 connections now open) 2016-04-25T12:49:34.276+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 289ms 2016-04-25T12:49:50.113+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:49:49.420+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 450ms 2016-04-25T12:50:14.905+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41355 #676 (36 connections now open) 2016-04-25T12:50:35.864+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 442ms 2016-04-25T12:51:02.016+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T12:51:24.307+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:51:46.117+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3000, after asserts: 4470, after connections: 14830, after extra_info: 43940, after globalLock: 46610, after locks: 46960, after network: 47220, after opcounters: 47400, after opcountersRepl: 47400, after repl: 174357, after storageEngine: 174357, after tcmalloc: 174357, after wiredTiger: 197427, at end: 224467 } 2016-04-25T12:51:55.280+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T12:52:07.268+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 357ms 2016-04-25T12:52:34.749+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T12:52:34.393+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3306ms 2016-04-25T12:52:58.603+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 574ms 2016-04-25T12:53:14.662+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:53:48.597+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41356 #677 (37 connections now open) 2016-04-25T12:54:14.168+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 251ms 2016-04-25T12:54:13.954+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T12:54:32.378+0000 I COMMAND [conn676] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 152993ms 2016-04-25T12:54:44.425+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 616ms 2016-04-25T12:55:09.190+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 719ms 2016-04-25T12:55:11.829+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T12:55:50.024+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:56:22.600+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T12:56:33.054+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 443ms 2016-04-25T12:56:45.588+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 451ms 2016-04-25T12:57:04.385+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 715ms 2016-04-25T12:57:15.878+0000 I COMMAND [conn677] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 112450ms 2016-04-25T12:57:15.710+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:57:56.108+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T12:58:13.417+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 288ms 2016-04-25T12:58:33.234+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T12:58:38.497+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 10625ms 2016-04-25T12:58:48.511+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 311ms 2016-04-25T12:58:53.231+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5090, after asserts: 5710, after connections: 7860, after extra_info: 19200, after globalLock: 20930, after locks: 24510, after network: 26470, after opcounters: 26640, after opcountersRepl: 26640, after repl: 71260, after storageEngine: 75570, after tcmalloc: 83420, after wiredTiger: 104810, at end: 126961 } 2016-04-25T12:59:05.556+0000 I NETWORK [conn677] end connection 127.0.0.1:41356 (36 connections now open) 2016-04-25T12:58:57.095+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T12:58:53.897+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41360 #678 (38 connections now open) 2016-04-25T12:59:51.350+0000 I COMMAND [conn676] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 160420ms 2016-04-25T12:59:56.801+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41361 #679 (38 connections now open) 2016-04-25T12:59:54.885+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:00:13.727+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T13:00:13.727+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 418ms 2016-04-25T13:00:20.999+0000 I NETWORK [conn676] end connection 127.0.0.1:41355 (37 connections now open) 2016-04-25T13:00:28.467+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1318ms 2016-04-25T13:00:41.814+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:00:45.299+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-04-25T13:01:05.182+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:01:09.544+0000 I COMMAND [conn678] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 64316ms 2016-04-25T13:01:22.925+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T13:01:40.277+0000 I COMMAND [conn679] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 55000ms 2016-04-25T13:01:51.700+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 604ms 2016-04-25T13:02:01.668+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:02:06.547+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 641ms 2016-04-25T13:02:21.852+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2744ms 2016-04-25T13:02:27.040+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:02:55.575+0000 I NETWORK [conn679] end connection 127.0.0.1:41361 (36 connections now open) 2016-04-25T13:02:55.951+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:02:56.889+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T13:03:27.106+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:03:41.051+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 545ms 2016-04-25T13:03:53.161+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:04:03.247+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1419ms 2016-04-25T13:04:10.779+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:04:19.856+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 144ms 2016-04-25T13:04:19.856+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41366 #680 (37 connections now open) 2016-04-25T13:04:30.728+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T13:04:31.587+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1870, after asserts: 3670, after connections: 4760, after extra_info: 15830, after globalLock: 17640, after locks: 29780, after network: 31180, after opcounters: 31180, after opcountersRepl: 31180, after repl: 86750, after storageEngine: 89960, after tcmalloc: 96560, after wiredTiger: 112914, at end: 115194 } 2016-04-25T13:04:42.257+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T13:04:54.445+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:05:07.129+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:05:28.098+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 298ms 2016-04-25T13:05:37.122+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 992ms 2016-04-25T13:05:57.249+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 299ms 2016-04-25T13:06:06.933+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:06:21.050+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41367 #681 (38 connections now open) 2016-04-25T13:06:31.559+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:06:48.537+0000 I COMMAND [conn680] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 95646ms 2016-04-25T13:07:01.930+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:07:18.273+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 337ms 2016-04-25T13:07:30.709+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T13:07:33.355+0000 I COMMAND [conn678] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 200358ms 2016-04-25T13:07:34.960+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 599ms 2016-04-25T13:07:42.273+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 405ms 2016-04-25T13:08:08.607+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:08:29.197+0000 I NETWORK [conn678] end connection 127.0.0.1:41360 (37 connections now open) 2016-04-25T13:08:31.236+0000 I COMMAND [conn681] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 71095ms 2016-04-25T13:08:54.320+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 364ms 2016-04-25T13:09:07.457+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T13:09:12.097+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:09:11.819+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 781ms 2016-04-25T13:09:35.823+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 577ms 2016-04-25T13:09:43.136+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:09:58.234+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:10:14.309+0000 I NETWORK [conn681] end connection 127.0.0.1:41367 (36 connections now open) 2016-04-25T13:10:44.279+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:10:49.105+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 459ms 2016-04-25T13:10:50.674+0000 I COMMAND [conn680] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 154405ms 2016-04-25T13:11:12.326+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41372 #682 (37 connections now open) 2016-04-25T13:11:17.853+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T13:11:18.817+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 503ms 2016-04-25T13:11:26.322+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4820, after asserts: 7660, after connections: 8450, after extra_info: 16890, after globalLock: 20040, after locks: 24070, after network: 26650, after opcounters: 28310, after opcountersRepl: 29480, after repl: 83080, after storageEngine: 84130, after tcmalloc: 105430, after wiredTiger: 130100, at end: 155796 } 2016-04-25T13:11:36.771+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 123ms 2016-04-25T13:11:38.456+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:11:43.048+0000 I NETWORK [conn680] end connection 127.0.0.1:41366 (36 connections now open) 2016-04-25T13:12:05.633+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:12:36.812+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:12:56.111+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 347ms 2016-04-25T13:13:27.397+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41374 #683 (37 connections now open) 2016-04-25T13:13:33.047+0000 I COMMAND [conn682] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 89234ms 2016-04-25T13:13:34.089+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:13:36.933+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1941ms 2016-04-25T13:14:05.524+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T13:14:05.451+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:14:10.666+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 674ms 2016-04-25T13:14:48.818+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:14:55.559+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T13:15:39.495+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 398ms 2016-04-25T13:15:39.482+0000 I NETWORK [conn682] end connection 127.0.0.1:41372 (36 connections now open) 2016-04-25T13:15:48.559+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:15:56.745+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 361ms 2016-04-25T13:16:31.382+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 452ms 2016-04-25T13:16:47.551+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T13:16:47.190+0000 I COMMAND [conn683] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 109385ms 2016-04-25T13:17:02.002+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41375 #684 (37 connections now open) 2016-04-25T13:17:17.979+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:17:49.685+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 369ms 2016-04-25T13:18:05.712+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3573ms 2016-04-25T13:18:25.939+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T13:18:28.015+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 623ms 2016-04-25T13:19:15.901+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:19:18.510+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3210, after asserts: 9990, after connections: 22850, after extra_info: 41230, after globalLock: 46500, after locks: 48970, after network: 51750, after opcounters: 54000, after opcountersRepl: 56810, after repl: 149573, after storageEngine: 163773, after tcmalloc: 172903, after wiredTiger: 187773, at end: 217493 } 2016-04-25T13:19:56.680+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 850ms 2016-04-25T13:20:11.646+0000 I COMMAND [conn684] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 94486ms 2016-04-25T13:20:11.948+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:20:17.638+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 329ms 2016-04-25T13:20:37.653+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:21:34.510+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 161ms 2016-04-25T13:21:42.863+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:21:53.676+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 495ms 2016-04-25T13:22:03.126+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 309ms 2016-04-25T13:22:21.172+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:22:21.853+0000 I NETWORK [conn684] end connection 127.0.0.1:41375 (36 connections now open) 2016-04-25T13:23:05.386+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:23:24.722+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 326ms 2016-04-25T13:23:28.334+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T13:23:43.739+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 423ms 2016-04-25T13:23:48.372+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:24:09.164+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 606ms 2016-04-25T13:24:30.273+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:24:39.853+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T13:25:09.596+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41380 #685 (37 connections now open) 2016-04-25T13:25:22.241+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 375ms 2016-04-25T13:25:38.866+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 972ms 2016-04-25T13:25:30.579+0000 I COMMAND [conn683] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 20276733 } } } protocol:op_command 284781ms 2016-04-25T13:25:51.668+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:25:57.121+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 404ms 2016-04-25T13:26:14.374+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41381 #686 (38 connections now open) 2016-04-25T13:26:59.975+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T13:27:21.997+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:27:25.642+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 195ms 2016-04-25T13:27:31.654+0000 I NETWORK [conn683] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:41374] 2016-04-25T13:27:40.694+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T13:27:45.240+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 218ms 2016-04-25T13:28:05.630+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 4977ms 2016-04-25T13:28:06.010+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3460, after asserts: 6730, after connections: 9410, after extra_info: 29850, after globalLock: 34670, after locks: 36870, after network: 40170, after opcounters: 42750, after opcountersRepl: 44580, after repl: 141488, after storageEngine: 145288, after tcmalloc: 165098, after wiredTiger: 177338, at end: 219358 } 2016-04-25T13:28:06.505+0000 I COMMAND [conn685] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 94060ms 2016-04-25T13:28:26.998+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:28:37.381+0000 I COMMAND [conn686] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 78363ms 2016-04-25T13:28:58.900+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:29:25.085+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 367ms 2016-04-25T13:29:47.780+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:30:00.539+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 5394ms 2016-04-25T13:30:00.539+0000 I NETWORK [conn686] end connection 127.0.0.1:41381 (36 connections now open) 2016-04-25T13:30:33.562+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 291ms 2016-04-25T13:30:52.970+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:31:24.309+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:31:44.046+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 356ms 2016-04-25T13:32:09.852+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 496ms 2016-04-25T13:32:13.530+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:32:22.501+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T13:32:43.665+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 5762ms 2016-04-25T13:33:09.975+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:33:37.422+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:33:36.747+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41386 #687 (37 connections now open) 2016-04-25T13:34:14.558+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 278ms 2016-04-25T13:34:42.443+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2069ms 2016-04-25T13:34:57.434+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:34:57.274+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T13:35:00.648+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 213ms 2016-04-25T13:35:07.405+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41387 #688 (38 connections now open) 2016-04-25T13:35:28.351+0000 I COMMAND [conn685] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 217853ms 2016-04-25T13:35:55.603+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T13:36:16.422+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 227ms 2016-04-25T13:36:25.310+0000 I NETWORK [conn685] end connection 127.0.0.1:41380 (37 connections now open) 2016-04-25T13:36:25.310+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:36:32.429+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1432ms 2016-04-25T13:36:43.942+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 388ms 2016-04-25T13:36:43.867+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T13:36:44.610+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 0, after locks: 0, after network: 0, after opcounters: 0, after opcountersRepl: 0, after repl: 46344, after storageEngine: 55904, after tcmalloc: 63344, after wiredTiger: 89844, at end: 112404 } 2016-04-25T13:36:52.438+0000 I COMMAND [conn687] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 101006ms 2016-04-25T13:37:10.178+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:37:14.852+0000 I COMMAND [conn688] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 71059ms 2016-04-25T13:37:53.632+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 226ms 2016-04-25T13:38:06.139+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 793ms 2016-04-25T13:38:19.043+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 320ms 2016-04-25T13:38:24.612+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:38:47.355+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:39:20.535+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:39:29.017+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 351ms 2016-04-25T13:39:34.765+0000 I NETWORK [conn688] end connection 127.0.0.1:41387 (36 connections now open) 2016-04-25T13:39:50.865+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1122ms 2016-04-25T13:39:52.792+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T13:39:56.630+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:40:07.533+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 453ms 2016-04-25T13:40:22.994+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:40:32.965+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T13:40:45.684+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T13:41:07.091+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:41:11.579+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 680ms 2016-04-25T13:41:22.305+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1219ms 2016-04-25T13:41:24.815+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T13:41:52.682+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41392 #689 (37 connections now open) 2016-04-25T13:41:54.266+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 149ms 2016-04-25T13:42:16.899+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:42:50.788+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41395 #690 (38 connections now open) 2016-04-25T13:42:55.033+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:42:55.017+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3810, after asserts: 7090, after connections: 9900, after extra_info: 30780, after globalLock: 40500, after locks: 43890, after network: 45610, after opcounters: 46300, after opcountersRepl: 46300, after repl: 111217, after storageEngine: 113877, after tcmalloc: 122457, after wiredTiger: 128394, at end: 128394 } 2016-04-25T13:42:55.575+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 370ms 2016-04-25T13:43:03.774+0000 I COMMAND [conn687] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 197742ms 2016-04-25T13:43:14.655+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 909ms 2016-04-25T13:43:33.732+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:43:34.325+0000 I NETWORK [conn687] end connection 127.0.0.1:41386 (37 connections now open) 2016-04-25T13:43:34.877+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 346ms 2016-04-25T13:44:00.092+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:44:09.648+0000 I COMMAND [conn689] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 94144ms 2016-04-25T13:44:50.051+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 327ms 2016-04-25T13:45:01.880+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 491ms 2016-04-25T13:45:30.221+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:45:33.230+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 283ms 2016-04-25T13:45:47.991+0000 I NETWORK [conn689] end connection 127.0.0.1:41392 (36 connections now open) 2016-04-25T13:46:18.790+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:46:30.525+0000 I COMMAND [conn690] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 145985ms 2016-04-25T13:46:48.353+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:47:06.705+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T13:47:09.162+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 424ms 2016-04-25T13:47:09.483+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:47:13.385+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 681ms 2016-04-25T13:47:29.644+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T13:47:54.674+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:48:11.483+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41398 #691 (37 connections now open) 2016-04-25T13:48:33.220+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 434ms 2016-04-25T13:48:43.359+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 962ms 2016-04-25T13:49:00.152+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T13:49:13.627+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 354ms 2016-04-25T13:49:47.791+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:50:15.372+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T13:50:48.010+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:50:47.774+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 380ms 2016-04-25T13:50:57.142+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3390, after asserts: 6250, after connections: 14280, after extra_info: 28260, after globalLock: 38890, after locks: 41730, after network: 49030, after opcounters: 51200, after opcountersRepl: 52130, after repl: 127405, after storageEngine: 137315, after tcmalloc: 151345, after wiredTiger: 174305, at end: 196995 } 2016-04-25T13:51:01.134+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 351ms 2016-04-25T13:51:05.783+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1167ms 2016-04-25T13:51:16.910+0000 I COMMAND [conn691] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 121374ms 2016-04-25T13:51:35.076+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:52:20.259+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 411ms 2016-04-25T13:52:30.266+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41402 #692 (38 connections now open) 2016-04-25T13:52:41.446+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 446ms 2016-04-25T13:52:50.840+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 279ms 2016-04-25T13:53:22.602+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:53:58.328+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:54:04.433+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T13:54:17.288+0000 I COMMAND [conn690] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 311440ms 2016-04-25T13:54:22.817+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 10975ms 2016-04-25T13:54:39.125+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 504ms 2016-04-25T13:54:40.238+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:55:03.330+0000 I NETWORK [conn691] end connection 127.0.0.1:41398 (37 connections now open) 2016-04-25T13:55:12.574+0000 I NETWORK [conn690] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:41395] 2016-04-25T13:56:02.170+0000 I COMMAND [conn692] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 152569ms 2016-04-25T13:56:05.100+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:56:13.385+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 353ms 2016-04-25T13:56:30.810+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3486ms 2016-04-25T13:56:43.636+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T13:56:47.791+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T13:56:57.316+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 401ms 2016-04-25T13:57:20.477+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T13:57:48.395+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T13:58:00.903+0000 I NETWORK [conn692] end connection 127.0.0.1:41402 (35 connections now open) 2016-04-25T13:58:26.211+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 497ms 2016-04-25T13:58:54.260+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1378ms 2016-04-25T13:59:19.252+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41404 #693 (36 connections now open) 2016-04-25T13:59:27.623+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 305ms 2016-04-25T13:59:55.736+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:00:24.948+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 7730, after asserts: 8830, after connections: 12250, after extra_info: 34850, after globalLock: 44530, after locks: 57970, after network: 60570, after opcounters: 69920, after opcountersRepl: 75930, after repl: 182932, after storageEngine: 182932, after tcmalloc: 182932, after wiredTiger: 186252, at end: 205122 } 2016-04-25T14:00:36.769+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:00:51.632+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 464ms 2016-04-25T14:01:15.129+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1270ms 2016-04-25T14:01:27.516+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T14:01:31.164+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 550ms 2016-04-25T14:02:12.498+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:02:48.491+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41406 #694 (37 connections now open) 2016-04-25T14:03:11.468+0000 I COMMAND [conn693] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 128324ms 2016-04-25T14:03:23.162+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 414ms 2016-04-25T14:03:37.862+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:03:51.439+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3686ms 2016-04-25T14:04:09.433+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T14:04:14.068+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 506ms 2016-04-25T14:04:41.827+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:05:14.713+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:05:35.539+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 347ms 2016-04-25T14:05:36.659+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:05:44.892+0000 I COMMAND [conn694] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 104611ms 2016-04-25T14:05:45.296+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 346ms 2016-04-25T14:05:45.700+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 234ms 2016-04-25T14:05:56.983+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:06:43.886+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T14:06:48.278+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 458ms 2016-04-25T14:07:07.558+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:07:07.450+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 306ms 2016-04-25T14:07:15.450+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 379ms 2016-04-25T14:07:31.191+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:07:53.789+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4320, after asserts: 5600, after connections: 8860, after extra_info: 20560, after globalLock: 24030, after locks: 32290, after network: 36270, after opcounters: 37850, after opcountersRepl: 38030, after repl: 85120, after storageEngine: 100040, after tcmalloc: 105810, after wiredTiger: 113220, at end: 130310 } 2016-04-25T14:08:00.697+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T14:08:21.534+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:08:29.277+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 446ms 2016-04-25T14:08:29.772+0000 I COMMAND [conn693] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 122299ms 2016-04-25T14:08:46.000+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1123ms 2016-04-25T14:09:02.954+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 402ms 2016-04-25T14:09:12.000+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41411 #695 (38 connections now open) 2016-04-25T14:09:15.126+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T14:09:45.952+0000 I NETWORK [conn693] end connection 127.0.0.1:41404 (37 connections now open) 2016-04-25T14:09:44.767+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:10:24.477+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 634ms 2016-04-25T14:10:24.906+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:11:15.732+0000 I COMMAND [conn694] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 220645ms 2016-04-25T14:11:37.025+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 829ms 2016-04-25T14:11:58.812+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:12:05.223+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41412 #696 (38 connections now open) 2016-04-25T14:12:05.223+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 552ms 2016-04-25T14:12:15.279+0000 I NETWORK [conn694] end connection 127.0.0.1:41406 (36 connections now open) 2016-04-25T14:12:55.857+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:13:04.097+0000 I COMMAND [conn695] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 154649ms 2016-04-25T14:13:22.825+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:13:29.973+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T14:13:50.452+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 475ms 2016-04-25T14:13:53.118+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:14:07.171+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 496ms 2016-04-25T14:14:24.595+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 781ms 2016-04-25T14:14:43.570+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:15:04.439+0000 I NETWORK [conn695] end connection 127.0.0.1:41411 (36 connections now open) 2016-04-25T14:15:15.123+0000 I COMMAND [conn696] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 101527ms 2016-04-25T14:15:42.010+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2009ms 2016-04-25T14:15:45.324+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:15:59.049+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 9070, after globalLock: 11180, after locks: 14070, after network: 16180, after opcounters: 16450, after opcountersRepl: 16450, after repl: 106690, after storageEngine: 111830, after tcmalloc: 117250, after wiredTiger: 141300, at end: 186340 } 2016-04-25T14:16:02.002+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3755ms 2016-04-25T14:16:03.283+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 162ms 2016-04-25T14:16:04.506+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:16:41.446+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T14:16:49.139+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T14:17:12.615+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 175ms 2016-04-25T14:17:26.673+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 384ms 2016-04-25T14:17:38.576+0000 I NETWORK [conn696] end connection 127.0.0.1:41412 (35 connections now open) 2016-04-25T14:17:51.100+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 371ms 2016-04-25T14:17:57.819+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41416 #697 (37 connections now open) 2016-04-25T14:18:50.304+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:19:17.858+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 326ms 2016-04-25T14:19:43.442+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 451ms 2016-04-25T14:19:56.044+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T14:20:41.861+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41418 #698 (37 connections now open) 2016-04-25T14:20:42.625+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:21:09.939+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 204ms 2016-04-25T14:21:10.430+0000 I COMMAND [conn697] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 113357ms 2016-04-25T14:21:48.539+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 409ms 2016-04-25T14:21:49.165+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:23:01.455+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:23:06.952+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 590ms 2016-04-25T14:23:18.929+0000 I NETWORK [conn697] end connection 127.0.0.1:41416 (36 connections now open) 2016-04-25T14:23:26.681+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:23:35.070+0000 I COMMAND [conn698] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 92005ms 2016-04-25T14:23:35.042+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1366ms 2016-04-25T14:24:03.567+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4470, after asserts: 6490, after connections: 15850, after extra_info: 23177, after globalLock: 23177, after locks: 27407, after network: 29737, after opcounters: 30567, after opcountersRepl: 30567, after repl: 151587, after storageEngine: 155777, after tcmalloc: 163777, after wiredTiger: 183867, at end: 198057 } 2016-04-25T14:24:05.244+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 215ms 2016-04-25T14:24:15.588+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T14:24:22.167+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:25:00.775+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:25:19.873+0000 I NETWORK [conn698] end connection 127.0.0.1:41418 (35 connections now open) 2016-04-25T14:25:21.426+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 437ms 2016-04-25T14:25:23.851+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 632ms 2016-04-25T14:25:36.858+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T14:25:49.240+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41421 #699 (37 connections now open) 2016-04-25T14:26:11.920+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 319ms 2016-04-25T14:26:25.795+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:27:21.516+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 554ms 2016-04-25T14:28:02.651+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T14:28:10.717+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1054ms 2016-04-25T14:28:42.830+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 6734ms 2016-04-25T14:28:55.559+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:29:53.125+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T14:29:55.269+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41422 #700 (37 connections now open) 2016-04-25T14:30:03.546+0000 I COMMAND [conn699] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 133503ms 2016-04-25T14:30:04.232+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 284ms 2016-04-25T14:30:11.365+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:30:32.458+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1004ms 2016-04-25T14:30:59.867+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 152ms 2016-04-25T14:31:07.607+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:31:42.236+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:32:19.255+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 432ms 2016-04-25T14:32:20.221+0000 I COMMAND [conn700] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 103896ms 2016-04-25T14:32:20.236+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:32:37.491+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1158ms 2016-04-25T14:32:59.403+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 699ms 2016-04-25T14:33:04.866+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:34:01.769+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:34:03.121+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 2670, after locks: 5330, after network: 6170, after opcounters: 6170, after opcountersRepl: 6170, after repl: 91500, after storageEngine: 97070, after tcmalloc: 104600, after wiredTiger: 161030, at end: 226840 } 2016-04-25T14:34:05.174+0000 I NETWORK [conn700] end connection 127.0.0.1:41422 (36 connections now open) 2016-04-25T14:34:22.414+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 581ms 2016-04-25T14:34:31.240+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T14:34:34.754+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:34:59.314+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 654ms 2016-04-25T14:34:59.499+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:35:16.284+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T14:35:17.401+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 455ms 2016-04-25T14:36:18.604+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:36:39.562+0000 I COMMAND [conn699] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 164732ms 2016-04-25T14:36:44.253+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 591ms 2016-04-25T14:36:44.360+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T14:36:59.466+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41427 #701 (37 connections now open) 2016-04-25T14:36:59.466+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 890ms 2016-04-25T14:37:22.268+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1055ms 2016-04-25T14:37:22.992+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:37:35.442+0000 I NETWORK [conn699] end connection 127.0.0.1:41421 (36 connections now open) 2016-04-25T14:37:41.403+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41428 #702 (38 connections now open) 2016-04-25T14:38:06.003+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T14:38:43.395+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 270ms 2016-04-25T14:38:44.501+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:39:03.158+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 399ms 2016-04-25T14:39:11.726+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1080ms 2016-04-25T14:39:17.570+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:39:20.986+0000 I COMMAND [conn701] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 82759ms 2016-04-25T14:39:52.871+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:39:52.871+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 1710, after locks: 6150, after network: 7610, after opcounters: 7820, after opcountersRepl: 7820, after repl: 57870, after storageEngine: 63500, after tcmalloc: 72700, after wiredTiger: 80080, at end: 90070 } 2016-04-25T14:40:01.277+0000 I COMMAND [conn702] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 51347ms 2016-04-25T14:40:18.431+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 474ms 2016-04-25T14:40:25.120+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:40:35.862+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 4531ms 2016-04-25T14:40:41.795+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 143ms 2016-04-25T14:40:58.315+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:40:58.315+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T14:41:33.978+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T14:41:38.874+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:41:44.941+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 409ms 2016-04-25T14:41:59.241+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T14:42:03.434+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 308ms 2016-04-25T14:42:20.498+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T14:42:20.885+0000 I COMMAND [conn701] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 75569ms 2016-04-25T14:42:37.078+0000 I NETWORK [conn701] end connection 127.0.0.1:41427 (36 connections now open) 2016-04-25T14:42:46.262+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:42:49.377+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41433 #703 (38 connections now open) 2016-04-25T14:43:10.700+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 352ms 2016-04-25T14:43:25.023+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 191ms 2016-04-25T14:43:42.490+0000 I NETWORK [conn702] end connection 127.0.0.1:41428 (36 connections now open) 2016-04-25T14:43:42.490+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 460ms 2016-04-25T14:43:46.648+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:44:02.598+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:44:22.194+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 0, after locks: 0, after network: 0, after opcounters: 0, after opcountersRepl: 0, after repl: 36180, after storageEngine: 37770, after tcmalloc: 43350, after wiredTiger: 52920, at end: 70090 } 2016-04-25T14:44:29.150+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:44:39.577+0000 I COMMAND [conn703] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 63314ms 2016-04-25T14:44:52.480+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:44:52.974+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1367ms 2016-04-25T14:44:59.713+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 267ms 2016-04-25T14:45:24.946+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 341ms 2016-04-25T14:45:36.024+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:45:36.024+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41436 #704 (37 connections now open) 2016-04-25T14:45:47.131+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:46:03.726+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:46:00.759+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T14:46:19.353+0000 I NETWORK [conn703] end connection 127.0.0.1:41433 (36 connections now open) 2016-04-25T14:46:20.937+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:46:26.042+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T14:46:39.505+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 349ms 2016-04-25T14:46:53.829+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 604ms 2016-04-25T14:46:53.298+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:47:06.466+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 274ms 2016-04-25T14:47:19.941+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T14:47:39.567+0000 I COMMAND [conn704] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 74443ms 2016-04-25T14:47:46.119+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:47:56.769+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T14:48:20.977+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 988ms 2016-04-25T14:48:24.990+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:48:29.281+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1440, after asserts: 3090, after connections: 4060, after extra_info: 13540, after globalLock: 19660, after locks: 21870, after network: 22120, after opcounters: 22120, after opcountersRepl: 22120, after repl: 89360, after storageEngine: 97010, after tcmalloc: 103650, after wiredTiger: 118240, at end: 140840 } 2016-04-25T14:48:35.313+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 417ms 2016-04-25T14:48:38.091+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41440 #705 (37 connections now open) 2016-04-25T14:49:07.353+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:49:29.482+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:49:48.235+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 590ms 2016-04-25T14:50:01.331+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 244ms 2016-04-25T14:50:09.836+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:50:23.495+0000 I COMMAND [conn705] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 63095ms 2016-04-25T14:50:45.481+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:50:59.244+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T14:51:03.431+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:51:18.032+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:51:18.810+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 603ms 2016-04-25T14:51:31.232+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T14:51:42.266+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 834ms 2016-04-25T14:51:44.086+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:51:44.376+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 172ms 2016-04-25T14:52:07.355+0000 I NETWORK [conn705] end connection 127.0.0.1:41440 (36 connections now open) 2016-04-25T14:52:12.987+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41442 #706 (38 connections now open) 2016-04-25T14:52:14.135+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:52:51.576+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 594ms 2016-04-25T14:52:52.730+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T14:53:00.949+0000 I COMMAND [conn704] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 227825ms 2016-04-25T14:53:01.758+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 900, after asserts: 1960, after connections: 3790, after extra_info: 20380, after globalLock: 26500, after locks: 29190, after network: 31960, after opcounters: 33390, after opcountersRepl: 33390, after repl: 68064, after storageEngine: 68064, after tcmalloc: 68064, after wiredTiger: 81514, at end: 99534 } 2016-04-25T14:53:20.843+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:53:20.404+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2547ms 2016-04-25T14:53:33.458+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41444 #707 (38 connections now open) 2016-04-25T14:53:33.458+0000 I NETWORK [conn704] end connection 127.0.0.1:41436 (36 connections now open) 2016-04-25T14:53:38.032+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 488ms 2016-04-25T14:53:44.034+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T14:54:05.731+0000 I COMMAND [conn706] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 57417ms 2016-04-25T14:54:45.384+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 304ms 2016-04-25T14:54:45.867+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:54:52.032+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 433ms 2016-04-25T14:55:05.017+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:55:17.286+0000 I NETWORK [conn706] end connection 127.0.0.1:41442 (36 connections now open) 2016-04-25T14:55:21.950+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 228ms 2016-04-25T14:55:22.851+0000 I COMMAND [conn707] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 45663ms 2016-04-25T14:55:45.503+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:56:13.358+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:56:30.579+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 284ms 2016-04-25T14:56:40.290+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:56:54.952+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 402ms 2016-04-25T14:56:57.953+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-04-25T14:57:13.256+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:57:27.733+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T14:57:36.032+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:57:49.788+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2080, after asserts: 3600, after connections: 4100, after extra_info: 5840, after globalLock: 7110, after locks: 8910, after network: 11290, after opcounters: 14480, after opcountersRepl: 16520, after repl: 60610, after storageEngine: 63800, after tcmalloc: 76710, after wiredTiger: 86700, at end: 96190 } 2016-04-25T14:57:51.955+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41448 #708 (37 connections now open) 2016-04-25T14:58:15.775+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T14:58:24.227+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1478ms 2016-04-25T14:58:40.538+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 398ms 2016-04-25T14:58:46.340+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T14:58:46.066+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T14:59:11.111+0000 I COMMAND [conn707] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 110155ms 2016-04-25T14:59:31.169+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41450 #709 (38 connections now open) 2016-04-25T14:59:40.434+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T14:59:43.042+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 292ms 2016-04-25T14:59:50.730+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 357ms 2016-04-25T14:59:50.444+0000 I COMMAND [conn708] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 65573ms 2016-04-25T14:59:55.269+0000 I NETWORK [conn707] end connection 127.0.0.1:41444 (37 connections now open) 2016-04-25T14:59:58.286+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:00:20.730+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T15:00:47.452+0000 I NETWORK [conn708] end connection 127.0.0.1:41448 (36 connections now open) 2016-04-25T15:01:09.677+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:01:09.571+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 296ms 2016-04-25T15:01:25.479+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1232ms 2016-04-25T15:01:39.671+0000 I COMMAND [conn709] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 68933ms 2016-04-25T15:01:51.369+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 141ms 2016-04-25T15:01:56.279+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:02:04.712+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:02:37.731+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:02:57.919+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 600ms 2016-04-25T15:03:05.795+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 10750, after asserts: 11420, after connections: 24080, after extra_info: 36850, after globalLock: 38260, after locks: 39600, after network: 39880, after opcounters: 39880, after opcountersRepl: 39880, after repl: 96960, after storageEngine: 100330, after tcmalloc: 106750, after wiredTiger: 119590, at end: 128710 } 2016-04-25T15:03:07.509+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:03:09.803+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1251ms 2016-04-25T15:03:17.756+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 191ms 2016-04-25T15:03:33.407+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:03:41.669+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41454 #710 (37 connections now open) 2016-04-25T15:03:53.480+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:03:56.663+0000 I NETWORK [conn709] end connection 127.0.0.1:41450 (35 connections now open) 2016-04-25T15:04:20.280+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:04:21.695+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T15:04:35.908+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:04:36.414+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 242ms 2016-04-25T15:04:37.216+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T15:04:55.445+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 274ms 2016-04-25T15:05:21.026+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:05:41.004+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T15:06:00.512+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41457 #711 (37 connections now open) 2016-04-25T15:06:12.149+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 310ms 2016-04-25T15:06:12.968+0000 I COMMAND [conn710] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 85925ms 2016-04-25T15:06:17.217+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T15:06:31.978+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1151ms 2016-04-25T15:06:40.428+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:06:40.851+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 213ms 2016-04-25T15:07:58.200+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:08:04.724+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 144ms 2016-04-25T15:08:05.071+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3790, after asserts: 5190, after connections: 6790, after extra_info: 12170, after globalLock: 14700, after locks: 23776, after network: 23776, after opcounters: 23776, after opcountersRepl: 23776, after repl: 81016, after storageEngine: 90366, after tcmalloc: 97166, after wiredTiger: 109896, at end: 125186 } 2016-04-25T15:08:24.317+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 614ms 2016-04-25T15:08:24.422+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:08:25.111+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 383ms 2016-04-25T15:08:33.249+0000 I COMMAND [conn711] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 77877ms 2016-04-25T15:08:45.680+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:09:08.439+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:09:26.836+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 274ms 2016-04-25T15:09:33.462+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 501ms 2016-04-25T15:09:45.911+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 138ms 2016-04-25T15:10:19.947+0000 I NETWORK [conn711] end connection 127.0.0.1:41457 (36 connections now open) 2016-04-25T15:10:20.964+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41460 #712 (38 connections now open) 2016-04-25T15:10:27.422+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:10:50.535+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:10:49.951+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T15:10:56.201+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1619ms 2016-04-25T15:11:12.853+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 907ms 2016-04-25T15:11:15.640+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:11:19.383+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T15:11:34.529+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 399ms 2016-04-25T15:11:45.886+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:12:23.759+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41461 #713 (38 connections now open) 2016-04-25T15:12:35.551+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:12:36.279+0000 I COMMAND [conn710] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 1223349 } } } protocol:op_command 250796ms 2016-04-25T15:12:45.505+0000 I COMMAND [conn712] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 70685ms 2016-04-25T15:12:49.356+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 158ms 2016-04-25T15:12:59.882+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T15:13:00.996+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 235ms 2016-04-25T15:13:10.725+0000 I NETWORK [conn710] end connection 127.0.0.1:41454 (37 connections now open) 2016-04-25T15:13:10.743+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 311ms 2016-04-25T15:13:34.584+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T15:13:50.323+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:14:31.784+0000 I COMMAND [conn713] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 85757ms 2016-04-25T15:14:38.120+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:14:39.316+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 274ms 2016-04-25T15:14:50.900+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 289ms 2016-04-25T15:15:02.048+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:15:04.937+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 263ms 2016-04-25T15:15:28.079+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:15:50.833+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:15:53.087+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1720, after asserts: 2420, after connections: 3020, after extra_info: 8260, after globalLock: 12060, after locks: 18300, after network: 24430, after opcounters: 25660, after opcountersRepl: 25660, after repl: 69990, after storageEngine: 77180, after tcmalloc: 80650, after wiredTiger: 108520, at end: 140700 } 2016-04-25T15:16:21.386+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 371ms 2016-04-25T15:16:29.386+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 401ms 2016-04-25T15:16:38.446+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:16:45.264+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 317ms 2016-04-25T15:17:31.174+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:17:52.240+0000 I COMMAND [conn713] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 141178ms 2016-04-25T15:17:56.087+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T15:17:56.087+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:17:59.177+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 576ms 2016-04-25T15:18:15.754+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41466 #714 (38 connections now open) 2016-04-25T15:18:38.951+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T15:18:41.632+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:18:45.574+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 813ms 2016-04-25T15:18:59.366+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41467 #715 (39 connections now open) 2016-04-25T15:19:19.493+0000 I COMMAND [conn712] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 242964ms 2016-04-25T15:19:34.525+0000 I NETWORK [conn713] end connection 127.0.0.1:41461 (38 connections now open) 2016-04-25T15:19:44.343+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:20:03.051+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 320ms 2016-04-25T15:20:16.505+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T15:20:26.036+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 4943ms 2016-04-25T15:20:37.268+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:20:39.115+0000 I COMMAND [conn714] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 42022ms 2016-04-25T15:21:04.985+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 557ms 2016-04-25T15:21:02.584+0000 I NETWORK [conn712] end connection 127.0.0.1:41460 (37 connections now open) 2016-04-25T15:21:17.718+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T15:21:32.982+0000 I COMMAND [conn715] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 87505ms 2016-04-25T15:21:34.993+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:22:18.604+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 410ms 2016-04-25T15:22:24.088+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:22:24.988+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 497ms 2016-04-25T15:22:35.450+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 348ms 2016-04-25T15:22:41.328+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:23:26.044+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:23:47.425+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 165ms 2016-04-25T15:23:48.839+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 16620, after asserts: 18310, after connections: 20730, after extra_info: 40980, after globalLock: 46880, after locks: 48670, after network: 51080, after opcounters: 52590, after opcountersRepl: 52590, after repl: 98720, after storageEngine: 102960, after tcmalloc: 117890, after wiredTiger: 148410, at end: 188470 } 2016-04-25T15:24:11.638+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:24:16.982+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1365ms 2016-04-25T15:24:34.488+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 564ms 2016-04-25T15:24:40.165+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:25:13.296+0000 I NETWORK [conn714] end connection 127.0.0.1:41466 (36 connections now open) 2016-04-25T15:25:28.254+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:25:45.898+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 442ms 2016-04-25T15:25:47.961+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T15:26:03.233+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 843ms 2016-04-25T15:26:13.712+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 125ms 2016-04-25T15:26:24.836+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T15:27:00.262+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41472 #716 (37 connections now open) 2016-04-25T15:27:11.161+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:27:19.648+0000 I COMMAND [conn715] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 167803ms 2016-04-25T15:27:29.302+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 594ms 2016-04-25T15:27:41.296+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:27:48.972+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 765ms 2016-04-25T15:28:14.540+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T15:28:22.701+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 929ms 2016-04-25T15:28:36.560+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41473 #717 (38 connections now open) 2016-04-25T15:28:51.670+0000 I NETWORK [conn715] end connection 127.0.0.1:41467 (36 connections now open) 2016-04-25T15:29:00.855+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:29:55.889+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 531ms 2016-04-25T15:30:09.112+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2334ms 2016-04-25T15:30:36.219+0000 I COMMAND [conn716] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 122255ms 2016-04-25T15:30:43.930+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 335ms 2016-04-25T15:30:49.984+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T15:31:46.076+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:32:09.058+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 753ms 2016-04-25T15:32:47.610+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 706ms 2016-04-25T15:33:01.573+0000 I COMMAND [conn717] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 159106ms 2016-04-25T15:33:16.714+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:33:20.634+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1014ms 2016-04-25T15:33:48.276+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 10310, after asserts: 17140, after connections: 22900, after extra_info: 41600, after globalLock: 44280, after locks: 51100, after network: 52840, after opcounters: 52840, after opcountersRepl: 52840, after repl: 202410, after storageEngine: 207310, after tcmalloc: 212300, after wiredTiger: 229920, at end: 257790 } 2016-04-25T15:34:04.374+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:34:48.487+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 331ms 2016-04-25T15:34:50.822+0000 I NETWORK [conn717] end connection 127.0.0.1:41473 (36 connections now open) 2016-04-25T15:35:08.882+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2833ms 2016-04-25T15:35:19.136+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 512ms 2016-04-25T15:35:32.283+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T15:35:52.307+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:36:46.126+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:37:03.318+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 511ms 2016-04-25T15:37:23.124+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T15:37:29.229+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 553ms 2016-04-25T15:37:55.383+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 592ms 2016-04-25T15:38:23.003+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:38:29.984+0000 I COMMAND [conn716] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 231244ms 2016-04-25T15:38:55.007+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41478 #718 (37 connections now open) 2016-04-25T15:39:12.357+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T15:39:17.888+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:39:24.268+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 333ms 2016-04-25T15:39:31.785+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41479 #719 (38 connections now open) 2016-04-25T15:39:55.982+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 422ms 2016-04-25T15:40:02.604+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:40:02.198+0000 I NETWORK [conn716] end connection 127.0.0.1:41472 (36 connections now open) 2016-04-25T15:40:38.088+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 294ms 2016-04-25T15:41:23.511+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:41:35.390+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 9740, after asserts: 11650, after connections: 13190, after extra_info: 21830, after globalLock: 25360, after locks: 29450, after network: 35080, after opcounters: 47160, after opcountersRepl: 47320, after repl: 69891, after storageEngine: 69891, after tcmalloc: 76631, after wiredTiger: 104211, at end: 135901 } 2016-04-25T15:42:15.585+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1646ms 2016-04-25T15:42:38.272+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:42:55.116+0000 I COMMAND [conn718] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 150512ms 2016-04-25T15:43:02.227+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 579ms 2016-04-25T15:43:24.049+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T15:43:41.721+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 358ms 2016-04-25T15:43:59.020+0000 I COMMAND [conn719] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 143593ms 2016-04-25T15:44:56.607+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 428ms 2016-04-25T15:45:01.701+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:45:19.184+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 725ms 2016-04-25T15:45:35.029+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 857ms 2016-04-25T15:45:47.169+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:46:09.940+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T15:46:26.585+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:46:50.624+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 336ms 2016-04-25T15:46:59.510+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:47:21.961+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1948ms 2016-04-25T15:47:43.747+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1096ms 2016-04-25T15:48:05.182+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:48:55.509+0000 I COMMAND [conn718] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 160148ms 2016-04-25T15:49:08.986+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T15:49:07.263+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 318ms 2016-04-25T15:49:37.191+0000 I NETWORK [conn719] end connection 127.0.0.1:41479 (36 connections now open) 2016-04-25T15:49:37.191+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41484 #720 (38 connections now open) 2016-04-25T15:49:39.633+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 714ms 2016-04-25T15:49:54.728+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:49:55.109+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 241ms 2016-04-25T15:50:10.784+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:50:23.839+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T15:50:28.232+0000 I NETWORK [conn718] end connection 127.0.0.1:41478 (36 connections now open) 2016-04-25T15:50:57.047+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3790, after asserts: 9690, after connections: 21690, after extra_info: 35810, after globalLock: 42470, after locks: 48140, after network: 50300, after opcounters: 51750, after opcountersRepl: 53150, after repl: 143682, after storageEngine: 148872, after tcmalloc: 157402, after wiredTiger: 176812, at end: 206142 } 2016-04-25T15:51:04.582+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 345ms 2016-04-25T15:51:17.283+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:52:32.209+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 543ms 2016-04-25T15:52:33.542+0000 I COMMAND [conn720] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 90894ms 2016-04-25T15:52:39.020+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:52:52.592+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1496ms 2016-04-25T15:53:08.273+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41487 #721 (37 connections now open) 2016-04-25T15:53:11.022+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 333ms 2016-04-25T15:53:55.304+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:54:20.617+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T15:54:30.799+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 330ms 2016-04-25T15:54:39.134+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 819ms 2016-04-25T15:54:57.254+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:54:56.807+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 261ms 2016-04-25T15:54:57.521+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T15:55:20.652+0000 I COMMAND [conn721] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 77252ms 2016-04-25T15:55:33.994+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:55:45.001+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T15:56:12.062+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 414ms 2016-04-25T15:56:13.624+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:56:16.245+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 209ms 2016-04-25T15:56:17.017+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:56:17.050+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 430ms 2016-04-25T15:56:40.593+0000 I COMMAND [conn720] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 53804ms 2016-04-25T15:56:40.593+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:56:57.278+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4300, after asserts: 4940, after connections: 5230, after extra_info: 14900, after globalLock: 16930, after locks: 17260, after network: 17860, after opcounters: 18330, after opcountersRepl: 18330, after repl: 60200, after storageEngine: 63450, after tcmalloc: 69590, after wiredTiger: 72620, at end: 94650 } 2016-04-25T15:57:19.701+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 185ms 2016-04-25T15:57:24.048+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:57:25.021+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1009ms 2016-04-25T15:57:27.984+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 696ms 2016-04-25T15:57:35.715+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:57:36.379+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T15:57:36.616+0000 I NETWORK [conn721] end connection 127.0.0.1:41487 (36 connections now open) 2016-04-25T15:57:36.745+0000 I NETWORK [conn720] end connection 127.0.0.1:41484 (36 connections now open) 2016-04-25T15:57:43.813+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41491 #722 (38 connections now open) 2016-04-25T15:58:09.054+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:58:40.143+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 124ms 2016-04-25T15:58:44.899+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:58:52.452+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 530ms 2016-04-25T15:58:52.140+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41492 #723 (37 connections now open) 2016-04-25T15:59:02.764+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 201ms 2016-04-25T15:59:04.758+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T15:59:06.063+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T15:59:12.940+0000 I COMMAND [conn722] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 23636ms 2016-04-25T15:59:32.541+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T15:59:45.407+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T16:00:03.393+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:00:10.349+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 237ms 2016-04-25T16:00:23.406+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 303ms 2016-04-25T16:00:33.550+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 322ms 2016-04-25T16:00:37.162+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T16:00:47.133+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:00:50.468+0000 I COMMAND [conn723] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 51251ms 2016-04-25T16:01:03.065+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:01:34.228+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1270, after asserts: 2700, after connections: 4210, after extra_info: 10570, after globalLock: 14620, after locks: 16690, after network: 17450, after opcounters: 17450, after opcountersRepl: 17450, after repl: 55020, after storageEngine: 57870, after tcmalloc: 62810, after wiredTiger: 71520, at end: 103970 } 2016-04-25T16:01:47.283+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:01:47.283+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 358ms 2016-04-25T16:02:02.075+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 772ms 2016-04-25T16:02:24.893+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:02:33.794+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:03:09.549+0000 I COMMAND [conn722] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 95509ms 2016-04-25T16:03:23.091+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:03:31.787+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 590ms 2016-04-25T16:03:41.625+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T16:03:52.828+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 999ms 2016-04-25T16:03:52.828+0000 I NETWORK [conn722] end connection 127.0.0.1:41491 (36 connections now open) 2016-04-25T16:04:09.958+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:04:09.909+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 311ms 2016-04-25T16:04:33.047+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T16:04:46.066+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:05:19.596+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 994ms 2016-04-25T16:05:36.408+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:05:41.346+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41498 #724 (37 connections now open) 2016-04-25T16:05:55.734+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1350ms 2016-04-25T16:06:02.705+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T16:06:08.213+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41499 #725 (38 connections now open) 2016-04-25T16:06:36.006+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:07:08.631+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 349ms 2016-04-25T16:07:27.666+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 434ms 2016-04-25T16:07:50.094+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T16:07:52.162+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 420ms 2016-04-25T16:08:11.872+0000 I COMMAND [conn723] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 6301957 } } } protocol:op_command 292835ms 2016-04-25T16:08:17.660+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:08:51.574+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3170, after asserts: 6800, after connections: 10680, after extra_info: 17742, after globalLock: 17742, after locks: 17742, after network: 17742, after opcounters: 20403, after opcountersRepl: 20403, after repl: 94363, after storageEngine: 100423, after tcmalloc: 105283, after wiredTiger: 126123, at end: 160543 } 2016-04-25T16:09:03.655+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 301ms 2016-04-25T16:09:06.666+0000 I COMMAND [conn725] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 107930ms 2016-04-25T16:09:06.666+0000 I COMMAND [conn724] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 125900ms 2016-04-25T16:09:16.677+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 914ms 2016-04-25T16:09:24.054+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:09:38.830+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 292ms 2016-04-25T16:09:40.433+0000 I NETWORK [conn723] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:41492] 2016-04-25T16:10:14.702+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:10:43.249+0000 I NETWORK [conn725] end connection 127.0.0.1:41499 (36 connections now open) 2016-04-25T16:10:56.665+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 529ms 2016-04-25T16:11:08.490+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:11:14.216+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 393ms 2016-04-25T16:11:37.442+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T16:11:38.456+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 361ms 2016-04-25T16:11:42.342+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:11:56.790+0000 I NETWORK [conn724] end connection 127.0.0.1:41498 (35 connections now open) 2016-04-25T16:12:01.186+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:12:48.313+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41503 #726 (36 connections now open) 2016-04-25T16:12:52.406+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:12:59.595+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 328ms 2016-04-25T16:13:31.186+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:13:49.770+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 621ms 2016-04-25T16:14:10.509+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T16:14:10.186+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:14:11.657+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 7162ms 2016-04-25T16:14:33.931+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41505 #727 (37 connections now open) 2016-04-25T16:14:51.332+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T16:15:33.548+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 271ms 2016-04-25T16:15:52.595+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:16:01.524+0000 I COMMAND [conn726] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 108835ms 2016-04-25T16:16:00.634+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 7651ms 2016-04-25T16:16:24.453+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 150ms 2016-04-25T16:16:27.529+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 170, after asserts: 2450, after connections: 5770, after extra_info: 13410, after globalLock: 20650, after locks: 27740, after network: 33380, after opcounters: 33540, after opcountersRepl: 33540, after repl: 107124, after storageEngine: 108874, after tcmalloc: 118264, after wiredTiger: 135214, at end: 165824 } 2016-04-25T16:16:51.025+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T16:16:55.183+0000 I COMMAND [conn727] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 72626ms 2016-04-25T16:17:27.077+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:17:53.530+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:17:53.812+0000 I NETWORK [conn726] end connection 127.0.0.1:41503 (36 connections now open) 2016-04-25T16:17:55.615+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 262ms 2016-04-25T16:18:28.325+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1026ms 2016-04-25T16:19:18.399+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1900ms 2016-04-25T16:19:31.586+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:19:31.585+0000 I NETWORK [conn727] end connection 127.0.0.1:41505 (35 connections now open) 2016-04-25T16:20:52.061+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:20:53.254+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 400ms 2016-04-25T16:21:22.442+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:21:35.308+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1032ms 2016-04-25T16:21:55.588+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T16:21:59.828+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41509 #728 (36 connections now open) 2016-04-25T16:22:00.355+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:22:11.296+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 264ms 2016-04-25T16:23:12.165+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:23:19.304+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T16:23:44.726+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 357ms 2016-04-25T16:23:44.726+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41510 #729 (37 connections now open) 2016-04-25T16:23:54.080+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 712ms 2016-04-25T16:24:12.197+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:24:16.255+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 887ms 2016-04-25T16:24:39.776+0000 I COMMAND [conn728] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 84916ms 2016-04-25T16:24:44.621+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T16:25:19.331+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 9540, after asserts: 19040, after connections: 21430, after extra_info: 31420, after globalLock: 35360, after locks: 40520, after network: 46440, after opcounters: 49150, after opcountersRepl: 49401, after repl: 120884, after storageEngine: 120884, after tcmalloc: 120884, after wiredTiger: 152624, at end: 177694 } 2016-04-25T16:25:37.051+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T16:25:39.658+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 625ms 2016-04-25T16:26:14.098+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 734ms 2016-04-25T16:26:18.144+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:26:29.358+0000 I NETWORK [conn728] end connection 127.0.0.1:41509 (36 connections now open) 2016-04-25T16:26:52.477+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 292ms 2016-04-25T16:27:56.947+0000 I COMMAND [conn729] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 163212ms 2016-04-25T16:28:25.874+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 490ms 2016-04-25T16:28:48.916+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1029ms 2016-04-25T16:29:14.465+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:29:21.961+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 491ms 2016-04-25T16:29:47.831+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:30:21.776+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:30:37.770+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 496ms 2016-04-25T16:31:10.823+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 11072ms 2016-04-25T16:31:14.835+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:31:28.205+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 345ms 2016-04-25T16:32:00.574+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41514 #730 (37 connections now open) 2016-04-25T16:32:31.497+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:33:06.342+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 421ms 2016-04-25T16:33:27.525+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:33:26.996+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3867ms 2016-04-25T16:33:39.537+0000 I COMMAND [conn729] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 174064ms 2016-04-25T16:33:51.755+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 556ms 2016-04-25T16:34:01.764+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:34:02.535+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T16:34:41.965+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:34:49.378+0000 I NETWORK [conn729] end connection 127.0.0.1:41510 (36 connections now open) 2016-04-25T16:34:51.187+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T16:34:52.380+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41516 #731 (38 connections now open) 2016-04-25T16:35:21.935+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 374ms 2016-04-25T16:35:44.813+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 6610, after globalLock: 16640, after locks: 25400, after network: 27210, after opcounters: 28570, after opcountersRepl: 29380, after repl: 128890, after storageEngine: 133968, after tcmalloc: 133968, after wiredTiger: 137028, at end: 164278 } 2016-04-25T16:35:46.314+0000 I COMMAND [conn730] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 113555ms 2016-04-25T16:35:47.142+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 795ms 2016-04-25T16:35:52.021+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:36:29.882+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 877ms 2016-04-25T16:37:00.062+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T16:37:13.031+0000 I COMMAND [conn731] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 106763ms 2016-04-25T16:37:50.381+0000 I NETWORK [conn730] end connection 127.0.0.1:41514 (36 connections now open) 2016-04-25T16:37:50.381+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 258ms 2016-04-25T16:38:00.595+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T16:38:19.960+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 992ms 2016-04-25T16:38:33.688+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2907ms 2016-04-25T16:39:06.598+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:40:01.604+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1746ms 2016-04-25T16:40:10.084+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:40:24.637+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 553ms 2016-04-25T16:40:54.504+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:41:02.089+0000 I NETWORK [conn731] end connection 127.0.0.1:41516 (35 connections now open) 2016-04-25T16:41:06.368+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 318ms 2016-04-25T16:41:09.879+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41520 #732 (37 connections now open) 2016-04-25T16:41:35.668+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:42:12.045+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:42:44.800+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 309ms 2016-04-25T16:43:06.631+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 7073ms 2016-04-25T16:43:20.863+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 282ms 2016-04-25T16:43:33.098+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:44:05.690+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41522 #733 (37 connections now open) 2016-04-25T16:44:06.306+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:44:19.392+0000 I COMMAND [conn732] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 105564ms 2016-04-25T16:44:29.116+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 9743, after asserts: 9743, after connections: 9743, after extra_info: 9743, after globalLock: 9743, after locks: 9743, after network: 9743, after opcounters: 9743, after opcountersRepl: 9743, after repl: 88453, after storageEngine: 92883, after tcmalloc: 98483, after wiredTiger: 123173, at end: 123994 } 2016-04-25T16:44:30.933+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 282ms 2016-04-25T16:44:38.081+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:44:42.801+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T16:44:57.264+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1374ms 2016-04-25T16:45:13.969+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T16:45:27.406+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:45:28.180+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2145ms 2016-04-25T16:46:58.424+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 523ms 2016-04-25T16:47:15.915+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:47:21.450+0000 I NETWORK [conn732] end connection 127.0.0.1:41520 (36 connections now open) 2016-04-25T16:47:21.450+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 256ms 2016-04-25T16:47:23.281+0000 I COMMAND [conn733] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 122400ms 2016-04-25T16:47:37.254+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T16:47:57.890+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 457ms 2016-04-25T16:48:10.311+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T16:48:57.703+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:49:15.987+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 333ms 2016-04-25T16:49:41.649+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 730ms 2016-04-25T16:50:15.386+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:50:19.344+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 220ms 2016-04-25T16:50:55.940+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:51:31.666+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41526 #734 (37 connections now open) 2016-04-25T16:51:48.257+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 7441ms 2016-04-25T16:52:00.250+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:52:08.115+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 340ms 2016-04-25T16:52:12.041+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 670ms 2016-04-25T16:52:57.448+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2270, after asserts: 6210, after connections: 10310, after extra_info: 34900, after globalLock: 41730, after locks: 44950, after network: 49320, after opcounters: 51610, after opcountersRepl: 53390, after repl: 137660, after storageEngine: 148970, after tcmalloc: 154022, after wiredTiger: 154022, at end: 215882 } 2016-04-25T16:53:17.455+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:53:45.346+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T16:53:56.659+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1592ms 2016-04-25T16:54:18.309+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1902ms 2016-04-25T16:54:44.817+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:55:01.466+0000 I COMMAND [conn734] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 115928ms 2016-04-25T16:55:10.691+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T16:55:21.617+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 554ms 2016-04-25T16:55:23.922+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T16:55:49.845+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 602ms 2016-04-25T16:56:02.701+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41529 #735 (38 connections now open) 2016-04-25T16:56:21.380+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 499ms 2016-04-25T16:56:28.301+0000 I COMMAND [conn733] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 213394ms 2016-04-25T16:56:31.894+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:57:01.033+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T16:57:26.737+0000 I NETWORK [conn733] end connection 127.0.0.1:41522 (37 connections now open) 2016-04-25T16:57:36.374+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 717ms 2016-04-25T16:57:42.733+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 407ms 2016-04-25T16:58:13.062+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:59:06.616+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 10730, after asserts: 14580, after connections: 17940, after extra_info: 24440, after globalLock: 26020, after locks: 28480, after network: 30570, after opcounters: 32300, after opcountersRepl: 33560, after repl: 91370, after storageEngine: 95890, after tcmalloc: 112120, after wiredTiger: 125870, at end: 140240 } 2016-04-25T16:59:06.806+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 719ms 2016-04-25T16:59:07.142+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T16:59:17.113+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 270ms 2016-04-25T16:59:27.196+0000 I COMMAND [conn735] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 95948ms 2016-04-25T16:59:42.166+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T16:59:59.126+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T17:00:34.426+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41533 #736 (38 connections now open) 2016-04-25T17:00:42.318+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:00:42.403+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 638ms 2016-04-25T17:01:02.036+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T17:01:03.388+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 592ms 2016-04-25T17:01:03.790+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 401ms 2016-04-25T17:01:10.672+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T17:01:19.526+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T17:01:35.239+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:01:51.123+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T17:02:01.497+0000 I COMMAND [conn736] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 27561ms 2016-04-25T17:02:06.122+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 341ms 2016-04-25T17:02:35.972+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 224ms 2016-04-25T17:02:46.034+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:02:49.636+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 440ms 2016-04-25T17:03:16.163+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T17:03:20.464+0000 I COMMAND [conn735] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 109994ms 2016-04-25T17:03:32.909+0000 I COMMAND [conn734] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 }, acquireWaitCount: { W: 1 }, timeAcquiringMicros: { W: 31992057 } } } protocol:op_command 300277ms 2016-04-25T17:03:33.442+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:03:45.527+0000 I NETWORK [conn735] end connection 127.0.0.1:41529 (37 connections now open) 2016-04-25T17:03:51.899+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 505ms 2016-04-25T17:03:52.478+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T17:04:08.502+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41536 #737 (39 connections now open) 2016-04-25T17:04:10.931+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 269ms 2016-04-25T17:04:16.693+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6470, after asserts: 7710, after connections: 11580, after extra_info: 22870, after globalLock: 27170, after locks: 28320, after network: 28810, after opcounters: 28810, after opcountersRepl: 28810, after repl: 74550, after storageEngine: 84450, after tcmalloc: 91340, after wiredTiger: 107740, at end: 120541 } 2016-04-25T17:04:35.041+0000 I NETWORK [conn736] end connection 127.0.0.1:41533 (36 connections now open) 2016-04-25T17:04:34.415+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:04:37.709+0000 I NETWORK [conn734] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:41526] 2016-04-25T17:05:27.225+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 288ms 2016-04-25T17:05:38.694+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 335ms 2016-04-25T17:05:47.181+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T17:06:01.422+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41538 #738 (37 connections now open) 2016-04-25T17:06:13.076+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:06:54.873+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T17:06:54.079+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T17:06:55.736+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 262ms 2016-04-25T17:06:59.130+0000 I COMMAND [conn737] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 96254ms 2016-04-25T17:07:11.869+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2102ms 2016-04-25T17:07:16.408+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:07:23.617+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 383ms 2016-04-25T17:07:51.762+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T17:08:02.495+0000 I COMMAND [conn738] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 58125ms 2016-04-25T17:08:10.157+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:08:38.390+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 5017ms 2016-04-25T17:08:39.784+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T17:08:40.434+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 361ms 2016-04-25T17:08:59.474+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T17:09:38.812+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:09:43.190+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 373ms 2016-04-25T17:10:02.448+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 391ms 2016-04-25T17:10:20.408+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 600ms 2016-04-25T17:10:48.244+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1880, after asserts: 3500, after connections: 5110, after extra_info: 16710, after globalLock: 19700, after locks: 23150, after network: 27310, after opcounters: 30130, after opcountersRepl: 30530, after repl: 119190, after storageEngine: 122440, after tcmalloc: 129560, after wiredTiger: 154120, at end: 181910 } 2016-04-25T17:11:01.416+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:11:33.846+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T17:11:47.199+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 292ms 2016-04-25T17:11:57.148+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T17:12:06.208+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 703ms 2016-04-25T17:12:20.616+0000 I COMMAND [conn737] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 162067ms 2016-04-25T17:12:25.210+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:12:38.124+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 130ms 2016-04-25T17:13:03.432+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41542 #739 (38 connections now open) 2016-04-25T17:13:19.153+0000 I NETWORK [conn737] end connection 127.0.0.1:41536 (36 connections now open) 2016-04-25T17:13:42.047+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41543 #740 (39 connections now open) 2016-04-25T17:13:42.917+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 301ms 2016-04-25T17:13:57.850+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:14:06.662+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 215ms 2016-04-25T17:14:12.714+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T17:14:22.915+0000 I COMMAND [conn738] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 276007ms 2016-04-25T17:14:23.740+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 116ms 2016-04-25T17:14:38.852+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T17:14:38.286+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:15:08.898+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T17:15:21.344+0000 I NETWORK [conn738] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:41538] 2016-04-25T17:15:55.713+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:15:56.467+0000 I COMMAND [conn739] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 92484ms 2016-04-25T17:16:28.585+0000 I COMMAND [conn740] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 94903ms 2016-04-25T17:16:41.990+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1484ms 2016-04-25T17:17:00.564+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T17:17:13.348+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 435ms 2016-04-25T17:17:21.858+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T17:17:40.979+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:18:23.430+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:18:46.960+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 476ms 2016-04-25T17:19:07.735+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-04-25T17:19:15.238+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2300, after asserts: 5780, after connections: 11560, after extra_info: 30580, after globalLock: 39510, after locks: 40610, after network: 40740, after opcounters: 40740, after opcountersRepl: 40740, after repl: 103930, after storageEngine: 109380, after tcmalloc: 114980, after wiredTiger: 135070, at end: 155040 } 2016-04-25T17:19:23.254+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 506ms 2016-04-25T17:19:53.956+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-04-25T17:20:29.525+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:20:31.283+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 328ms 2016-04-25T17:21:03.090+0000 I NETWORK [conn740] end connection 127.0.0.1:41543 (36 connections now open) 2016-04-25T17:21:03.090+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 327ms 2016-04-25T17:21:35.150+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 616ms 2016-04-25T17:21:52.621+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41548 #741 (37 connections now open) 2016-04-25T17:22:29.620+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:22:56.749+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 199ms 2016-04-25T17:22:58.484+0000 I COMMAND [conn739] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 44 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 224448ms 2016-04-25T17:22:58.452+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T17:23:09.272+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1545ms 2016-04-25T17:23:29.995+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 603ms 2016-04-25T17:23:37.007+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-04-25T17:23:54.747+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41551 #742 (38 connections now open) 2016-04-25T17:23:55.356+0000 I NETWORK [conn739] end connection 127.0.0.1:41542 (36 connections now open) 2016-04-25T17:24:07.818+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:24:46.808+0000 I COMMAND [conn741] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 109152ms 2016-04-25T17:24:57.955+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1580ms 2016-04-25T17:25:04.924+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T17:25:08.162+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 871ms 2016-04-25T17:25:26.568+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1038ms 2016-04-25T17:25:45.288+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:25:51.305+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T17:25:51.643+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T17:25:51.643+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-04-25T17:25:51.643+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-04-25T17:25:51.643+0000 I COMMAND [conn742] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 73605ms 2016-04-25T17:25:52.247+0000 I NETWORK [conn34] end connection 127.0.0.1:56363 (36 connections now open) 2016-04-25T17:25:52.247+0000 I NETWORK [conn49] end connection 127.0.0.1:56383 (36 connections now open) 2016-04-25T17:25:52.247+0000 I NETWORK [conn48] end connection 127.0.0.1:56382 (36 connections now open) 2016-04-25T17:25:52.247+0000 I NETWORK [conn47] end connection 127.0.0.1:56380 (36 connections now open) 2016-04-25T17:25:52.247+0000 I NETWORK [conn36] end connection 127.0.0.1:56365 (36 connections now open) 2016-04-25T17:25:52.247+0000 I NETWORK [conn35] end connection 127.0.0.1:56364 (36 connections now open) 2016-04-25T17:25:52.247+0000 I NETWORK [conn27] end connection 127.0.0.1:56351 (36 connections now open) 2016-04-25T17:25:52.901+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 690, after connections: 2590, after extra_info: 10120, after globalLock: 14500, after locks: 17630, after network: 21440, after opcounters: 24250, after opcountersRepl: 34900, after repl: 95990, after storageEngine: 96280, after tcmalloc: 96990, after wiredTiger: 96990, at end: 97100 } 2016-04-25T17:25:53.580+0000 I COMMAND [conn742] command local.replset.election command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 44, candidateIndex: 0, configVersion: 2, lastCommittedOp: { ts: Timestamp 1461566648000|2, t: 41 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:63 locks:{ Global: { acquireCount: { r: 1, w: 1 } }, Database: { acquireCount: { W: 1 } } } protocol:op_command 1660ms 2016-04-25T17:25:56.644+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-25T17:25:56.644+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-25T17:25:56.644+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-04-25T17:25:56.644+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state PRIMARY 2016-04-25T17:25:57.387+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-25T17:25:57.388+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-25T17:25:57.388+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-25T17:26:00.382+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41565 #743 (31 connections now open) 2016-04-25T17:26:00.382+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41566 #744 (32 connections now open) 2016-04-25T17:26:33.594+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41614 #745 (33 connections now open) 2016-04-25T17:26:33.595+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41615 #746 (34 connections now open) 2016-04-25T17:26:33.595+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41616 #747 (35 connections now open) 2016-04-25T17:26:33.595+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41617 #748 (36 connections now open) 2016-04-25T17:26:33.596+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41618 #749 (37 connections now open) 2016-04-25T17:26:33.647+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41622 #750 (38 connections now open) 2016-04-25T17:26:33.647+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41624 #751 (39 connections now open) 2016-04-25T17:26:33.653+0000 I NETWORK [conn751] end connection 127.0.0.1:41624 (38 connections now open) 2016-04-25T17:26:33.669+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41627 #752 (39 connections now open) 2016-04-25T17:26:33.697+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41632 #753 (40 connections now open) 2016-04-25T17:26:34.663+0000 I ACCESS [conn752] Successfully authenticated as principal oplogger on admin 2016-04-25T17:26:35.162+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41634 #754 (41 connections now open) 2016-04-25T17:26:35.165+0000 I NETWORK [conn754] end connection 127.0.0.1:41634 (40 connections now open) 2016-04-25T17:26:35.177+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41637 #755 (41 connections now open) 2016-04-25T17:26:35.660+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41642 #756 (42 connections now open) 2016-04-25T17:26:36.619+0000 I ACCESS [conn755] Successfully authenticated as principal oplogger on admin 2016-04-25T17:26:50.598+0000 W NETWORK [HostnameCanonicalizationWorker] Failed to obtain address information for hostname ip-172-31-6-169: Name or service not known 2016-04-25T17:30:00.145+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-25T18:00:16.321+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 25 17:59:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 25 18:00:16:1) 2016-04-25T18:00:16.322+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-25T18:00:17.322+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-25T18:00:17.323+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-25T18:29:45.076+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41788 #757 (43 connections now open) 2016-04-25T18:29:45.076+0000 I NETWORK [conn757] end connection 127.0.0.1:41788 (42 connections now open) 2016-04-25T18:29:45.078+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41789 #758 (43 connections now open) 2016-04-25T18:29:45.079+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41790 #759 (44 connections now open) 2016-04-25T18:32:03.967+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:41794 #760 (45 connections now open) 2016-04-25T20:16:49.962+0000 I NETWORK [conn759] end connection 127.0.0.1:41790 (44 connections now open) 2016-04-25T20:16:49.999+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42097 #761 (45 connections now open) 2016-04-25T20:16:49.999+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42098 #762 (46 connections now open) 2016-04-25T20:16:50.004+0000 I NETWORK [conn761] end connection 127.0.0.1:42097 (45 connections now open) 2016-04-25T21:54:18.543+0000 I NETWORK [conn762] end connection 127.0.0.1:42098 (44 connections now open) 2016-04-25T21:54:24.544+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42420 #763 (45 connections now open) 2016-04-25T21:54:24.544+0000 I NETWORK [conn763] end connection 127.0.0.1:42420 (44 connections now open) 2016-04-25T21:54:24.545+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42421 #764 (45 connections now open) 2016-04-25T22:21:45.060+0000 I NETWORK [conn764] end connection 127.0.0.1:42421 (44 connections now open) 2016-04-25T22:26:45.061+0000 I NETWORK [conn760] end connection 127.0.0.1:41794 (43 connections now open) 2016-04-25T22:26:45.062+0000 I NETWORK [conn758] end connection 127.0.0.1:41789 (42 connections now open) 2016-04-25T22:53:45.058+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 25 22:52:56:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 25 22:53:45:3) 2016-04-25T22:53:45.058+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-25T22:53:51.060+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-25T22:53:51.061+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-25T22:53:51.062+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-25T22:59:55.081+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-25T23:01:39.209+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 25 23:00:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 25 23:01:39:1) 2016-04-25T23:01:39.209+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-25T23:01:45.210+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-25T23:01:45.211+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-26T00:09:23.069+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-26T00:09:29.071+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-26T00:09:29.071+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-26T00:09:29.080+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-26T00:12:20.656+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-26T01:45:16.771+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 26 01:44:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 26 01:45:16:2) 2016-04-26T01:45:16.772+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-26T01:45:16.788+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-26T01:45:21.790+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-26T01:45:21.792+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-26T02:29:42.465+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43492 #765 (43 connections now open) 2016-04-26T02:29:42.467+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43493 #766 (44 connections now open) 2016-04-26T02:29:42.467+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43494 #767 (45 connections now open) 2016-04-26T02:29:42.467+0000 I NETWORK [conn765] end connection 127.0.0.1:43492 (44 connections now open) 2016-04-26T02:31:02.566+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43502 #768 (45 connections now open) 2016-04-26T02:47:24.800+0000 I NETWORK [conn767] end connection 127.0.0.1:43494 (44 connections now open) 2016-04-26T02:47:25.794+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43580 #769 (45 connections now open) 2016-04-26T02:47:25.795+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43581 #770 (46 connections now open) 2016-04-26T02:47:25.795+0000 I NETWORK [conn769] end connection 127.0.0.1:43580 (45 connections now open) 2016-04-26T03:30:45.043+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 26 03:30:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 26 03:30:45:1) 2016-04-26T03:30:45.043+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-26T03:30:50.047+0000 I NETWORK [conn770] end connection 127.0.0.1:43581 (44 connections now open) 2016-04-26T03:30:51.044+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-26T03:30:51.045+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-26T03:35:50.045+0000 I NETWORK [conn768] end connection 127.0.0.1:43502 (43 connections now open) 2016-04-26T03:35:50.045+0000 I NETWORK [conn766] end connection 127.0.0.1:43493 (42 connections now open) 2016-04-26T03:55:45.077+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43878 #771 (43 connections now open) 2016-04-26T03:55:45.078+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43879 #772 (44 connections now open) 2016-04-26T03:55:45.078+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43880 #773 (45 connections now open) 2016-04-26T03:55:45.078+0000 I NETWORK [conn771] end connection 127.0.0.1:43878 (44 connections now open) 2016-04-26T03:55:49.042+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43884 #774 (45 connections now open) 2016-04-26T04:45:38.011+0000 I NETWORK [conn773] end connection 127.0.0.1:43880 (44 connections now open) 2016-04-26T04:45:48.034+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44057 #775 (45 connections now open) 2016-04-26T04:45:48.034+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44058 #776 (46 connections now open) 2016-04-26T04:45:48.035+0000 I NETWORK [conn775] end connection 127.0.0.1:44057 (45 connections now open) 2016-04-26T04:48:50.064+0000 I NETWORK [conn776] end connection 127.0.0.1:44058 (44 connections now open) 2016-04-26T04:49:26.089+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44073 #777 (45 connections now open) 2016-04-26T04:49:26.090+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44074 #778 (46 connections now open) 2016-04-26T04:49:26.091+0000 I NETWORK [conn777] end connection 127.0.0.1:44073 (45 connections now open) 2016-04-26T05:36:21.712+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 26 05:35:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 26 05:36:21:1) 2016-04-26T05:36:21.712+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-26T05:36:26.710+0000 I NETWORK [conn778] end connection 127.0.0.1:44074 (44 connections now open) 2016-04-26T05:36:27.721+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-26T05:36:27.722+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-26T05:41:21.713+0000 I NETWORK [conn774] end connection 127.0.0.1:43884 (43 connections now open) 2016-04-26T05:41:21.713+0000 I NETWORK [conn772] end connection 127.0.0.1:43879 (42 connections now open) 2016-04-26T06:10:24.272+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44330 #779 (43 connections now open) 2016-04-26T06:10:24.273+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44331 #780 (44 connections now open) 2016-04-26T06:10:24.273+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44332 #781 (45 connections now open) 2016-04-26T06:10:24.273+0000 I NETWORK [conn779] end connection 127.0.0.1:44330 (44 connections now open) 2016-04-26T06:13:09.449+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44336 #782 (45 connections now open) 2016-04-26T06:45:39.943+0000 I NETWORK [conn781] end connection 127.0.0.1:44332 (44 connections now open) 2016-04-26T06:45:40.944+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44519 #783 (45 connections now open) 2016-04-26T06:45:40.947+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44520 #784 (46 connections now open) 2016-04-26T06:45:40.948+0000 I NETWORK [conn783] end connection 127.0.0.1:44519 (45 connections now open) 2016-04-26T06:48:45.054+0000 I NETWORK [conn784] end connection 127.0.0.1:44520 (44 connections now open) 2016-04-26T06:53:45.063+0000 I NETWORK [conn780] end connection 127.0.0.1:44331 (43 connections now open) 2016-04-26T06:53:45.063+0000 I NETWORK [conn782] end connection 127.0.0.1:44336 (42 connections now open) 2016-04-26T07:56:24.285+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44847 #785 (43 connections now open) 2016-04-26T07:56:24.285+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44848 #786 (44 connections now open) 2016-04-26T07:56:24.285+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44849 #787 (45 connections now open) 2016-04-26T07:56:24.285+0000 I NETWORK [conn785] end connection 127.0.0.1:44847 (44 connections now open) 2016-04-26T07:58:00.070+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44853 #788 (45 connections now open) 2016-04-26T08:26:45.760+0000 I NETWORK [conn787] end connection 127.0.0.1:44849 (44 connections now open) 2016-04-26T08:26:45.775+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44994 #789 (45 connections now open) 2016-04-26T08:26:45.776+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:44995 #790 (46 connections now open) 2016-04-26T08:26:45.776+0000 I NETWORK [conn789] end connection 127.0.0.1:44994 (45 connections now open) 2016-04-26T08:43:45.068+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 26 08:43:07:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 26 08:43:45:4) 2016-04-26T08:43:45.069+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-26T08:43:45.070+0000 I NETWORK [conn790] end connection 127.0.0.1:44995 (44 connections now open) 2016-04-26T08:43:46.069+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-26T08:43:46.070+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-26T08:48:45.070+0000 I NETWORK [conn786] end connection 127.0.0.1:44848 (43 connections now open) 2016-04-26T08:48:45.070+0000 I NETWORK [conn788] end connection 127.0.0.1:44853 (42 connections now open) 2016-04-26T09:34:45.034+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 26 09:34:07:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 26 09:34:45:2) 2016-04-26T09:34:45.034+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-26T09:34:45.036+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-26T09:34:45.037+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-26T09:34:57.048+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-26T09:35:45.039+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-26T09:35:50.040+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-26T09:35:50.042+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-26T09:38:05.078+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45424 #791 (43 connections now open) 2016-04-26T09:38:05.078+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45425 #792 (44 connections now open) 2016-04-26T09:38:05.078+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45426 #793 (45 connections now open) 2016-04-26T09:38:05.079+0000 I NETWORK [conn791] end connection 127.0.0.1:45424 (44 connections now open) 2016-04-26T09:41:12.423+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45445 #794 (45 connections now open) 2016-04-26T10:30:45.069+0000 I NETWORK [conn793] end connection 127.0.0.1:45426 (44 connections now open) 2016-04-26T10:32:45.086+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 26 10:32:06:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 26 10:32:45:5) 2016-04-26T10:32:45.087+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-26T10:32:45.088+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-26T10:32:45.088+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-26T10:34:55.961+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-26T10:35:45.068+0000 I NETWORK [conn792] end connection 127.0.0.1:45425 (43 connections now open) 2016-04-26T10:35:45.068+0000 I NETWORK [conn794] end connection 127.0.0.1:45445 (42 connections now open) 2016-04-26T11:09:45.060+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 26 11:09:06:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 26 11:09:45:5) 2016-04-26T11:09:45.060+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-26T11:09:45.061+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-26T11:09:45.062+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-26T11:11:45.072+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-26T11:21:50.025+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46007 #795 (43 connections now open) 2016-04-26T11:21:50.025+0000 I NETWORK [conn795] end connection 127.0.0.1:46007 (42 connections now open) 2016-04-26T11:21:50.025+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46008 #796 (43 connections now open) 2016-04-26T11:21:50.027+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46009 #797 (44 connections now open) 2016-04-26T11:23:45.079+0000 I NETWORK [conn797] end connection 127.0.0.1:46009 (43 connections now open) 2016-04-26T11:24:05.086+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46024 #798 (44 connections now open) 2016-04-26T11:24:05.087+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46025 #799 (45 connections now open) 2016-04-26T11:24:05.087+0000 I NETWORK [conn798] end connection 127.0.0.1:46024 (44 connections now open) 2016-04-26T11:31:00.023+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46054 #800 (45 connections now open) 2016-04-26T12:29:19.517+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 26 12:28:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 26 12:29:19:1) 2016-04-26T12:29:19.517+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-26T12:29:19.519+0000 I NETWORK [conn799] end connection 127.0.0.1:46025 (44 connections now open) 2016-04-26T12:29:24.544+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-26T12:29:24.545+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-26T12:34:19.519+0000 I NETWORK [conn800] end connection 127.0.0.1:46054 (43 connections now open) 2016-04-26T12:34:19.520+0000 I NETWORK [conn796] end connection 127.0.0.1:46008 (42 connections now open) 2016-04-26T12:52:34.966+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46453 #801 (43 connections now open) 2016-04-26T12:52:34.975+0000 I NETWORK [conn801] end connection 127.0.0.1:46453 (42 connections now open) 2016-04-26T12:52:34.975+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46454 #802 (43 connections now open) 2016-04-26T12:52:34.976+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46455 #803 (44 connections now open) 2016-04-26T12:54:13.561+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46467 #804 (45 connections now open) 2016-04-26T13:01:46.182+0000 I NETWORK [conn802] end connection 127.0.0.1:46454 (44 connections now open) 2016-04-26T13:02:01.188+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46501 #805 (45 connections now open) 2016-04-26T13:02:01.189+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46502 #806 (46 connections now open) 2016-04-26T13:02:01.189+0000 I NETWORK [conn805] end connection 127.0.0.1:46501 (45 connections now open) 2016-04-26T13:50:45.051+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 26 13:50:13:1) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 26 13:50:45:1) 2016-04-26T13:50:45.051+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-26T13:50:45.062+0000 I NETWORK [conn806] end connection 127.0.0.1:46502 (44 connections now open) 2016-04-26T13:50:46.051+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-26T13:54:01.083+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46733 #807 (45 connections now open) 2016-04-26T13:54:01.086+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46734 #808 (46 connections now open) 2016-04-26T13:54:01.086+0000 I NETWORK [conn807] end connection 127.0.0.1:46733 (45 connections now open) 2016-04-26T14:30:35.796+0000 I NETWORK [conn808] end connection 127.0.0.1:46734 (44 connections now open) 2016-04-26T14:30:41.798+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46845 #809 (45 connections now open) 2016-04-26T14:30:41.799+0000 I NETWORK [conn809] end connection 127.0.0.1:46845 (44 connections now open) 2016-04-26T14:30:41.801+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46846 #810 (45 connections now open) 2016-04-26T15:32:50.033+0000 I NETWORK [conn810] end connection 127.0.0.1:46846 (44 connections now open) 2016-04-26T15:37:45.052+0000 I NETWORK [conn804] end connection 127.0.0.1:46467 (43 connections now open) 2016-04-26T15:37:45.052+0000 I NETWORK [conn803] end connection 127.0.0.1:46455 (43 connections now open) 2016-04-26T17:26:50.044+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47313 #811 (43 connections now open) 2016-04-26T17:26:50.044+0000 I NETWORK [conn811] end connection 127.0.0.1:47313 (42 connections now open) 2016-04-26T17:26:50.045+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47314 #812 (43 connections now open) 2016-04-26T17:26:50.046+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47315 #813 (44 connections now open) 2016-04-26T17:30:45.061+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47323 #814 (45 connections now open) 2016-04-26T17:39:18.960+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 26 17:38:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 26 17:39:18:1) 2016-04-26T17:39:18.960+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-26T17:39:18.963+0000 I NETWORK [conn813] end connection 127.0.0.1:47315 (44 connections now open) 2016-04-26T17:39:23.978+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-26T17:39:23.979+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-26T17:42:45.027+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 26 17:41:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 26 17:42:45:2) 2016-04-26T17:42:45.027+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-26T17:42:45.044+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-26T17:42:46.027+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-26T17:44:18.963+0000 I NETWORK [conn814] end connection 127.0.0.1:47323 (43 connections now open) 2016-04-26T17:44:18.963+0000 I NETWORK [conn812] end connection 127.0.0.1:47314 (42 connections now open) 2016-04-26T17:45:30.097+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 26 17:44:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 26 17:45:29:1) 2016-04-26T17:45:30.097+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-26T17:45:36.099+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-26T17:45:36.102+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-26T18:11:16.567+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 26 18:10:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 26 18:11:16:1) 2016-04-26T18:11:16.567+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-26T18:11:21.584+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-26T18:11:21.586+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-26T18:11:21.587+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-26T18:21:20.256+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-26T18:40:50.052+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-26T18:40:50.053+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-26T18:40:50.054+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-26T18:49:01.304+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-26T19:12:39.607+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 26 19:11:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 26 19:12:39:3) 2016-04-26T19:12:39.608+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-26T19:12:39.609+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-26T19:12:39.609+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-26T19:12:39.625+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-26T19:12:44.626+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-26T19:12:44.627+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-26T20:05:46.618+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 26 20:04:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 26 20:05:45:5) 2016-04-26T20:05:46.618+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-26T20:05:51.626+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-26T20:05:51.627+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-26T20:05:51.627+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-26T20:08:00.068+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-26T20:25:45.041+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 26 20:24:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 26 20:25:45:2) 2016-04-26T20:25:45.041+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-26T20:25:46.042+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-26T20:25:46.043+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-26T20:25:46.043+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-26T20:26:54.661+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-26T20:27:50.057+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47775 #815 (43 connections now open) 2016-04-26T20:27:50.059+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47776 #816 (44 connections now open) 2016-04-26T20:27:50.059+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47777 #817 (45 connections now open) 2016-04-26T20:27:50.059+0000 I NETWORK [conn815] end connection 127.0.0.1:47775 (44 connections now open) 2016-04-26T20:30:16.148+0000 I NETWORK [conn817] end connection 127.0.0.1:47777 (43 connections now open) 2016-04-26T20:35:16.157+0000 I NETWORK [conn816] end connection 127.0.0.1:47776 (42 connections now open) 2016-04-26T20:37:24.625+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47795 #818 (43 connections now open) 2016-04-26T20:37:24.626+0000 I NETWORK [conn818] end connection 127.0.0.1:47795 (42 connections now open) 2016-04-26T20:37:24.626+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47796 #819 (43 connections now open) 2016-04-26T20:37:24.627+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47797 #820 (44 connections now open) 2016-04-26T20:42:15.083+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47811 #821 (45 connections now open) 2016-04-26T21:45:50.043+0000 I NETWORK [conn820] end connection 127.0.0.1:47797 (44 connections now open) 2016-04-26T21:45:50.047+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47973 #822 (45 connections now open) 2016-04-26T21:45:50.049+0000 I NETWORK [conn822] end connection 127.0.0.1:47973 (44 connections now open) 2016-04-26T21:45:50.050+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47974 #823 (45 connections now open) 2016-04-27T00:20:29.712+0000 I NETWORK [conn823] end connection 127.0.0.1:47974 (44 connections now open) 2016-04-27T00:20:34.740+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48442 #824 (45 connections now open) 2016-04-27T00:20:34.740+0000 I NETWORK [conn824] end connection 127.0.0.1:48442 (44 connections now open) 2016-04-27T00:20:34.743+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48443 #825 (45 connections now open) 2016-04-27T01:19:45.029+0000 I NETWORK [conn825] end connection 127.0.0.1:48443 (44 connections now open) 2016-04-27T01:19:51.030+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48653 #826 (45 connections now open) 2016-04-27T01:19:51.031+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48654 #827 (46 connections now open) 2016-04-27T01:19:51.032+0000 I NETWORK [conn826] end connection 127.0.0.1:48653 (45 connections now open) 2016-04-27T02:54:42.878+0000 I NETWORK [conn827] end connection 127.0.0.1:48654 (44 connections now open) 2016-04-27T02:54:47.882+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48978 #828 (45 connections now open) 2016-04-27T02:54:47.883+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48979 #829 (46 connections now open) 2016-04-27T02:54:47.884+0000 I NETWORK [conn828] end connection 127.0.0.1:48978 (45 connections now open) 2016-04-27T03:01:50.041+0000 I NETWORK [conn829] end connection 127.0.0.1:48979 (44 connections now open) 2016-04-27T03:01:51.043+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49008 #830 (45 connections now open) 2016-04-27T03:01:51.044+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49009 #831 (46 connections now open) 2016-04-27T03:01:51.044+0000 I NETWORK [conn830] end connection 127.0.0.1:49008 (45 connections now open) 2016-04-27T04:16:30.461+0000 I NETWORK [conn831] end connection 127.0.0.1:49009 (44 connections now open) 2016-04-27T04:21:30.462+0000 I NETWORK [conn821] end connection 127.0.0.1:47811 (43 connections now open) 2016-04-27T04:21:30.462+0000 I NETWORK [conn819] end connection 127.0.0.1:47796 (42 connections now open) 2016-04-27T04:24:47.224+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49303 #832 (43 connections now open) 2016-04-27T04:24:47.225+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49304 #833 (44 connections now open) 2016-04-27T04:24:47.225+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49305 #834 (45 connections now open) 2016-04-27T04:24:47.225+0000 I NETWORK [conn832] end connection 127.0.0.1:49303 (44 connections now open) 2016-04-27T04:28:36.435+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49320 #835 (45 connections now open) 2016-04-27T04:34:25.445+0000 I NETWORK [conn834] end connection 127.0.0.1:49305 (44 connections now open) 2016-04-27T04:34:30.447+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49340 #836 (45 connections now open) 2016-04-27T04:34:30.447+0000 I NETWORK [conn836] end connection 127.0.0.1:49340 (44 connections now open) 2016-04-27T04:34:30.450+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49341 #837 (45 connections now open) 2016-04-27T04:49:43.237+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 27 04:48:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 27 04:49:42:1) 2016-04-27T04:49:43.237+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-27T04:49:43.240+0000 I NETWORK [conn837] end connection 127.0.0.1:49341 (44 connections now open) 2016-04-27T04:49:48.259+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-27T04:49:48.268+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-27T04:54:43.240+0000 I NETWORK [conn835] end connection 127.0.0.1:49320 (43 connections now open) 2016-04-27T04:54:43.240+0000 I NETWORK [conn833] end connection 127.0.0.1:49304 (42 connections now open) 2016-04-27T06:31:45.053+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 27 06:31:07:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 27 06:31:45:2) 2016-04-27T06:31:45.060+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-27T06:31:46.060+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-27T06:31:46.062+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-27T06:31:46.063+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-27T06:32:11.030+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-27T06:34:50.065+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-27T06:34:50.068+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-27T08:16:46.069+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50255 #838 (43 connections now open) 2016-04-27T08:16:46.075+0000 I NETWORK [conn838] end connection 127.0.0.1:50255 (42 connections now open) 2016-04-27T08:16:46.077+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50256 #839 (43 connections now open) 2016-04-27T08:16:46.080+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50257 #840 (44 connections now open) 2016-04-27T08:18:09.211+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50270 #841 (45 connections now open) 2016-04-27T08:44:45.061+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 27 08:44:07:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 27 08:44:45:3) 2016-04-27T08:44:45.061+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-27T08:44:45.064+0000 I NETWORK [conn839] end connection 127.0.0.1:50256 (44 connections now open) 2016-04-27T08:44:46.061+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-27T08:44:46.063+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-27T08:49:45.065+0000 I NETWORK [conn841] end connection 127.0.0.1:50270 (43 connections now open) 2016-04-27T08:49:45.066+0000 I NETWORK [conn840] end connection 127.0.0.1:50257 (43 connections now open) 2016-04-27T09:36:45.054+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 27 09:36:03:1) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 27 09:36:45:4) 2016-04-27T09:36:45.054+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-27T09:36:51.055+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-27T09:36:51.056+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-27T11:16:45.046+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 27 11:16:06:1) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 27 11:16:45:2) 2016-04-27T11:16:45.046+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-27T11:16:50.047+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-27T11:16:50.049+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-27T11:16:50.050+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-27T11:17:45.062+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 27 11:17:08:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 27 11:17:45:5) 2016-04-27T11:17:45.063+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-27T11:17:45.064+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-27T12:55:45.074+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 27 12:55:07:4) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 27 12:55:45:1) 2016-04-27T12:55:45.074+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-27T12:55:46.074+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-27T12:56:50.048+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51750 #842 (43 connections now open) 2016-04-27T12:56:50.050+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51751 #843 (44 connections now open) 2016-04-27T12:56:50.050+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51752 #844 (45 connections now open) 2016-04-27T12:56:50.050+0000 I NETWORK [conn842] end connection 127.0.0.1:51750 (44 connections now open) 2016-04-27T13:01:07.330+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51776 #845 (45 connections now open) 2016-04-27T13:24:34.648+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 27 13:23:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 27 13:24:33:2) 2016-04-27T13:24:34.648+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-27T13:24:39.650+0000 I NETWORK [conn844] end connection 127.0.0.1:51752 (44 connections now open) 2016-04-27T13:24:49.651+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-27T13:24:49.652+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-27T13:26:17.805+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 27 13:25:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 27 13:26:17:1) 2016-04-27T13:26:17.811+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-27T13:26:22.815+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-27T13:26:22.816+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-27T13:26:22.817+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-27T13:26:45.074+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-27T13:29:39.650+0000 I NETWORK [conn843] end connection 127.0.0.1:51751 (43 connections now open) 2016-04-27T13:29:39.650+0000 I NETWORK [conn845] end connection 127.0.0.1:51776 (42 connections now open) 2016-04-27T15:37:45.061+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 27 15:36:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 27 15:37:45:5) 2016-04-27T15:37:45.061+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-27T15:37:45.062+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-27T15:37:45.064+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-27T15:38:45.073+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-27T15:43:22.274+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52326 #846 (43 connections now open) 2016-04-27T15:43:22.276+0000 I NETWORK [conn846] end connection 127.0.0.1:52326 (42 connections now open) 2016-04-27T15:43:22.276+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52327 #847 (43 connections now open) 2016-04-27T15:43:22.291+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52328 #848 (44 connections now open) 2016-04-27T15:59:45.067+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52364 #849 (45 connections now open) 2016-04-27T17:11:28.629+0000 I NETWORK [conn46] end connection 127.0.0.1:56379 (44 connections now open) 2016-04-27T17:11:28.629+0000 I NETWORK [conn45] end connection 127.0.0.1:56378 (43 connections now open) 2016-04-27T17:11:28.629+0000 I NETWORK [conn44] end connection 127.0.0.1:56377 (42 connections now open) 2016-04-27T17:11:28.629+0000 I NETWORK [conn43] end connection 127.0.0.1:56376 (41 connections now open) 2016-04-27T17:11:28.629+0000 I NETWORK [conn42] end connection 127.0.0.1:56375 (40 connections now open) 2016-04-27T17:11:28.629+0000 I NETWORK [conn33] end connection 127.0.0.1:56357 (39 connections now open) 2016-04-27T17:11:28.630+0000 I NETWORK [conn23] end connection 127.0.0.1:56342 (38 connections now open) 2016-04-27T17:11:29.438+0000 I NETWORK [conn54] end connection 127.0.0.1:56388 (37 connections now open) 2016-04-27T17:11:29.438+0000 I NETWORK [conn53] end connection 127.0.0.1:56387 (36 connections now open) 2016-04-27T17:11:29.438+0000 I NETWORK [conn52] end connection 127.0.0.1:56386 (35 connections now open) 2016-04-27T17:11:29.439+0000 I NETWORK [conn51] end connection 127.0.0.1:56385 (34 connections now open) 2016-04-27T17:11:29.439+0000 I NETWORK [conn50] end connection 127.0.0.1:56384 (33 connections now open) 2016-04-27T17:11:29.439+0000 I NETWORK [conn30] end connection 127.0.0.1:56354 (32 connections now open) 2016-04-27T17:11:29.439+0000 I NETWORK [conn29] end connection 127.0.0.1:56353 (31 connections now open) 2016-04-27T17:11:30.238+0000 I NETWORK [conn41] end connection 127.0.0.1:56373 (30 connections now open) 2016-04-27T17:11:30.238+0000 I NETWORK [conn40] end connection 127.0.0.1:56372 (29 connections now open) 2016-04-27T17:11:30.238+0000 I NETWORK [conn39] end connection 127.0.0.1:56371 (28 connections now open) 2016-04-27T17:11:30.238+0000 I NETWORK [conn38] end connection 127.0.0.1:56370 (27 connections now open) 2016-04-27T17:11:30.238+0000 I NETWORK [conn37] end connection 127.0.0.1:56368 (26 connections now open) 2016-04-27T17:11:30.239+0000 I NETWORK [conn28] end connection 127.0.0.1:56352 (25 connections now open) 2016-04-27T17:11:30.239+0000 I NETWORK [conn20] end connection 127.0.0.1:56332 (24 connections now open) 2016-04-27T17:11:30.240+0000 I NETWORK [conn744] end connection 127.0.0.1:41566 (23 connections now open) 2016-04-27T17:11:30.240+0000 I NETWORK [conn743] end connection 127.0.0.1:41565 (22 connections now open) 2016-04-27T17:11:31.697+0000 I NETWORK [conn756] end connection 127.0.0.1:41642 (21 connections now open) 2016-04-27T17:11:31.697+0000 I NETWORK [conn755] end connection 127.0.0.1:41637 (20 connections now open) 2016-04-27T17:11:31.698+0000 I NETWORK [conn753] end connection 127.0.0.1:41632 (19 connections now open) 2016-04-27T17:11:31.706+0000 I NETWORK [conn752] end connection 127.0.0.1:41627 (18 connections now open) 2016-04-27T17:11:31.707+0000 I NETWORK [conn750] end connection 127.0.0.1:41622 (17 connections now open) 2016-04-27T17:11:31.707+0000 I NETWORK [conn749] end connection 127.0.0.1:41618 (16 connections now open) 2016-04-27T17:11:31.707+0000 I NETWORK [conn748] end connection 127.0.0.1:41617 (15 connections now open) 2016-04-27T17:11:31.707+0000 I NETWORK [conn747] end connection 127.0.0.1:41616 (14 connections now open) 2016-04-27T17:11:31.707+0000 I NETWORK [conn746] end connection 127.0.0.1:41615 (13 connections now open) 2016-04-27T17:11:31.707+0000 I NETWORK [conn745] end connection 127.0.0.1:41614 (12 connections now open) 2016-04-27T17:11:32.478+0000 I NETWORK [conn32] end connection 127.0.0.1:56356 (11 connections now open) 2016-04-27T17:11:32.478+0000 I NETWORK [conn31] end connection 127.0.0.1:56355 (10 connections now open) 2016-04-27T17:11:32.478+0000 I NETWORK [conn26] end connection 127.0.0.1:56346 (10 connections now open) 2016-04-27T17:11:32.478+0000 I NETWORK [conn25] end connection 127.0.0.1:56345 (9 connections now open) 2016-04-27T17:11:32.479+0000 I NETWORK [conn24] end connection 127.0.0.1:56344 (8 connections now open) 2016-04-27T17:11:32.479+0000 I NETWORK [conn22] end connection 127.0.0.1:56341 (7 connections now open) 2016-04-27T17:11:32.479+0000 I NETWORK [conn21] end connection 127.0.0.1:56340 (6 connections now open) 2016-04-27T17:12:09.468+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52587 #850 (6 connections now open) 2016-04-27T17:12:09.468+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52588 #851 (7 connections now open) 2016-04-27T17:12:09.468+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52589 #852 (8 connections now open) 2016-04-27T17:12:09.476+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52590 #853 (9 connections now open) 2016-04-27T17:12:09.476+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52591 #854 (10 connections now open) 2016-04-27T17:12:09.638+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52595 #855 (11 connections now open) 2016-04-27T17:12:09.638+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52597 #856 (12 connections now open) 2016-04-27T17:12:09.695+0000 I NETWORK [conn856] end connection 127.0.0.1:52597 (11 connections now open) 2016-04-27T17:12:09.803+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52600 #857 (12 connections now open) 2016-04-27T17:12:09.873+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52605 #858 (13 connections now open) 2016-04-27T17:12:12.369+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52617 #859 (14 connections now open) 2016-04-27T17:12:12.371+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52618 #860 (15 connections now open) 2016-04-27T17:12:12.372+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52619 #861 (16 connections now open) 2016-04-27T17:12:12.373+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52620 #862 (17 connections now open) 2016-04-27T17:12:12.374+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52621 #863 (18 connections now open) 2016-04-27T17:12:12.517+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52625 #864 (19 connections now open) 2016-04-27T17:12:12.519+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52627 #865 (20 connections now open) 2016-04-27T17:12:12.607+0000 I NETWORK [conn865] end connection 127.0.0.1:52627 (19 connections now open) 2016-04-27T17:12:12.663+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52630 #866 (20 connections now open) 2016-04-27T17:12:12.782+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52635 #867 (21 connections now open) 2016-04-27T17:12:14.809+0000 I ACCESS [conn857] Successfully authenticated as principal oplogger on admin 2016-04-27T17:12:14.948+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52647 #868 (22 connections now open) 2016-04-27T17:12:14.948+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52648 #869 (23 connections now open) 2016-04-27T17:12:14.948+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52649 #870 (24 connections now open) 2016-04-27T17:12:14.948+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52650 #871 (25 connections now open) 2016-04-27T17:12:14.957+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52651 #872 (26 connections now open) 2016-04-27T17:12:15.185+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52655 #873 (27 connections now open) 2016-04-27T17:12:15.185+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52657 #874 (28 connections now open) 2016-04-27T17:12:15.214+0000 I NETWORK [conn874] end connection 127.0.0.1:52657 (27 connections now open) 2016-04-27T17:12:15.317+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52660 #875 (28 connections now open) 2016-04-27T17:12:15.470+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52665 #876 (29 connections now open) 2016-04-27T17:12:17.614+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52667 #877 (30 connections now open) 2016-04-27T17:12:17.650+0000 I NETWORK [conn877] end connection 127.0.0.1:52667 (29 connections now open) 2016-04-27T17:12:17.697+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52670 #878 (30 connections now open) 2016-04-27T17:12:19.748+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52683 #879 (31 connections now open) 2016-04-27T17:12:19.748+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52684 #880 (32 connections now open) 2016-04-27T17:12:19.762+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52685 #881 (33 connections now open) 2016-04-27T17:12:19.762+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52686 #882 (34 connections now open) 2016-04-27T17:12:19.762+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52687 #883 (35 connections now open) 2016-04-27T17:12:19.848+0000 I ACCESS [conn866] Successfully authenticated as principal oplogger on admin 2016-04-27T17:12:19.848+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52691 #884 (36 connections now open) 2016-04-27T17:12:19.931+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52693 #885 (37 connections now open) 2016-04-27T17:12:19.931+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52698 #886 (38 connections now open) 2016-04-27T17:12:19.931+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52700 #887 (39 connections now open) 2016-04-27T17:12:19.935+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52703 #888 (40 connections now open) 2016-04-27T17:12:19.935+0000 I NETWORK [conn885] end connection 127.0.0.1:52693 (39 connections now open) 2016-04-27T17:12:19.971+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52708 #889 (40 connections now open) 2016-04-27T17:12:19.991+0000 I NETWORK [conn887] end connection 127.0.0.1:52700 (39 connections now open) 2016-04-27T17:12:20.049+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52710 #890 (40 connections now open) 2016-04-27T17:12:20.164+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52715 #891 (41 connections now open) 2016-04-27T17:12:22.926+0000 I ACCESS [conn875] Successfully authenticated as principal oplogger on admin 2016-04-27T17:12:22.982+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52717 #892 (42 connections now open) 2016-04-27T17:12:23.010+0000 I NETWORK [conn892] end connection 127.0.0.1:52717 (41 connections now open) 2016-04-27T17:12:23.102+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52720 #893 (42 connections now open) 2016-04-27T17:12:23.125+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52725 #894 (43 connections now open) 2016-04-27T17:12:23.395+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52737 #895 (44 connections now open) 2016-04-27T17:12:23.426+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52738 #896 (45 connections now open) 2016-04-27T17:12:23.426+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52739 #897 (46 connections now open) 2016-04-27T17:12:23.426+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52740 #898 (47 connections now open) 2016-04-27T17:12:23.426+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52741 #899 (48 connections now open) 2016-04-27T17:12:23.591+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52745 #900 (49 connections now open) 2016-04-27T17:12:23.591+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52747 #901 (50 connections now open) 2016-04-27T17:12:23.593+0000 I NETWORK [conn901] end connection 127.0.0.1:52747 (49 connections now open) 2016-04-27T17:12:23.695+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52750 #902 (50 connections now open) 2016-04-27T17:12:23.878+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52755 #903 (51 connections now open) 2016-04-27T17:12:24.120+0000 I ACCESS [conn878] Successfully authenticated as principal oplogger on admin 2016-04-27T17:12:24.610+0000 I ACCESS [conn888] Successfully authenticated as principal oplogger on admin 2016-04-27T17:12:25.584+0000 I ACCESS [conn893] Successfully authenticated as principal oplogger on admin 2016-04-27T17:12:26.280+0000 I ACCESS [conn902] Successfully authenticated as principal oplogger on admin 2016-04-27T17:12:27.110+0000 I ACCESS [conn890] Successfully authenticated as principal oplogger on admin 2016-04-27T17:12:27.166+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52757 #904 (52 connections now open) 2016-04-27T17:12:27.177+0000 I NETWORK [conn904] end connection 127.0.0.1:52757 (51 connections now open) 2016-04-27T17:12:27.195+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52760 #905 (52 connections now open) 2016-04-27T17:12:29.383+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52765 #906 (53 connections now open) 2016-04-27T17:12:31.462+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52767 #907 (54 connections now open) 2016-04-27T17:12:31.463+0000 I NETWORK [conn907] end connection 127.0.0.1:52767 (53 connections now open) 2016-04-27T17:12:31.488+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52770 #908 (54 connections now open) 2016-04-27T17:12:33.689+0000 I ACCESS [conn905] Successfully authenticated as principal oplogger on admin 2016-04-27T17:12:33.767+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52777 #909 (55 connections now open) 2016-04-27T17:12:37.536+0000 I ACCESS [conn908] Successfully authenticated as principal oplogger on admin 2016-04-27T18:24:16.526+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 27 18:23:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 27 18:24:16:1) 2016-04-27T18:24:16.526+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-27T18:24:21.525+0000 I NETWORK [conn848] end connection 127.0.0.1:52328 (54 connections now open) 2016-04-27T18:24:21.528+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-27T18:24:21.530+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-27T18:29:16.528+0000 I NETWORK [conn849] end connection 127.0.0.1:52364 (53 connections now open) 2016-04-27T18:29:16.528+0000 I NETWORK [conn847] end connection 127.0.0.1:52327 (53 connections now open) 2016-04-27T18:50:45.038+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 27 18:50:07:1) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 27 18:50:45:2) 2016-04-27T18:50:45.038+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-27T18:50:45.040+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-27T18:50:45.040+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-27T18:51:45.053+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 27 18:51:09:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 27 18:51:45:5) 2016-04-27T18:51:45.053+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-27T18:51:45.055+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-27T18:52:45.069+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-27T18:52:45.070+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-27T19:49:45.079+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 27 19:49:11:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 27 19:49:45:4) 2016-04-27T19:49:45.079+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-27T19:49:51.076+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53220 #910 (53 connections now open) 2016-04-27T19:49:51.077+0000 I NETWORK [conn910] end connection 127.0.0.1:53220 (52 connections now open) 2016-04-27T19:49:51.077+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53221 #911 (53 connections now open) 2016-04-27T19:49:51.077+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53222 #912 (54 connections now open) 2016-04-27T19:49:56.079+0000 I NETWORK [conn912] end connection 127.0.0.1:53222 (53 connections now open) 2016-04-27T19:50:45.096+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-27T19:50:45.097+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-27T19:50:46.094+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53225 #913 (54 connections now open) 2016-04-27T19:50:46.095+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53226 #914 (55 connections now open) 2016-04-27T19:50:46.096+0000 I NETWORK [conn913] end connection 127.0.0.1:53225 (54 connections now open) 2016-04-27T19:52:28.286+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53231 #915 (55 connections now open) 2016-04-27T20:14:44.687+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 27 20:13:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 27 20:14:44:2) 2016-04-27T20:14:44.687+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-27T20:14:49.687+0000 I NETWORK [conn914] end connection 127.0.0.1:53226 (54 connections now open) 2016-04-27T20:14:49.689+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-27T20:14:49.689+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-27T20:14:50.693+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53277 #916 (55 connections now open) 2016-04-27T20:14:50.694+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53278 #917 (56 connections now open) 2016-04-27T20:14:50.695+0000 I NETWORK [conn916] end connection 127.0.0.1:53277 (55 connections now open) 2016-04-27T20:20:32.370+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 27 20:19:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 27 20:20:31:2) 2016-04-27T20:20:32.371+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-27T20:20:37.372+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-27T20:20:37.384+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-27T20:20:37.387+0000 I NETWORK [conn917] end connection 127.0.0.1:53278 (54 connections now open) 2016-04-27T20:23:36.126+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 27 20:22:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 27 20:23:34:2) 2016-04-27T20:23:36.126+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-27T20:23:41.127+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-27T20:23:41.128+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-27T20:25:37.372+0000 I NETWORK [conn911] end connection 127.0.0.1:53221 (53 connections now open) 2016-04-27T20:25:37.372+0000 I NETWORK [conn915] end connection 127.0.0.1:53231 (53 connections now open) 2016-04-27T20:34:25.827+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 27 20:33:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 27 20:34:25:1) 2016-04-27T20:34:25.827+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-27T20:34:30.106+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53332 #918 (53 connections now open) 2016-04-27T20:34:30.107+0000 I NETWORK [conn918] end connection 127.0.0.1:53332 (52 connections now open) 2016-04-27T20:34:30.107+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53333 #919 (53 connections now open) 2016-04-27T20:34:30.112+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53335 #920 (54 connections now open) 2016-04-27T20:34:30.114+0000 I NETWORK [conn920] end connection 127.0.0.1:53335 (53 connections now open) 2016-04-27T20:34:30.828+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-27T20:34:30.829+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-27T20:34:30.830+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-27T20:37:33.221+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-27T20:39:30.112+0000 I NETWORK [conn919] end connection 127.0.0.1:53333 (52 connections now open) 2016-04-27T22:12:45.044+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-27T22:12:46.057+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-27T22:12:46.058+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-27T22:12:46.060+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-27T22:12:51.045+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53652 #921 (53 connections now open) 2016-04-27T22:12:51.047+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53653 #922 (54 connections now open) 2016-04-27T22:12:51.047+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53654 #923 (55 connections now open) 2016-04-27T22:12:51.047+0000 I NETWORK [conn921] end connection 127.0.0.1:53652 (54 connections now open) 2016-04-27T22:14:38.723+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-27T22:17:45.078+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53670 #924 (55 connections now open) 2016-04-27T23:39:25.716+0000 I NETWORK [conn923] end connection 127.0.0.1:53654 (54 connections now open) 2016-04-27T23:39:26.725+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53972 #925 (55 connections now open) 2016-04-27T23:39:26.728+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53973 #926 (56 connections now open) 2016-04-27T23:39:26.728+0000 I NETWORK [conn925] end connection 127.0.0.1:53972 (55 connections now open) 2016-04-27T23:51:45.039+0000 I NETWORK [conn926] end connection 127.0.0.1:53973 (54 connections now open) 2016-04-27T23:51:46.038+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54032 #927 (55 connections now open) 2016-04-27T23:51:46.039+0000 I NETWORK [conn927] end connection 127.0.0.1:54032 (54 connections now open) 2016-04-27T23:51:46.040+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54033 #928 (55 connections now open) 2016-04-28T01:05:37.570+0000 I NETWORK [conn928] end connection 127.0.0.1:54033 (54 connections now open) 2016-04-28T01:05:42.579+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54314 #929 (55 connections now open) 2016-04-28T01:05:42.580+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54315 #930 (56 connections now open) 2016-04-28T01:05:42.580+0000 I NETWORK [conn929] end connection 127.0.0.1:54314 (55 connections now open) 2016-04-28T02:09:21.848+0000 I NETWORK [conn930] end connection 127.0.0.1:54315 (54 connections now open) 2016-04-28T02:09:21.854+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54531 #931 (55 connections now open) 2016-04-28T02:09:21.855+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54532 #932 (56 connections now open) 2016-04-28T02:09:21.857+0000 I NETWORK [conn931] end connection 127.0.0.1:54531 (55 connections now open) 2016-04-28T02:19:50.032+0000 I NETWORK [conn932] end connection 127.0.0.1:54532 (54 connections now open) 2016-04-28T02:19:50.035+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54567 #933 (55 connections now open) 2016-04-28T02:19:50.036+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54568 #934 (56 connections now open) 2016-04-28T02:19:50.037+0000 I NETWORK [conn933] end connection 127.0.0.1:54567 (55 connections now open) 2016-04-28T03:55:45.029+0000 I NETWORK [conn934] end connection 127.0.0.1:54568 (54 connections now open) 2016-04-28T03:55:45.073+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 28 03:55:08:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 28 03:55:45:1) 2016-04-28T03:55:45.073+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-28T03:55:50.034+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54881 #935 (55 connections now open) 2016-04-28T03:55:50.035+0000 I NETWORK [conn935] end connection 127.0.0.1:54881 (54 connections now open) 2016-04-28T03:55:50.036+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54882 #936 (55 connections now open) 2016-04-28T03:55:50.044+0000 I NETWORK [conn936] end connection 127.0.0.1:54882 (54 connections now open) 2016-04-28T03:56:45.101+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-28T03:56:45.101+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-28T03:56:45.102+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-28T03:59:09.128+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-28T04:00:50.038+0000 I NETWORK [conn922] end connection 127.0.0.1:53653 (53 connections now open) 2016-04-28T04:00:50.038+0000 I NETWORK [conn924] end connection 127.0.0.1:53670 (52 connections now open) 2016-04-28T04:04:32.204+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-28T04:04:37.207+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-28T04:04:37.210+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-28T04:04:37.211+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-28T04:07:00.074+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-28T04:21:45.859+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 28 04:20:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 28 04:21:45:5) 2016-04-28T04:21:45.859+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-28T04:21:50.864+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-28T04:21:50.865+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-28T04:21:50.865+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-28T04:24:00.106+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-28T05:11:45.066+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 28 05:11:09:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 28 05:11:45:3) 2016-04-28T05:11:45.066+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-28T05:11:51.071+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-28T05:11:51.072+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-28T05:41:38.568+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-28T05:41:38.571+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-28T05:41:38.572+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-28T05:44:00.691+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-28T09:18:45.074+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 28 09:18:09:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 28 09:18:45:2) 2016-04-28T09:18:45.080+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-28T09:18:45.089+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-28T09:19:05.112+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-28T09:19:05.123+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-28T09:19:05.123+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-28T09:22:13.550+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-28T10:35:45.066+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-28T10:36:00.076+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-28T10:36:00.085+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-28T10:36:00.085+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-28T10:36:45.079+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 28 10:36:00:1) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 28 10:36:45:5) 2016-04-28T10:36:45.079+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-28T10:37:00.087+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-28T10:37:00.088+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-28T10:47:09.568+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-28T11:28:21.247+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56739 #937 (53 connections now open) 2016-04-28T11:28:21.247+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56740 #938 (54 connections now open) 2016-04-28T11:28:21.247+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56741 #939 (55 connections now open) 2016-04-28T11:28:21.248+0000 I NETWORK [conn937] end connection 127.0.0.1:56739 (54 connections now open) 2016-04-28T11:31:08.666+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:56754 #940 (55 connections now open) 2016-04-28T12:00:45.059+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 28 12:00:13:3) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 28 12:00:45:1) 2016-04-28T12:00:45.060+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-28T12:00:45.062+0000 I NETWORK [conn939] end connection 127.0.0.1:56741 (54 connections now open) 2016-04-28T12:00:46.060+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-28T12:00:46.061+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-28T12:05:45.062+0000 I NETWORK [conn938] end connection 127.0.0.1:56740 (53 connections now open) 2016-04-28T12:05:45.062+0000 I NETWORK [conn940] end connection 127.0.0.1:56754 (52 connections now open) 2016-04-28T12:39:25.055+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 28 12:38:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 28 12:39:24:1) 2016-04-28T12:39:25.056+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-28T12:39:30.062+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-28T12:39:30.063+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-28T13:48:38.928+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 28 13:47:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 28 13:48:38:1) 2016-04-28T13:48:38.928+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-28T13:48:43.930+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-28T13:48:43.932+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-28T13:48:43.932+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-28T13:52:06.315+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-28T15:35:35.616+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 28 15:34:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 28 15:35:35:1) 2016-04-28T15:35:35.616+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-28T15:35:40.620+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-28T15:35:40.621+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-28T16:13:28.323+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-28T16:13:33.343+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-28T16:13:33.344+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-28T16:13:33.344+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-28T16:22:45.830+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-28T16:44:45.041+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57917 #941 (53 connections now open) 2016-04-28T16:44:45.042+0000 I NETWORK [conn941] end connection 127.0.0.1:57917 (52 connections now open) 2016-04-28T16:44:45.042+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57918 #942 (53 connections now open) 2016-04-28T16:44:45.044+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57919 #943 (54 connections now open) 2016-04-28T16:45:45.056+0000 I NETWORK [conn943] end connection 127.0.0.1:57919 (53 connections now open) 2016-04-28T16:50:45.056+0000 I NETWORK [conn942] end connection 127.0.0.1:57918 (52 connections now open) 2016-04-28T17:39:30.206+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 28 17:38:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 28 17:39:29:2) 2016-04-28T17:39:30.206+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-28T17:39:35.209+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-28T17:39:35.209+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-28T18:03:34.708+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 28 18:02:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 28 18:03:34:1) 2016-04-28T18:03:34.708+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-28T18:03:35.709+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-28T18:03:40.697+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58121 #944 (53 connections now open) 2016-04-28T18:03:40.698+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58122 #945 (54 connections now open) 2016-04-28T18:03:40.698+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58123 #946 (55 connections now open) 2016-04-28T18:03:40.698+0000 I NETWORK [conn944] end connection 127.0.0.1:58121 (54 connections now open) 2016-04-28T18:05:25.006+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58127 #947 (55 connections now open) 2016-04-28T20:52:45.049+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 28 20:51:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 28 20:52:45:2) 2016-04-28T20:52:45.050+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-28T20:52:46.051+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-28T20:52:46.052+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-28T22:02:45.033+0000 I NETWORK [conn946] end connection 127.0.0.1:58123 (54 connections now open) 2016-04-28T22:02:50.034+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58700 #948 (55 connections now open) 2016-04-28T22:02:50.036+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58701 #949 (56 connections now open) 2016-04-28T22:02:50.036+0000 I NETWORK [conn948] end connection 127.0.0.1:58700 (55 connections now open) 2016-04-28T22:12:27.401+0000 I NETWORK [conn949] end connection 127.0.0.1:58701 (54 connections now open) 2016-04-28T22:12:27.403+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58730 #950 (55 connections now open) 2016-04-28T22:12:27.403+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58731 #951 (56 connections now open) 2016-04-28T22:12:27.404+0000 I NETWORK [conn950] end connection 127.0.0.1:58730 (55 connections now open) 2016-04-28T22:14:23.285+0000 I NETWORK [conn951] end connection 127.0.0.1:58731 (54 connections now open) 2016-04-28T22:19:22.284+0000 I NETWORK [conn947] end connection 127.0.0.1:58127 (53 connections now open) 2016-04-28T22:19:22.284+0000 I NETWORK [conn945] end connection 127.0.0.1:58122 (52 connections now open) 2016-04-28T22:20:29.684+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 28 22:19:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 28 22:20:29:1) 2016-04-28T22:20:29.684+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-28T22:20:35.685+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-28T22:20:35.686+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-28T23:28:45.076+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 28 23:28:09:1) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 28 23:28:45:5) 2016-04-28T23:28:45.077+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-28T23:29:10.094+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-28T23:29:10.096+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-28T23:29:10.097+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-28T23:29:10.127+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-28T23:35:45.042+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-28T23:35:50.044+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-28T23:35:50.046+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-29T00:25:22.295+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 29 00:24:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 29 00:25:22:1) 2016-04-29T00:25:22.295+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-29T00:25:27.301+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-29T00:25:27.303+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-29T00:54:45.033+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 29 00:53:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 29 00:54:45:2) 2016-04-29T00:54:45.033+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-29T00:54:50.035+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-29T00:54:50.036+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-29T02:44:19.895+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 29 02:43:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 29 02:44:19:1) 2016-04-29T02:44:19.895+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-29T02:44:49.907+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-29T02:44:49.907+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-29T02:48:45.019+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 29 02:48:08:2) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 29 02:48:45:1) 2016-04-29T02:48:45.019+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-29T02:48:46.022+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-29T02:48:46.026+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-29T02:48:46.026+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-29T02:54:02.796+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-29T04:36:45.047+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 29 04:35:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 29 04:36:45:1) 2016-04-29T04:36:45.047+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-29T04:36:45.050+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-29T04:36:51.048+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-29T04:36:51.049+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-29T04:36:51.049+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-29T04:37:45.084+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-29T09:07:22.438+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 29 09:06:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 29 09:07:22:2) 2016-04-29T09:07:22.438+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-29T09:07:28.439+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-29T09:07:28.442+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-29T09:44:45.080+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-29T09:45:05.083+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-29T09:45:05.084+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-29T09:45:05.085+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-29T09:45:06.104+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33256 #952 (53 connections now open) 2016-04-29T09:45:06.105+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33257 #953 (54 connections now open) 2016-04-29T09:45:06.105+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33258 #954 (55 connections now open) 2016-04-29T09:45:06.105+0000 I NETWORK [conn952] end connection 127.0.0.1:33256 (54 connections now open) 2016-04-29T09:51:02.055+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-29T09:56:09.958+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33313 #955 (55 connections now open) 2016-04-29T10:37:46.048+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33527 #956 (56 connections now open) 2016-04-29T10:37:46.048+0000 I NETWORK [conn956] end connection 127.0.0.1:33527 (55 connections now open) 2016-04-29T11:33:45.047+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 29 11:33:01:1) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 29 11:33:45:1) 2016-04-29T11:33:45.047+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-29T11:33:50.063+0000 I NETWORK [conn954] end connection 127.0.0.1:33258 (54 connections now open) 2016-04-29T11:34:01.054+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-29T11:34:01.055+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-29T11:38:50.062+0000 I NETWORK [conn953] end connection 127.0.0.1:33257 (53 connections now open) 2016-04-29T11:38:50.062+0000 I NETWORK [conn955] end connection 127.0.0.1:33313 (52 connections now open) 2016-04-29T13:27:17.107+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 29 13:26:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 29 13:27:16:1) 2016-04-29T13:27:17.107+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-29T13:27:22.113+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-29T13:27:22.113+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-29T13:27:22.114+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-29T13:29:00.049+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-29T13:30:24.185+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 29 13:29:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 29 13:30:24:1) 2016-04-29T13:30:24.185+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-29T13:30:29.195+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-29T13:30:29.196+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-29T13:40:45.061+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-29T13:40:46.063+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-29T13:40:46.063+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-29T13:40:46.064+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-29T13:41:01.141+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-29T13:59:42.369+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 29 13:58:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 29 13:59:41:2) 2016-04-29T13:59:42.369+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-29T13:59:47.370+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-29T13:59:47.370+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-29T13:59:47.372+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-29T14:01:46.192+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 29 14:00:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 29 14:01:45:5) 2016-04-29T14:01:46.193+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-29T14:01:52.195+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-29T14:01:52.196+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-29T14:15:50.582+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-29T14:48:45.040+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 29 14:48:01:1) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 29 14:48:45:1) 2016-04-29T14:48:45.041+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-29T14:48:51.042+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-29T14:48:51.043+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-29T14:53:23.147+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 29 14:52:45:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 29 14:53:23:1) 2016-04-29T14:53:23.147+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-29T14:53:23.192+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-29T14:53:28.148+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-29T14:53:28.151+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-29T14:53:28.152+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-29T14:53:29.192+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34624 #957 (53 connections now open) 2016-04-29T14:53:29.193+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34625 #958 (54 connections now open) 2016-04-29T14:53:29.193+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34626 #959 (55 connections now open) 2016-04-29T14:53:29.193+0000 I NETWORK [conn957] end connection 127.0.0.1:34624 (54 connections now open) 2016-04-29T14:54:02.434+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-29T15:06:16.846+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34666 #960 (55 connections now open) 2016-04-29T15:09:31.133+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 29 15:08:45:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 29 15:09:29:2) 2016-04-29T15:09:31.133+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-29T15:09:36.135+0000 I NETWORK [conn959] end connection 127.0.0.1:34626 (54 connections now open) 2016-04-29T15:09:37.135+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-29T15:09:37.136+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-29T15:14:36.135+0000 I NETWORK [conn960] end connection 127.0.0.1:34666 (53 connections now open) 2016-04-29T15:14:36.135+0000 I NETWORK [conn958] end connection 127.0.0.1:34625 (52 connections now open) 2016-04-29T16:46:45.086+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34915 #961 (53 connections now open) 2016-04-29T16:46:45.086+0000 I NETWORK [conn961] end connection 127.0.0.1:34915 (52 connections now open) 2016-04-29T16:46:45.086+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34916 #962 (53 connections now open) 2016-04-29T16:46:45.090+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34917 #963 (54 connections now open) 2016-04-29T17:17:45.087+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34960 #964 (55 connections now open) 2016-04-29T17:26:45.036+0000 I NETWORK [conn963] end connection 127.0.0.1:34917 (54 connections now open) 2016-04-29T17:27:46.062+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34994 #965 (55 connections now open) 2016-04-29T17:27:46.063+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34995 #966 (56 connections now open) 2016-04-29T17:27:46.063+0000 I NETWORK [conn965] end connection 127.0.0.1:34994 (55 connections now open) 2016-04-29T21:39:43.764+0000 I NETWORK [conn884] end connection 127.0.0.1:52691 (54 connections now open) 2016-04-29T21:39:43.773+0000 I NETWORK [conn878] end connection 127.0.0.1:52670 (53 connections now open) 2016-04-29T21:39:43.773+0000 I NETWORK [conn858] end connection 127.0.0.1:52605 (52 connections now open) 2016-04-29T21:39:43.773+0000 I NETWORK [conn857] end connection 127.0.0.1:52600 (51 connections now open) 2016-04-29T21:39:43.773+0000 I NETWORK [conn855] end connection 127.0.0.1:52595 (50 connections now open) 2016-04-29T21:39:43.774+0000 I NETWORK [conn854] end connection 127.0.0.1:52591 (49 connections now open) 2016-04-29T21:39:43.774+0000 I NETWORK [conn853] end connection 127.0.0.1:52590 (48 connections now open) 2016-04-29T21:39:43.774+0000 I NETWORK [conn852] end connection 127.0.0.1:52589 (47 connections now open) 2016-04-29T21:39:43.774+0000 I NETWORK [conn851] end connection 127.0.0.1:52588 (46 connections now open) 2016-04-29T21:39:43.775+0000 I NETWORK [conn850] end connection 127.0.0.1:52587 (45 connections now open) 2016-04-29T21:39:44.635+0000 I NETWORK [conn889] end connection 127.0.0.1:52708 (44 connections now open) 2016-04-29T21:39:44.636+0000 I NETWORK [conn888] end connection 127.0.0.1:52703 (43 connections now open) 2016-04-29T21:39:44.636+0000 I NETWORK [conn867] end connection 127.0.0.1:52635 (42 connections now open) 2016-04-29T21:39:44.636+0000 I NETWORK [conn866] end connection 127.0.0.1:52630 (41 connections now open) 2016-04-29T21:39:44.644+0000 I NETWORK [conn863] end connection 127.0.0.1:52621 (40 connections now open) 2016-04-29T21:39:44.644+0000 I NETWORK [conn862] end connection 127.0.0.1:52620 (39 connections now open) 2016-04-29T21:39:44.644+0000 I NETWORK [conn861] end connection 127.0.0.1:52619 (38 connections now open) 2016-04-29T21:39:44.644+0000 I NETWORK [conn860] end connection 127.0.0.1:52618 (37 connections now open) 2016-04-29T21:39:44.644+0000 I NETWORK [conn859] end connection 127.0.0.1:52617 (37 connections now open) 2016-04-29T21:39:44.644+0000 I NETWORK [conn864] end connection 127.0.0.1:52625 (35 connections now open) 2016-04-29T21:39:45.572+0000 I NETWORK [conn894] end connection 127.0.0.1:52725 (34 connections now open) 2016-04-29T21:39:45.577+0000 I NETWORK [conn893] end connection 127.0.0.1:52720 (33 connections now open) 2016-04-29T21:39:45.577+0000 I NETWORK [conn876] end connection 127.0.0.1:52665 (32 connections now open) 2016-04-29T21:39:45.577+0000 I NETWORK [conn875] end connection 127.0.0.1:52660 (31 connections now open) 2016-04-29T21:39:45.578+0000 I NETWORK [conn873] end connection 127.0.0.1:52655 (30 connections now open) 2016-04-29T21:39:45.578+0000 I NETWORK [conn872] end connection 127.0.0.1:52651 (29 connections now open) 2016-04-29T21:39:45.578+0000 I NETWORK [conn871] end connection 127.0.0.1:52650 (28 connections now open) 2016-04-29T21:39:45.578+0000 I NETWORK [conn870] end connection 127.0.0.1:52649 (27 connections now open) 2016-04-29T21:39:45.578+0000 I NETWORK [conn869] end connection 127.0.0.1:52648 (26 connections now open) 2016-04-29T21:39:45.578+0000 I NETWORK [conn868] end connection 127.0.0.1:52647 (25 connections now open) 2016-04-29T21:39:46.462+0000 I NETWORK [conn906] end connection 127.0.0.1:52765 (24 connections now open) 2016-04-29T21:39:46.463+0000 I NETWORK [conn905] end connection 127.0.0.1:52760 (23 connections now open) 2016-04-29T21:39:46.463+0000 I NETWORK [conn891] end connection 127.0.0.1:52715 (22 connections now open) 2016-04-29T21:39:46.464+0000 I NETWORK [conn890] end connection 127.0.0.1:52710 (21 connections now open) 2016-04-29T21:39:46.464+0000 I NETWORK [conn886] end connection 127.0.0.1:52698 (20 connections now open) 2016-04-29T21:39:46.465+0000 I NETWORK [conn883] end connection 127.0.0.1:52687 (19 connections now open) 2016-04-29T21:39:46.465+0000 I NETWORK [conn882] end connection 127.0.0.1:52686 (18 connections now open) 2016-04-29T21:39:46.465+0000 I NETWORK [conn881] end connection 127.0.0.1:52685 (17 connections now open) 2016-04-29T21:39:46.465+0000 I NETWORK [conn880] end connection 127.0.0.1:52684 (16 connections now open) 2016-04-29T21:39:46.465+0000 I NETWORK [conn879] end connection 127.0.0.1:52683 (15 connections now open) 2016-04-29T21:39:47.317+0000 I NETWORK [conn909] end connection 127.0.0.1:52777 (14 connections now open) 2016-04-29T21:39:47.318+0000 I NETWORK [conn908] end connection 127.0.0.1:52770 (13 connections now open) 2016-04-29T21:39:47.318+0000 I NETWORK [conn903] end connection 127.0.0.1:52755 (12 connections now open) 2016-04-29T21:39:47.319+0000 I NETWORK [conn902] end connection 127.0.0.1:52750 (11 connections now open) 2016-04-29T21:39:47.319+0000 I NETWORK [conn900] end connection 127.0.0.1:52745 (11 connections now open) 2016-04-29T21:39:47.320+0000 I NETWORK [conn899] end connection 127.0.0.1:52741 (10 connections now open) 2016-04-29T21:39:47.320+0000 I NETWORK [conn898] end connection 127.0.0.1:52740 (9 connections now open) 2016-04-29T21:39:47.320+0000 I NETWORK [conn897] end connection 127.0.0.1:52739 (8 connections now open) 2016-04-29T21:39:47.320+0000 I NETWORK [conn896] end connection 127.0.0.1:52738 (7 connections now open) 2016-04-29T21:39:47.320+0000 I NETWORK [conn895] end connection 127.0.0.1:52737 (6 connections now open) 2016-04-29T21:43:48.714+0000 I COMMAND [repl writer worker 12] CMD: drop sherpa.notifications 2016-04-29T21:43:48.762+0000 I COMMAND [repl writer worker 5] CMD: drop sherpa.olog 2016-04-29T21:44:00.016+0000 I COMMAND [conn964] command local.oplog.rs command: getMore { getMore: 14615949196, collection: "oplog.rs", maxTimeMS: 5000, term: 45, lastKnownCommittedOpTime: { ts: Timestamp 1461966239000|449, t: 45 } } cursorid:14615949196 keyUpdates:0 writeConflicts:0 numYields:17 nreturned:2239 reslen:1330843 locks:{ Global: { acquireCount: { r: 36 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 218948 } }, Database: { acquireCount: { r: 18 } }, oplog: { acquireCount: { r: 18 } } } protocol:op_command 229ms 2016-04-29T21:44:00.411+0000 I COMMAND [conn964] command local.oplog.rs command: getMore { getMore: 14615949196, collection: "oplog.rs", maxTimeMS: 5000, term: 45, lastKnownCommittedOpTime: { ts: Timestamp 1461966239000|3841, t: 45 } } cursorid:14615949196 keyUpdates:0 writeConflicts:0 numYields:11 nreturned:1408 reslen:837023 locks:{ Global: { acquireCount: { r: 24 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 167221 } }, Database: { acquireCount: { r: 12 } }, oplog: { acquireCount: { r: 12 } } } protocol:op_command 168ms 2016-04-29T21:44:00.719+0000 I COMMAND [conn962] command local.oplog.rs command: getMore { getMore: 14615949196, collection: "oplog.rs", maxTimeMS: 5000, term: 45, lastKnownCommittedOpTime: { ts: Timestamp 1461966239000|4801, t: 45 } } cursorid:14615949196 keyUpdates:0 writeConflicts:0 numYields:29 nreturned:3792 reslen:2255830 locks:{ Global: { acquireCount: { r: 60 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 284737 } }, Database: { acquireCount: { r: 30 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 142 } }, oplog: { acquireCount: { r: 30 } } } protocol:op_command 294ms 2016-04-29T21:44:02.629+0000 I COMMAND [conn964] command local.oplog.rs command: getMore { getMore: 14615949196, collection: "oplog.rs", maxTimeMS: 5000, term: 45, lastKnownCommittedOpTime: { ts: Timestamp 1461966242000|321, t: 45 } } cursorid:14615949196 keyUpdates:0 writeConflicts:0 numYields:1 nreturned:128 reslen:69230 locks:{ Global: { acquireCount: { r: 4 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 122693 } }, Database: { acquireCount: { r: 2 } }, oplog: { acquireCount: { r: 2 } } } protocol:op_command 136ms 2016-04-29T21:44:03.054+0000 I INDEX [repl writer worker 14] build index on: sherpa.notifications properties: { v: 1, key: { domain: 1.0 }, name: "domain_1", ns: "sherpa.notifications" } 2016-04-29T21:44:03.054+0000 I INDEX [repl writer worker 14] building index using bulk method 2016-04-29T21:44:03.073+0000 I INDEX [repl writer worker 14] build index done. scanned 4478 total records. 0 secs 2016-04-29T21:44:03.082+0000 I INDEX [repl writer worker 1] build index on: sherpa.notifications properties: { v: 1, key: { date: 1.0 }, name: "date_1", ns: "sherpa.notifications" } 2016-04-29T21:44:03.082+0000 I INDEX [repl writer worker 1] building index using bulk method 2016-04-29T21:44:03.105+0000 I INDEX [repl writer worker 1] build index done. scanned 4478 total records. 0 secs 2016-04-29T21:44:03.121+0000 I INDEX [repl writer worker 12] build index on: sherpa.notifications properties: { v: 1, key: { PNOTIFY_processed: 1.0 }, name: "PNOTIFY_processed_1", ns: "sherpa.notifications" } 2016-04-29T21:44:03.122+0000 I INDEX [repl writer worker 12] building index using bulk method 2016-04-29T21:44:03.152+0000 I INDEX [repl writer worker 12] build index done. scanned 4478 total records. 0 secs 2016-04-29T21:44:03.160+0000 I INDEX [repl writer worker 8] build index on: sherpa.notifications properties: { v: 1, key: { EMAIL_processed: 1.0 }, name: "EMAIL_processed_1", ns: "sherpa.notifications" } 2016-04-29T21:44:03.160+0000 I INDEX [repl writer worker 8] building index using bulk method 2016-04-29T21:44:03.211+0000 I INDEX [repl writer worker 8] build index done. scanned 4478 total records. 0 secs 2016-04-29T21:44:03.219+0000 I INDEX [repl writer worker 6] build index on: sherpa.notifications properties: { v: 1, key: { SMS_processed: 1.0 }, name: "SMS_processed_1", ns: "sherpa.notifications" } 2016-04-29T21:44:03.219+0000 I INDEX [repl writer worker 6] building index using bulk method 2016-04-29T21:44:03.255+0000 I INDEX [repl writer worker 6] build index done. scanned 4478 total records. 0 secs 2016-04-29T21:44:03.271+0000 I INDEX [repl writer worker 3] build index on: sherpa.notifications properties: { v: 1, key: { SMS_messageSid: 1.0 }, name: "SMS_messageSid_1", ns: "sherpa.notifications" } 2016-04-29T21:44:03.271+0000 I INDEX [repl writer worker 3] building index using bulk method 2016-04-29T21:44:03.311+0000 I INDEX [repl writer worker 3] build index done. scanned 4478 total records. 0 secs 2016-04-29T21:44:03.312+0000 I COMMAND [repl writer worker 15] CMD: drop sherpa.gateways 2016-04-29T21:44:03.662+0000 I INDEX [repl writer worker 0] build index on: sherpa.gateways properties: { v: 1, key: { domain: 1.0 }, name: "domain_1", ns: "sherpa.gateways" } 2016-04-29T21:44:03.662+0000 I INDEX [repl writer worker 0] building index using bulk method 2016-04-29T21:44:03.666+0000 I INDEX [repl writer worker 0] build index done. scanned 187 total records. 0 secs 2016-04-29T21:44:03.684+0000 I INDEX [repl writer worker 11] build index on: sherpa.gateways properties: { v: 1, key: { limeLightInstanceId: 1.0 }, name: "limeLightInstanceId_1", ns: "sherpa.gateways" } 2016-04-29T21:44:03.684+0000 I INDEX [repl writer worker 11] building index using bulk method 2016-04-29T21:44:03.689+0000 I INDEX [repl writer worker 11] build index done. scanned 187 total records. 0 secs 2016-04-29T21:44:03.699+0000 I INDEX [repl writer worker 5] build index on: sherpa.gateways properties: { v: 1, key: { key: 1.0 }, name: "key_1", ns: "sherpa.gateways" } 2016-04-29T21:44:03.699+0000 I INDEX [repl writer worker 5] building index using bulk method 2016-04-29T21:44:03.703+0000 I INDEX [repl writer worker 5] build index done. scanned 187 total records. 0 secs 2016-04-29T21:44:03.718+0000 I INDEX [repl writer worker 2] build index on: sherpa.gateways properties: { v: 1, key: { campaignStatus.nextDate: 1.0 }, name: "campaignStatus.nextDate_1", ns: "sherpa.gateways" } 2016-04-29T21:44:03.718+0000 I INDEX [repl writer worker 2] building index using bulk method 2016-04-29T21:44:03.723+0000 I INDEX [repl writer worker 2] build index done. scanned 187 total records. 0 secs 2016-04-29T21:44:03.748+0000 I COMMAND [repl writer worker 14] CMD: drop sherpa.cfs.uploads.filerecord 2016-04-29T21:44:04.312+0000 I COMMAND [repl writer worker 12] CMD: drop sherpa.events 2016-04-29T21:44:05.134+0000 I INDEX [repl writer worker 14] build index on: sherpa.events properties: { v: 1, key: { domain: 1.0 }, name: "domain_1", ns: "sherpa.events" } 2016-04-29T21:44:05.134+0000 I INDEX [repl writer worker 14] building index using bulk method 2016-04-29T21:44:05.143+0000 I INDEX [repl writer worker 14] build index done. scanned 116 total records. 0 secs 2016-04-29T21:44:05.148+0000 I INDEX [repl writer worker 5] build index on: sherpa.events properties: { v: 1, key: { date: 1.0 }, name: "date_1", ns: "sherpa.events" } 2016-04-29T21:44:05.148+0000 I INDEX [repl writer worker 5] building index using bulk method 2016-04-29T21:44:05.151+0000 I INDEX [repl writer worker 5] build index done. scanned 116 total records. 0 secs 2016-04-29T21:44:05.156+0000 I INDEX [repl writer worker 3] build index on: sherpa.events properties: { v: 1, key: { type: 1.0 }, name: "type_1", ns: "sherpa.events" } 2016-04-29T21:44:05.156+0000 I INDEX [repl writer worker 3] building index using bulk method 2016-04-29T21:44:05.162+0000 I INDEX [repl writer worker 3] build index done. scanned 116 total records. 0 secs 2016-04-29T21:44:05.168+0000 I INDEX [repl writer worker 6] build index on: sherpa.events properties: { v: 1, key: { eventData.limeLightInstanceId: 1.0 }, name: "eventData.limeLightInstanceId_1", ns: "sherpa.events" } 2016-04-29T21:44:05.168+0000 I INDEX [repl writer worker 6] building index using bulk method 2016-04-29T21:44:05.171+0000 I INDEX [repl writer worker 6] build index done. scanned 116 total records. 0 secs 2016-04-29T21:44:05.182+0000 I INDEX [repl writer worker 2] build index on: sherpa.events properties: { v: 1, key: { eventData.gatewayId: 1.0 }, name: "eventData.gatewayId_1", ns: "sherpa.events" } 2016-04-29T21:44:05.182+0000 I INDEX [repl writer worker 2] building index using bulk method 2016-04-29T21:44:05.187+0000 I INDEX [repl writer worker 2] build index done. scanned 116 total records. 0 secs 2016-04-29T21:44:05.231+0000 I COMMAND [conn964] command local.oplog.rs command: getMore { getMore: 14615949196, collection: "oplog.rs", maxTimeMS: 5000, term: 45, lastKnownCommittedOpTime: { ts: Timestamp 1461966244000|1527, t: 45 } } cursorid:14615949196 keyUpdates:0 writeConflicts:0 numYields:18 nreturned:2390 reslen:848945 locks:{ Global: { acquireCount: { r: 38 }, acquireWaitCount: { r: 8 }, timeAcquiringMicros: { r: 250790 } }, Database: { acquireCount: { r: 19 } }, oplog: { acquireCount: { r: 19 } } } protocol:op_command 259ms 2016-04-29T21:44:05.458+0000 I COMMAND [repl writer worker 11] CMD: drop sherpa.users 2016-04-29T21:44:05.626+0000 I INDEX [repl writer worker 0] build index on: sherpa.olog properties: { v: 1, key: { domain: 1.0 }, name: "domain_1", ns: "sherpa.olog" } 2016-04-29T21:44:05.626+0000 I INDEX [repl writer worker 0] building index using bulk method 2016-04-29T21:44:05.657+0000 I INDEX [repl writer worker 0] build index done. scanned 4886 total records. 0 secs 2016-04-29T21:44:05.668+0000 I INDEX [repl writer worker 1] build index on: sherpa.olog properties: { v: 1, key: { date: 1.0 }, name: "date_1", ns: "sherpa.olog" } 2016-04-29T21:44:05.668+0000 I INDEX [repl writer worker 1] building index using bulk method 2016-04-29T21:44:05.692+0000 I INDEX [repl writer worker 1] build index done. scanned 4886 total records. 0 secs 2016-04-29T21:44:05.715+0000 I INDEX [repl writer worker 13] build index on: sherpa.olog properties: { v: 1, key: { date: 1.0, hrtime: 1.0 }, name: "date_1_hrtime_1", ns: "sherpa.olog" } 2016-04-29T21:44:05.715+0000 I INDEX [repl writer worker 13] building index using bulk method 2016-04-29T21:44:05.786+0000 I INDEX [repl writer worker 13] build index done. scanned 4886 total records. 0 secs 2016-04-29T21:44:05.799+0000 I INDEX [repl writer worker 8] build index on: sherpa.olog properties: { v: 1, key: { userId: 1.0 }, name: "userId_1", ns: "sherpa.olog" } 2016-04-29T21:44:05.799+0000 I INDEX [repl writer worker 8] building index using bulk method 2016-04-29T21:44:05.833+0000 I INDEX [repl writer worker 8] build index done. scanned 4886 total records. 0 secs 2016-04-29T21:44:05.859+0000 I COMMAND [repl writer worker 2] CMD: drop sherpa.lime_light_instances 2016-04-29T21:44:05.876+0000 I COMMAND [repl writer worker 9] CMD: drop sherpa.orders 2016-04-29T21:44:06.316+0000 I INDEX [repl writer worker 12] build index on: sherpa.users properties: { v: 1, unique: true, key: { username: 1.0 }, name: "username_1", ns: "sherpa.users", sparse: 1.0 } 2016-04-29T21:44:06.316+0000 I INDEX [repl writer worker 12] building index using bulk method 2016-04-29T21:44:06.324+0000 I INDEX [repl writer worker 12] build index done. scanned 5 total records. 0 secs 2016-04-29T21:44:06.329+0000 I INDEX [repl writer worker 14] build index on: sherpa.users properties: { v: 1, unique: true, key: { emails.address: 1.0 }, name: "emails.address_1", ns: "sherpa.users", sparse: 1.0 } 2016-04-29T21:44:06.329+0000 I INDEX [repl writer worker 14] building index using bulk method 2016-04-29T21:44:06.333+0000 I INDEX [repl writer worker 14] build index done. scanned 5 total records. 0 secs 2016-04-29T21:44:06.348+0000 I INDEX [repl writer worker 5] build index on: sherpa.users properties: { v: 1, unique: true, key: { services.resume.loginTokens.hashedToken: 1.0 }, name: "services.resume.loginTokens.hashedToken_1", ns: "sherpa.users", sparse: 1.0 } 2016-04-29T21:44:06.348+0000 I INDEX [repl writer worker 5] building index using bulk method 2016-04-29T21:44:06.354+0000 I INDEX [repl writer worker 5] build index done. scanned 5 total records. 0 secs 2016-04-29T21:44:06.365+0000 I INDEX [repl writer worker 3] build index on: sherpa.users properties: { v: 1, unique: true, key: { services.resume.loginTokens.token: 1.0 }, name: "services.resume.loginTokens.token_1", sparse: 1.0, ns: "sherpa.users" } 2016-04-29T21:44:06.365+0000 I INDEX [repl writer worker 3] building index using bulk method 2016-04-29T21:44:06.366+0000 I INDEX [repl writer worker 3] build index done. scanned 5 total records. 0 secs 2016-04-29T21:44:06.388+0000 I INDEX [repl writer worker 10] build index on: sherpa.users properties: { v: 1, key: { services.resume.haveLoginTokensToDelete: 1.0 }, name: "services.resume.haveLoginTokensToDelete_1", ns: "sherpa.users", sparse: 1.0 } 2016-04-29T21:44:06.388+0000 I INDEX [repl writer worker 10] building index using bulk method 2016-04-29T21:44:06.388+0000 I INDEX [repl writer worker 10] build index done. scanned 5 total records. 0 secs 2016-04-29T21:44:06.409+0000 I INDEX [repl writer worker 2] build index on: sherpa.users properties: { v: 1, key: { services.resume.loginTokens.when: 1.0 }, name: "services.resume.loginTokens.when_1", ns: "sherpa.users", sparse: 1.0 } 2016-04-29T21:44:06.409+0000 I INDEX [repl writer worker 2] building index using bulk method 2016-04-29T21:44:06.413+0000 I INDEX [repl writer worker 2] build index done. scanned 5 total records. 0 secs 2016-04-29T21:44:06.430+0000 I INDEX [repl writer worker 9] build index on: sherpa.users properties: { v: 1, unique: true, key: { services.email.verificationTokens.token: 1.0 }, name: "services.email.verificationTokens.token_1", ns: "sherpa.users", sparse: 1.0 } 2016-04-29T21:44:06.430+0000 I INDEX [repl writer worker 9] building index using bulk method 2016-04-29T21:44:06.438+0000 I INDEX [repl writer worker 9] build index done. scanned 5 total records. 0 secs 2016-04-29T21:44:06.469+0000 I INDEX [repl writer worker 6] build index on: sherpa.users properties: { v: 1, unique: true, key: { services.password.reset.token: 1.0 }, name: "services.password.reset.token_1", ns: "sherpa.users", sparse: 1.0 } 2016-04-29T21:44:06.469+0000 I INDEX [repl writer worker 6] building index using bulk method 2016-04-29T21:44:06.477+0000 I INDEX [repl writer worker 6] build index done. scanned 5 total records. 0 secs 2016-04-29T21:44:06.492+0000 I INDEX [repl writer worker 4] build index on: sherpa.lime_light_instances properties: { v: 1, key: { key: 1.0 }, name: "key_1", ns: "sherpa.lime_light_instances" } 2016-04-29T21:44:06.492+0000 I INDEX [repl writer worker 4] building index using bulk method 2016-04-29T21:44:06.495+0000 I INDEX [repl writer worker 4] build index done. scanned 3 total records. 0 secs 2016-04-29T21:44:06.512+0000 I INDEX [repl writer worker 11] build index on: sherpa.lime_light_instances properties: { v: 1, key: { userId: 1.0 }, name: "userId_1", ns: "sherpa.lime_light_instances" } 2016-04-29T21:44:06.512+0000 I INDEX [repl writer worker 11] building index using bulk method 2016-04-29T21:44:06.516+0000 I INDEX [repl writer worker 11] build index done. scanned 3 total records. 0 secs 2016-04-29T21:44:06.522+0000 I INDEX [repl writer worker 7] build index on: sherpa.lime_light_instances properties: { v: 1, key: { domain: 1.0 }, name: "domain_1", ns: "sherpa.lime_light_instances" } 2016-04-29T21:44:06.522+0000 I INDEX [repl writer worker 7] building index using bulk method 2016-04-29T21:44:06.532+0000 I INDEX [repl writer worker 7] build index done. scanned 3 total records. 0 secs 2016-04-29T21:44:06.542+0000 I INDEX [repl writer worker 0] build index on: sherpa.lime_light_instances properties: { v: 1, key: { name: 1.0 }, name: "name_1", ns: "sherpa.lime_light_instances" } 2016-04-29T21:44:06.542+0000 I INDEX [repl writer worker 0] building index using bulk method 2016-04-29T21:44:06.549+0000 I INDEX [repl writer worker 0] build index done. scanned 3 total records. 0 secs 2016-04-29T21:44:06.550+0000 I COMMAND [repl writer worker 1] CMD: drop sherpa.cards 2016-04-29T21:44:06.662+0000 I COMMAND [repl writer worker 13] CMD: drop sherpa.products 2016-04-29T21:44:06.681+0000 I COMMAND [repl writer worker 15] CMD: drop sherpa.domains 2016-04-29T21:44:06.711+0000 I COMMAND [conn964] command local.oplog.rs command: getMore { getMore: 14615949196, collection: "oplog.rs", maxTimeMS: 5000, term: 45, lastKnownCommittedOpTime: { ts: Timestamp 1461966246000|12, t: 45 } } cursorid:14615949196 keyUpdates:0 writeConflicts:0 numYields:12 nreturned:1605 reslen:954281 locks:{ Global: { acquireCount: { r: 26 }, acquireWaitCount: { r: 5 }, timeAcquiringMicros: { r: 139955 } }, Database: { acquireCount: { r: 13 }, acquireWaitCount: { r: 2 }, timeAcquiringMicros: { r: 718 } }, oplog: { acquireCount: { r: 13 } } } protocol:op_command 142ms 2016-04-29T21:44:07.068+0000 I INDEX [repl writer worker 8] build index on: sherpa.prospects properties: { v: 1, key: { domain: 1.0 }, name: "domain_1", ns: "sherpa.prospects" } 2016-04-29T21:44:07.068+0000 I INDEX [repl writer worker 8] building index using bulk method 2016-04-29T21:44:07.127+0000 I INDEX [repl writer worker 8] build index done. scanned 11605 total records. 0 secs 2016-04-29T21:44:07.135+0000 I INDEX [repl writer worker 6] build index on: sherpa.prospects properties: { v: 1, key: { limeLightInstanceId: 1.0 }, name: "limeLightInstanceId_1", ns: "sherpa.prospects" } 2016-04-29T21:44:07.135+0000 I INDEX [repl writer worker 6] building index using bulk method 2016-04-29T21:44:07.203+0000 I INDEX [repl writer worker 6] build index done. scanned 11605 total records. 0 secs 2016-04-29T21:44:07.215+0000 I INDEX [repl writer worker 0] build index on: sherpa.prospects properties: { v: 1, key: { email: 1.0 }, name: "email_1", ns: "sherpa.prospects" } 2016-04-29T21:44:07.215+0000 I INDEX [repl writer worker 0] building index using bulk method 2016-04-29T21:44:07.359+0000 I INDEX [repl writer worker 0] build index done. scanned 11605 total records. 0 secs 2016-04-29T21:44:07.375+0000 I COMMAND [conn964] command local.oplog.rs command: getMore { getMore: 14615949196, collection: "oplog.rs", maxTimeMS: 5000, term: 45, lastKnownCommittedOpTime: { ts: Timestamp 1461966247000|1, t: 45 } } cursorid:14615949196 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:457 locks:{ Global: { acquireCount: { r: 2 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 167700 } }, Database: { acquireCount: { r: 1 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 518 } }, oplog: { acquireCount: { r: 1 } } } protocol:op_command 168ms 2016-04-29T21:44:07.390+0000 I INDEX [repl writer worker 10] build index on: sherpa.prospects properties: { v: 1, key: { signedup_at: 1.0 }, name: "signedup_at_1", ns: "sherpa.prospects" } 2016-04-29T21:44:07.390+0000 I INDEX [repl writer worker 10] building index using bulk method 2016-04-29T21:44:07.489+0000 I INDEX [repl writer worker 10] build index done. scanned 11605 total records. 0 secs 2016-04-29T21:44:07.489+0000 I COMMAND [conn964] command local.oplog.rs command: getMore { getMore: 14615949196, collection: "oplog.rs", maxTimeMS: 5000, term: 45, lastKnownCommittedOpTime: { ts: Timestamp 1461966247000|2, t: 45 } } cursorid:14615949196 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:1 reslen:469 locks:{ Global: { acquireCount: { r: 2 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 105392 } }, Database: { acquireCount: { r: 1 } }, oplog: { acquireCount: { r: 1 } } } protocol:op_command 105ms 2016-04-29T21:44:07.504+0000 I INDEX [repl writer worker 13] build index on: sherpa.cards properties: { v: 1, key: { domain: 1.0 }, name: "domain_1", ns: "sherpa.cards" } 2016-04-29T21:44:07.504+0000 I INDEX [repl writer worker 13] building index using bulk method 2016-04-29T21:44:07.510+0000 I INDEX [repl writer worker 13] build index done. scanned 4 total records. 0 secs 2016-04-29T21:44:07.527+0000 I INDEX [repl writer worker 15] build index on: sherpa.cards properties: { v: 1, key: { creditCardNumber: 1.0 }, name: "creditCardNumber_1", ns: "sherpa.cards" } 2016-04-29T21:44:07.527+0000 I INDEX [repl writer worker 15] building index using bulk method 2016-04-29T21:44:07.533+0000 I INDEX [repl writer worker 15] build index done. scanned 4 total records. 0 secs 2016-04-29T21:44:07.533+0000 I COMMAND [repl writer worker 12] CMD: drop sherpa.config 2016-04-29T21:44:07.539+0000 I COMMAND [repl writer worker 14] CMD: drop sherpa.cfs._tempstore.chunks 2016-04-29T21:44:07.543+0000 I COMMAND [repl writer worker 5] CMD: drop sherpa.meteor_accounts_loginServiceConfiguration 2016-04-29T21:44:07.649+0000 I INDEX [repl writer worker 2] build index on: sherpa.meteor_accounts_loginServiceConfiguration properties: { v: 1, unique: true, key: { service: 1.0 }, name: "service_1", ns: "sherpa.meteor_accounts_loginServiceConfiguration" } 2016-04-29T21:44:07.649+0000 I INDEX [repl writer worker 2] building index using bulk method 2016-04-29T21:44:07.650+0000 I INDEX [repl writer worker 2] build index done. scanned 0 total records. 0 secs 2016-04-29T21:44:24.459+0000 I COMMAND [repl writer worker 9] CMD: drop sherpa.orders 2016-04-29T21:49:40.152+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35566 #967 (6 connections now open) 2016-04-29T21:49:40.194+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35567 #968 (7 connections now open) 2016-04-29T21:49:40.195+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35568 #969 (8 connections now open) 2016-04-29T21:49:40.195+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35569 #970 (9 connections now open) 2016-04-29T21:49:40.196+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35570 #971 (10 connections now open) 2016-04-29T21:49:40.349+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35574 #972 (11 connections now open) 2016-04-29T21:49:40.349+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35576 #973 (12 connections now open) 2016-04-29T21:49:40.460+0000 I NETWORK [conn973] end connection 127.0.0.1:35576 (11 connections now open) 2016-04-29T21:49:40.604+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35579 #974 (12 connections now open) 2016-04-29T21:49:40.696+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35584 #975 (13 connections now open) 2016-04-29T21:49:45.982+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35596 #976 (14 connections now open) 2016-04-29T21:49:45.982+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35597 #977 (15 connections now open) 2016-04-29T21:49:45.982+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35598 #978 (16 connections now open) 2016-04-29T21:49:45.982+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35599 #979 (17 connections now open) 2016-04-29T21:49:45.999+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35600 #980 (18 connections now open) 2016-04-29T21:49:46.238+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35604 #981 (19 connections now open) 2016-04-29T21:49:46.238+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35606 #982 (20 connections now open) 2016-04-29T21:49:46.271+0000 I NETWORK [conn982] end connection 127.0.0.1:35606 (19 connections now open) 2016-04-29T21:49:46.450+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35609 #983 (20 connections now open) 2016-04-29T21:49:49.537+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35614 #984 (21 connections now open) 2016-04-29T21:49:50.327+0000 I ACCESS [conn974] Successfully authenticated as principal oplogger on admin 2016-04-29T21:49:50.439+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35616 #985 (22 connections now open) 2016-04-29T21:49:50.485+0000 I NETWORK [conn985] end connection 127.0.0.1:35616 (21 connections now open) 2016-04-29T21:49:50.562+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35619 #986 (22 connections now open) 2016-04-29T21:49:51.859+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35632 #987 (23 connections now open) 2016-04-29T21:49:51.860+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35633 #988 (24 connections now open) 2016-04-29T21:49:51.872+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35634 #989 (25 connections now open) 2016-04-29T21:49:51.873+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35635 #990 (26 connections now open) 2016-04-29T21:49:51.874+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35636 #991 (27 connections now open) 2016-04-29T21:49:52.125+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35640 #992 (28 connections now open) 2016-04-29T21:49:52.141+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35642 #993 (29 connections now open) 2016-04-29T21:49:52.240+0000 I NETWORK [conn993] end connection 127.0.0.1:35642 (28 connections now open) 2016-04-29T21:49:52.510+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35645 #994 (29 connections now open) 2016-04-29T21:49:53.988+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35650 #995 (30 connections now open) 2016-04-29T21:49:55.692+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35654 #996 (31 connections now open) 2016-04-29T21:49:56.726+0000 I ACCESS [conn983] Successfully authenticated as principal oplogger on admin 2016-04-29T21:49:56.835+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35656 #997 (32 connections now open) 2016-04-29T21:49:56.836+0000 I NETWORK [conn997] end connection 127.0.0.1:35656 (31 connections now open) 2016-04-29T21:49:56.885+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35659 #998 (32 connections now open) 2016-04-29T21:49:56.958+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35664 #999 (33 connections now open) 2016-04-29T21:49:58.248+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35676 #1000 (34 connections now open) 2016-04-29T21:49:58.249+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35677 #1001 (35 connections now open) 2016-04-29T21:49:58.267+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35678 #1002 (36 connections now open) 2016-04-29T21:49:58.267+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35679 #1003 (37 connections now open) 2016-04-29T21:49:58.270+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35680 #1004 (38 connections now open) 2016-04-29T21:49:58.530+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35684 #1005 (39 connections now open) 2016-04-29T21:49:58.530+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35686 #1006 (40 connections now open) 2016-04-29T21:49:58.534+0000 I NETWORK [conn1006] end connection 127.0.0.1:35686 (39 connections now open) 2016-04-29T21:49:58.614+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35689 #1007 (40 connections now open) 2016-04-29T21:49:58.794+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35694 #1008 (41 connections now open) 2016-04-29T21:50:02.118+0000 I ACCESS [conn986] Successfully authenticated as principal oplogger on admin 2016-04-29T21:50:03.430+0000 I ACCESS [conn998] Successfully authenticated as principal oplogger on admin 2016-04-29T21:50:03.863+0000 I ACCESS [conn994] Successfully authenticated as principal oplogger on admin 2016-04-29T21:50:04.106+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35697 #1009 (42 connections now open) 2016-04-29T21:50:04.111+0000 I NETWORK [conn1009] end connection 127.0.0.1:35697 (41 connections now open) 2016-04-29T21:50:04.140+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35700 #1010 (42 connections now open) 2016-04-29T21:50:04.259+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35705 #1011 (43 connections now open) 2016-04-29T21:50:04.432+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35716 #1012 (44 connections now open) 2016-04-29T21:50:04.442+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35717 #1013 (45 connections now open) 2016-04-29T21:50:04.444+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35718 #1014 (46 connections now open) 2016-04-29T21:50:04.444+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35719 #1015 (47 connections now open) 2016-04-29T21:50:04.445+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35720 #1016 (48 connections now open) 2016-04-29T21:50:04.602+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35724 #1017 (49 connections now open) 2016-04-29T21:50:04.604+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35726 #1018 (50 connections now open) 2016-04-29T21:50:04.664+0000 I NETWORK [conn1018] end connection 127.0.0.1:35726 (49 connections now open) 2016-04-29T21:50:04.747+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35729 #1019 (50 connections now open) 2016-04-29T21:50:07.956+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35734 #1020 (51 connections now open) 2016-04-29T21:50:09.810+0000 I ACCESS [conn1007] Successfully authenticated as principal oplogger on admin 2016-04-29T21:50:09.866+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35742 #1021 (52 connections now open) 2016-04-29T21:50:09.937+0000 I NETWORK [conn1021] end connection 127.0.0.1:35742 (51 connections now open) 2016-04-29T21:50:09.946+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35749 #1022 (52 connections now open) 2016-04-29T21:50:09.946+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35750 #1023 (53 connections now open) 2016-04-29T21:50:09.946+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35751 #1024 (54 connections now open) 2016-04-29T21:50:09.946+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35752 #1025 (55 connections now open) 2016-04-29T21:50:09.946+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35753 #1026 (56 connections now open) 2016-04-29T21:50:10.059+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35755 #1027 (57 connections now open) 2016-04-29T21:50:10.103+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35760 #1028 (58 connections now open) 2016-04-29T21:50:10.120+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35762 #1029 (59 connections now open) 2016-04-29T21:50:10.154+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35767 #1030 (60 connections now open) 2016-04-29T21:50:10.196+0000 I NETWORK [conn1029] end connection 127.0.0.1:35762 (59 connections now open) 2016-04-29T21:50:10.318+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35769 #1031 (60 connections now open) 2016-04-29T21:50:10.416+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35774 #1032 (61 connections now open) 2016-04-29T21:50:13.688+0000 I ACCESS [conn1031] Successfully authenticated as principal oplogger on admin 2016-04-29T21:50:13.855+0000 I ACCESS [conn1010] Successfully authenticated as principal oplogger on admin 2016-04-29T21:50:15.697+0000 I ACCESS [conn1019] Successfully authenticated as principal oplogger on admin 2016-04-29T21:50:15.816+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35782 #1033 (62 connections now open) 2016-04-29T21:50:15.892+0000 I NETWORK [conn1033] end connection 127.0.0.1:35782 (61 connections now open) 2016-04-29T21:50:15.893+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35789 #1034 (62 connections now open) 2016-04-29T21:50:15.894+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35790 #1035 (63 connections now open) 2016-04-29T21:50:15.896+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35791 #1036 (64 connections now open) 2016-04-29T21:50:15.908+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35792 #1037 (65 connections now open) 2016-04-29T21:50:15.911+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35793 #1038 (66 connections now open) 2016-04-29T21:50:16.001+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35795 #1039 (67 connections now open) 2016-04-29T21:50:16.282+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35800 #1040 (68 connections now open) 2016-04-29T21:50:16.282+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35802 #1041 (69 connections now open) 2016-04-29T21:50:16.376+0000 I NETWORK [conn1041] end connection 127.0.0.1:35802 (68 connections now open) 2016-04-29T21:50:16.484+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35805 #1042 (69 connections now open) 2016-04-29T21:50:16.634+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35810 #1043 (70 connections now open) 2016-04-29T21:50:19.434+0000 I ACCESS [conn1042] Successfully authenticated as principal oplogger on admin 2016-04-29T21:50:19.553+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35814 #1044 (71 connections now open) 2016-04-29T21:50:20.126+0000 I ACCESS [conn1027] Successfully authenticated as principal oplogger on admin 2016-04-29T21:50:20.330+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35816 #1045 (72 connections now open) 2016-04-29T21:50:20.444+0000 I NETWORK [conn1045] end connection 127.0.0.1:35816 (71 connections now open) 2016-04-29T21:50:20.446+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35819 #1046 (72 connections now open) 2016-04-29T21:50:20.500+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35824 #1047 (73 connections now open) 2016-04-29T21:50:24.466+0000 I ACCESS [conn1039] Successfully authenticated as principal oplogger on admin 2016-04-29T21:50:24.926+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35826 #1048 (74 connections now open) 2016-04-29T21:50:25.022+0000 I NETWORK [conn1048] end connection 127.0.0.1:35826 (73 connections now open) 2016-04-29T21:50:25.063+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35829 #1049 (74 connections now open) 2016-04-29T21:50:27.141+0000 I ACCESS [conn1046] Successfully authenticated as principal oplogger on admin 2016-04-29T21:50:27.223+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35834 #1050 (75 connections now open) 2016-04-29T21:50:30.877+0000 I ACCESS [conn1049] Successfully authenticated as principal oplogger on admin 2016-04-29T21:57:01.076+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:35915 #1051 (76 connections now open) 2016-04-29T21:57:01.078+0000 I NETWORK [conn1051] end connection 127.0.0.1:35915 (75 connections now open) 2016-04-29T22:07:57.745+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 29 22:07:26:8) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 29 22:07:57:3) 2016-04-29T22:07:57.745+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-29T22:08:02.747+0000 I NETWORK [conn966] end connection 127.0.0.1:34995 (74 connections now open) 2016-04-29T22:08:02.779+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-29T22:08:02.780+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-29T22:12:57.749+0000 I NETWORK [conn964] end connection 127.0.0.1:34960 (73 connections now open) 2016-04-29T22:12:57.749+0000 I NETWORK [conn962] end connection 127.0.0.1:34916 (73 connections now open) 2016-04-29T22:16:00.070+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36093 #1052 (73 connections now open) 2016-04-29T22:16:00.071+0000 I NETWORK [conn1052] end connection 127.0.0.1:36093 (72 connections now open) 2016-04-29T22:16:00.072+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36094 #1053 (73 connections now open) 2016-04-29T22:16:00.072+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36095 #1054 (74 connections now open) 2016-04-29T22:16:11.473+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36099 #1055 (75 connections now open) 2016-04-29T22:17:00.059+0000 I NETWORK [conn1054] end connection 127.0.0.1:36095 (74 connections now open) 2016-04-29T22:22:00.065+0000 I NETWORK [conn1053] end connection 127.0.0.1:36094 (73 connections now open) 2016-04-29T22:22:00.065+0000 I NETWORK [conn1055] end connection 127.0.0.1:36099 (72 connections now open) 2016-04-29T22:26:59.968+0000 I NETWORK [conn1047] end connection 127.0.0.1:35824 (71 connections now open) 2016-04-29T22:26:59.968+0000 I NETWORK [conn1046] end connection 127.0.0.1:35819 (71 connections now open) 2016-04-29T22:26:59.968+0000 I NETWORK [conn1032] end connection 127.0.0.1:35774 (71 connections now open) 2016-04-29T22:27:00.032+0000 I NETWORK [conn1030] end connection 127.0.0.1:35767 (69 connections now open) 2016-04-29T22:26:59.968+0000 I NETWORK [conn1028] end connection 127.0.0.1:35760 (71 connections now open) 2016-04-29T22:26:59.968+0000 I NETWORK [conn1026] end connection 127.0.0.1:35753 (71 connections now open) 2016-04-29T22:26:59.968+0000 I NETWORK [conn1025] end connection 127.0.0.1:35752 (71 connections now open) 2016-04-29T22:26:59.968+0000 I NETWORK [conn1024] end connection 127.0.0.1:35751 (71 connections now open) 2016-04-29T22:26:59.968+0000 I NETWORK [conn1023] end connection 127.0.0.1:35750 (71 connections now open) 2016-04-29T22:26:59.968+0000 I NETWORK [conn1022] end connection 127.0.0.1:35749 (71 connections now open) 2016-04-29T22:27:00.032+0000 I NETWORK [conn1027] end connection 127.0.0.1:35755 (69 connections now open) 2016-04-29T22:27:00.032+0000 I NETWORK [conn1008] end connection 127.0.0.1:35694 (69 connections now open) 2016-04-29T22:27:00.032+0000 I NETWORK [conn1007] end connection 127.0.0.1:35689 (69 connections now open) 2016-04-29T22:27:00.032+0000 I NETWORK [conn1005] end connection 127.0.0.1:35684 (69 connections now open) 2016-04-29T22:27:00.032+0000 I NETWORK [conn1004] end connection 127.0.0.1:35680 (69 connections now open) 2016-04-29T22:27:00.032+0000 I NETWORK [conn1003] end connection 127.0.0.1:35679 (69 connections now open) 2016-04-29T22:27:00.032+0000 I NETWORK [conn1002] end connection 127.0.0.1:35678 (69 connections now open) 2016-04-29T22:27:00.032+0000 I NETWORK [conn1001] end connection 127.0.0.1:35677 (69 connections now open) 2016-04-29T22:27:00.032+0000 I NETWORK [conn1000] end connection 127.0.0.1:35676 (69 connections now open) 2016-04-29T22:26:59.968+0000 I NETWORK [conn1031] end connection 127.0.0.1:35769 (71 connections now open) 2016-04-29T22:27:05.973+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36218 #1056 (53 connections now open) 2016-04-29T22:27:05.974+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36219 #1057 (54 connections now open) 2016-04-29T22:27:05.974+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36220 #1058 (55 connections now open) 2016-04-29T22:27:05.974+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36221 #1059 (56 connections now open) 2016-04-29T22:27:05.975+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36222 #1060 (57 connections now open) 2016-04-29T22:27:06.020+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36231 #1061 (58 connections now open) 2016-04-29T22:27:06.021+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36233 #1062 (59 connections now open) 2016-04-29T22:27:06.057+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36240 #1063 (60 connections now open) 2016-04-29T22:27:06.057+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36241 #1064 (61 connections now open) 2016-04-29T22:27:06.058+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36242 #1065 (62 connections now open) 2016-04-29T22:27:06.058+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36243 #1066 (63 connections now open) 2016-04-29T22:27:06.058+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36244 #1067 (64 connections now open) 2016-04-29T22:27:06.071+0000 I NETWORK [conn1062] end connection 127.0.0.1:36233 (63 connections now open) 2016-04-29T22:27:06.099+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36246 #1068 (64 connections now open) 2016-04-29T22:27:06.107+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36250 #1069 (65 connections now open) 2016-04-29T22:27:06.107+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36252 #1070 (66 connections now open) 2016-04-29T22:27:06.127+0000 I NETWORK [conn1070] end connection 127.0.0.1:36252 (65 connections now open) 2016-04-29T22:27:06.167+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36256 #1071 (66 connections now open) 2016-04-29T22:27:06.197+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36261 #1072 (67 connections now open) 2016-04-29T22:27:06.977+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36265 #1073 (68 connections now open) 2016-04-29T22:27:08.030+0000 I ACCESS [conn1071] Successfully authenticated as principal oplogger on admin 2016-04-29T22:27:08.915+0000 I ACCESS [conn1068] Successfully authenticated as principal oplogger on admin 2016-04-29T22:27:08.943+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36267 #1074 (69 connections now open) 2016-04-29T22:27:08.945+0000 I NETWORK [conn1074] end connection 127.0.0.1:36267 (68 connections now open) 2016-04-29T22:27:08.964+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36270 #1075 (69 connections now open) 2016-04-29T22:27:08.965+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36272 #1076 (70 connections now open) 2016-04-29T22:27:08.968+0000 I NETWORK [conn1076] end connection 127.0.0.1:36272 (69 connections now open) 2016-04-29T22:27:09.007+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36276 #1077 (70 connections now open) 2016-04-29T22:27:09.897+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36282 #1078 (71 connections now open) 2016-04-29T22:27:10.144+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36290 #1079 (72 connections now open) 2016-04-29T22:27:11.588+0000 I ACCESS [conn1077] Successfully authenticated as principal oplogger on admin 2016-04-29T22:27:12.997+0000 I ACCESS [conn1075] Successfully authenticated as principal oplogger on admin 2016-04-29T22:43:00.860+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 29 22:42:27:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 29 22:43:00:f) 2016-04-29T22:43:00.860+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-29T22:43:06.873+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-29T22:43:06.876+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-29T23:12:01.825+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 29 23:11:27:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 29 23:12:01:1a) 2016-04-29T23:12:01.825+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-29T23:12:01.849+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-29T23:12:02.845+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-29T23:12:02.868+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-29T23:30:01.386+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 29 23:29:27:9) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 29 23:30:01:d) 2016-04-29T23:30:01.386+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-29T23:30:01.390+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-29T23:30:01.391+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-29T23:31:11.181+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-30T00:23:05.041+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T00:23:05.042+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T00:23:05.043+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-30T00:23:11.703+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-30T00:39:55.605+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 00:39:22:b) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 00:39:55:1) 2016-04-30T00:39:55.614+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T00:40:01.615+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T00:40:01.616+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T00:40:01.617+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-30T00:40:11.795+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-30T00:55:00.045+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T00:55:00.047+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T00:55:00.047+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-30T00:55:11.271+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-30T01:28:10.142+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38186 #1080 (73 connections now open) 2016-04-30T01:28:10.143+0000 I NETWORK [conn1080] end connection 127.0.0.1:38186 (72 connections now open) 2016-04-30T01:28:10.143+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38187 #1081 (73 connections now open) 2016-04-30T01:28:10.144+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38188 #1082 (74 connections now open) 2016-04-30T01:28:11.610+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:38189 #1083 (75 connections now open) 2016-04-30T02:02:00.041+0000 I NETWORK [conn1082] end connection 127.0.0.1:38188 (74 connections now open) 2016-04-30T02:07:00.047+0000 I NETWORK [conn1083] end connection 127.0.0.1:38189 (73 connections now open) 2016-04-30T02:07:00.047+0000 I NETWORK [conn1081] end connection 127.0.0.1:38187 (72 connections now open) 2016-04-30T03:24:00.021+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 03:23:21:10) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 03:24:00:1) 2016-04-30T03:24:00.021+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T03:24:05.022+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T03:24:05.025+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T03:49:06.829+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39566 #1084 (73 connections now open) 2016-04-30T03:49:06.832+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39567 #1085 (74 connections now open) 2016-04-30T03:49:06.832+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39568 #1086 (75 connections now open) 2016-04-30T03:49:06.833+0000 I NETWORK [conn1084] end connection 127.0.0.1:39566 (74 connections now open) 2016-04-30T03:49:11.040+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39573 #1087 (75 connections now open) 2016-04-30T03:50:53.890+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 03:50:21:c) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 03:50:53:b) 2016-04-30T03:50:53.890+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T03:50:58.863+0000 I NETWORK [conn1086] end connection 127.0.0.1:39568 (74 connections now open) 2016-04-30T03:50:58.878+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39591 #1088 (75 connections now open) 2016-04-30T03:50:58.878+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39592 #1089 (76 connections now open) 2016-04-30T03:50:58.879+0000 I NETWORK [conn1088] end connection 127.0.0.1:39591 (75 connections now open) 2016-04-30T03:50:58.882+0000 I NETWORK [conn1089] end connection 127.0.0.1:39592 (74 connections now open) 2016-04-30T03:50:58.900+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T03:50:58.901+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T03:50:58.901+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-30T03:51:11.851+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-30T03:55:58.881+0000 I NETWORK [conn1087] end connection 127.0.0.1:39573 (73 connections now open) 2016-04-30T03:55:58.882+0000 I NETWORK [conn1085] end connection 127.0.0.1:39567 (72 connections now open) 2016-04-30T03:58:05.027+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T03:58:05.028+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T03:58:05.031+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-30T03:58:10.073+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-30T04:08:54.356+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 04:08:23:d) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 04:08:54:b) 2016-04-30T04:08:54.356+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T04:08:54.373+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-04-30T04:08:55.356+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T04:48:00.511+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40289 #1090 (73 connections now open) 2016-04-30T04:48:00.512+0000 I NETWORK [conn1090] end connection 127.0.0.1:40289 (72 connections now open) 2016-04-30T04:48:00.513+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40290 #1091 (73 connections now open) 2016-04-30T04:48:00.519+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40291 #1092 (74 connections now open) 2016-04-30T04:48:11.017+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40299 #1093 (75 connections now open) 2016-04-30T06:07:21.562+0000 I COMMAND [conn1093] command local.oplog.rs command: getMore { getMore: 16667524543, collection: "oplog.rs", maxTimeMS: 5000, term: 45, lastKnownCommittedOpTime: { ts: Timestamp 1461996441000|1, t: 45 } } cursorid:16667524543 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:0 reslen:292 locks:{ Global: { acquireCount: { r: 2 } }, Database: { acquireCount: { r: 1 } }, oplog: { acquireCount: { r: 1 } } } protocol:op_command 126ms 2016-04-30T06:17:01.187+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 06:16:21:8) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 06:17:01:4) 2016-04-30T06:17:01.187+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T06:17:06.188+0000 I NETWORK [conn1092] end connection 127.0.0.1:40291 (74 connections now open) 2016-04-30T06:17:07.188+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T06:17:07.189+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T06:22:01.189+0000 I NETWORK [conn1093] end connection 127.0.0.1:40299 (73 connections now open) 2016-04-30T06:22:01.189+0000 I NETWORK [conn1091] end connection 127.0.0.1:40290 (72 connections now open) 2016-04-30T07:25:05.410+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42386 #1094 (73 connections now open) 2016-04-30T07:25:05.411+0000 I NETWORK [conn1094] end connection 127.0.0.1:42386 (72 connections now open) 2016-04-30T07:25:05.411+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42387 #1095 (73 connections now open) 2016-04-30T07:25:05.411+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42388 #1096 (74 connections now open) 2016-04-30T07:25:39.605+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42400 #1097 (75 connections now open) 2016-04-30T07:29:00.046+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 07:28:27:6) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 07:29:00:1) 2016-04-30T07:29:00.047+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T07:29:05.046+0000 I NETWORK [conn1096] end connection 127.0.0.1:42388 (74 connections now open) 2016-04-30T07:29:05.048+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T07:29:05.050+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T07:34:00.048+0000 I NETWORK [conn1097] end connection 127.0.0.1:42400 (73 connections now open) 2016-04-30T07:34:00.048+0000 I NETWORK [conn1095] end connection 127.0.0.1:42387 (72 connections now open) 2016-04-30T07:52:03.590+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42790 #1098 (73 connections now open) 2016-04-30T07:52:03.591+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42791 #1099 (74 connections now open) 2016-04-30T07:52:03.591+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42792 #1100 (75 connections now open) 2016-04-30T07:52:03.591+0000 I NETWORK [conn1098] end connection 127.0.0.1:42790 (74 connections now open) 2016-04-30T07:52:56.284+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42803 #1101 (75 connections now open) 2016-04-30T07:58:03.727+0000 I NETWORK [conn1100] end connection 127.0.0.1:42792 (74 connections now open) 2016-04-30T07:58:03.729+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42882 #1102 (75 connections now open) 2016-04-30T07:58:03.730+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42883 #1103 (76 connections now open) 2016-04-30T07:58:03.730+0000 I NETWORK [conn1102] end connection 127.0.0.1:42882 (75 connections now open) 2016-04-30T08:10:06.065+0000 I NETWORK [conn1103] end connection 127.0.0.1:42883 (74 connections now open) 2016-04-30T08:10:07.076+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43060 #1104 (75 connections now open) 2016-04-30T08:10:07.077+0000 I NETWORK [conn1104] end connection 127.0.0.1:43060 (74 connections now open) 2016-04-30T08:10:07.082+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43061 #1105 (75 connections now open) 2016-04-30T08:19:01.413+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 08:18:27:3) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 08:19:01:8) 2016-04-30T08:19:01.413+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T08:19:06.412+0000 I NETWORK [conn1105] end connection 127.0.0.1:43061 (74 connections now open) 2016-04-30T08:19:07.416+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T08:19:07.416+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T08:24:01.416+0000 I NETWORK [conn1099] end connection 127.0.0.1:42791 (73 connections now open) 2016-04-30T08:24:01.416+0000 I NETWORK [conn1101] end connection 127.0.0.1:42803 (72 connections now open) 2016-04-30T08:55:00.462+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 08:54:27:3) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 08:55:00:f) 2016-04-30T08:55:00.462+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T08:55:05.472+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T08:55:05.473+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T08:55:05.473+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-30T08:55:11.075+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-30T09:10:00.813+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 09:09:21:3) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 30 09:10:00:b) 2016-04-30T09:10:00.813+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T09:10:00.814+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T09:10:00.815+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-30T09:10:02.183+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-30T09:16:00.948+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 09:15:27:3) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 09:16:00:18) 2016-04-30T09:16:00.949+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T09:16:06.950+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T09:16:06.951+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T09:16:06.951+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-30T09:16:11.310+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-30T09:49:00.052+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T09:49:11.069+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T09:49:11.093+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T09:49:11.093+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-30T09:49:11.648+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-30T09:51:01.114+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 09:50:27:9) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 09:51:01:3) 2016-04-30T09:51:01.114+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T09:51:07.116+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T09:51:07.116+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T10:21:01.434+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 10:20:27:6) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 10:21:00:2) 2016-04-30T10:21:01.434+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T10:21:06.446+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T10:21:06.447+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T10:43:03.747+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45318 #1106 (73 connections now open) 2016-04-30T10:43:03.748+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45319 #1107 (74 connections now open) 2016-04-30T10:43:03.749+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45320 #1108 (75 connections now open) 2016-04-30T10:43:03.749+0000 I NETWORK [conn1106] end connection 127.0.0.1:45318 (74 connections now open) 2016-04-30T10:43:10.786+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45327 #1109 (75 connections now open) 2016-04-30T10:45:59.879+0000 I NETWORK [conn1108] end connection 127.0.0.1:45320 (74 connections now open) 2016-04-30T10:50:59.882+0000 I NETWORK [conn1109] end connection 127.0.0.1:45327 (73 connections now open) 2016-04-30T10:50:59.883+0000 I NETWORK [conn1107] end connection 127.0.0.1:45319 (72 connections now open) 2016-04-30T10:52:04.153+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45456 #1110 (73 connections now open) 2016-04-30T10:52:04.154+0000 I NETWORK [conn1110] end connection 127.0.0.1:45456 (72 connections now open) 2016-04-30T10:52:04.154+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45457 #1111 (73 connections now open) 2016-04-30T10:52:04.159+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45458 #1112 (74 connections now open) 2016-04-30T10:52:11.194+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45465 #1113 (75 connections now open) 2016-04-30T10:53:06.187+0000 I NETWORK [conn1112] end connection 127.0.0.1:45458 (74 connections now open) 2016-04-30T10:53:06.208+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45473 #1114 (75 connections now open) 2016-04-30T10:53:06.209+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45474 #1115 (76 connections now open) 2016-04-30T10:53:06.209+0000 I NETWORK [conn1114] end connection 127.0.0.1:45473 (75 connections now open) 2016-04-30T10:55:04.212+0000 I NETWORK [conn1115] end connection 127.0.0.1:45474 (74 connections now open) 2016-04-30T10:55:04.237+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45506 #1116 (75 connections now open) 2016-04-30T10:55:04.238+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45507 #1117 (76 connections now open) 2016-04-30T10:55:04.238+0000 I NETWORK [conn1116] end connection 127.0.0.1:45506 (75 connections now open) 2016-04-30T10:58:04.318+0000 I NETWORK [conn1117] end connection 127.0.0.1:45507 (74 connections now open) 2016-04-30T10:58:04.329+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45552 #1118 (75 connections now open) 2016-04-30T10:58:04.330+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45553 #1119 (76 connections now open) 2016-04-30T10:58:04.330+0000 I NETWORK [conn1118] end connection 127.0.0.1:45552 (75 connections now open) 2016-04-30T10:59:06.340+0000 I NETWORK [conn1119] end connection 127.0.0.1:45553 (74 connections now open) 2016-04-30T10:59:06.375+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45569 #1120 (75 connections now open) 2016-04-30T10:59:06.376+0000 I NETWORK [conn1120] end connection 127.0.0.1:45569 (74 connections now open) 2016-04-30T10:59:06.376+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45570 #1121 (75 connections now open) 2016-04-30T11:11:06.737+0000 I NETWORK [conn1121] end connection 127.0.0.1:45570 (74 connections now open) 2016-04-30T11:14:03.865+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45798 #1122 (75 connections now open) 2016-04-30T11:14:03.866+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45799 #1123 (76 connections now open) 2016-04-30T11:14:03.867+0000 I NETWORK [conn1122] end connection 127.0.0.1:45798 (75 connections now open) 2016-04-30T11:15:58.949+0000 I NETWORK [conn1123] end connection 127.0.0.1:45799 (74 connections now open) 2016-04-30T11:20:58.949+0000 I NETWORK [conn1113] end connection 127.0.0.1:45465 (73 connections now open) 2016-04-30T11:20:58.950+0000 I NETWORK [conn1111] end connection 127.0.0.1:45457 (72 connections now open) 2016-04-30T11:41:04.966+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46191 #1124 (73 connections now open) 2016-04-30T11:41:04.967+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46192 #1125 (74 connections now open) 2016-04-30T11:41:04.967+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46193 #1126 (75 connections now open) 2016-04-30T11:41:04.967+0000 I NETWORK [conn1124] end connection 127.0.0.1:46191 (74 connections now open) 2016-04-30T11:41:11.014+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46200 #1127 (75 connections now open) 2016-04-30T11:42:06.027+0000 I NETWORK [conn1126] end connection 127.0.0.1:46193 (74 connections now open) 2016-04-30T11:42:06.042+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46210 #1128 (75 connections now open) 2016-04-30T11:42:06.043+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:46211 #1129 (76 connections now open) 2016-04-30T11:42:06.043+0000 I NETWORK [conn1128] end connection 127.0.0.1:46210 (75 connections now open) 2016-04-30T11:44:01.849+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 11:43:26:6) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 11:44:00:2) 2016-04-30T11:44:01.850+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T11:44:06.850+0000 I NETWORK [conn1129] end connection 127.0.0.1:46211 (74 connections now open) 2016-04-30T11:44:06.876+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T11:44:06.877+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T11:49:06.851+0000 I NETWORK [conn1125] end connection 127.0.0.1:46192 (73 connections now open) 2016-04-30T11:49:06.851+0000 I NETWORK [conn1127] end connection 127.0.0.1:46200 (72 connections now open) 2016-04-30T11:50:00.049+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 11:49:27:6) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 11:50:00:2) 2016-04-30T11:50:00.049+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T11:50:05.083+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T11:50:05.085+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T11:50:05.086+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-30T11:51:06.631+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-30T11:53:00.149+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 11:52:27:4) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 30 11:53:00:6) 2016-04-30T11:53:00.149+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T11:53:06.150+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T11:53:06.151+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T12:27:05.418+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T12:27:05.419+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T12:27:05.419+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-30T12:28:03.636+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-30T13:16:05.742+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47591 #1130 (73 connections now open) 2016-04-30T13:16:05.743+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47592 #1131 (74 connections now open) 2016-04-30T13:16:05.743+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47593 #1132 (75 connections now open) 2016-04-30T13:16:05.743+0000 I NETWORK [conn1130] end connection 127.0.0.1:47591 (74 connections now open) 2016-04-30T13:16:10.933+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47599 #1133 (75 connections now open) 2016-04-30T13:31:00.251+0000 I NETWORK [conn1132] end connection 127.0.0.1:47593 (74 connections now open) 2016-04-30T13:31:05.257+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47815 #1134 (75 connections now open) 2016-04-30T13:31:05.258+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:47816 #1135 (76 connections now open) 2016-04-30T13:31:05.258+0000 I NETWORK [conn1134] end connection 127.0.0.1:47815 (75 connections now open) 2016-04-30T13:52:05.844+0000 I NETWORK [conn1135] end connection 127.0.0.1:47816 (74 connections now open) 2016-04-30T13:52:06.845+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48125 #1136 (75 connections now open) 2016-04-30T13:52:06.847+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48126 #1137 (76 connections now open) 2016-04-30T13:52:06.847+0000 I NETWORK [conn1136] end connection 127.0.0.1:48125 (75 connections now open) 2016-04-30T13:58:01.149+0000 I NETWORK [conn741] end connection 127.0.0.1:41548 (74 connections now open) 2016-04-30T13:58:01.152+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:48211 #1138 (75 connections now open) 2016-04-30T13:58:06.150+0000 I NETWORK [conn1137] end connection 127.0.0.1:48126 (74 connections now open) 2016-04-30T13:59:01.831+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 13:58:26:c) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 13:59:00:2) 2016-04-30T13:59:01.831+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T13:59:06.840+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T13:59:06.841+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T13:59:06.842+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-30T13:59:11.358+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-30T14:03:00.027+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 14:02:28:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 30 14:03:00:1) 2016-04-30T14:03:00.028+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T14:03:00.049+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-04-30T14:03:01.033+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T14:03:01.150+0000 I NETWORK [conn1133] end connection 127.0.0.1:47599 (73 connections now open) 2016-04-30T14:03:01.150+0000 I NETWORK [conn1131] end connection 127.0.0.1:47592 (72 connections now open) 2016-04-30T14:27:00.053+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 14:26:27:11) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 30 14:27:00:2) 2016-04-30T14:27:00.053+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T14:27:11.057+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T14:27:11.125+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T14:57:00.044+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 14:56:22:10) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 30 14:57:00:1) 2016-04-30T14:57:00.044+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T14:57:05.059+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T14:57:05.060+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T15:28:54.897+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 15:28:23:12) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 30 15:28:54:7) 2016-04-30T15:28:54.897+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T15:28:59.924+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T15:28:59.925+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T15:34:02.739+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T15:34:02.740+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T15:34:02.740+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-30T15:35:11.561+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-30T16:18:03.685+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49893 #1139 (73 connections now open) 2016-04-30T16:18:03.686+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49894 #1140 (74 connections now open) 2016-04-30T16:18:03.686+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49895 #1141 (75 connections now open) 2016-04-30T16:18:03.686+0000 I NETWORK [conn1139] end connection 127.0.0.1:49893 (74 connections now open) 2016-04-30T16:18:11.987+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49902 #1142 (75 connections now open) 2016-04-30T16:29:00.062+0000 I NETWORK [conn1141] end connection 127.0.0.1:49895 (74 connections now open) 2016-04-30T16:33:55.089+0000 I NETWORK [conn1140] end connection 127.0.0.1:49894 (73 connections now open) 2016-04-30T16:33:55.089+0000 I NETWORK [conn1142] end connection 127.0.0.1:49902 (72 connections now open) 2016-04-30T16:53:07.595+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50319 #1143 (73 connections now open) 2016-04-30T16:53:07.596+0000 I NETWORK [conn1143] end connection 127.0.0.1:50319 (72 connections now open) 2016-04-30T16:53:07.596+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50320 #1144 (73 connections now open) 2016-04-30T16:53:07.597+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50321 #1145 (74 connections now open) 2016-04-30T16:53:10.871+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:50326 #1146 (75 connections now open) 2016-04-30T16:57:01.467+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 16:56:21:19) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 16:57:01:f) 2016-04-30T16:57:01.467+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T16:57:06.469+0000 I NETWORK [conn1145] end connection 127.0.0.1:50321 (74 connections now open) 2016-04-30T16:57:06.483+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T16:57:06.484+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T17:02:06.468+0000 I NETWORK [conn1146] end connection 127.0.0.1:50326 (73 connections now open) 2016-04-30T17:02:06.468+0000 I NETWORK [conn1144] end connection 127.0.0.1:50320 (72 connections now open) 2016-04-30T17:09:00.061+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 17:08:22:3) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 17:09:00:3) 2016-04-30T17:09:00.062+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T17:09:00.073+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T17:09:00.074+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-30T17:09:21.728+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-30T17:18:00.177+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 17:17:22:16) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 30 17:18:00:27) 2016-04-30T17:18:00.177+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T17:18:01.179+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T17:18:01.180+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T17:31:57.638+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 17:31:21:1c) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 30 17:31:57:2) 2016-04-30T17:31:57.638+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T17:32:02.650+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T17:32:02.651+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T17:45:59.991+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 17:45:21:1c) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 30 17:45:59:e) 2016-04-30T17:45:59.991+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T17:46:05.005+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T17:46:05.005+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T17:46:25.838+0000 I NETWORK [conn1044] end connection 127.0.0.1:35814 (71 connections now open) 2016-04-30T17:46:25.839+0000 I NETWORK [conn1039] end connection 127.0.0.1:35795 (70 connections now open) 2016-04-30T17:46:25.839+0000 I NETWORK [conn1020] end connection 127.0.0.1:35734 (69 connections now open) 2016-04-30T17:46:25.852+0000 I NETWORK [conn1019] end connection 127.0.0.1:35729 (68 connections now open) 2016-04-30T17:46:25.852+0000 I NETWORK [conn1017] end connection 127.0.0.1:35724 (67 connections now open) 2016-04-30T17:46:25.853+0000 I NETWORK [conn1016] end connection 127.0.0.1:35720 (66 connections now open) 2016-04-30T17:46:25.853+0000 I NETWORK [conn1015] end connection 127.0.0.1:35719 (65 connections now open) 2016-04-30T17:46:25.853+0000 I NETWORK [conn1014] end connection 127.0.0.1:35718 (64 connections now open) 2016-04-30T17:46:25.853+0000 I NETWORK [conn1013] end connection 127.0.0.1:35717 (63 connections now open) 2016-04-30T17:46:25.853+0000 I NETWORK [conn1012] end connection 127.0.0.1:35716 (62 connections now open) 2016-04-30T17:46:29.070+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51000 #1147 (63 connections now open) 2016-04-30T17:46:29.071+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51001 #1148 (64 connections now open) 2016-04-30T17:46:29.071+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51002 #1149 (65 connections now open) 2016-04-30T17:46:29.082+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51003 #1150 (66 connections now open) 2016-04-30T17:46:29.082+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51004 #1151 (67 connections now open) 2016-04-30T17:46:29.106+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51008 #1152 (68 connections now open) 2016-04-30T17:46:29.106+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51010 #1153 (69 connections now open) 2016-04-30T17:46:29.121+0000 I NETWORK [conn1153] end connection 127.0.0.1:51010 (68 connections now open) 2016-04-30T17:46:29.136+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51013 #1154 (69 connections now open) 2016-04-30T17:46:29.154+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51018 #1155 (70 connections now open) 2016-04-30T17:46:30.580+0000 I ACCESS [conn1154] Successfully authenticated as principal oplogger on admin 2016-04-30T17:46:30.592+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51020 #1156 (71 connections now open) 2016-04-30T17:46:30.595+0000 I NETWORK [conn1156] end connection 127.0.0.1:51020 (70 connections now open) 2016-04-30T17:46:30.599+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51023 #1157 (71 connections now open) 2016-04-30T17:46:30.624+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51028 #1158 (72 connections now open) 2016-04-30T17:46:31.561+0000 I ACCESS [conn1157] Successfully authenticated as principal oplogger on admin 2016-04-30T18:48:01.480+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 18:47:22:c) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 30 18:48:01:6) 2016-04-30T18:48:01.480+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T18:48:06.502+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T18:48:06.502+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T19:06:53.987+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 19:06:21:1c) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 30 19:06:53:19) 2016-04-30T19:06:53.987+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T19:06:59.988+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T19:06:59.989+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T19:37:56.724+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 19:37:25:3) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 30 19:37:56:a) 2016-04-30T19:37:56.724+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T19:38:01.728+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T19:38:01.729+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T19:55:57.157+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 19:55:21:14) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 30 19:55:57:5) 2016-04-30T19:55:57.157+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T19:56:03.158+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T19:56:03.159+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T20:22:00.158+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 20:21:21:1d) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 30 20:22:00:1e) 2016-04-30T20:22:00.158+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T20:22:01.158+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T20:22:01.159+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T20:22:01.160+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-30T20:22:10.880+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-30T20:48:00.086+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 20:47:22:5) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 20:48:00:1f) 2016-04-30T20:48:00.088+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T20:48:01.088+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T20:48:01.089+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T21:06:00.075+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52975 #1159 (73 connections now open) 2016-04-30T21:06:00.075+0000 I NETWORK [conn1159] end connection 127.0.0.1:52975 (72 connections now open) 2016-04-30T21:06:00.076+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52976 #1160 (73 connections now open) 2016-04-30T21:06:00.114+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52977 #1161 (74 connections now open) 2016-04-30T21:06:10.137+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:52980 #1162 (75 connections now open) 2016-04-30T21:13:58.997+0000 I NETWORK [conn1161] end connection 127.0.0.1:52977 (74 connections now open) 2016-04-30T21:13:58.998+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53053 #1163 (75 connections now open) 2016-04-30T21:13:58.999+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53054 #1164 (76 connections now open) 2016-04-30T21:13:58.999+0000 I NETWORK [conn1163] end connection 127.0.0.1:53053 (75 connections now open) 2016-04-30T21:16:00.134+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 21:15:22:1c) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 21:16:00:29) 2016-04-30T21:16:00.134+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T21:16:05.134+0000 I NETWORK [conn1164] end connection 127.0.0.1:53054 (74 connections now open) 2016-04-30T21:16:06.135+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T21:16:06.136+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T21:18:00.182+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53106 #1165 (75 connections now open) 2016-04-30T21:18:00.182+0000 I NETWORK [conn1165] end connection 127.0.0.1:53106 (74 connections now open) 2016-04-30T21:18:00.183+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53107 #1166 (75 connections now open) 2016-04-30T21:29:00.441+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 21:28:22:6) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 21:29:00:3d) 2016-04-30T21:29:00.441+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T21:29:00.449+0000 I NETWORK [conn1166] end connection 127.0.0.1:53107 (74 connections now open) 2016-04-30T21:29:01.441+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T21:29:01.442+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T21:34:00.449+0000 I NETWORK [conn1162] end connection 127.0.0.1:52980 (73 connections now open) 2016-04-30T21:34:00.449+0000 I NETWORK [conn1160] end connection 127.0.0.1:52976 (72 connections now open) 2016-04-30T22:28:59.010+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 22:28:22:7) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 22:28:58:21) 2016-04-30T22:28:59.010+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T22:29:04.035+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T22:29:04.036+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T22:29:04.036+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-30T22:30:20.065+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-30T22:56:00.104+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T22:56:01.104+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T22:56:01.105+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T22:56:01.105+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-30T22:56:06.098+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54067 #1167 (73 connections now open) 2016-04-30T22:56:06.099+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54068 #1168 (74 connections now open) 2016-04-30T22:56:06.099+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54069 #1169 (75 connections now open) 2016-04-30T22:56:06.099+0000 I NETWORK [conn1167] end connection 127.0.0.1:54067 (74 connections now open) 2016-04-30T22:56:21.345+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54077 #1170 (75 connections now open) 2016-04-30T22:57:10.059+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-04-30T23:04:00.346+0000 I NETWORK [conn1169] end connection 127.0.0.1:54069 (74 connections now open) 2016-04-30T23:09:00.359+0000 I NETWORK [conn1170] end connection 127.0.0.1:54077 (73 connections now open) 2016-04-30T23:09:00.359+0000 I NETWORK [conn1168] end connection 127.0.0.1:54068 (72 connections now open) 2016-04-30T23:22:00.204+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 23:21:21:c) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 23:22:00:2c) 2016-04-30T23:22:00.205+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T23:22:00.206+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T23:22:00.207+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-30T23:22:59.968+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 23:22:21:d) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 30 23:22:59:15) 2016-04-30T23:22:59.968+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T23:23:05.017+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T23:23:05.019+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T23:24:00.035+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 23:23:22:5) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: Apr 30 23:24:00:5) 2016-04-30T23:24:00.035+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T23:24:00.055+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-04-30T23:25:00.050+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 23:24:28:13) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 23:25:00:2) 2016-04-30T23:25:00.050+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-04-30T23:25:01.051+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-04-30T23:54:00.144+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: Apr 30 23:53:21:1e) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: Apr 30 23:54:00:14) 2016-04-30T23:54:00.144+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-04-30T23:54:00.146+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-04-30T23:54:00.148+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-04-30T23:54:00.189+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T00:02:00.145+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 00:01:21:8) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: May 1 00:02:00:18) 2016-05-01T00:02:00.145+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T00:02:01.145+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T00:02:01.146+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T00:02:01.147+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T00:02:10.811+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T00:06:05.091+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54777 #1171 (73 connections now open) 2016-05-01T00:06:05.091+0000 I NETWORK [conn1171] end connection 127.0.0.1:54777 (72 connections now open) 2016-05-01T00:06:05.091+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54778 #1172 (73 connections now open) 2016-05-01T00:06:05.096+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54779 #1173 (74 connections now open) 2016-05-01T00:08:11.171+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54799 #1174 (75 connections now open) 2016-05-01T00:12:05.327+0000 I NETWORK [conn1173] end connection 127.0.0.1:54779 (74 connections now open) 2016-05-01T00:12:05.333+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54837 #1175 (75 connections now open) 2016-05-01T00:12:05.333+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54838 #1176 (76 connections now open) 2016-05-01T00:12:05.333+0000 I NETWORK [conn1175] end connection 127.0.0.1:54837 (75 connections now open) 2016-05-01T00:23:02.764+0000 I NETWORK [conn1176] end connection 127.0.0.1:54838 (74 connections now open) 2016-05-01T00:23:03.767+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54949 #1177 (75 connections now open) 2016-05-01T00:23:03.768+0000 I NETWORK [conn1177] end connection 127.0.0.1:54949 (74 connections now open) 2016-05-01T00:23:03.791+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54950 #1178 (75 connections now open) 2016-05-01T00:33:00.032+0000 I NETWORK [conn1178] end connection 127.0.0.1:54950 (74 connections now open) 2016-05-01T00:33:00.060+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 00:32:21:c) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 00:33:00:d) 2016-05-01T00:33:00.060+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T00:33:05.058+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:55048 #1179 (75 connections now open) 2016-05-01T00:33:05.059+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:55049 #1180 (76 connections now open) 2016-05-01T00:33:05.059+0000 I NETWORK [conn1179] end connection 127.0.0.1:55048 (75 connections now open) 2016-05-01T00:33:05.062+0000 I NETWORK [conn1180] end connection 127.0.0.1:55049 (74 connections now open) 2016-05-01T00:33:05.078+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T00:33:05.095+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T00:38:05.062+0000 I NETWORK [conn1174] end connection 127.0.0.1:54799 (73 connections now open) 2016-05-01T00:38:05.062+0000 I NETWORK [conn1172] end connection 127.0.0.1:54778 (72 connections now open) 2016-05-01T00:46:00.464+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 00:45:21:16) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 00:46:00:4b) 2016-05-01T00:46:00.464+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T00:46:06.465+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-01T00:46:06.466+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-05-01T00:46:06.466+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T00:46:11.136+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T01:14:52.984+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 01:14:21:18) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: May 1 01:14:52:1f) 2016-05-01T01:14:52.984+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T01:14:52.999+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-01T01:14:53.985+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-01T01:43:55.984+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T01:44:01.023+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T01:44:01.024+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T01:44:01.024+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T01:45:11.830+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T01:48:00.185+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 01:47:21:21) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 01:48:00:33) 2016-05-01T01:48:00.186+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T01:48:06.187+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-01T01:48:06.187+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-05-01T02:16:00.244+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T02:16:01.244+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T02:16:01.244+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T02:16:01.245+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T02:16:11.584+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T02:25:55.587+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 02:25:21:d) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 02:25:55:a) 2016-05-01T02:25:55.587+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T02:26:00.589+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T02:26:00.590+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T02:32:54.743+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 02:32:21:e) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 02:32:54:a) 2016-05-01T02:32:54.744+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T02:33:04.746+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-01T02:33:04.747+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-05-01T02:33:04.748+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T02:33:21.259+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T02:41:00.087+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T02:41:01.087+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T02:41:01.088+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T02:41:01.088+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T02:41:20.083+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T03:58:53.709+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 03:58:21:6) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 03:58:53:4) 2016-05-01T03:58:53.709+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T03:58:58.714+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T03:58:58.714+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T06:22:01.432+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33840 #1181 (73 connections now open) 2016-05-01T06:22:01.434+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33841 #1182 (74 connections now open) 2016-05-01T06:22:01.434+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33842 #1183 (75 connections now open) 2016-05-01T06:22:01.434+0000 I NETWORK [conn1181] end connection 127.0.0.1:33840 (74 connections now open) 2016-05-01T06:24:15.514+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:33922 #1184 (75 connections now open) 2016-05-01T06:25:11.860+0000 I COMMAND [conn1184] command local.oplog.rs command: getMore { getMore: 17151970752, collection: "oplog.rs", maxTimeMS: 5000, term: 45, lastKnownCommittedOpTime: { ts: Timestamp 1462083911000|29, t: 45 } } cursorid:17151970752 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:5 reslen:1658 locks:{ Global: { acquireCount: { r: 2 }, acquireWaitCount: { r: 1 }, timeAcquiringMicros: { r: 235650 } }, Database: { acquireCount: { r: 1 } }, oplog: { acquireCount: { r: 1 } } } protocol:op_command 235ms 2016-05-01T07:33:00.233+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 07:32:21:7) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 07:33:00:3e) 2016-05-01T07:33:00.234+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T07:33:00.235+0000 I NETWORK [conn1183] end connection 127.0.0.1:33842 (74 connections now open) 2016-05-01T07:33:10.236+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T07:33:10.237+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T07:38:00.235+0000 I NETWORK [conn1182] end connection 127.0.0.1:33841 (73 connections now open) 2016-05-01T07:38:00.235+0000 I NETWORK [conn1184] end connection 127.0.0.1:33922 (72 connections now open) 2016-05-01T08:48:00.058+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 08:47:21:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 08:48:00:c) 2016-05-01T08:48:00.058+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T08:48:01.058+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T08:48:01.059+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T08:50:05.099+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37552 #1185 (73 connections now open) 2016-05-01T08:50:05.100+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37553 #1186 (74 connections now open) 2016-05-01T08:50:05.100+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37554 #1187 (75 connections now open) 2016-05-01T08:50:05.100+0000 I NETWORK [conn1185] end connection 127.0.0.1:37552 (74 connections now open) 2016-05-01T08:50:11.675+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37562 #1188 (75 connections now open) 2016-05-01T09:01:00.280+0000 I COMMAND [conn1188] command local.oplog.rs command: getMore { getMore: 16790329846, collection: "oplog.rs", maxTimeMS: 5000, term: 45, lastKnownCommittedOpTime: { ts: Timestamp 1462093260000|36, t: 45 } } cursorid:16790329846 keyUpdates:0 writeConflicts:0 numYields:0 nreturned:24 reslen:3312 locks:{ Global: { acquireCount: { r: 2 } }, Database: { acquireCount: { r: 1 } }, oplog: { acquireCount: { r: 1 } } } protocol:op_command 121ms 2016-05-01T10:00:05.111+0000 I NETWORK [conn1187] end connection 127.0.0.1:37554 (74 connections now open) 2016-05-01T10:00:06.117+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39027 #1189 (75 connections now open) 2016-05-01T10:00:06.118+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39028 #1190 (76 connections now open) 2016-05-01T10:00:06.118+0000 I NETWORK [conn1189] end connection 127.0.0.1:39027 (75 connections now open) 2016-05-01T10:06:00.294+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39151 #1191 (76 connections now open) 2016-05-01T10:06:00.295+0000 I NETWORK [conn1138] end connection 127.0.0.1:48211 (75 connections now open) 2016-05-01T10:06:05.293+0000 I NETWORK [conn1190] end connection 127.0.0.1:39028 (74 connections now open) 2016-05-01T10:06:06.296+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39155 #1192 (75 connections now open) 2016-05-01T10:06:06.297+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39156 #1193 (76 connections now open) 2016-05-01T10:06:06.297+0000 I NETWORK [conn1192] end connection 127.0.0.1:39155 (75 connections now open) 2016-05-01T10:26:00.151+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 10:25:21:2) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 10:26:00:b) 2016-05-01T10:26:00.151+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T10:26:00.173+0000 I NETWORK [conn1193] end connection 127.0.0.1:39156 (74 connections now open) 2016-05-01T10:26:10.154+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T10:26:10.155+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T10:26:10.171+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39585 #1194 (75 connections now open) 2016-05-01T10:26:10.172+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:39586 #1195 (76 connections now open) 2016-05-01T10:26:10.172+0000 I NETWORK [conn1194] end connection 127.0.0.1:39585 (75 connections now open) 2016-05-01T10:32:00.359+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 10:31:21:c) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 10:32:00:45) 2016-05-01T10:32:00.359+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T10:32:10.361+0000 I NETWORK [conn1195] end connection 127.0.0.1:39586 (74 connections now open) 2016-05-01T10:32:11.362+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T10:32:11.378+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T10:37:05.361+0000 I NETWORK [conn1188] end connection 127.0.0.1:37562 (73 connections now open) 2016-05-01T10:37:05.361+0000 I NETWORK [conn1186] end connection 127.0.0.1:37553 (72 connections now open) 2016-05-01T10:50:06.119+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40091 #1196 (73 connections now open) 2016-05-01T10:50:06.120+0000 I NETWORK [conn1196] end connection 127.0.0.1:40091 (72 connections now open) 2016-05-01T10:50:06.120+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40092 #1197 (73 connections now open) 2016-05-01T10:50:06.125+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40093 #1198 (74 connections now open) 2016-05-01T10:50:11.082+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:40100 #1199 (75 connections now open) 2016-05-01T10:54:00.264+0000 I NETWORK [conn1198] end connection 127.0.0.1:40093 (74 connections now open) 2016-05-01T10:59:00.246+0000 I NETWORK [conn1197] end connection 127.0.0.1:40092 (73 connections now open) 2016-05-01T10:59:00.246+0000 I NETWORK [conn1199] end connection 127.0.0.1:40100 (72 connections now open) 2016-05-01T11:02:00.307+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 11:01:21:12) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 11:02:00:32) 2016-05-01T11:02:00.308+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T11:02:05.312+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-01T11:02:05.312+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-05-01T11:02:05.313+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T11:02:17.535+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T11:48:00.143+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T11:48:01.143+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T11:48:01.144+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T11:48:01.144+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T11:49:11.358+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T12:14:00.118+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 12:13:21:6) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 12:14:00:4) 2016-05-01T12:14:00.118+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T12:14:01.118+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T12:14:01.119+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T12:40:00.134+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 12:39:21:e) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 12:40:00:22) 2016-05-01T12:40:00.152+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-01T12:40:00.154+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-05-01T12:40:00.155+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T12:40:00.174+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T12:40:01.175+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T12:40:01.176+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T13:04:05.031+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42932 #1200 (73 connections now open) 2016-05-01T13:04:05.032+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42933 #1201 (74 connections now open) 2016-05-01T13:04:05.032+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42934 #1202 (75 connections now open) 2016-05-01T13:04:05.032+0000 I NETWORK [conn1200] end connection 127.0.0.1:42932 (74 connections now open) 2016-05-01T13:05:11.024+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:42970 #1203 (75 connections now open) 2016-05-01T13:06:00.084+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 13:05:21:4) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 13:06:00:13) 2016-05-01T13:06:00.084+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T13:06:05.086+0000 I NETWORK [conn1202] end connection 127.0.0.1:42934 (74 connections now open) 2016-05-01T13:06:06.085+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T13:06:06.086+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T13:11:00.113+0000 I NETWORK [conn1201] end connection 127.0.0.1:42933 (73 connections now open) 2016-05-01T13:11:00.113+0000 I NETWORK [conn1203] end connection 127.0.0.1:42970 (73 connections now open) 2016-05-01T14:03:00.419+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 14:02:27:12) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 14:03:00:31) 2016-05-01T14:03:00.419+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T14:03:01.424+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T14:03:01.425+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T15:12:00.209+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 15:11:21:8) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 15:12:00:38) 2016-05-01T15:12:00.209+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T15:12:06.194+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45631 #1204 (73 connections now open) 2016-05-01T15:12:06.195+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45632 #1205 (74 connections now open) 2016-05-01T15:12:06.195+0000 I NETWORK [conn1204] end connection 127.0.0.1:45631 (73 connections now open) 2016-05-01T15:12:06.195+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:45633 #1206 (74 connections now open) 2016-05-01T15:12:06.202+0000 I NETWORK [conn1206] end connection 127.0.0.1:45633 (73 connections now open) 2016-05-01T15:12:06.210+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T15:12:06.210+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T15:14:00.299+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 15:13:21:4) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 15:14:00:31) 2016-05-01T15:14:00.312+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T15:14:00.369+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-05-01T15:14:01.312+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T15:17:06.203+0000 I NETWORK [conn1205] end connection 127.0.0.1:45632 (72 connections now open) 2016-05-01T15:40:00.214+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 15:39:21:8) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 15:40:00:38) 2016-05-01T15:40:00.214+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-01T15:40:00.217+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T15:40:00.218+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-05-01T15:40:11.498+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T16:00:05.135+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T16:00:05.135+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T16:00:05.137+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T16:00:11.871+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T16:40:00.129+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 16:39:21:1c) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 16:40:00:44) 2016-05-01T16:40:00.129+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T16:40:05.139+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-01T16:40:05.140+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-05-01T16:40:05.141+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T16:41:04.946+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T16:42:00.184+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 16:41:21:16) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: May 1 16:42:00:11) 2016-05-01T16:42:00.184+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T16:42:00.260+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T16:46:00.355+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 16:45:21:10) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 16:46:00:41) 2016-05-01T16:46:00.355+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T16:46:06.357+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-01T16:46:06.357+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-05-01T16:56:00.112+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T16:56:01.114+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T16:56:01.115+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T16:56:01.115+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T16:56:01.121+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T18:36:01.180+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49949 #1207 (73 connections now open) 2016-05-01T18:36:01.181+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49950 #1208 (74 connections now open) 2016-05-01T18:36:01.181+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49951 #1209 (75 connections now open) 2016-05-01T18:36:01.181+0000 I NETWORK [conn1207] end connection 127.0.0.1:49949 (74 connections now open) 2016-05-01T18:36:15.700+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:49960 #1210 (75 connections now open) 2016-05-01T19:01:00.406+0000 I COMMAND [conn742] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 45 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:425 locks:{} protocol:op_command 138ms 2016-05-01T19:01:00.406+0000 I COMMAND [conn1191] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 45 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:425 locks:{} protocol:op_command 138ms 2016-05-01T19:04:00.461+0000 I NETWORK [conn1209] end connection 127.0.0.1:49951 (74 connections now open) 2016-05-01T19:09:00.467+0000 I NETWORK [conn1208] end connection 127.0.0.1:49950 (73 connections now open) 2016-05-01T19:09:00.468+0000 I NETWORK [conn1210] end connection 127.0.0.1:49960 (72 connections now open) 2016-05-01T19:14:00.091+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 19:13:21:1e) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 19:14:00:1) 2016-05-01T19:14:00.091+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T19:14:05.091+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-01T19:14:05.094+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-05-01T19:14:05.094+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T19:14:17.996+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T20:18:00.487+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 20:17:27:4) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: May 1 20:18:00:4f) 2016-05-01T20:18:00.487+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T20:18:06.488+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-01T20:18:06.489+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-05-01T20:35:00.159+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T20:35:11.206+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T20:35:11.208+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T20:35:11.208+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T20:35:22.389+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T20:55:00.161+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 20:54:21:9) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 20:55:00:20) 2016-05-01T20:55:00.161+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T20:55:05.162+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T20:55:05.163+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T20:57:00.255+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 20:56:20:8) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 20:57:00:23) 2016-05-01T20:57:00.258+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T20:57:01.258+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T21:15:00.103+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 21:14:21:15) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 21:15:00:25) 2016-05-01T21:15:00.118+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-01T21:15:00.153+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-05-01T21:15:00.154+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T21:15:11.038+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T21:16:00.237+0000 I COMMAND [conn1011] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 142ms 2016-05-01T21:17:00.149+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 21:16:21:c) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: May 1 21:17:00:c) 2016-05-01T21:17:00.149+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T21:17:01.149+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T21:17:01.150+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T21:29:10.488+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53606 #1211 (73 connections now open) 2016-05-01T21:29:10.489+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53607 #1212 (74 connections now open) 2016-05-01T21:29:10.489+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53608 #1213 (75 connections now open) 2016-05-01T21:29:10.489+0000 I NETWORK [conn1211] end connection 127.0.0.1:53606 (74 connections now open) 2016-05-01T21:29:11.787+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:53609 #1214 (75 connections now open) 2016-05-01T21:49:00.151+0000 I NETWORK [conn1213] end connection 127.0.0.1:53608 (74 connections now open) 2016-05-01T21:51:00.470+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 21:50:21:14) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 21:51:00:48) 2016-05-01T21:51:00.470+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T21:51:00.503+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-05-01T21:51:01.475+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-01T21:51:01.476+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-05-01T21:51:01.477+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T21:51:11.615+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T21:54:00.101+0000 I NETWORK [conn1214] end connection 127.0.0.1:53609 (73 connections now open) 2016-05-01T21:54:00.103+0000 I NETWORK [conn1212] end connection 127.0.0.1:53607 (72 connections now open) 2016-05-01T22:09:00.368+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 22:08:21:1c) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: May 1 22:09:00:35) 2016-05-01T22:09:00.368+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T22:09:00.454+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T22:09:00.455+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T22:09:17.253+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T22:33:00.220+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54958 #1215 (73 connections now open) 2016-05-01T22:33:00.276+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54959 #1216 (74 connections now open) 2016-05-01T22:33:00.276+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54960 #1217 (75 connections now open) 2016-05-01T22:33:00.276+0000 I NETWORK [conn1215] end connection 127.0.0.1:54958 (74 connections now open) 2016-05-01T22:33:20.723+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:54974 #1218 (75 connections now open) 2016-05-01T22:47:00.136+0000 I NETWORK [conn1217] end connection 127.0.0.1:54960 (74 connections now open) 2016-05-01T22:51:00.286+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 22:50:21:20) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 22:51:00:4d) 2016-05-01T22:51:00.287+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-01T22:51:00.289+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-05-01T22:51:00.289+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T22:51:36.420+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T22:52:00.180+0000 I NETWORK [conn1216] end connection 127.0.0.1:54959 (73 connections now open) 2016-05-01T22:52:00.180+0000 I NETWORK [conn1218] end connection 127.0.0.1:54974 (73 connections now open) 2016-05-01T22:52:00.232+0000 I COMMAND [conn742] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 45 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:425 locks:{} protocol:op_command 133ms 2016-05-01T22:59:00.093+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 22:58:21:13) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: May 1 22:59:00:7) 2016-05-01T22:59:00.094+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T22:59:01.106+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T22:59:01.107+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T22:59:01.108+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T22:59:21.130+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T23:19:00.207+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 23:18:21:a) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 23:19:00:30) 2016-05-01T23:19:00.208+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T23:19:05.216+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T23:19:05.217+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T23:39:00.093+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 23:38:21:8) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 1 23:39:00:16) 2016-05-01T23:39:00.094+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-01T23:39:06.095+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-01T23:39:06.099+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-05-01T23:39:06.100+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T23:39:21.393+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-01T23:47:00.327+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 1 23:46:21:e) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: May 1 23:47:00:39) 2016-05-01T23:47:00.327+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-01T23:47:00.331+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-01T23:47:00.351+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-01T23:47:11.672+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-02T00:31:05.077+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57469 #1219 (73 connections now open) 2016-05-02T00:31:05.078+0000 I NETWORK [conn1219] end connection 127.0.0.1:57469 (72 connections now open) 2016-05-02T00:31:05.078+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57470 #1220 (73 connections now open) 2016-05-02T00:31:05.083+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57471 #1221 (74 connections now open) 2016-05-02T00:31:10.861+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:57478 #1222 (75 connections now open) 2016-05-02T00:37:00.134+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 2 00:36:22:11) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 2 00:37:00:c) 2016-05-02T00:37:00.135+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-02T00:37:01.135+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-02T00:37:01.136+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-02T00:37:01.146+0000 I NETWORK [conn1221] end connection 127.0.0.1:57471 (74 connections now open) 2016-05-02T00:42:00.149+0000 I NETWORK [conn1222] end connection 127.0.0.1:57478 (73 connections now open) 2016-05-02T00:42:00.149+0000 I NETWORK [conn1220] end connection 127.0.0.1:57470 (72 connections now open) 2016-05-02T01:00:00.105+0000 I COMMAND [conn975] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 105ms 2016-05-02T01:11:05.222+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58319 #1223 (73 connections now open) 2016-05-02T01:11:05.223+0000 I NETWORK [conn1223] end connection 127.0.0.1:58319 (72 connections now open) 2016-05-02T01:11:05.223+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58320 #1224 (73 connections now open) 2016-05-02T01:11:05.226+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58321 #1225 (74 connections now open) 2016-05-02T01:12:21.496+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58360 #1226 (75 connections now open) 2016-05-02T01:15:05.320+0000 I NETWORK [conn1225] end connection 127.0.0.1:58321 (74 connections now open) 2016-05-02T01:15:05.323+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58407 #1227 (75 connections now open) 2016-05-02T01:15:05.323+0000 I NETWORK [conn1227] end connection 127.0.0.1:58407 (74 connections now open) 2016-05-02T01:15:05.325+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:58408 #1228 (75 connections now open) 2016-05-02T01:59:00.215+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 2 01:58:22:4) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 2 01:59:00:19) 2016-05-02T01:59:00.217+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-02T01:59:00.250+0000 I NETWORK [conn1228] end connection 127.0.0.1:58408 (74 connections now open) 2016-05-02T01:59:01.232+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-02T01:59:01.233+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-02T02:04:00.266+0000 I NETWORK [conn1226] end connection 127.0.0.1:58360 (73 connections now open) 2016-05-02T02:04:00.266+0000 I NETWORK [conn1224] end connection 127.0.0.1:58320 (73 connections now open) 2016-05-02T02:17:00.204+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 2 02:16:21:f) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 2 02:17:00:c) 2016-05-02T02:17:00.204+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-02T02:17:01.203+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59715 #1229 (73 connections now open) 2016-05-02T02:17:01.204+0000 I NETWORK [conn1229] end connection 127.0.0.1:59715 (72 connections now open) 2016-05-02T02:17:01.204+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59716 #1230 (73 connections now open) 2016-05-02T02:17:01.204+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59717 #1231 (74 connections now open) 2016-05-02T02:17:01.205+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-02T02:17:01.207+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-02T02:17:40.964+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:59739 #1232 (75 connections now open) 2016-05-02T02:39:00.192+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 2 02:38:21:10) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 2 02:39:00:3) 2016-05-02T02:39:00.192+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-02T02:39:01.052+0000 I NETWORK [conn1231] end connection 127.0.0.1:59717 (74 connections now open) 2016-05-02T02:39:05.193+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-02T02:39:05.194+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-05-02T02:39:05.194+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-02T02:40:11.151+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-02T02:43:00.340+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 2 02:42:25:16) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: May 2 02:43:00:2c) 2016-05-02T02:43:00.384+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-02T02:43:00.446+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-02T02:44:00.057+0000 I NETWORK [conn1232] end connection 127.0.0.1:59739 (73 connections now open) 2016-05-02T02:44:00.057+0000 I NETWORK [conn1230] end connection 127.0.0.1:59716 (72 connections now open) 2016-05-02T03:05:06.059+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60741 #1233 (73 connections now open) 2016-05-02T03:05:06.062+0000 I NETWORK [conn1233] end connection 127.0.0.1:60741 (72 connections now open) 2016-05-02T03:05:06.062+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60742 #1234 (73 connections now open) 2016-05-02T03:05:06.067+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60743 #1235 (74 connections now open) 2016-05-02T03:05:19.762+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:60751 #1236 (75 connections now open) 2016-05-02T03:13:00.381+0000 I NETWORK [conn1235] end connection 127.0.0.1:60743 (74 connections now open) 2016-05-02T03:18:00.381+0000 I NETWORK [conn1234] end connection 127.0.0.1:60742 (73 connections now open) 2016-05-02T03:18:00.381+0000 I NETWORK [conn1236] end connection 127.0.0.1:60751 (72 connections now open) 2016-05-02T03:23:00.349+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 2 03:22:21:11) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 2 03:23:00:30) 2016-05-02T03:23:00.349+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-02T03:23:00.431+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-05-02T03:23:00.432+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-02T03:23:19.593+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-02T03:41:00.100+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 2 03:40:21:a) which is more than 30s behind member localhost:27017 whose most recent OpTime is (term: 45, timestamp: May 2 03:41:00:2d) 2016-05-02T03:41:00.100+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-02T03:41:00.158+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-02T03:41:00.170+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-02T03:41:18.936+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-02T04:13:00.067+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 2 04:12:21:11) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 2 04:13:00:b) 2016-05-02T04:13:00.068+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-02T04:13:01.068+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-02T04:13:01.069+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-02T04:27:05.225+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34250 #1237 (73 connections now open) 2016-05-02T04:27:05.226+0000 I NETWORK [conn1237] end connection 127.0.0.1:34250 (72 connections now open) 2016-05-02T04:27:05.226+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34251 #1238 (73 connections now open) 2016-05-02T04:27:05.230+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34252 #1239 (74 connections now open) 2016-05-02T04:27:11.394+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:34259 #1240 (75 connections now open) 2016-05-02T04:43:00.103+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 2 04:42:22:3) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 2 04:43:00:21) 2016-05-02T04:43:00.114+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-02T04:43:00.150+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-05-02T04:43:01.114+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-02T04:43:01.163+0000 I NETWORK [conn1239] end connection 127.0.0.1:34252 (74 connections now open) 2016-05-02T04:48:00.160+0000 I NETWORK [conn1238] end connection 127.0.0.1:34251 (73 connections now open) 2016-05-02T04:48:00.162+0000 I NETWORK [conn1240] end connection 127.0.0.1:34259 (72 connections now open) 2016-05-02T05:09:00.137+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 2 05:08:22:4) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 2 05:09:00:1f) 2016-05-02T05:09:00.142+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-02T05:09:01.142+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-02T05:09:01.154+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-05-02T05:09:01.158+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-02T05:09:38.165+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-02T05:15:00.169+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-02T05:15:10.171+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-02T05:15:10.172+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-02T05:15:10.173+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-02T05:15:20.029+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-02T05:37:00.263+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 2 05:36:21:e) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 2 05:37:00:36) 2016-05-02T05:37:00.274+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-02T05:37:05.275+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-02T05:37:05.277+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-05-02T05:37:05.283+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-02T05:37:40.280+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-02T06:01:00.207+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-02T06:01:01.210+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-02T06:01:01.216+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-02T06:01:01.220+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-02T06:01:37.851+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-02T06:25:00.093+0000 I REPL [ReplicationExecutor] re-evaluating sync source because our current sync source's most recent OpTime is (term: 45, timestamp: May 2 06:24:21:7) which is more than 30s behind member localhost:27015 whose most recent OpTime is (term: 45, timestamp: May 2 06:25:00:12) 2016-05-02T06:25:00.113+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-02T06:25:01.114+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-02T06:25:01.125+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-05-02T06:25:01.130+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-02T06:25:36.739+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-02T06:28:32.691+0000 I COMMAND [conn1191] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 45 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:425 locks:{} protocol:op_command 211ms 2016-05-02T06:28:32.691+0000 I COMMAND [conn742] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 45 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:425 locks:{} protocol:op_command 211ms 2016-05-02T06:28:32.945+0000 I COMMAND [conn981] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 132ms 2016-05-02T06:28:33.386+0000 I COMMAND [conn975] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 197ms 2016-05-02T06:28:35.747+0000 I COMMAND [conn1073] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 1469ms 2016-05-02T06:28:35.747+0000 I COMMAND [conn1072] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 1469ms 2016-05-02T06:28:35.747+0000 I COMMAND [conn984] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 1469ms 2016-05-02T06:28:35.747+0000 I COMMAND [conn1043] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 1469ms 2016-05-02T06:28:35.747+0000 I COMMAND [conn1078] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 1469ms 2016-05-02T06:28:35.747+0000 I COMMAND [conn1050] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 1469ms 2016-05-02T06:28:35.747+0000 I COMMAND [conn999] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 1469ms 2016-05-02T06:28:35.747+0000 I COMMAND [conn995] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 1469ms 2016-05-02T06:28:35.747+0000 I COMMAND [conn1061] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 1469ms 2016-05-02T06:28:35.751+0000 I COMMAND [conn1069] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 1469ms 2016-05-02T06:28:35.751+0000 I COMMAND [conn972] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 1469ms 2016-05-02T06:28:42.288+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-02T06:28:44.322+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 190, after asserts: 560, after connections: 1130, after extra_info: 1930, after globalLock: 2300, after locks: 2400, after network: 2500, after opcounters: 2500, after opcountersRepl: 2500, after repl: 4480, after storageEngine: 5200, after tcmalloc: 5970, after wiredTiger: 7270, at end: 8840 } 2016-05-02T06:28:44.704+0000 I COMMAND [conn1191] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 45 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:425 locks:{} protocol:op_command 6363ms 2016-05-02T06:28:44.704+0000 I COMMAND [conn742] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 45 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:425 locks:{} protocol:op_command 6363ms 2016-05-02T06:28:46.275+0000 I COMMAND [conn1152] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 597ms 2016-05-02T06:28:46.281+0000 I COMMAND [conn1079] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 1048ms 2016-05-02T06:28:47.373+0000 I NETWORK [conn742] end connection 127.0.0.1:41551 (71 connections now open) 2016-05-02T06:28:47.373+0000 I NETWORK [conn1191] end connection 127.0.0.1:39151 (71 connections now open) 2016-05-02T06:28:48.853+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36845 #1241 (73 connections now open) 2016-05-02T06:28:49.991+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36847 #1242 (72 connections now open) 2016-05-02T06:28:52.594+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36848 #1243 (73 connections now open) 2016-05-02T06:28:53.000+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:28:55.280+0000 I COMMAND [conn1241] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 1642ms 2016-05-02T06:28:55.280+0000 I COMMAND [conn992] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 407ms 2016-05-02T06:28:56.262+0000 I COMMAND [conn1242] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 1120ms 2016-05-02T06:28:56.267+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T06:28:57.486+0000 I COMMAND [conn1243] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 198ms 2016-05-02T06:28:57.881+0000 I NETWORK [conn1242] end connection 127.0.0.1:36847 (72 connections now open) 2016-05-02T06:28:57.881+0000 I NETWORK [conn1241] end connection 127.0.0.1:36845 (72 connections now open) 2016-05-02T06:29:05.854+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 10, after asserts: 90, after connections: 400, after extra_info: 1470, after globalLock: 1700, after locks: 1710, after network: 1710, after opcounters: 1710, after opcountersRepl: 1710, after repl: 3200, after storageEngine: 3790, after tcmalloc: 4560, after wiredTiger: 5920, at end: 7660 } 2016-05-02T06:29:06.146+0000 I NETWORK [conn1243] end connection 127.0.0.1:36848 (70 connections now open) 2016-05-02T06:29:06.335+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36850 #1244 (72 connections now open) 2016-05-02T06:29:08.171+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T06:29:10.361+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T06:29:13.623+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36851 #1245 (72 connections now open) 2016-05-02T06:29:14.622+0000 I COMMAND [conn1244] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:368 locks:{} protocol:op_query 4163ms 2016-05-02T06:29:14.627+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:29:15.016+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:29:15.757+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-05-02T06:29:17.545+0000 I COMMAND [conn1245] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1087ms 2016-05-02T06:29:18.872+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:29:19.157+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-05-02T06:29:20.375+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 390, after connections: 490, after extra_info: 910, after globalLock: 930, after locks: 930, after network: 930, after opcounters: 930, after opcountersRepl: 930, after repl: 930, after storageEngine: 930, after tcmalloc: 1020, after wiredTiger: 1110, at end: 1260 } 2016-05-02T06:29:22.224+0000 I REPL [ReplicationExecutor] dry election run succeeded, running for election 2016-05-02T06:29:23.217+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:29:23.228+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-05-02T06:29:23.836+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 600, after connections: 750, after extra_info: 950, after globalLock: 950, after locks: 950, after network: 950, after opcounters: 950, after opcountersRepl: 950, after repl: 970, after storageEngine: 970, after tcmalloc: 970, after wiredTiger: 970, at end: 1540 } 2016-05-02T06:29:27.070+0000 I COMMAND [conn1244] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 45 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 712ms 2016-05-02T06:29:27.070+0000 I COMMAND [conn1245] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 45 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 712ms 2016-05-02T06:29:30.208+0000 I REPL [ReplicationExecutor] election succeeded, assuming primary role in term 46 2016-05-02T06:29:30.211+0000 I REPL [ReplicationExecutor] transition to PRIMARY 2016-05-02T06:29:30.985+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 200, after asserts: 300, after connections: 390, after extra_info: 1080, after globalLock: 1420, after locks: 1420, after network: 1510, after opcounters: 1510, after opcountersRepl: 1510, after repl: 1910, after storageEngine: 1910, after tcmalloc: 2010, after wiredTiger: 2010, at end: 2650 } 2016-05-02T06:29:32.444+0000 I COMMAND [conn999] command local.$cmd command: ping { ping: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:37 locks:{} protocol:op_query 197ms 2016-05-02T06:29:34.848+0000 I COMMAND [conn1245] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:416 locks:{} protocol:op_command 709ms 2016-05-02T06:29:35.616+0000 I COMMAND [conn1244] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:416 locks:{} protocol:op_command 642ms 2016-05-02T06:29:36.338+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 290, after connections: 390, after extra_info: 830, after globalLock: 920, after locks: 930, after network: 930, after opcounters: 930, after opcountersRepl: 930, after repl: 1120, after storageEngine: 1210, after tcmalloc: 1210, after wiredTiger: 1220, at end: 1220 } 2016-05-02T06:29:36.343+0000 I REPL [rsSync] transition to primary complete; database writes are now permitted 2016-05-02T06:29:36.361+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36875 #1246 (73 connections now open) 2016-05-02T06:29:43.430+0000 I COMMAND [conn1244] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:416 locks:{} protocol:op_command 674ms 2016-05-02T06:29:43.430+0000 I COMMAND [conn1245] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:416 locks:{} protocol:op_command 674ms 2016-05-02T06:29:43.729+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 10, after asserts: 80, after connections: 80, after extra_info: 310, after globalLock: 460, after locks: 640, after network: 640, after opcounters: 640, after opcountersRepl: 640, after repl: 1620, after storageEngine: 1730, after tcmalloc: 2100, after wiredTiger: 2100, at end: 2780 } 2016-05-02T06:29:44.933+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36879 #1247 (74 connections now open) 2016-05-02T06:29:48.602+0000 I COMMAND [conn1247] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 1250ms 2016-05-02T06:29:48.702+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 280, after globalLock: 480, after locks: 580, after network: 670, after opcounters: 670, after opcountersRepl: 670, after repl: 1930, after storageEngine: 2130, after tcmalloc: 2130, after wiredTiger: 2670, at end: 2770 } 2016-05-02T06:29:51.012+0000 I COMMAND [conn1245] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:416 locks:{} protocol:op_command 634ms 2016-05-02T06:29:51.388+0000 I COMMAND [conn1247] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:1 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 4 } }, Database: { acquireCount: { r: 2 } }, oplog: { acquireCount: { r: 2 } } } 1996ms 2016-05-02T06:29:54.430+0000 I COMMAND [conn1244] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27017", fromId: 0, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:416 locks:{} protocol:op_command 2608ms 2016-05-02T06:29:55.830+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36881 #1248 (75 connections now open) 2016-05-02T06:29:57.195+0000 I NETWORK [conn1247] end connection 127.0.0.1:36879 (73 connections now open) 2016-05-02T06:29:57.881+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36882 #1249 (76 connections now open) 2016-05-02T06:30:01.632+0000 I COMMAND [conn1245] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:416 locks:{} protocol:op_command 2800ms 2016-05-02T06:30:01.635+0000 I COMMAND [conn1248] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 2620ms 2016-05-02T06:30:04.427+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 283, after asserts: 283, after connections: 283, after extra_info: 283, after globalLock: 284, after locks: 284, after network: 284, after opcounters: 284, after opcountersRepl: 284, after repl: 2314, after storageEngine: 2944, after tcmalloc: 3404, after wiredTiger: 4074, at end: 6244 } 2016-05-02T06:30:04.838+0000 I COMMAND [conn1249] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3048ms 2016-05-02T06:30:06.428+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36883 #1250 (76 connections now open) 2016-05-02T06:30:07.846+0000 I COMMAND [conn1249] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 0, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 1271ms 2016-05-02T06:30:08.799+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Operation timed out 2016-05-02T06:30:13.524+0000 I COMMAND [conn1245] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:416 locks:{} protocol:op_command 4428ms 2016-05-02T06:30:13.527+0000 I COMMAND [conn1250] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:392 locks:{} protocol:op_query 3306ms 2016-05-02T06:30:16.321+0000 I NETWORK [conn1249] end connection 127.0.0.1:36882 (75 connections now open) 2016-05-02T06:30:21.816+0000 I COMMAND [conn1245] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 829ms 2016-05-02T06:30:21.816+0000 I REPL [ReplicationExecutor] can't see a majority of the set, relinquishing primary 2016-05-02T06:30:23.446+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 190, after asserts: 680, after connections: 1140, after extra_info: 2080, after globalLock: 2690, after locks: 3090, after network: 3520, after opcounters: 3620, after opcountersRepl: 3620, after repl: 5140, after storageEngine: 5600, after tcmalloc: 6430, after wiredTiger: 7320, at end: 9260 } 2016-05-02T06:30:23.446+0000 I REPL [ReplicationExecutor] Stepping down from primary in response to heartbeat 2016-05-02T06:30:24.427+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36887 #1251 (76 connections now open) 2016-05-02T06:30:25.426+0000 I COMMAND [conn1250] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 5934ms 2016-05-02T06:30:25.427+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:30:27.430+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-05-02T06:30:29.602+0000 I REPL [replExecDBWorker-2] transition to SECONDARY 2016-05-02T06:30:30.552+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36888 #1252 (77 connections now open) 2016-05-02T06:30:30.552+0000 I NETWORK [conn1250] end connection 127.0.0.1:36883 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn1154] end connection 127.0.0.1:51013 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn972] end connection 127.0.0.1:35574 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn1011] end connection 127.0.0.1:35705 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn983] end connection 127.0.0.1:35609 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn975] end connection 127.0.0.1:35584 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn984] end connection 127.0.0.1:35614 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn1152] end connection 127.0.0.1:51008 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn1077] end connection 127.0.0.1:36276 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn1072] end connection 127.0.0.1:36261 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn992] end connection 127.0.0.1:35640 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn981] end connection 127.0.0.1:35604 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn1078] end connection 127.0.0.1:36282 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn1061] end connection 127.0.0.1:36231 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn974] end connection 127.0.0.1:35579 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn995] end connection 127.0.0.1:35650 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn986] end connection 127.0.0.1:35619 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn1043] end connection 127.0.0.1:35810 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn1068] end connection 127.0.0.1:36246 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn1069] end connection 127.0.0.1:36250 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn1049] end connection 127.0.0.1:35829 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn1244] end connection 127.0.0.1:36850 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn1050] end connection 127.0.0.1:35834 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn1079] end connection 127.0.0.1:36290 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn994] end connection 127.0.0.1:35645 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn1042] end connection 127.0.0.1:35805 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn998] end connection 127.0.0.1:35659 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn999] end connection 127.0.0.1:35664 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn1071] end connection 127.0.0.1:36256 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn1073] end connection 127.0.0.1:36265 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn1075] end connection 127.0.0.1:36270 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn1010] end connection 127.0.0.1:35700 (75 connections now open) 2016-05-02T06:30:33.989+0000 I NETWORK [conn1157] end connection 127.0.0.1:51023 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1155] end connection 127.0.0.1:51018 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1057] end connection 127.0.0.1:36219 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn978] end connection 127.0.0.1:35598 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn979] end connection 127.0.0.1:35599 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1150] end connection 127.0.0.1:51003 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn988] end connection 127.0.0.1:35633 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1246] end connection 127.0.0.1:36875 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1038] end connection 127.0.0.1:35793 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1034] end connection 127.0.0.1:35789 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1059] end connection 127.0.0.1:36221 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn976] end connection 127.0.0.1:35596 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn991] end connection 127.0.0.1:35636 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn967] end connection 127.0.0.1:35566 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn970] end connection 127.0.0.1:35569 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn968] end connection 127.0.0.1:35567 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1035] end connection 127.0.0.1:35790 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn987] end connection 127.0.0.1:35632 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1066] end connection 127.0.0.1:36243 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1036] end connection 127.0.0.1:35791 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1060] end connection 127.0.0.1:36222 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1037] end connection 127.0.0.1:35792 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn971] end connection 127.0.0.1:35570 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1158] end connection 127.0.0.1:51028 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn969] end connection 127.0.0.1:35568 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1147] end connection 127.0.0.1:51000 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn980] end connection 127.0.0.1:35600 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1065] end connection 127.0.0.1:36242 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1151] end connection 127.0.0.1:51004 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1056] end connection 127.0.0.1:36218 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn996] end connection 127.0.0.1:35654 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1148] end connection 127.0.0.1:51001 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1064] end connection 127.0.0.1:36241 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1149] end connection 127.0.0.1:51002 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn989] end connection 127.0.0.1:35634 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1058] end connection 127.0.0.1:36220 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn990] end connection 127.0.0.1:35635 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1067] end connection 127.0.0.1:36244 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1063] end connection 127.0.0.1:36240 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn977] end connection 127.0.0.1:35597 (75 connections now open) 2016-05-02T06:30:34.177+0000 I NETWORK [conn1252] end connection 127.0.0.1:36888 (75 connections now open) 2016-05-02T06:30:35.661+0000 I COMMAND [conn1251] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7862ms 2016-05-02T06:30:36.986+0000 I COMMAND [conn1245] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 9851ms 2016-05-02T06:30:37.367+0000 I COMMAND [conn1040] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4897ms 2016-05-02T06:30:37.449+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36891 #1253 (5 connections now open) 2016-05-02T06:30:37.450+0000 I NETWORK [conn1251] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:36887] 2016-05-02T06:30:38.839+0000 I NETWORK [conn1245] end connection 127.0.0.1:36851 (3 connections now open) 2016-05-02T06:30:39.719+0000 I NETWORK [conn1040] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:35800] 2016-05-02T06:30:42.558+0000 I COMMAND [conn1253] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1228ms 2016-05-02T06:30:43.174+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T06:30:44.193+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T06:30:46.208+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36893 #1254 (3 connections now open) 2016-05-02T06:30:47.147+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:30:47.812+0000 I NETWORK [conn1253] end connection 127.0.0.1:36891 (2 connections now open) 2016-05-02T06:30:48.169+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:30:50.970+0000 I COMMAND [conn1248] command local.oplog.rs command: find { find: "oplog.rs", filter: { ts: { $gte: Timestamp 1462170501000|4 } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 60000, term: 46 } planSummary: COLLSCAN cursorid:14320132530 keysExamined:0 docsExamined:2 keyUpdates:0 writeConflicts:0 numYields:4 nreturned:2 reslen:754 locks:{ Global: { acquireCount: { r: 10 } }, Database: { acquireCount: { r: 5 } }, oplog: { acquireCount: { r: 5 } } } protocol:op_command 19416ms 2016-05-02T06:30:52.315+0000 I COMMAND [conn1254] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1400ms 2016-05-02T06:30:54.591+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:30:54.591+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 310, after asserts: 720, after connections: 1210, after extra_info: 2554, after globalLock: 2554, after locks: 2554, after network: 2554, after opcounters: 2554, after opcountersRepl: 2554, after repl: 5584, after storageEngine: 5954, after tcmalloc: 6424, after wiredTiger: 7834, at end: 9314 } 2016-05-02T06:30:57.330+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:30:57.328+0000 I NETWORK [conn1248] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:36881] 2016-05-02T06:31:00.585+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-05-02T06:31:01.940+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-05-02T06:31:03.744+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:31:05.036+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:31:05.599+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:31:06.565+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:31:09.270+0000 I COMMAND [conn1254] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3604ms 2016-05-02T06:31:16.372+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 310, after asserts: 580, after connections: 780, after extra_info: 1110, after globalLock: 1110, after locks: 1110, after network: 1110, after opcounters: 1110, after opcountersRepl: 1110, after repl: 1120, after storageEngine: 1670, after tcmalloc: 2720, after wiredTiger: 4390, at end: 7160 } 2016-05-02T06:31:17.526+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:31:17.815+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36898 #1255 (2 connections now open) 2016-05-02T06:31:22.024+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:31:27.195+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:31:29.017+0000 I COMMAND [conn1255] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6646ms 2016-05-02T06:31:30.856+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36899 #1256 (3 connections now open) 2016-05-02T06:31:30.864+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:31:36.381+0000 I COMMAND [conn1254] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 6030ms 2016-05-02T06:31:38.178+0000 I NETWORK [conn1254] end connection 127.0.0.1:36893 (2 connections now open) 2016-05-02T06:31:39.844+0000 I COMMAND [conn1256] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1928ms 2016-05-02T06:31:40.548+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 194ms 2016-05-02T06:31:42.058+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 132ms 2016-05-02T06:31:41.972+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:31:42.068+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:31:42.172+0000 I COMMAND [conn1255] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 6824ms 2016-05-02T06:31:43.387+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 580, after asserts: 970, after connections: 1530, after extra_info: 2470, after globalLock: 2860, after locks: 3540, after network: 3880, after opcounters: 3880, after opcountersRepl: 3880, after repl: 5290, after storageEngine: 6170, after tcmalloc: 6520, after wiredTiger: 7430, at end: 9710 } 2016-05-02T06:31:44.149+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36901 #1257 (3 connections now open) 2016-05-02T06:31:45.999+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36903 #1258 (4 connections now open) 2016-05-02T06:31:46.089+0000 I NETWORK [conn1255] end connection 127.0.0.1:36898 (2 connections now open) 2016-05-02T06:31:48.907+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:31:53.405+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:31:53.796+0000 I COMMAND [conn1257] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5963ms 2016-05-02T06:31:54.117+0000 I COMMAND [conn1258] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2549ms 2016-05-02T06:31:54.119+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:31:57.107+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36904 #1259 (4 connections now open) 2016-05-02T06:31:57.289+0000 I COMMAND [conn1256] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2208ms 2016-05-02T06:31:58.909+0000 I COMMAND [conn1257] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 0, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 1372ms 2016-05-02T06:31:59.992+0000 I NETWORK [conn1256] end connection 127.0.0.1:36899 (3 connections now open) 2016-05-02T06:32:04.928+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:32:05.720+0000 I COMMAND [conn1259] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3337ms 2016-05-02T06:32:07.592+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 80, after globalLock: 80, after locks: 80, after network: 80, after opcounters: 80, after opcountersRepl: 80, after repl: 520, after storageEngine: 1230, after tcmalloc: 2050, after wiredTiger: 4260, at end: 7540 } 2016-05-02T06:32:07.695+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:32:09.207+0000 I NETWORK [conn1257] end connection 127.0.0.1:36901 (2 connections now open) 2016-05-02T06:32:12.045+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:32:23.875+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:32:25.178+0000 I COMMAND [conn1259] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5793ms 2016-05-02T06:32:29.450+0000 I NETWORK [conn1259] end connection 127.0.0.1:36904 (1 connection now open) 2016-05-02T06:32:29.861+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:32:34.688+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:32:38.768+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36906 #1260 (2 connections now open) 2016-05-02T06:32:39.768+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:32:42.216+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:32:47.598+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 350, after asserts: 640, after connections: 1140, after extra_info: 2750, after globalLock: 3330, after locks: 3870, after network: 4150, after opcounters: 4150, after opcountersRepl: 4150, after repl: 8083, after storageEngine: 8083, after tcmalloc: 8083, after wiredTiger: 10963, at end: 14623 } 2016-05-02T06:32:50.429+0000 I COMMAND [conn1260] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3642ms 2016-05-02T06:32:50.924+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:32:52.746+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36907 #1261 (3 connections now open) 2016-05-02T06:32:52.945+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:32:59.430+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:33:04.589+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:33:08.727+0000 I COMMAND [conn1260] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6389ms 2016-05-02T06:33:13.332+0000 I NETWORK [conn1260] end connection 127.0.0.1:36906 (2 connections now open) 2016-05-02T06:33:13.899+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:33:15.983+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:33:19.124+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36909 #1262 (3 connections now open) 2016-05-02T06:33:19.318+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:33:19.833+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 910, after connections: 1600, after extra_info: 2900, after globalLock: 3080, after locks: 3530, after network: 3710, after opcounters: 3710, after opcountersRepl: 3710, after repl: 4760, after storageEngine: 5760, after tcmalloc: 7010, after wiredTiger: 9170, at end: 10549 } 2016-05-02T06:33:20.096+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:33:27.881+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:33:28.684+0000 I COMMAND [conn1262] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2927ms 2016-05-02T06:33:33.445+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:33:36.939+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:33:36.939+0000 I NETWORK [conn1261] end connection 127.0.0.1:36907 (2 connections now open) 2016-05-02T06:33:39.671+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:33:45.791+0000 I COMMAND [conn1262] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4709ms 2016-05-02T06:33:45.912+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 830, after asserts: 1120, after connections: 1550, after extra_info: 3000, after globalLock: 3290, after locks: 3670, after network: 4070, after opcounters: 4150, after opcountersRepl: 4150, after repl: 7510, after storageEngine: 8340, after tcmalloc: 9500, after wiredTiger: 10530, at end: 10550 } 2016-05-02T06:33:52.155+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:33:53.991+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36912 #1263 (3 connections now open) 2016-05-02T06:33:55.265+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:34:00.246+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:34:00.447+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:34:02.927+0000 I COMMAND [conn1262] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2206ms 2016-05-02T06:34:03.017+0000 I COMMAND [conn1263] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2049ms 2016-05-02T06:34:03.556+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:34:03.564+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36913 #1264 (4 connections now open) 2016-05-02T06:34:08.494+0000 I COMMAND [conn1262] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 1113ms 2016-05-02T06:34:08.926+0000 I COMMAND [conn1264] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1113ms 2016-05-02T06:34:09.319+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 270, after asserts: 630, after connections: 630, after extra_info: 1150, after globalLock: 1420, after locks: 1420, after network: 1420, after opcounters: 1420, after opcountersRepl: 1420, after repl: 1770, after storageEngine: 2130, after tcmalloc: 2780, after wiredTiger: 4270, at end: 5950 } 2016-05-02T06:34:12.373+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-05-02T06:34:13.727+0000 I COMMAND [conn1263] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 6623ms 2016-05-02T06:34:16.455+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:34:18.375+0000 I NETWORK [conn1263] end connection 127.0.0.1:36912 (3 connections now open) 2016-05-02T06:34:19.315+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36914 #1265 (5 connections now open) 2016-05-02T06:34:19.604+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T06:34:20.554+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T06:34:26.164+0000 I COMMAND [conn1262] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 9976ms 2016-05-02T06:34:26.673+0000 I COMMAND [conn1265] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2825ms 2016-05-02T06:34:29.580+0000 I NETWORK [conn1262] end connection 127.0.0.1:36909 (3 connections now open) 2016-05-02T06:34:30.154+0000 I COMMAND [conn1264] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3128ms 2016-05-02T06:34:31.183+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:34:33.786+0000 I NETWORK [conn1264] end connection 127.0.0.1:36913 (2 connections now open) 2016-05-02T06:34:33.687+0000 I COMMAND [conn1265] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 736ms 2016-05-02T06:34:34.920+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:34:35.102+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 1060, after connections: 1380, after extra_info: 2460, after globalLock: 2970, after locks: 3160, after network: 3290, after opcounters: 3290, after opcountersRepl: 3290, after repl: 4530, after storageEngine: 5300, after tcmalloc: 6580, after wiredTiger: 8920, at end: 12010 } 2016-05-02T06:34:35.527+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36916 #1266 (4 connections now open) 2016-05-02T06:34:35.535+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-05-02T06:34:36.335+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:34:37.604+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-05-02T06:34:42.229+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:34:44.904+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:34:45.893+0000 I NETWORK [conn1265] end connection 127.0.0.1:36914 (2 connections now open) 2016-05-02T06:34:46.862+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:34:46.954+0000 I COMMAND [conn1258] command local.oplog.rs command: find { find: "oplog.rs", filter: { ts: { $gte: Timestamp 1462170501000|4 } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 60000, term: 46 } planSummary: COLLSCAN cursorid:14248968167 keysExamined:0 docsExamined:2 keyUpdates:0 writeConflicts:0 numYields:4 nreturned:2 reslen:754 locks:{ Global: { acquireCount: { r: 10 } }, Database: { acquireCount: { r: 5 } }, oplog: { acquireCount: { r: 5 } } } protocol:op_command 25748ms 2016-05-02T06:34:46.956+0000 I NETWORK [conn1258] end connection 127.0.0.1:36903 (1 connection now open) 2016-05-02T06:34:46.958+0000 I COMMAND [conn1266] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4911ms 2016-05-02T06:34:54.548+0000 I COMMAND [conn1266] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5049ms 2016-05-02T06:34:59.122+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:34:59.995+0000 I NETWORK [conn1266] end connection 127.0.0.1:36916 (0 connections now open) 2016-05-02T06:35:02.676+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:35:04.879+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:35:06.614+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36917 #1267 (1 connection now open) 2016-05-02T06:35:14.538+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:35:14.538+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 650, after asserts: 1090, after connections: 1770, after extra_info: 3430, after globalLock: 4170, after locks: 4570, after network: 4660, after opcounters: 4660, after opcountersRepl: 4660, after repl: 6586, after storageEngine: 7056, after tcmalloc: 7966, after wiredTiger: 9346, at end: 11576 } 2016-05-02T06:35:15.185+0000 I COMMAND [conn1267] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2982ms 2016-05-02T06:35:21.033+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:35:24.952+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:35:25.300+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:35:30.279+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:35:36.468+0000 I COMMAND [conn1267] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7217ms 2016-05-02T06:35:36.969+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 400, after connections: 480, after extra_info: 780, after globalLock: 970, after locks: 980, after network: 980, after opcounters: 980, after opcountersRepl: 980, after repl: 3800, after storageEngine: 4470, after tcmalloc: 5470, after wiredTiger: 7530, at end: 9990 } 2016-05-02T06:35:41.502+0000 I NETWORK [conn1267] end connection 127.0.0.1:36917 (0 connections now open) 2016-05-02T06:35:41.494+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:35:43.498+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 188ms 2016-05-02T06:35:49.316+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:35:51.760+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36920 #1268 (1 connection now open) 2016-05-02T06:35:53.040+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:35:56.143+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:36:03.364+0000 I COMMAND [conn1268] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4265ms 2016-05-02T06:36:06.568+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:36:09.742+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:36:12.379+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 660, after asserts: 1150, after connections: 2290, after extra_info: 3740, after globalLock: 4520, after locks: 4950, after network: 5040, after opcounters: 5040, after opcountersRepl: 5040, after repl: 6720, after storageEngine: 7570, after tcmalloc: 8120, after wiredTiger: 9840, at end: 11860 } 2016-05-02T06:36:15.196+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:36:17.165+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:36:20.533+0000 I COMMAND [conn1268] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7591ms 2016-05-02T06:36:22.545+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:36:27.492+0000 I NETWORK [conn1268] end connection 127.0.0.1:36920 (0 connections now open) 2016-05-02T06:36:31.860+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36922 #1269 (1 connection now open) 2016-05-02T06:36:33.026+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:36:34.467+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:36:39.695+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:36:45.293+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 570, after locks: 790, after network: 880, after opcounters: 880, after opcountersRepl: 880, after repl: 5510, after storageEngine: 6320, after tcmalloc: 7270, after wiredTiger: 9280, at end: 11520 } 2016-05-02T06:36:45.717+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:36:45.814+0000 I COMMAND [conn1269] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 8076ms 2016-05-02T06:36:55.085+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:36:57.378+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:36:58.264+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:37:02.243+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:37:07.281+0000 I COMMAND [conn1269] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 11969ms 2016-05-02T06:37:11.291+0000 I NETWORK [conn1269] end connection 127.0.0.1:36922 (0 connections now open) 2016-05-02T06:37:12.372+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36924 #1270 (2 connections now open) 2016-05-02T06:37:12.869+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:37:14.727+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 590, after asserts: 1190, after connections: 2390, after extra_info: 4380, after globalLock: 5240, after locks: 5890, after network: 6460, after opcounters: 6870, after opcountersRepl: 7280, after repl: 9870, after storageEngine: 11010, after tcmalloc: 12330, after wiredTiger: 13006, at end: 13236 } 2016-05-02T06:37:18.440+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:37:21.909+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:37:25.783+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36925 #1271 (2 connections now open) 2016-05-02T06:37:27.072+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:37:27.476+0000 I COMMAND [conn1270] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 8198ms 2016-05-02T06:37:37.082+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:37:41.559+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:37:41.983+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:37:43.834+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:37:44.808+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 102ms 2016-05-02T06:37:46.964+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 104ms 2016-05-02T06:37:47.067+0000 I COMMAND [conn1270] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 11085ms 2016-05-02T06:37:49.207+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36927 #1272 (3 connections now open) 2016-05-02T06:37:49.704+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 182ms 2016-05-02T06:37:52.570+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 980, after connections: 1360, after extra_info: 2120, after globalLock: 2610, after locks: 3100, after network: 3540, after opcounters: 4010, after opcountersRepl: 4480, after repl: 11140, after storageEngine: 12260, after tcmalloc: 13240, after wiredTiger: 13344, at end: 14874 } 2016-05-02T06:37:54.782+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:37:54.787+0000 I NETWORK [conn1270] end connection 127.0.0.1:36924 (2 connections now open) 2016-05-02T06:37:58.843+0000 I COMMAND [conn1272] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4047ms 2016-05-02T06:37:58.838+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:38:04.098+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:38:06.722+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:38:14.456+0000 I COMMAND [conn1272] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5135ms 2016-05-02T06:38:17.424+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:38:20.729+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:38:20.732+0000 I NETWORK [conn1272] end connection 127.0.0.1:36927 (1 connection now open) 2016-05-02T06:38:22.458+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 360, after asserts: 820, after connections: 1030, after extra_info: 2110, after globalLock: 2840, after locks: 3530, after network: 3890, after opcounters: 3990, after opcountersRepl: 3990, after repl: 6470, after storageEngine: 7610, after tcmalloc: 9200, after wiredTiger: 11100, at end: 14900 } 2016-05-02T06:38:22.460+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:38:27.457+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36929 #1273 (2 connections now open) 2016-05-02T06:38:29.336+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:38:30.364+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36930 #1274 (3 connections now open) 2016-05-02T06:38:32.186+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:38:33.768+0000 I NETWORK [conn1271] end connection 127.0.0.1:36925 (2 connections now open) 2016-05-02T06:38:38.654+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:38:39.985+0000 I COMMAND [conn1274] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3216ms 2016-05-02T06:38:44.069+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:38:46.883+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:38:51.863+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 112ms 2016-05-02T06:38:54.756+0000 I COMMAND [conn1274] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4589ms 2016-05-02T06:38:57.550+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:38:58.651+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 420, after asserts: 740, after connections: 740, after extra_info: 1770, after globalLock: 2340, after locks: 2540, after network: 2540, after opcounters: 2540, after opcountersRepl: 2540, after repl: 4900, after storageEngine: 5800, after tcmalloc: 6770, after wiredTiger: 8730, at end: 12360 } 2016-05-02T06:39:00.323+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:39:02.348+0000 I NETWORK [conn1274] end connection 127.0.0.1:36930 (1 connection now open) 2016-05-02T06:39:02.956+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:39:04.642+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:39:07.283+0000 I COMMAND [conn1273] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1780ms 2016-05-02T06:39:08.555+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36932 #1275 (2 connections now open) 2016-05-02T06:39:11.054+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:39:14.293+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:39:19.653+0000 I COMMAND [conn1275] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5455ms 2016-05-02T06:39:20.751+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:39:24.662+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:39:29.998+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 920, after connections: 1500, after extra_info: 2590, after globalLock: 3060, after locks: 3460, after network: 3850, after opcounters: 3960, after opcountersRepl: 3960, after repl: 9410, after storageEngine: 10100, after tcmalloc: 10590, after wiredTiger: 11870, at end: 14290 } 2016-05-02T06:39:30.452+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:39:35.038+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:39:35.574+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:39:35.575+0000 I COMMAND [conn1275] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3961ms 2016-05-02T06:39:40.153+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:39:44.695+0000 I NETWORK [conn1275] end connection 127.0.0.1:36932 (1 connection now open) 2016-05-02T06:39:46.601+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:39:49.038+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36934 #1276 (2 connections now open) 2016-05-02T06:39:50.161+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:39:58.092+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:39:58.871+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 460, after asserts: 850, after connections: 1480, after extra_info: 1571, after globalLock: 1571, after locks: 1571, after network: 1651, after opcounters: 1661, after opcountersRepl: 1661, after repl: 3011, after storageEngine: 3721, after tcmalloc: 4541, after wiredTiger: 6141, at end: 9131 } 2016-05-02T06:39:59.646+0000 I COMMAND [conn1276] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3451ms 2016-05-02T06:40:01.279+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:40:03.749+0000 I NETWORK [conn1273] end connection 127.0.0.1:36929 (1 connection now open) 2016-05-02T06:40:08.644+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:40:12.701+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:40:16.449+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:40:18.164+0000 I COMMAND [conn1276] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3246ms 2016-05-02T06:40:19.896+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:40:22.490+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36937 #1277 (2 connections now open) 2016-05-02T06:40:23.517+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36941 #1278 (3 connections now open) 2016-05-02T06:40:24.849+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36942 #1279 (4 connections now open) 2016-05-02T06:40:25.121+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 270, after asserts: 760, after connections: 1270, after extra_info: 2780, after globalLock: 3070, after locks: 3420, after network: 3430, after opcounters: 3430, after opcountersRepl: 3430, after repl: 4129, after storageEngine: 4129, after tcmalloc: 4129, after wiredTiger: 4129, at end: 4678 } 2016-05-02T06:40:25.207+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:40:26.333+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:40:29.776+0000 I COMMAND [conn1278] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4151ms 2016-05-02T06:40:29.776+0000 I COMMAND [conn1277] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4151ms 2016-05-02T06:40:30.791+0000 I COMMAND [conn1276] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 540ms 2016-05-02T06:40:31.405+0000 I COMMAND [conn1279] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2051ms 2016-05-02T06:40:32.076+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36943 #1280 (5 connections now open) 2016-05-02T06:40:36.485+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:40:38.843+0000 I COMMAND [conn1276] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2526ms 2016-05-02T06:40:40.076+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:40:42.124+0000 I COMMAND [conn1279] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 5822ms 2016-05-02T06:40:44.771+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:40:45.060+0000 I NETWORK [conn1276] end connection 127.0.0.1:36934 (4 connections now open) 2016-05-02T06:40:45.058+0000 I COMMAND [conn1280] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6170ms 2016-05-02T06:40:47.423+0000 I NETWORK [conn1279] end connection 127.0.0.1:36942 (3 connections now open) 2016-05-02T06:40:47.819+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:40:48.010+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36945 #1281 (5 connections now open) 2016-05-02T06:40:48.714+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36946 #1282 (6 connections now open) 2016-05-02T06:40:48.908+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:40:52.836+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 640, after asserts: 1250, after connections: 1870, after extra_info: 3200, after globalLock: 3660, after locks: 3850, after network: 3940, after opcounters: 3940, after opcountersRepl: 3940, after repl: 8150, after storageEngine: 8466, after tcmalloc: 8568, after wiredTiger: 9488, at end: 11918 } 2016-05-02T06:40:54.279+0000 I COMMAND [conn1281] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2538ms 2016-05-02T06:40:55.882+0000 I COMMAND [conn1282] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2227ms 2016-05-02T06:40:58.542+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:41:00.587+0000 I COMMAND [conn1280] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3206ms 2016-05-02T06:41:00.677+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-05-02T06:41:01.427+0000 I COMMAND [conn1281] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 730ms 2016-05-02T06:41:01.986+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T06:41:02.762+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36947 #1283 (6 connections now open) 2016-05-02T06:41:03.496+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T06:41:05.882+0000 I NETWORK [conn1280] end connection 127.0.0.1:36943 (5 connections now open) 2016-05-02T06:41:12.083+0000 I COMMAND [conn1283] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2661ms 2016-05-02T06:41:12.380+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:41:12.964+0000 I NETWORK [conn1281] end connection 127.0.0.1:36945 (4 connections now open) 2016-05-02T06:41:17.073+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:41:17.827+0000 I COMMAND [conn1277] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3623ms 2016-05-02T06:41:19.574+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-05-02T06:41:21.894+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-05-02T06:41:21.894+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 860, after connections: 1440, after extra_info: 3010, after globalLock: 3490, after locks: 4080, after network: 4700, after opcounters: 4800, after opcountersRepl: 4800, after repl: 8020, after storageEngine: 8620, after tcmalloc: 9560, after wiredTiger: 11480, at end: 13250 } 2016-05-02T06:41:24.616+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:41:25.147+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:41:29.403+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:41:33.148+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:41:41.987+0000 I COMMAND [conn1283] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 18655ms 2016-05-02T06:41:42.473+0000 I COMMAND [conn1278] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 8250ms 2016-05-02T06:41:44.199+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:41:44.100+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36949 #1284 (5 connections now open) 2016-05-02T06:41:50.476+0000 I NETWORK [conn1283] end connection 127.0.0.1:36947 (4 connections now open) 2016-05-02T06:41:51.612+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:41:54.847+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:41:55.738+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 102ms 2016-05-02T06:42:00.369+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:42:00.459+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 290, after connections: 490, after extra_info: 1830, after globalLock: 2290, after locks: 2490, after network: 2590, after opcounters: 2590, after opcountersRepl: 2590, after repl: 6310, after storageEngine: 6880, after tcmalloc: 7460, after wiredTiger: 9530, at end: 11640 } 2016-05-02T06:42:01.476+0000 I COMMAND [conn1284] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 8170ms 2016-05-02T06:42:11.642+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:42:14.956+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:42:19.718+0000 I COMMAND [conn1284] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 8732ms 2016-05-02T06:42:19.719+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:42:25.499+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:42:27.672+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36951 #1285 (5 connections now open) 2016-05-02T06:42:28.711+0000 I NETWORK [conn1284] end connection 127.0.0.1:36949 (3 connections now open) 2016-05-02T06:42:28.719+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:42:35.008+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:42:35.941+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 310, after asserts: 600, after connections: 1410, after extra_info: 3070, after globalLock: 3430, after locks: 3530, after network: 3530, after opcounters: 3530, after opcountersRepl: 3530, after repl: 7538, after storageEngine: 7538, after tcmalloc: 8028, after wiredTiger: 9928, at end: 13218 } 2016-05-02T06:42:36.332+0000 I COMMAND [conn1285] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2565ms 2016-05-02T06:42:38.135+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:42:43.556+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:42:49.412+0000 I NETWORK [conn1277] end connection 127.0.0.1:36937 (3 connections now open) 2016-05-02T06:42:49.412+0000 I NETWORK [conn1278] end connection 127.0.0.1:36941 (3 connections now open) 2016-05-02T06:42:50.666+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:42:52.121+0000 I COMMAND [conn1285] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3501ms 2016-05-02T06:42:58.130+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 182ms 2016-05-02T06:42:58.136+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:43:00.140+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:43:00.140+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 850, after connections: 1540, after extra_info: 2690, after globalLock: 3090, after locks: 3490, after network: 3750, after opcounters: 3870, after opcountersRepl: 3870, after repl: 4200, after storageEngine: 4210, after tcmalloc: 4710, after wiredTiger: 6660, at end: 9640 } 2016-05-02T06:43:00.864+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36964 #1286 (3 connections now open) 2016-05-02T06:43:05.177+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:43:10.649+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:43:14.574+0000 I COMMAND [conn1286] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7895ms 2016-05-02T06:43:15.006+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36965 #1287 (4 connections now open) 2016-05-02T06:43:15.497+0000 I COMMAND [conn1285] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 1437ms 2016-05-02T06:43:16.724+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:43:20.600+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:43:27.370+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:43:28.687+0000 I COMMAND [conn1287] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5270ms 2016-05-02T06:43:29.966+0000 I COMMAND [conn1286] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 7752ms 2016-05-02T06:43:33.000+0000 I COMMAND [conn1285] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 10590ms 2016-05-02T06:43:33.000+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:43:34.189+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36968 #1288 (5 connections now open) 2016-05-02T06:43:34.189+0000 I NETWORK [conn1286] end connection 127.0.0.1:36964 (3 connections now open) 2016-05-02T06:43:36.935+0000 I NETWORK [conn1285] end connection 127.0.0.1:36951 (3 connections now open) 2016-05-02T06:43:41.164+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 770, after asserts: 1160, after connections: 1460, after extra_info: 1940, after globalLock: 2260, after locks: 2260, after network: 2260, after opcounters: 2260, after opcountersRepl: 2260, after repl: 8170, after storageEngine: 9030, after tcmalloc: 9352, after wiredTiger: 9712, at end: 13392 } 2016-05-02T06:43:42.719+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:43:43.311+0000 I COMMAND [conn1287] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4959ms 2016-05-02T06:43:44.100+0000 I COMMAND [conn1288] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3918ms 2016-05-02T06:43:46.474+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:43:47.184+0000 I NETWORK [conn1287] end connection 127.0.0.1:36965 (2 connections now open) 2016-05-02T06:43:48.659+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:43:48.935+0000 I COMMAND [conn1288] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 0, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 598ms 2016-05-02T06:43:51.658+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:43:51.658+0000 I COMMAND [conn1282] command local.oplog.rs command: find { find: "oplog.rs", filter: { ts: { $gte: Timestamp 1462170501000|4 } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 60000, term: 46 } planSummary: COLLSCAN cursorid:13459726472 keysExamined:0 docsExamined:2 keyUpdates:0 writeConflicts:0 numYields:4 nreturned:2 reslen:754 locks:{ Global: { acquireCount: { r: 10 } }, Database: { acquireCount: { r: 5 } }, oplog: { acquireCount: { r: 5 } } } protocol:op_command 15104ms 2016-05-02T06:43:53.170+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36970 #1289 (3 connections now open) 2016-05-02T06:43:57.791+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:43:59.089+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 188ms 2016-05-02T06:43:59.089+0000 I NETWORK [conn1282] end connection 127.0.0.1:36946 (2 connections now open) 2016-05-02T06:44:01.387+0000 I NETWORK [conn1288] end connection 127.0.0.1:36968 (2 connections now open) 2016-05-02T06:44:01.871+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:44:02.677+0000 I COMMAND [conn1289] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3981ms 2016-05-02T06:44:03.403+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 90, after globalLock: 650, after locks: 940, after network: 1040, after opcounters: 1040, after opcountersRepl: 1040, after repl: 2250, after storageEngine: 2850, after tcmalloc: 3450, after wiredTiger: 5800, at end: 7860 } 2016-05-02T06:44:05.121+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-05-02T06:44:11.148+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T06:44:14.011+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T06:44:22.400+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:44:23.428+0000 I COMMAND [conn1289] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 9527ms 2016-05-02T06:44:23.659+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:44:29.295+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:44:30.388+0000 I NETWORK [conn1289] end connection 127.0.0.1:36970 (0 connections now open) 2016-05-02T06:44:30.618+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 870, after asserts: 1200, after connections: 2070, after extra_info: 3120, after globalLock: 4030, after locks: 4450, after network: 4460, after opcounters: 4460, after opcountersRepl: 4460, after repl: 5720, after storageEngine: 6400, after tcmalloc: 7100, after wiredTiger: 8350, at end: 10070 } 2016-05-02T06:44:31.818+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-05-02T06:44:33.688+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36972 #1290 (1 connection now open) 2016-05-02T06:44:33.925+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:44:34.939+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-05-02T06:44:38.213+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:44:43.962+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:44:47.623+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:44:52.129+0000 I COMMAND [conn1290] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 11063ms 2016-05-02T06:44:54.007+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:45:01.485+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-05-02T06:45:06.150+0000 I COMMAND [conn1290] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6545ms 2016-05-02T06:45:06.437+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 1000, after connections: 1310, after extra_info: 2370, after globalLock: 2870, after locks: 3540, after network: 4090, after opcounters: 4340, after opcountersRepl: 4340, after repl: 5410, after storageEngine: 5720, after tcmalloc: 6350, after wiredTiger: 7970, at end: 11240 } 2016-05-02T06:45:06.642+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:45:09.639+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T06:45:10.257+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36973 #1291 (2 connections now open) 2016-05-02T06:45:10.503+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T06:45:10.503+0000 I NETWORK [conn1290] end connection 127.0.0.1:36972 (0 connections now open) 2016-05-02T06:45:15.819+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36974 #1292 (2 connections now open) 2016-05-02T06:45:20.307+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:45:24.355+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:45:25.670+0000 I COMMAND [conn1292] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3355ms 2016-05-02T06:45:27.191+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-05-02T06:45:29.406+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-05-02T06:45:32.256+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:45:34.568+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:45:36.317+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:45:39.677+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:45:44.613+0000 I COMMAND [conn1291] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6788ms 2016-05-02T06:45:46.132+0000 I COMMAND [conn1292] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 8821ms 2016-05-02T06:45:47.873+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 590, after asserts: 1010, after connections: 1870, after extra_info: 3120, after globalLock: 3450, after locks: 3790, after network: 4270, after opcounters: 4650, after opcountersRepl: 4660, after repl: 14630, after storageEngine: 15200, after tcmalloc: 15880, after wiredTiger: 17400, at end: 19550 } 2016-05-02T06:45:49.830+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:45:54.378+0000 I NETWORK [conn1292] end connection 127.0.0.1:36974 (1 connection now open) 2016-05-02T06:45:55.376+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:45:57.325+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36976 #1293 (2 connections now open) 2016-05-02T06:45:58.840+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:46:05.478+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:46:10.910+0000 I COMMAND [conn1293] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7426ms 2016-05-02T06:46:14.667+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:46:15.737+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 940, after connections: 1760, after extra_info: 2760, after globalLock: 3040, after locks: 3130, after network: 3230, after opcounters: 3230, after opcountersRepl: 3230, after repl: 4870, after storageEngine: 5410, after tcmalloc: 5920, after wiredTiger: 7390, at end: 9120 } 2016-05-02T06:46:16.730+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:46:16.935+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:46:19.985+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36978 #1294 (3 connections now open) 2016-05-02T06:46:21.602+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:46:24.016+0000 I COMMAND [conn1293] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6081ms 2016-05-02T06:46:28.561+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:46:30.384+0000 I NETWORK [conn1293] end connection 127.0.0.1:36976 (2 connections now open) 2016-05-02T06:46:31.496+0000 I COMMAND [conn1291] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2610ms 2016-05-02T06:46:32.366+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-05-02T06:46:37.800+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 870, after connections: 1310, after extra_info: 2060, after globalLock: 2490, after locks: 2930, after network: 3540, after opcounters: 3830, after opcountersRepl: 3830, after repl: 4930, after storageEngine: 5890, after tcmalloc: 6610, after wiredTiger: 8380, at end: 10800 } 2016-05-02T06:46:38.356+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:46:38.745+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36979 #1295 (3 connections now open) 2016-05-02T06:46:40.405+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T06:46:42.533+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T06:46:51.689+0000 I COMMAND [conn1295] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7053ms 2016-05-02T06:46:53.359+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:46:56.331+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:46:58.133+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-05-02T06:46:59.236+0000 I COMMAND [conn1294] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2888ms 2016-05-02T06:47:00.436+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-05-02T06:47:02.172+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:47:02.729+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:47:05.060+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T06:47:08.208+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T06:47:16.154+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:47:16.458+0000 I COMMAND [conn1295] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 14124ms 2016-05-02T06:47:19.648+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:47:20.494+0000 I NETWORK [conn1295] end connection 127.0.0.1:36979 (2 connections now open) 2016-05-02T06:47:23.285+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 530, after asserts: 720, after connections: 990, after extra_info: 2130, after globalLock: 2400, after locks: 2490, after network: 2690, after opcounters: 2690, after opcountersRepl: 2690, after repl: 14020, after storageEngine: 15110, after tcmalloc: 16530, after wiredTiger: 18070, at end: 20520 } 2016-05-02T06:47:25.382+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:47:26.406+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36982 #1296 (3 connections now open) 2016-05-02T06:47:28.135+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:47:29.587+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:47:29.594+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-05-02T06:47:33.742+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:47:35.833+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:47:39.673+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:47:41.529+0000 I COMMAND [conn1296] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7519ms 2016-05-02T06:47:42.301+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:47:47.696+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:47:54.944+0000 I COMMAND [conn1296] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3262ms 2016-05-02T06:47:55.634+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:47:57.314+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 700, after asserts: 1180, after connections: 2180, after extra_info: 3390, after globalLock: 3880, after locks: 4210, after network: 4550, after opcounters: 4550, after opcountersRepl: 4550, after repl: 8050, after storageEngine: 8870, after tcmalloc: 9760, after wiredTiger: 11410, at end: 13460 } 2016-05-02T06:47:59.694+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:47:59.688+0000 I NETWORK [conn1296] end connection 127.0.0.1:36982 (2 connections now open) 2016-05-02T06:48:03.620+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:48:06.508+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36984 #1297 (3 connections now open) 2016-05-02T06:48:15.614+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:48:17.147+0000 I COMMAND [conn1297] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3221ms 2016-05-02T06:48:20.047+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:48:24.924+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:48:30.313+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:48:32.650+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:48:35.801+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 910, after asserts: 1250, after connections: 1820, after extra_info: 3300, after globalLock: 3610, after locks: 4520, after network: 5000, after opcounters: 5370, after opcountersRepl: 5670, after repl: 10360, after storageEngine: 11140, after tcmalloc: 11780, after wiredTiger: 14350, at end: 17060 } 2016-05-02T06:48:38.805+0000 I COMMAND [conn1297] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7963ms 2016-05-02T06:48:42.394+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:48:44.700+0000 I NETWORK [conn1297] end connection 127.0.0.1:36984 (2 connections now open) 2016-05-02T06:48:46.881+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:48:50.145+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:48:53.435+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36986 #1298 (3 connections now open) 2016-05-02T06:48:55.076+0000 I NETWORK [conn1291] end connection 127.0.0.1:36973 (1 connection now open) 2016-05-02T06:48:58.585+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:49:01.768+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 201ms 2016-05-02T06:49:05.111+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:49:05.446+0000 I COMMAND [conn1298] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4181ms 2016-05-02T06:49:08.969+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:49:11.000+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 950, after globalLock: 1970, after locks: 2700, after network: 3000, after opcounters: 3000, after opcountersRepl: 3000, after repl: 7470, after storageEngine: 8020, after tcmalloc: 8850, after wiredTiger: 10590, at end: 13750 } 2016-05-02T06:49:15.230+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:49:18.309+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:49:24.801+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:49:25.197+0000 I COMMAND [conn1298] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4529ms 2016-05-02T06:49:29.181+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:49:32.896+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:49:33.973+0000 I NETWORK [conn1298] end connection 127.0.0.1:36986 (1 connection now open) 2016-05-02T06:49:42.901+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:49:46.565+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36989 #1299 (2 connections now open) 2016-05-02T06:49:48.391+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 680, after asserts: 1060, after connections: 1480, after extra_info: 2170, after globalLock: 2850, after locks: 3530, after network: 4100, after opcounters: 4670, after opcountersRepl: 4680, after repl: 10340, after storageEngine: 11270, after tcmalloc: 12350, after wiredTiger: 14240, at end: 15803 } 2016-05-02T06:49:51.837+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:49:56.135+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:50:01.763+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:50:02.979+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 211ms 2016-05-02T06:50:03.714+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:50:05.569+0000 I COMMAND [conn1299] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 10589ms 2016-05-02T06:50:15.051+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:50:19.449+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:50:25.850+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:50:35.959+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 960, after asserts: 1540, after connections: 2370, after extra_info: 3800, after globalLock: 4670, after locks: 5170, after network: 5790, after opcounters: 5790, after opcountersRepl: 5790, after repl: 13790, after storageEngine: 14790, after tcmalloc: 16280, after wiredTiger: 18760, at end: 24110 } 2016-05-02T06:50:37.489+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:50:37.993+0000 I COMMAND [conn1299] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 18411ms 2016-05-02T06:50:43.649+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36990 #1300 (3 connections now open) 2016-05-02T06:50:44.961+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:50:50.305+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:50:50.800+0000 I NETWORK [conn1299] end connection 127.0.0.1:36989 (2 connections now open) 2016-05-02T06:50:53.059+0000 I NETWORK [conn1294] end connection 127.0.0.1:36978 (2 connections now open) 2016-05-02T06:50:54.051+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:51:02.420+0000 I COMMAND [conn1300] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 8319ms 2016-05-02T06:51:03.720+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:51:04.356+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 130ms 2016-05-02T06:51:07.720+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 104ms 2016-05-02T06:51:09.087+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:51:09.195+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36992 #1301 (2 connections now open) 2016-05-02T06:51:13.111+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T06:51:17.527+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 440, after asserts: 830, after connections: 1710, after extra_info: 3540, after globalLock: 4180, after locks: 5140, after network: 5720, after opcounters: 6210, after opcountersRepl: 6210, after repl: 7084, after storageEngine: 7084, after tcmalloc: 7834, after wiredTiger: 9914, at end: 13784 } 2016-05-02T06:51:20.880+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:51:21.480+0000 I COMMAND [conn1300] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 9885ms 2016-05-02T06:51:24.445+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:51:30.072+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36994 #1302 (3 connections now open) 2016-05-02T06:51:34.361+0000 I NETWORK [conn1300] end connection 127.0.0.1:36990 (1 connection now open) 2016-05-02T06:51:42.844+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:51:47.319+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:51:50.779+0000 I COMMAND [conn1302] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 9255ms 2016-05-02T06:51:56.446+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:51:56.878+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:52:01.893+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:52:08.337+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:52:10.051+0000 I NETWORK [conn1301] end connection 127.0.0.1:36992 (1 connection now open) 2016-05-02T06:52:16.224+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:52:18.490+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 500, after asserts: 790, after connections: 1090, after extra_info: 1480, after globalLock: 1930, after locks: 2410, after network: 2750, after opcounters: 3060, after opcountersRepl: 3350, after repl: 9930, after storageEngine: 11270, after tcmalloc: 12360, after wiredTiger: 16980, at end: 20470 } 2016-05-02T06:52:22.794+0000 I COMMAND [conn1302] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 19490ms 2016-05-02T06:52:28.020+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:36998 #1303 (2 connections now open) 2016-05-02T06:52:30.120+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:52:33.958+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:52:33.958+0000 I NETWORK [conn1302] end connection 127.0.0.1:36994 (1 connection now open) 2016-05-02T06:52:37.645+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:52:43.510+0000 I COMMAND [conn1303] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7625ms 2016-05-02T06:52:45.779+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:52:45.780+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:52:52.334+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:52:56.478+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 700, after connections: 910, after extra_info: 1690, after globalLock: 2380, after locks: 3400, after network: 3920, after opcounters: 4010, after opcountersRepl: 4010, after repl: 6710, after storageEngine: 7400, after tcmalloc: 8560, after wiredTiger: 12000, at end: 13930 } 2016-05-02T06:52:58.068+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:53:05.956+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:53:15.328+0000 I COMMAND [conn1303] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 19963ms 2016-05-02T06:53:15.764+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:53:19.581+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37002 #1304 (2 connections now open) 2016-05-02T06:53:20.376+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:53:22.063+0000 I NETWORK [conn1303] end connection 127.0.0.1:36998 (1 connection now open) 2016-05-02T06:53:26.155+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:53:33.305+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:53:35.152+0000 I COMMAND [conn1304] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6236ms 2016-05-02T06:53:36.233+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:53:42.574+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:53:45.963+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 1130, after connections: 1830, after extra_info: 3200, after globalLock: 3820, after locks: 4410, after network: 5080, after opcounters: 5360, after opcountersRepl: 5800, after repl: 10980, after storageEngine: 11820, after tcmalloc: 12800, after wiredTiger: 14610, at end: 17540 } 2016-05-02T06:53:47.259+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:53:51.843+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:53:59.909+0000 I COMMAND [conn1304] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 13450ms 2016-05-02T06:54:03.214+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:54:03.917+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37006 #1305 (2 connections now open) 2016-05-02T06:54:08.007+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:54:08.752+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-05-02T06:54:09.725+0000 I NETWORK [conn1304] end connection 127.0.0.1:37002 (1 connection now open) 2016-05-02T06:54:11.098+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 180ms 2016-05-02T06:54:13.704+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 177ms 2016-05-02T06:54:14.519+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:54:22.845+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:54:23.149+0000 I COMMAND [conn1305] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 10688ms 2016-05-02T06:54:26.345+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:54:32.974+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:54:36.584+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 430, after asserts: 600, after connections: 1260, after extra_info: 3040, after globalLock: 3640, after locks: 4240, after network: 4640, after opcounters: 5040, after opcountersRepl: 5340, after repl: 7890, after storageEngine: 8680, after tcmalloc: 9690, after wiredTiger: 12390, at end: 15380 } 2016-05-02T06:54:39.384+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:54:44.924+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:54:50.818+0000 I COMMAND [conn1305] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 16761ms 2016-05-02T06:54:57.595+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:54:58.100+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37008 #1306 (2 connections now open) 2016-05-02T06:54:59.948+0000 I NETWORK [conn1305] end connection 127.0.0.1:37006 (0 connections now open) 2016-05-02T06:55:01.296+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:55:07.239+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:55:14.475+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:55:15.323+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-05-02T06:55:16.221+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:55:17.142+0000 I COMMAND [conn1306] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 9802ms 2016-05-02T06:55:25.306+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:55:29.899+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:55:31.124+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 740, after connections: 850, after extra_info: 1980, after globalLock: 2610, after locks: 2940, after network: 3240, after opcounters: 3550, after opcountersRepl: 4210, after repl: 9800, after storageEngine: 10710, after tcmalloc: 11910, after wiredTiger: 16630, at end: 19400 } 2016-05-02T06:55:33.902+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:55:36.773+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37011 #1307 (2 connections now open) 2016-05-02T06:55:39.335+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37013 #1308 (3 connections now open) 2016-05-02T06:55:40.437+0000 I COMMAND [conn1306] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 11603ms 2016-05-02T06:55:46.032+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37016 #1309 (4 connections now open) 2016-05-02T06:55:48.670+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:55:50.428+0000 I NETWORK [conn1306] end connection 127.0.0.1:37008 (3 connections now open) 2016-05-02T06:55:54.609+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:55:56.077+0000 I COMMAND [conn1307] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6991ms 2016-05-02T06:55:56.077+0000 I COMMAND [conn1308] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6991ms 2016-05-02T06:55:59.502+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:56:06.719+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:56:06.818+0000 I COMMAND [conn1309] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 9660ms 2016-05-02T06:56:11.503+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:56:13.710+0000 I NETWORK [conn1308] end connection 127.0.0.1:37013 (2 connections now open) 2016-05-02T06:56:15.942+0000 I COMMAND [conn1307] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2373ms 2016-05-02T06:56:16.041+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:56:18.707+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 880, after asserts: 1280, after connections: 1990, after extra_info: 3390, after globalLock: 3890, after locks: 4080, after network: 4370, after opcounters: 4760, after opcountersRepl: 5000, after repl: 10100, after storageEngine: 10840, after tcmalloc: 11590, after wiredTiger: 13500, at end: 16340 } 2016-05-02T06:56:23.020+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:56:27.342+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:56:35.932+0000 I COMMAND [conn1309] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 17387ms 2016-05-02T06:56:36.336+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37020 #1310 (3 connections now open) 2016-05-02T06:56:41.987+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:56:43.807+0000 I NETWORK [conn1309] end connection 127.0.0.1:37016 (2 connections now open) 2016-05-02T06:56:46.679+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:56:50.308+0000 I COMMAND [conn1310] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3121ms 2016-05-02T06:56:52.702+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:56:59.148+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:57:08.161+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:57:08.860+0000 I COMMAND [conn1310] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5020ms 2016-05-02T06:57:11.430+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:57:13.549+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 520, after asserts: 890, after connections: 1100, after extra_info: 2450, after globalLock: 3320, after locks: 3930, after network: 4420, after opcounters: 4970, after opcountersRepl: 5370, after repl: 10300, after storageEngine: 11270, after tcmalloc: 12470, after wiredTiger: 15500, at end: 17380 } 2016-05-02T06:57:15.161+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T06:57:16.392+0000 I NETWORK [conn1310] end connection 127.0.0.1:37020 (1 connection now open) 2016-05-02T06:57:18.966+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 201ms 2016-05-02T06:57:21.653+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:57:21.556+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 303ms 2016-05-02T06:57:23.016+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37026 #1311 (2 connections now open) 2016-05-02T06:57:26.894+0000 I NETWORK [conn1307] end connection 127.0.0.1:37011 (1 connection now open) 2016-05-02T06:57:29.439+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:57:38.857+0000 I COMMAND [conn1311] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 10531ms 2016-05-02T06:57:38.852+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:57:45.458+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:57:46.761+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:57:52.505+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:57:58.230+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:58:03.759+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:58:04.688+0000 I COMMAND [conn1311] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 15364ms 2016-05-02T06:58:05.191+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37032 #1312 (2 connections now open) 2016-05-02T06:58:05.397+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 920, after asserts: 1240, after connections: 1810, after extra_info: 3170, after globalLock: 3730, after locks: 4310, after network: 4590, after opcounters: 4960, after opcountersRepl: 5070, after repl: 11650, after storageEngine: 12440, after tcmalloc: 13830, after wiredTiger: 17030, at end: 17642 } 2016-05-02T06:58:12.290+0000 I NETWORK [conn1311] end connection 127.0.0.1:37026 (1 connection now open) 2016-05-02T06:58:13.398+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:58:16.357+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:58:19.426+0000 I COMMAND [conn1312] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5574ms 2016-05-02T06:58:24.305+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:58:28.340+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:58:29.120+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:58:34.720+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:58:38.184+0000 I COMMAND [conn1312] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 9248ms 2016-05-02T06:58:39.429+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:58:40.187+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 850, after connections: 1310, after extra_info: 2400, after globalLock: 3030, after locks: 3790, after network: 4150, after opcounters: 4430, after opcountersRepl: 4720, after repl: 9050, after storageEngine: 9990, after tcmalloc: 11260, after wiredTiger: 13100, at end: 14930 } 2016-05-02T06:58:42.467+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37034 #1313 (2 connections now open) 2016-05-02T06:58:44.499+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:58:46.653+0000 I NETWORK [conn1312] end connection 127.0.0.1:37032 (1 connection now open) 2016-05-02T06:58:46.782+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37035 #1314 (3 connections now open) 2016-05-02T06:58:49.075+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37037 #1315 (3 connections now open) 2016-05-02T06:58:53.774+0000 I COMMAND [conn1313] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3554ms 2016-05-02T06:58:54.452+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:58:58.176+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:59:05.290+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:59:08.959+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T06:59:10.256+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:59:18.944+0000 I COMMAND [conn1315] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5737ms 2016-05-02T06:59:20.687+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:59:20.884+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 510, after asserts: 800, after connections: 1440, after extra_info: 3750, after globalLock: 4070, after locks: 4590, after network: 4820, after opcounters: 4820, after opcountersRepl: 4820, after repl: 8890, after storageEngine: 9550, after tcmalloc: 10690, after wiredTiger: 12280, at end: 14910 } 2016-05-02T06:59:21.370+0000 I COMMAND [conn1313] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 12484ms 2016-05-02T06:59:23.566+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37039 #1316 (4 connections now open) 2016-05-02T06:59:25.341+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:59:26.240+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 101ms 2016-05-02T06:59:32.071+0000 I NETWORK [conn1313] end connection 127.0.0.1:37034 (3 connections now open) 2016-05-02T06:59:37.130+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T06:59:41.115+0000 I COMMAND [conn1316] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7828ms 2016-05-02T06:59:41.214+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:59:48.986+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T06:59:52.415+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T06:59:57.191+0000 I COMMAND [conn1316] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5974ms 2016-05-02T07:00:00.905+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:00:01.997+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37041 #1317 (4 connections now open) 2016-05-02T07:00:02.235+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:00:06.086+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 310, after asserts: 700, after connections: 1110, after extra_info: 2790, after globalLock: 3490, after locks: 3910, after network: 4010, after opcounters: 4010, after opcountersRepl: 4010, after repl: 6780, after storageEngine: 7170, after tcmalloc: 7840, after wiredTiger: 12397, at end: 12397 } 2016-05-02T07:00:08.006+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:00:08.505+0000 I NETWORK [conn1316] end connection 127.0.0.1:37039 (3 connections now open) 2016-05-02T07:00:14.704+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:00:18.314+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:00:18.762+0000 I NETWORK [conn1315] end connection 127.0.0.1:37037 (2 connections now open) 2016-05-02T07:00:18.762+0000 I COMMAND [conn1317] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6697ms 2016-05-02T07:00:19.461+0000 I NETWORK [conn1314] end connection 127.0.0.1:37035 (2 connections now open) 2016-05-02T07:00:24.839+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:00:28.289+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 187ms 2016-05-02T07:00:30.931+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 181ms 2016-05-02T07:00:32.832+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:00:35.045+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:00:39.135+0000 I COMMAND [conn1317] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 10227ms 2016-05-02T07:00:41.743+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37043 #1318 (2 connections now open) 2016-05-02T07:00:43.055+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:00:45.496+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37044 #1319 (3 connections now open) 2016-05-02T07:00:45.976+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 700, after asserts: 1090, after connections: 1780, after extra_info: 2320, after globalLock: 2820, after locks: 2890, after network: 2890, after opcounters: 2890, after opcountersRepl: 2890, after repl: 6770, after storageEngine: 7650, after tcmalloc: 8740, after wiredTiger: 9141, at end: 10222 } 2016-05-02T07:00:46.669+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:00:48.076+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:00:48.465+0000 I NETWORK [conn1317] end connection 127.0.0.1:37041 (2 connections now open) 2016-05-02T07:00:54.030+0000 I COMMAND [conn1318] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3866ms 2016-05-02T07:00:56.469+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:00:57.259+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37046 #1320 (3 connections now open) 2016-05-02T07:00:57.805+0000 I COMMAND [conn1319] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5234ms 2016-05-02T07:00:59.793+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:01:02.549+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:01:10.881+0000 I COMMAND [conn1320] command local.$cmd command: isMaster { ismaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 8283ms 2016-05-02T07:01:14.001+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:01:17.783+0000 I COMMAND [conn1318] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 9432ms 2016-05-02T07:01:19.877+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 930, after connections: 1720, after extra_info: 3060, after globalLock: 3820, after locks: 4440, after network: 4840, after opcounters: 4950, after opcountersRepl: 4950, after repl: 9550, after storageEngine: 10190, after tcmalloc: 11320, after wiredTiger: 13170, at end: 15390 } 2016-05-02T07:01:20.681+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:01:26.072+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:01:27.334+0000 I NETWORK [conn1318] end connection 127.0.0.1:37043 (2 connections now open) 2016-05-02T07:01:29.413+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37048 #1321 (4 connections now open) 2016-05-02T07:01:31.472+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:01:33.898+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:01:33.898+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 188ms 2016-05-02T07:01:45.730+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:01:46.834+0000 I COMMAND [conn1321] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7056ms 2016-05-02T07:01:48.979+0000 I NETWORK [conn1319] end connection 127.0.0.1:37044 (2 connections now open) 2016-05-02T07:01:51.455+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:01:56.133+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:01:58.355+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:02:01.917+0000 I NETWORK [conn1320] end connection 127.0.0.1:37046 (1 connection now open) 2016-05-02T07:02:03.283+0000 I COMMAND [conn1321] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5278ms 2016-05-02T07:02:05.528+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 300, after connections: 590, after extra_info: 1100, after globalLock: 1690, after locks: 2120, after network: 2510, after opcounters: 2810, after opcountersRepl: 2920, after repl: 6140, after storageEngine: 6880, after tcmalloc: 7960, after wiredTiger: 10840, at end: 13930 } 2016-05-02T07:02:06.530+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37050 #1322 (2 connections now open) 2016-05-02T07:02:07.979+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:02:09.427+0000 I NETWORK [conn1321] end connection 127.0.0.1:37048 (1 connection now open) 2016-05-02T07:02:12.570+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:02:14.404+0000 I COMMAND [conn1322] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3841ms 2016-05-02T07:02:15.911+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:02:16.277+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:02:26.872+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:02:29.151+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:02:37.013+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 197ms 2016-05-02T07:02:37.804+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:02:40.158+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 110, after asserts: 420, after connections: 1090, after extra_info: 2170, after globalLock: 2510, after locks: 2710, after network: 2800, after opcounters: 2800, after opcountersRepl: 2800, after repl: 4120, after storageEngine: 4490, after tcmalloc: 5590, after wiredTiger: 7610, at end: 10460 } 2016-05-02T07:02:41.822+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:02:42.650+0000 I COMMAND [conn1322] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 9365ms 2016-05-02T07:02:51.760+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:02:53.443+0000 I NETWORK [conn1322] end connection 127.0.0.1:37050 (0 connections now open) 2016-05-02T07:02:54.755+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:02:56.846+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37055 #1323 (1 connection now open) 2016-05-02T07:02:57.131+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:03:02.655+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:03:05.969+0000 I COMMAND [conn1323] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2337ms 2016-05-02T07:03:06.465+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:03:08.493+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 630, after globalLock: 1210, after locks: 1620, after network: 1720, after opcounters: 1720, after opcountersRepl: 1720, after repl: 3090, after storageEngine: 3690, after tcmalloc: 4740, after wiredTiger: 6450, at end: 8740 } 2016-05-02T07:03:12.867+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:03:18.621+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:03:21.697+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:03:26.282+0000 I COMMAND [conn1323] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 9886ms 2016-05-02T07:03:29.786+0000 I NETWORK [conn1323] end connection 127.0.0.1:37055 (0 connections now open) 2016-05-02T07:03:33.312+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:03:37.322+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:03:39.595+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 570, after connections: 850, after extra_info: 2080, after globalLock: 2610, after locks: 2610, after network: 2610, after opcounters: 2610, after opcountersRepl: 2610, after repl: 4610, after storageEngine: 5090, after tcmalloc: 6380, after wiredTiger: 7800, at end: 10480 } 2016-05-02T07:03:39.888+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:03:43.480+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:03:43.579+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37057 #1324 (1 connection now open) 2016-05-02T07:03:45.310+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:03:53.643+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:03:53.750+0000 I COMMAND [conn1324] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3064ms 2016-05-02T07:03:56.824+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:03:59.735+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:04:06.880+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:04:08.020+0000 I COMMAND [conn1324] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5377ms 2016-05-02T07:04:10.117+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 430, after asserts: 730, after connections: 1190, after extra_info: 2600, after globalLock: 3050, after locks: 3540, after network: 3820, after opcounters: 4280, after opcountersRepl: 4280, after repl: 7420, after storageEngine: 8670, after tcmalloc: 10010, after wiredTiger: 11360, at end: 13440 } 2016-05-02T07:04:11.457+0000 I NETWORK [conn1324] end connection 127.0.0.1:37057 (0 connections now open) 2016-05-02T07:04:15.489+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:04:17.791+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:04:20.824+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:04:20.828+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37059 #1325 (1 connection now open) 2016-05-02T07:04:21.623+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:04:29.310+0000 I COMMAND [conn1325] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2511ms 2016-05-02T07:04:33.421+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:04:35.628+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 780, after connections: 1270, after extra_info: 2750, after globalLock: 3050, after locks: 3480, after network: 3780, after opcounters: 3880, after opcountersRepl: 3880, after repl: 5050, after storageEngine: 5900, after tcmalloc: 6630, after wiredTiger: 7650, at end: 9800 } 2016-05-02T07:04:36.144+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:04:38.585+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:04:46.700+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:04:50.317+0000 I COMMAND [conn1325] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7991ms 2016-05-02T07:04:56.016+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:04:56.518+0000 I NETWORK [conn1325] end connection 127.0.0.1:37059 (0 connections now open) 2016-05-02T07:04:59.045+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:05:00.972+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:05:01.168+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:05:03.080+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37061 #1326 (1 connection now open) 2016-05-02T07:05:07.596+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 720, after connections: 1110, after extra_info: 2140, after globalLock: 2910, after locks: 3280, after network: 3850, after opcounters: 3860, after opcountersRepl: 3860, after repl: 8440, after storageEngine: 9370, after tcmalloc: 9570, after wiredTiger: 9668, at end: 11718 } 2016-05-02T07:05:11.024+0000 I COMMAND [conn1326] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1897ms 2016-05-02T07:05:12.365+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:05:14.710+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-05-02T07:05:16.604+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:05:23.435+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T07:05:24.883+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T07:05:33.486+0000 I COMMAND [conn1326] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7639ms 2016-05-02T07:05:33.572+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:05:36.142+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 630, after connections: 1120, after extra_info: 2230, after globalLock: 2330, after locks: 2330, after network: 2330, after opcounters: 2330, after opcountersRepl: 2330, after repl: 10370, after storageEngine: 10750, after tcmalloc: 11200, after wiredTiger: 12690, at end: 15340 } 2016-05-02T07:05:36.706+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:05:38.448+0000 I NETWORK [conn1326] end connection 127.0.0.1:37061 (0 connections now open) 2016-05-02T07:05:40.550+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 101ms 2016-05-02T07:05:41.865+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:05:42.471+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 108ms 2016-05-02T07:05:44.830+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-05-02T07:05:45.667+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37063 #1327 (1 connection now open) 2016-05-02T07:05:47.025+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-05-02T07:05:47.025+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:05:50.924+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T07:05:53.702+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T07:05:59.997+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T07:06:02.512+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27017; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:06:05.987+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:06:06.852+0000 I COMMAND [conn1327] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 14070ms 2016-05-02T07:06:09.228+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:06:11.251+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:06:12.356+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1030, after asserts: 1260, after connections: 1570, after extra_info: 2540, after globalLock: 3150, after locks: 3620, after network: 4100, after opcounters: 4310, after opcountersRepl: 4660, after repl: 11370, after storageEngine: 12290, after tcmalloc: 12590, after wiredTiger: 14750, at end: 17880 } 2016-05-02T07:06:12.846+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:06:14.194+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-05-02T07:06:17.761+0000 I NETWORK [conn1327] end connection 127.0.0.1:37063 (0 connections now open) 2016-05-02T07:06:19.030+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:06:22.097+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:06:30.343+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37066 #1328 (1 connection now open) 2016-05-02T07:06:30.340+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:06:38.592+0000 I COMMAND [conn1328] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1901ms 2016-05-02T07:06:39.297+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:06:41.323+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:06:41.527+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:06:43.307+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 100, after asserts: 560, after connections: 1140, after extra_info: 3040, after globalLock: 3540, after locks: 3720, after network: 4260, after opcounters: 4360, after opcountersRepl: 4360, after repl: 5060, after storageEngine: 5740, after tcmalloc: 6870, after wiredTiger: 8560, at end: 11030 } 2016-05-02T07:06:52.826+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:06:56.437+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-05-02T07:06:59.359+0000 I COMMAND [conn1328] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 8578ms 2016-05-02T07:07:04.686+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T07:07:05.385+0000 I NETWORK [conn1328] end connection 127.0.0.1:37066 (0 connections now open) 2016-05-02T07:07:06.263+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T07:07:08.315+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 200, after asserts: 400, after connections: 590, after extra_info: 1270, after globalLock: 1640, after locks: 2140, after network: 2600, after opcounters: 2610, after opcountersRepl: 2610, after repl: 4220, after storageEngine: 5250, after tcmalloc: 6580, after wiredTiger: 8400, at end: 10991 } 2016-05-02T07:07:08.425+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37067 #1329 (1 connection now open) 2016-05-02T07:07:14.721+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:07:19.547+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:07:20.888+0000 I COMMAND [conn1329] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5027ms 2016-05-02T07:07:20.898+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:07:23.017+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:07:24.116+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:07:25.783+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-05-02T07:07:30.648+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:07:34.075+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:07:34.447+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 760, after connections: 1200, after extra_info: 1890, after globalLock: 2630, after locks: 3320, after network: 3920, after opcounters: 3920, after opcountersRepl: 3920, after repl: 6550, after storageEngine: 7600, after tcmalloc: 9040, after wiredTiger: 10550, at end: 12130 } 2016-05-02T07:07:38.612+0000 I COMMAND [conn1329] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5425ms 2016-05-02T07:07:42.486+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:07:44.604+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 132ms 2016-05-02T07:07:44.604+0000 I NETWORK [conn1329] end connection 127.0.0.1:37067 (0 connections now open) 2016-05-02T07:07:45.793+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 222ms 2016-05-02T07:07:51.433+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:07:53.993+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:07:56.394+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37070 #1330 (1 connection now open) 2016-05-02T07:08:00.884+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:08:03.115+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 350, after asserts: 640, after connections: 870, after extra_info: 1570, after globalLock: 2200, after locks: 2630, after network: 3060, after opcounters: 3250, after opcountersRepl: 3250, after repl: 5044, after storageEngine: 5044, after tcmalloc: 5044, after wiredTiger: 7334, at end: 9174 } 2016-05-02T07:08:04.704+0000 I COMMAND [conn1330] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1853ms 2016-05-02T07:08:05.513+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:08:10.465+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:08:17.173+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:08:20.676+0000 I COMMAND [conn1330] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6377ms 2016-05-02T07:08:26.868+0000 I NETWORK [conn1330] end connection 127.0.0.1:37070 (0 connections now open) 2016-05-02T07:08:27.854+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:08:31.091+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:08:32.727+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 140, after asserts: 330, after connections: 1260, after extra_info: 3210, after globalLock: 4080, after locks: 4550, after network: 4910, after opcounters: 4990, after opcountersRepl: 4990, after repl: 5980, after storageEngine: 6780, after tcmalloc: 7250, after wiredTiger: 8750, at end: 10780 } 2016-05-02T07:08:34.090+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37072 #1331 (1 connection now open) 2016-05-02T07:08:35.779+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:08:42.473+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:08:43.484+0000 I COMMAND [conn1331] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2269ms 2016-05-02T07:08:47.311+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:08:48.284+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 229ms 2016-05-02T07:08:54.822+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:08:58.524+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 1120, after connections: 1840, after extra_info: 2860, after globalLock: 3450, after locks: 3930, after network: 4290, after opcounters: 4400, after opcountersRepl: 4400, after repl: 5360, after storageEngine: 6220, after tcmalloc: 7600, after wiredTiger: 9290, at end: 12070 } 2016-05-02T07:09:02.233+0000 I COMMAND [conn1331] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3807ms 2016-05-02T07:09:02.905+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:09:07.426+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:09:10.704+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:09:17.575+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37074 #1332 (2 connections now open) 2016-05-02T07:09:21.288+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:09:25.484+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:09:26.480+0000 I COMMAND [conn1332] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3291ms 2016-05-02T07:09:30.630+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37075 #1333 (3 connections now open) 2016-05-02T07:09:32.381+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:09:32.393+0000 I COMMAND [conn1331] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6874ms 2016-05-02T07:09:35.293+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 250, after asserts: 340, after connections: 700, after extra_info: 1740, after globalLock: 2580, after locks: 3140, after network: 3340, after opcounters: 3340, after opcountersRepl: 3340, after repl: 8190, after storageEngine: 8556, after tcmalloc: 8556, after wiredTiger: 8926, at end: 10916 } 2016-05-02T07:09:39.191+0000 I NETWORK [conn1331] end connection 127.0.0.1:37072 (2 connections now open) 2016-05-02T07:09:39.782+0000 I COMMAND [conn1333] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2960ms 2016-05-02T07:09:40.448+0000 I COMMAND [conn1332] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 7319ms 2016-05-02T07:09:41.881+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:09:44.082+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:09:45.034+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37077 #1334 (3 connections now open) 2016-05-02T07:09:46.308+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37078 #1335 (4 connections now open) 2016-05-02T07:09:47.294+0000 I NETWORK [conn1332] end connection 127.0.0.1:37074 (2 connections now open) 2016-05-02T07:09:51.145+0000 I COMMAND [conn1333] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4152ms 2016-05-02T07:09:53.681+0000 I COMMAND [conn1334] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2606ms 2016-05-02T07:09:54.326+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:09:54.820+0000 I COMMAND [conn1335] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1530ms 2016-05-02T07:09:55.986+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:09:58.652+0000 I NETWORK [conn1333] end connection 127.0.0.1:37075 (2 connections now open) 2016-05-02T07:09:59.848+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:10:00.344+0000 I COMMAND [conn1334] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 1035ms 2016-05-02T07:10:01.584+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 350, after asserts: 730, after connections: 1210, after extra_info: 2040, after globalLock: 2480, after locks: 2960, after network: 3340, after opcounters: 3340, after opcountersRepl: 3340, after repl: 4800, after storageEngine: 5480, after tcmalloc: 6420, after wiredTiger: 7540, at end: 9310 } 2016-05-02T07:10:03.003+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37079 #1336 (3 connections now open) 2016-05-02T07:10:09.128+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:10:10.902+0000 I NETWORK [conn1334] end connection 127.0.0.1:37077 (2 connections now open) 2016-05-02T07:10:11.202+0000 I COMMAND [conn1336] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1572ms 2016-05-02T07:10:16.449+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:10:20.233+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:10:21.387+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:10:26.440+0000 I COMMAND [conn1336] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2895ms 2016-05-02T07:10:28.949+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 320, after asserts: 860, after connections: 1460, after extra_info: 2500, after globalLock: 2580, after locks: 2580, after network: 2790, after opcounters: 2890, after opcountersRepl: 2890, after repl: 5040, after storageEngine: 5820, after tcmalloc: 6460, after wiredTiger: 8300, at end: 10490 } 2016-05-02T07:10:31.510+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:10:37.001+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:10:43.550+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37081 #1337 (3 connections now open) 2016-05-02T07:10:44.020+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:10:50.400+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 157ms 2016-05-02T07:10:50.876+0000 I COMMAND [conn1337] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1615ms 2016-05-02T07:10:52.315+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37083 #1338 (4 connections now open) 2016-05-02T07:10:52.315+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-05-02T07:10:52.321+0000 I COMMAND [conn1336] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 999ms 2016-05-02T07:10:54.706+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:10:56.527+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:10:56.610+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:10:56.610+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 380, after connections: 510, after extra_info: 1320, after globalLock: 1330, after locks: 1510, after network: 1910, after opcounters: 2130, after opcountersRepl: 2130, after repl: 3420, after storageEngine: 4000, after tcmalloc: 5490, after wiredTiger: 6212, at end: 9562 } 2016-05-02T07:11:01.093+0000 I COMMAND [conn1338] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3560ms 2016-05-02T07:11:04.556+0000 I COMMAND [conn1336] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4625ms 2016-05-02T07:11:04.556+0000 I COMMAND [conn1337] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 7808ms 2016-05-02T07:11:07.198+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:11:10.819+0000 I NETWORK [conn1336] end connection 127.0.0.1:37079 (3 connections now open) 2016-05-02T07:11:11.012+0000 I NETWORK [conn1337] end connection 127.0.0.1:37081 (3 connections now open) 2016-05-02T07:11:11.511+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:11:13.499+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37084 #1339 (3 connections now open) 2016-05-02T07:11:20.170+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:11:22.790+0000 I COMMAND [conn1338] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7449ms 2016-05-02T07:11:24.761+0000 I COMMAND [conn1339] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3910ms 2016-05-02T07:11:25.200+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 760, after connections: 967, after extra_info: 967, after globalLock: 967, after locks: 967, after network: 967, after opcounters: 967, after opcountersRepl: 967, after repl: 4437, after storageEngine: 5407, after tcmalloc: 6097, after wiredTiger: 7677, at end: 9797 } 2016-05-02T07:11:28.911+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:11:30.683+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37086 #1340 (4 connections now open) 2016-05-02T07:11:32.092+0000 I NETWORK [conn1338] end connection 127.0.0.1:37083 (3 connections now open) 2016-05-02T07:11:32.916+0000 I COMMAND [conn1335] command local.oplog.rs command: find { find: "oplog.rs", filter: { ts: { $gte: Timestamp 1462170501000|4 } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 60000, term: 46 } planSummary: COLLSCAN cursorid:16766851819 keysExamined:0 docsExamined:2 keyUpdates:0 writeConflicts:0 numYields:4 nreturned:2 reslen:754 locks:{ Global: { acquireCount: { r: 10 } }, Database: { acquireCount: { r: 5 } }, oplog: { acquireCount: { r: 5 } } } protocol:op_command 18105ms 2016-05-02T07:11:33.010+0000 I COMMAND [conn1339] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 0, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 726ms 2016-05-02T07:11:33.711+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:11:34.182+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:11:37.983+0000 I NETWORK [conn1335] end connection 127.0.0.1:37078 (2 connections now open) 2016-05-02T07:11:40.086+0000 I COMMAND [conn1340] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4754ms 2016-05-02T07:11:44.252+0000 I NETWORK [conn1339] end connection 127.0.0.1:37084 (1 connection now open) 2016-05-02T07:11:45.054+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:11:48.176+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:11:53.336+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 104ms 2016-05-02T07:11:54.803+0000 I COMMAND [conn1340] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4085ms 2016-05-02T07:11:56.637+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:11:58.444+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 520, after asserts: 1140, after connections: 1630, after extra_info: 2720, after globalLock: 3160, after locks: 3510, after network: 3990, after opcounters: 4520, after opcountersRepl: 4890, after repl: 8170, after storageEngine: 9260, after tcmalloc: 10310, after wiredTiger: 12580, at end: 14670 } 2016-05-02T07:12:08.790+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:12:12.520+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:12:13.612+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37088 #1341 (2 connections now open) 2016-05-02T07:12:18.244+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:12:20.876+0000 I COMMAND [conn1340] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2732ms 2016-05-02T07:12:22.484+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37089 #1342 (3 connections now open) 2016-05-02T07:12:23.307+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:12:23.222+0000 I COMMAND [conn1341] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2045ms 2016-05-02T07:12:29.020+0000 I NETWORK [conn1340] end connection 127.0.0.1:37086 (2 connections now open) 2016-05-02T07:12:30.011+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:12:32.939+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 920, after connections: 1650, after extra_info: 2236, after globalLock: 2236, after locks: 2236, after network: 2236, after opcounters: 2236, after opcountersRepl: 2616, after repl: 4146, after storageEngine: 4806, after tcmalloc: 5606, after wiredTiger: 7226, at end: 10196 } 2016-05-02T07:12:35.072+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:12:36.058+0000 I COMMAND [conn1342] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6194ms 2016-05-02T07:12:39.049+0000 I COMMAND [conn1341] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 8102ms 2016-05-02T07:12:46.046+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37091 #1343 (3 connections now open) 2016-05-02T07:12:46.295+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:12:48.008+0000 I NETWORK [conn1341] end connection 127.0.0.1:37088 (1 connection now open) 2016-05-02T07:12:48.151+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37092 #1344 (4 connections now open) 2016-05-02T07:12:50.950+0000 I COMMAND [conn1342] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4060ms 2016-05-02T07:12:51.052+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:12:55.048+0000 I COMMAND [conn1343] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1625ms 2016-05-02T07:12:55.138+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37093 #1345 (4 connections now open) 2016-05-02T07:12:55.333+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 278ms 2016-05-02T07:12:56.105+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:12:56.700+0000 I NETWORK [conn1342] end connection 127.0.0.1:37089 (3 connections now open) 2016-05-02T07:12:56.696+0000 I COMMAND [conn1344] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2265ms 2016-05-02T07:12:56.804+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:13:02.998+0000 I COMMAND [conn1344] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 1466ms 2016-05-02T07:13:03.206+0000 I COMMAND [conn1345] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2470ms 2016-05-02T07:13:07.300+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:13:09.095+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 550, after asserts: 850, after connections: 1040, after extra_info: 1680, after globalLock: 2080, after locks: 2540, after network: 2540, after opcounters: 2540, after opcountersRepl: 2540, after repl: 3410, after storageEngine: 4190, after tcmalloc: 5050, after wiredTiger: 7760, at end: 9970 } 2016-05-02T07:13:10.264+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:13:13.584+0000 I NETWORK [conn1344] end connection 127.0.0.1:37092 (2 connections now open) 2016-05-02T07:13:17.220+0000 I COMMAND [conn1345] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4045ms 2016-05-02T07:13:21.807+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:13:25.127+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37095 #1346 (3 connections now open) 2016-05-02T07:13:25.230+0000 I NETWORK [conn1345] end connection 127.0.0.1:37093 (1 connection now open) 2016-05-02T07:13:25.237+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:13:28.385+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:13:32.244+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:13:38.851+0000 I COMMAND [conn1346] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6793ms 2016-05-02T07:13:42.472+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:13:43.586+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 200, after asserts: 790, after connections: 1610, after extra_info: 2710, after globalLock: 3310, after locks: 3930, after network: 4430, after opcounters: 4820, after opcountersRepl: 5310, after repl: 10530, after storageEngine: 10830, after tcmalloc: 11790, after wiredTiger: 14080, at end: 16110 } 2016-05-02T07:13:46.068+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:13:51.926+0000 I COMMAND [conn1346] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4385ms 2016-05-02T07:13:55.903+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 196ms 2016-05-02T07:13:56.520+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:13:59.884+0000 I NETWORK [conn1346] end connection 127.0.0.1:37095 (1 connection now open) 2016-05-02T07:14:02.127+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:14:08.169+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:14:08.459+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:14:10.718+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37097 #1347 (2 connections now open) 2016-05-02T07:14:13.954+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 720, after connections: 1340, after extra_info: 2760, after globalLock: 3420, after locks: 4100, after network: 4610, after opcounters: 5060, after opcountersRepl: 5150, after repl: 8850, after storageEngine: 9740, after tcmalloc: 10330, after wiredTiger: 11869, at end: 11869 } 2016-05-02T07:14:21.497+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:14:24.879+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:14:26.476+0000 I COMMAND [conn1347] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7591ms 2016-05-02T07:14:36.735+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:14:40.372+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:14:42.392+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:14:44.614+0000 I COMMAND [conn1347] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 8285ms 2016-05-02T07:14:48.035+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:14:50.015+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 200, after asserts: 580, after connections: 1350, after extra_info: 3160, after globalLock: 3780, after locks: 4360, after network: 4790, after opcounters: 5180, after opcountersRepl: 5180, after repl: 10670, after storageEngine: 11010, after tcmalloc: 11580, after wiredTiger: 13230, at end: 16850 } 2016-05-02T07:14:50.916+0000 I NETWORK [conn1347] end connection 127.0.0.1:37097 (1 connection now open) 2016-05-02T07:14:56.335+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37099 #1348 (2 connections now open) 2016-05-02T07:14:57.529+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:15:00.383+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:15:08.651+0000 I COMMAND [conn1348] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3899ms 2016-05-02T07:15:11.839+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:15:16.264+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:15:22.262+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:15:23.902+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:15:26.773+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 580, after asserts: 1350, after connections: 2100, after extra_info: 3830, after globalLock: 4430, after locks: 5170, after network: 5730, after opcounters: 6130, after opcountersRepl: 6520, after repl: 10770, after storageEngine: 11520, after tcmalloc: 12410, after wiredTiger: 14160, at end: 17410 } 2016-05-02T07:15:28.458+0000 I COMMAND [conn1348] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7821ms 2016-05-02T07:15:35.261+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:15:36.041+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37101 #1349 (3 connections now open) 2016-05-02T07:15:37.781+0000 I NETWORK [conn1348] end connection 127.0.0.1:37099 (1 connection now open) 2016-05-02T07:15:39.069+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:15:46.056+0000 I COMMAND [conn1349] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3062ms 2016-05-02T07:15:49.722+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:15:54.982+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:15:58.165+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 580, after asserts: 920, after connections: 1570, after extra_info: 2910, after globalLock: 3400, after locks: 3820, after network: 4310, after opcounters: 4880, after opcountersRepl: 5180, after repl: 6880, after storageEngine: 7700, after tcmalloc: 8830, after wiredTiger: 10540, at end: 12560 } 2016-05-02T07:15:59.055+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:15:59.063+0000 I COMMAND [conn1349] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1336ms 2016-05-02T07:16:00.340+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:16:11.697+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:16:12.705+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37103 #1350 (3 connections now open) 2016-05-02T07:16:17.050+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:16:23.474+0000 I COMMAND [conn1350] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4137ms 2016-05-02T07:16:24.771+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37104 #1351 (4 connections now open) 2016-05-02T07:16:24.771+0000 I COMMAND [conn1349] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 3088ms 2016-05-02T07:16:27.547+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:16:30.361+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 710, after asserts: 990, after connections: 1690, after extra_info: 3330, after globalLock: 3770, after locks: 4590, after network: 5010, after opcounters: 5020, after opcountersRepl: 5020, after repl: 6690, after storageEngine: 7720, after tcmalloc: 7904, after wiredTiger: 7904, at end: 11064 } 2016-05-02T07:16:33.423+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:16:34.566+0000 I COMMAND [conn1350] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 5891ms 2016-05-02T07:16:34.677+0000 I COMMAND [conn1351] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3261ms 2016-05-02T07:16:37.492+0000 I COMMAND [conn1349] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5017ms 2016-05-02T07:16:37.497+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:16:39.149+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:16:40.549+0000 I NETWORK [conn1350] end connection 127.0.0.1:37103 (3 connections now open) 2016-05-02T07:16:42.182+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37106 #1352 (5 connections now open) 2016-05-02T07:16:44.213+0000 I NETWORK [conn1349] end connection 127.0.0.1:37101 (2 connections now open) 2016-05-02T07:16:45.406+0000 I COMMAND [conn1351] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 1772ms 2016-05-02T07:16:50.578+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-05-02T07:16:51.258+0000 I COMMAND [conn1352] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2505ms 2016-05-02T07:16:55.290+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T07:16:55.688+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T07:16:57.738+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37107 #1353 (4 connections now open) 2016-05-02T07:16:57.738+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 103ms 2016-05-02T07:16:59.140+0000 I COMMAND [conn1352] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 1762ms 2016-05-02T07:16:59.516+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 171ms 2016-05-02T07:17:00.501+0000 I COMMAND [conn1343] command local.oplog.rs command: find { find: "oplog.rs", filter: { ts: { $gte: Timestamp 1462170501000|4 } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 60000, term: 46 } planSummary: COLLSCAN cursorid:16876646852 keysExamined:0 docsExamined:2 keyUpdates:0 writeConflicts:0 numYields:4 nreturned:2 reslen:754 locks:{ Global: { acquireCount: { r: 10 } }, Database: { acquireCount: { r: 5 } }, oplog: { acquireCount: { r: 5 } } } protocol:op_command 17933ms 2016-05-02T07:17:00.494+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 610, after asserts: 1090, after connections: 1460, after extra_info: 2960, after globalLock: 3440, after locks: 4280, after network: 4820, after opcounters: 5100, after opcountersRepl: 5100, after repl: 7500, after storageEngine: 7690, after tcmalloc: 8700, after wiredTiger: 10004, at end: 10564 } 2016-05-02T07:17:05.466+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37109 #1354 (5 connections now open) 2016-05-02T07:17:07.658+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:17:07.747+0000 I COMMAND [conn1353] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3422ms 2016-05-02T07:17:09.695+0000 I COMMAND [conn1351] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 5790ms 2016-05-02T07:17:09.791+0000 I NETWORK [conn1343] end connection 127.0.0.1:37091 (4 connections now open) 2016-05-02T07:17:10.600+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:17:11.603+0000 I NETWORK [conn1352] end connection 127.0.0.1:37106 (4 connections now open) 2016-05-02T07:17:12.395+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-05-02T07:17:13.565+0000 I COMMAND [conn1354] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3605ms 2016-05-02T07:17:14.489+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-05-02T07:17:16.703+0000 I COMMAND [conn1353] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:1 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 4 } }, Database: { acquireCount: { r: 2 } }, oplog: { acquireCount: { r: 2 } } } 4417ms 2016-05-02T07:17:16.904+0000 I NETWORK [conn1351] end connection 127.0.0.1:37104 (2 connections now open) 2016-05-02T07:17:17.301+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:17:18.544+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:17:21.561+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:17:21.772+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37110 #1355 (3 connections now open) 2016-05-02T07:17:23.652+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37111 #1356 (4 connections now open) 2016-05-02T07:17:24.996+0000 I NETWORK [conn1353] end connection 127.0.0.1:37107 (2 connections now open) 2016-05-02T07:17:29.244+0000 I COMMAND [conn1355] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1684ms 2016-05-02T07:17:31.994+0000 I COMMAND [conn1356] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2249ms 2016-05-02T07:17:32.086+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:17:32.287+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 880, after asserts: 1460, after connections: 1566, after extra_info: 1566, after globalLock: 1567, after locks: 1567, after network: 1567, after opcounters: 1567, after opcountersRepl: 1567, after repl: 1657, after storageEngine: 2277, after tcmalloc: 3277, after wiredTiger: 4617, at end: 7657 } 2016-05-02T07:17:35.372+0000 I COMMAND [conn1354] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3638ms 2016-05-02T07:17:36.705+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:17:36.912+0000 I COMMAND [conn1355] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 1620ms 2016-05-02T07:17:41.690+0000 I NETWORK [conn1354] end connection 127.0.0.1:37109 (2 connections now open) 2016-05-02T07:17:42.291+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37112 #1357 (4 connections now open) 2016-05-02T07:17:43.649+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:17:44.888+0000 I NETWORK [conn1355] end connection 127.0.0.1:37110 (2 connections now open) 2016-05-02T07:17:49.930+0000 I COMMAND [conn1357] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1418ms 2016-05-02T07:17:53.799+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:17:58.740+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:18:00.185+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:18:00.185+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 430, after asserts: 760, after connections: 1520, after extra_info: 2320, after globalLock: 2810, after locks: 3490, after network: 3930, after opcounters: 4130, after opcountersRepl: 4130, after repl: 5920, after storageEngine: 6910, after tcmalloc: 7870, after wiredTiger: 9560, at end: 12420 } 2016-05-02T07:18:06.718+0000 I COMMAND [conn1357] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3021ms 2016-05-02T07:18:09.569+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:18:12.678+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:18:20.678+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:18:27.365+0000 I COMMAND [conn1357] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 2194ms 2016-05-02T07:18:27.757+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37115 #1358 (3 connections now open) 2016-05-02T07:18:28.806+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 690, after connections: 990, after extra_info: 2150, after globalLock: 2520, after locks: 3290, after network: 3670, after opcounters: 3950, after opcountersRepl: 4340, after repl: 7220, after storageEngine: 7820, after tcmalloc: 8560, after wiredTiger: 11220, at end: 11817 } 2016-05-02T07:18:29.252+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:18:33.326+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37116 #1359 (4 connections now open) 2016-05-02T07:18:34.268+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:18:35.475+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:18:37.892+0000 I COMMAND [conn1357] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2544ms 2016-05-02T07:18:38.286+0000 I COMMAND [conn1358] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3424ms 2016-05-02T07:18:41.824+0000 I COMMAND [conn1359] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2532ms 2016-05-02T07:18:44.288+0000 I NETWORK [conn1357] end connection 127.0.0.1:37112 (3 connections now open) 2016-05-02T07:18:45.178+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:18:47.908+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:18:51.231+0000 I COMMAND [conn1358] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 7103ms 2016-05-02T07:18:55.395+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:18:56.088+0000 I NETWORK [conn1358] end connection 127.0.0.1:37115 (2 connections now open) 2016-05-02T07:18:56.088+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 680, after connections: 1040, after extra_info: 2520, after globalLock: 2850, after locks: 3330, after network: 3820, after opcounters: 4440, after opcountersRepl: 4540, after repl: 7220, after storageEngine: 7780, after tcmalloc: 8830, after wiredTiger: 10730, at end: 11900 } 2016-05-02T07:18:57.093+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37118 #1360 (4 connections now open) 2016-05-02T07:18:59.868+0000 I COMMAND [conn1359] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4704ms 2016-05-02T07:19:03.702+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:19:04.613+0000 I COMMAND [conn1360] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2721ms 2016-05-02T07:19:06.491+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:19:06.496+0000 I NETWORK [conn1359] end connection 127.0.0.1:37116 (2 connections now open) 2016-05-02T07:19:07.078+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:19:11.391+0000 I COMMAND [conn1360] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 1002ms 2016-05-02T07:19:14.631+0000 I COMMAND [conn1356] command local.oplog.rs command: find { find: "oplog.rs", filter: { ts: { $gte: Timestamp 1462170501000|4 } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 60000, term: 46 } planSummary: COLLSCAN cursorid:16431274329 keysExamined:0 docsExamined:2 keyUpdates:0 writeConflicts:0 numYields:4 nreturned:2 reslen:754 locks:{ Global: { acquireCount: { r: 10 } }, Database: { acquireCount: { r: 5 } }, oplog: { acquireCount: { r: 5 } } } protocol:op_command 15984ms 2016-05-02T07:19:18.653+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:19:21.542+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 180, after asserts: 670, after connections: 1150, after extra_info: 2430, after globalLock: 2910, after locks: 3260, after network: 3600, after opcounters: 3600, after opcountersRepl: 3600, after repl: 4950, after storageEngine: 5420, after tcmalloc: 6890, after wiredTiger: 7920, at end: 10560 } 2016-05-02T07:19:22.675+0000 I NETWORK [conn1360] end connection 127.0.0.1:37118 (1 connection now open) 2016-05-02T07:19:22.675+0000 I NETWORK [conn1356] end connection 127.0.0.1:37111 (1 connection now open) 2016-05-02T07:19:22.675+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37119 #1361 (3 connections now open) 2016-05-02T07:19:22.677+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:19:29.786+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:19:30.796+0000 I COMMAND [conn1361] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3562ms 2016-05-02T07:19:39.068+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:19:42.256+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:19:44.949+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:19:45.542+0000 I COMMAND [conn1361] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4735ms 2016-05-02T07:19:49.509+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 260, after asserts: 540, after connections: 840, after extra_info: 1850, after globalLock: 2220, after locks: 2710, after network: 3290, after opcounters: 3300, after opcountersRepl: 3300, after repl: 7850, after storageEngine: 8620, after tcmalloc: 9880, after wiredTiger: 11370, at end: 14200 } 2016-05-02T07:19:52.547+0000 I NETWORK [conn1361] end connection 127.0.0.1:37119 (0 connections now open) 2016-05-02T07:19:53.994+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:19:56.784+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:19:59.467+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37121 #1362 (1 connection now open) 2016-05-02T07:20:01.648+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 106ms 2016-05-02T07:20:04.828+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:20:09.281+0000 I COMMAND [conn1362] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3587ms 2016-05-02T07:20:14.246+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:20:17.464+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:20:17.767+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 730, after asserts: 1120, after connections: 1690, after extra_info: 3260, after globalLock: 3780, after locks: 4250, after network: 4850, after opcounters: 4860, after opcountersRepl: 4860, after repl: 6840, after storageEngine: 7830, after tcmalloc: 8980, after wiredTiger: 11270, at end: 13230 } 2016-05-02T07:20:25.548+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:20:29.157+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:20:34.472+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:20:37.938+0000 I COMMAND [conn1362] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 8383ms 2016-05-02T07:20:43.616+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:20:47.255+0000 I NETWORK [conn1362] end connection 127.0.0.1:37121 (0 connections now open) 2016-05-02T07:20:49.925+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37124 #1363 (2 connections now open) 2016-05-02T07:20:51.187+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 470, after connections: 640, after extra_info: 880, after globalLock: 1270, after locks: 1380, after network: 1470, after opcounters: 1470, after opcountersRepl: 1470, after repl: 6170, after storageEngine: 7320, after tcmalloc: 8630, after wiredTiger: 10720, at end: 11875 } 2016-05-02T07:20:51.986+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:20:58.270+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:20:59.891+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:21:03.995+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 199ms 2016-05-02T07:21:04.995+0000 I COMMAND [conn1363] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7017ms 2016-05-02T07:21:08.504+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:21:12.920+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:21:19.745+0000 I COMMAND [conn1363] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5275ms 2016-05-02T07:21:20.745+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:21:25.029+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 390, after connections: 610, after extra_info: 1240, after globalLock: 1690, after locks: 1870, after network: 2060, after opcounters: 2060, after opcountersRepl: 2060, after repl: 6970, after storageEngine: 7670, after tcmalloc: 8790, after wiredTiger: 11540, at end: 14840 } 2016-05-02T07:21:25.806+0000 I NETWORK [conn1363] end connection 127.0.0.1:37124 (0 connections now open) 2016-05-02T07:21:31.215+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:21:34.612+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:21:39.015+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:21:40.595+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37126 #1364 (1 connection now open) 2016-05-02T07:21:45.092+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:21:48.898+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:21:52.051+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 200, after globalLock: 800, after locks: 1290, after network: 1400, after opcounters: 1400, after opcountersRepl: 1400, after repl: 2570, after storageEngine: 3100, after tcmalloc: 4220, after wiredTiger: 5830, at end: 9180 } 2016-05-02T07:21:55.701+0000 I COMMAND [conn1364] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7311ms 2016-05-02T07:21:56.103+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:22:04.792+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:22:07.356+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:22:07.704+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:22:11.270+0000 I COMMAND [conn1364] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5045ms 2016-05-02T07:22:17.801+0000 I NETWORK [conn1364] end connection 127.0.0.1:37126 (0 connections now open) 2016-05-02T07:22:18.117+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37128 #1365 (2 connections now open) 2016-05-02T07:22:18.905+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:22:20.663+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 370, after asserts: 660, after connections: 1140, after extra_info: 1930, after globalLock: 2220, after locks: 2610, after network: 3060, after opcounters: 3250, after opcountersRepl: 3350, after repl: 4160, after storageEngine: 4910, after tcmalloc: 5310, after wiredTiger: 5982, at end: 6502 } 2016-05-02T07:22:21.452+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:22:29.775+0000 I COMMAND [conn1365] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4932ms 2016-05-02T07:22:30.767+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:22:40.675+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:22:40.771+0000 I COMMAND [conn1365] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2693ms 2016-05-02T07:22:43.403+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:22:46.977+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:22:52.528+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 630, after asserts: 1110, after connections: 1900, after extra_info: 3200, after globalLock: 3830, after locks: 4140, after network: 4230, after opcounters: 4230, after opcountersRepl: 4230, after repl: 6330, after storageEngine: 7220, after tcmalloc: 8260, after wiredTiger: 10140, at end: 12770 } 2016-05-02T07:22:53.904+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37130 #1366 (2 connections now open) 2016-05-02T07:22:54.811+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:23:00.759+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:23:03.651+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37131 #1367 (3 connections now open) 2016-05-02T07:23:05.394+0000 I COMMAND [conn1365] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 4875ms 2016-05-02T07:23:05.696+0000 I COMMAND [conn1366] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4875ms 2016-05-02T07:23:06.166+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:23:11.950+0000 I COMMAND [conn1367] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2251ms 2016-05-02T07:23:14.412+0000 I COMMAND [conn1365] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3304ms 2016-05-02T07:23:16.832+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:23:19.456+0000 I COMMAND [conn1366] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 8004ms 2016-05-02T07:23:19.691+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 680, after asserts: 880, after connections: 1180, after extra_info: 2170, after globalLock: 2590, after locks: 2880, after network: 3080, after opcounters: 3080, after opcountersRepl: 3080, after repl: 4770, after storageEngine: 5500, after tcmalloc: 6620, after wiredTiger: 9010, at end: 11000 } 2016-05-02T07:23:19.908+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:23:20.677+0000 I NETWORK [conn1365] end connection 127.0.0.1:37128 (2 connections now open) 2016-05-02T07:23:25.364+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37133 #1368 (3 connections now open) 2016-05-02T07:23:25.361+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:23:27.669+0000 I NETWORK [conn1366] end connection 127.0.0.1:37130 (2 connections now open) 2016-05-02T07:23:27.669+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37134 #1369 (4 connections now open) 2016-05-02T07:23:31.296+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:23:31.621+0000 I COMMAND [conn1367] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2939ms 2016-05-02T07:23:34.850+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:23:35.102+0000 I COMMAND [conn1368] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2967ms 2016-05-02T07:23:40.023+0000 I COMMAND [conn1369] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4939ms 2016-05-02T07:23:41.708+0000 I COMMAND [conn1368] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 1593ms 2016-05-02T07:23:42.650+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37135 #1370 (4 connections now open) 2016-05-02T07:23:43.047+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:23:50.841+0000 I COMMAND [conn1370] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2881ms 2016-05-02T07:23:51.035+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 660, after asserts: 1060, after connections: 1790, after extra_info: 3610, after globalLock: 4010, after locks: 4470, after network: 4580, after opcounters: 4580, after opcountersRepl: 4580, after repl: 5612, after storageEngine: 6112, after tcmalloc: 6732, after wiredTiger: 8042, at end: 11792 } 2016-05-02T07:23:51.237+0000 I COMMAND [conn1367] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4233ms 2016-05-02T07:23:51.565+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:23:56.691+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:23:57.707+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37137 #1371 (5 connections now open) 2016-05-02T07:23:59.302+0000 I NETWORK [conn1368] end connection 127.0.0.1:37133 (4 connections now open) 2016-05-02T07:24:00.033+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:24:01.623+0000 I COMMAND [conn1367] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 3454ms 2016-05-02T07:24:03.332+0000 I COMMAND [conn1370] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:1 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 4 } }, Database: { acquireCount: { r: 2 } }, oplog: { acquireCount: { r: 2 } } } 7073ms 2016-05-02T07:24:06.483+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 105ms 2016-05-02T07:24:07.220+0000 I COMMAND [conn1371] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2419ms 2016-05-02T07:24:07.314+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:24:07.636+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 101ms 2016-05-02T07:24:09.851+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37138 #1372 (5 connections now open) 2016-05-02T07:24:09.851+0000 I NETWORK [conn1370] end connection 127.0.0.1:37135 (3 connections now open) 2016-05-02T07:24:09.851+0000 I NETWORK [conn1367] end connection 127.0.0.1:37131 (3 connections now open) 2016-05-02T07:24:11.056+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:24:20.254+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:24:21.085+0000 I NETWORK [conn1371] end connection 127.0.0.1:37137 (2 connections now open) 2016-05-02T07:24:21.281+0000 I COMMAND [conn1372] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5089ms 2016-05-02T07:24:22.570+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37140 #1373 (4 connections now open) 2016-05-02T07:24:23.161+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 640, after asserts: 1230, after connections: 2050, after extra_info: 3233, after globalLock: 3233, after locks: 3233, after network: 3233, after opcounters: 3423, after opcountersRepl: 3823, after repl: 6763, after storageEngine: 7793, after tcmalloc: 8913, after wiredTiger: 11303, at end: 13473 } 2016-05-02T07:24:28.838+0000 I COMMAND [conn1369] command local.oplog.rs command: find { find: "oplog.rs", filter: { ts: { $gte: Timestamp 1462170501000|4 } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 60000, term: 46 } planSummary: COLLSCAN cursorid:16779142365 keysExamined:0 docsExamined:2 keyUpdates:0 writeConflicts:0 numYields:3 nreturned:2 reslen:754 locks:{ Global: { acquireCount: { r: 8 } }, Database: { acquireCount: { r: 4 } }, oplog: { acquireCount: { r: 4 } } } protocol:op_command 15615ms 2016-05-02T07:24:28.839+0000 I COMMAND [conn1372] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 1534ms 2016-05-02T07:24:29.852+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:24:30.546+0000 I COMMAND [conn1373] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1941ms 2016-05-02T07:24:32.166+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:24:35.451+0000 I NETWORK [conn1369] end connection 127.0.0.1:37134 (2 connections now open) 2016-05-02T07:24:39.524+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:24:42.989+0000 I NETWORK [conn1372] end connection 127.0.0.1:37138 (1 connection now open) 2016-05-02T07:24:43.500+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:24:47.687+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 430, after asserts: 530, after connections: 800, after extra_info: 1510, after globalLock: 1770, after locks: 2170, after network: 2580, after opcounters: 2710, after opcountersRepl: 2710, after repl: 5030, after storageEngine: 5460, after tcmalloc: 6320, after wiredTiger: 8110, at end: 10420 } 2016-05-02T07:24:47.891+0000 I COMMAND [conn1373] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4578ms 2016-05-02T07:24:48.189+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:24:52.645+0000 I NETWORK [conn1373] end connection 127.0.0.1:37140 (0 connections now open) 2016-05-02T07:24:55.925+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:25:03.804+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37142 #1374 (1 connection now open) 2016-05-02T07:25:07.619+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:25:11.610+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:25:15.872+0000 I COMMAND [conn1374] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5468ms 2016-05-02T07:25:16.516+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:25:18.419+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 270, after extra_info: 1500, after globalLock: 2160, after locks: 2550, after network: 2560, after opcounters: 2560, after opcountersRepl: 2560, after repl: 4860, after storageEngine: 5460, after tcmalloc: 6800, after wiredTiger: 8300, at end: 11080 } 2016-05-02T07:25:22.420+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:25:29.443+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:25:34.167+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:25:38.768+0000 I COMMAND [conn1374] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 12165ms 2016-05-02T07:25:46.587+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:25:46.689+0000 I NETWORK [conn1374] end connection 127.0.0.1:37142 (0 connections now open) 2016-05-02T07:25:47.475+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37144 #1375 (2 connections now open) 2016-05-02T07:25:51.545+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:25:57.474+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:25:57.846+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 800, after connections: 1730, after extra_info: 2780, after globalLock: 3500, after locks: 4320, after network: 4720, after opcounters: 5100, after opcountersRepl: 5110, after repl: 6201, after storageEngine: 6911, after tcmalloc: 7511, after wiredTiger: 9151, at end: 13001 } 2016-05-02T07:25:58.243+0000 I COMMAND [conn1375] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2872ms 2016-05-02T07:25:58.249+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:26:09.058+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:26:11.003+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 181ms 2016-05-02T07:26:12.609+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 182ms 2016-05-02T07:26:13.944+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:26:19.213+0000 I COMMAND [conn1375] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7745ms 2016-05-02T07:26:25.738+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:26:25.738+0000 I NETWORK [conn1375] end connection 127.0.0.1:37144 (0 connections now open) 2016-05-02T07:26:27.128+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 500, after asserts: 820, after connections: 1120, after extra_info: 2210, after globalLock: 2900, after locks: 3500, after network: 3830, after opcounters: 4040, after opcountersRepl: 4040, after repl: 6830, after storageEngine: 7900, after tcmalloc: 9140, after wiredTiger: 11450, at end: 14700 } 2016-05-02T07:26:29.109+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37146 #1376 (2 connections now open) 2016-05-02T07:26:29.415+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:26:36.750+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:26:37.071+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:26:38.697+0000 I COMMAND [conn1376] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3539ms 2016-05-02T07:26:47.218+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:26:51.587+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:26:58.543+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1000, after asserts: 1440, after connections: 2280, after extra_info: 3350, after globalLock: 4150, after locks: 4650, after network: 5030, after opcounters: 5230, after opcountersRepl: 5230, after repl: 7650, after storageEngine: 8450, after tcmalloc: 9220, after wiredTiger: 11340, at end: 14000 } 2016-05-02T07:26:59.036+0000 I COMMAND [conn1376] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4789ms 2016-05-02T07:27:05.009+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:27:05.905+0000 I NETWORK [conn1376] end connection 127.0.0.1:37146 (0 connections now open) 2016-05-02T07:27:09.191+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:27:15.166+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 185ms 2016-05-02T07:27:16.191+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:27:16.187+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:27:16.911+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37148 #1377 (1 connection now open) 2016-05-02T07:27:25.692+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:27:25.689+0000 I COMMAND [conn1377] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2175ms 2016-05-02T07:27:25.689+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 520, after asserts: 740, after connections: 920, after extra_info: 1159, after globalLock: 1159, after locks: 1359, after network: 1769, after opcounters: 1779, after opcountersRepl: 1779, after repl: 3929, after storageEngine: 4289, after tcmalloc: 4689, after wiredTiger: 6059, at end: 8369 } 2016-05-02T07:27:29.635+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:27:41.952+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:27:46.751+0000 I COMMAND [conn1377] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2891ms 2016-05-02T07:27:46.947+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:27:50.430+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:27:53.542+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:28:01.867+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 590, after asserts: 890, after connections: 1600, after extra_info: 2850, after globalLock: 3410, after locks: 4190, after network: 4590, after opcounters: 4690, after opcountersRepl: 4690, after repl: 6650, after storageEngine: 7570, after tcmalloc: 8550, after wiredTiger: 10400, at end: 13810 } 2016-05-02T07:28:04.563+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:28:10.078+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:28:10.470+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37150 #1378 (2 connections now open) 2016-05-02T07:28:12.149+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37151 #1379 (3 connections now open) 2016-05-02T07:28:14.146+0000 I COMMAND [conn1377] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 7458ms 2016-05-02T07:28:17.415+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 199ms 2016-05-02T07:28:18.255+0000 I COMMAND [conn1378] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2369ms 2016-05-02T07:28:18.970+0000 I NETWORK [conn1377] end connection 127.0.0.1:37148 (2 connections now open) 2016-05-02T07:28:19.410+0000 I COMMAND [conn1379] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2143ms 2016-05-02T07:28:22.317+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:28:24.365+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:28:27.802+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 200, after asserts: 500, after connections: 700, after extra_info: 1540, after globalLock: 2120, after locks: 2420, after network: 2420, after opcounters: 2420, after opcountersRepl: 2420, after repl: 3390, after storageEngine: 4400, after tcmalloc: 5730, after wiredTiger: 7660, at end: 9500 } 2016-05-02T07:28:30.219+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:28:30.226+0000 I COMMAND [conn1378] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 7457ms 2016-05-02T07:28:34.183+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:28:37.794+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37153 #1380 (3 connections now open) 2016-05-02T07:28:38.712+0000 I COMMAND [conn1379] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4933ms 2016-05-02T07:28:37.699+0000 I NETWORK [conn1378] end connection 127.0.0.1:37150 (1 connection now open) 2016-05-02T07:28:40.571+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37154 #1381 (4 connections now open) 2016-05-02T07:28:41.061+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:28:47.252+0000 I NETWORK [conn1379] end connection 127.0.0.1:37151 (2 connections now open) 2016-05-02T07:28:47.734+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:28:48.419+0000 I COMMAND [conn1380] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3691ms 2016-05-02T07:28:50.181+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37155 #1382 (3 connections now open) 2016-05-02T07:28:52.487+0000 I COMMAND [conn1381] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5023ms 2016-05-02T07:28:55.700+0000 I COMMAND [conn1380] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 1826ms 2016-05-02T07:28:56.103+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37157 #1383 (4 connections now open) 2016-05-02T07:28:56.894+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 1300, after globalLock: 1910, after locks: 2410, after network: 2700, after opcounters: 2810, after opcountersRepl: 2810, after repl: 6122, after storageEngine: 6122, after tcmalloc: 6122, after wiredTiger: 7222, at end: 9342 } 2016-05-02T07:28:57.320+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:28:57.726+0000 I COMMAND [conn1382] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2500ms 2016-05-02T07:28:59.651+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:29:01.465+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:29:05.019+0000 I COMMAND [conn1383] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3307ms 2016-05-02T07:29:08.051+0000 I NETWORK [conn1380] end connection 127.0.0.1:37153 (3 connections now open) 2016-05-02T07:29:11.936+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:29:15.598+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:29:18.878+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 192ms 2016-05-02T07:29:20.703+0000 I COMMAND [conn1382] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6296ms 2016-05-02T07:29:22.587+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:29:25.794+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 220, after asserts: 630, after connections: 720, after extra_info: 1980, after globalLock: 2380, after locks: 2880, after network: 3270, after opcounters: 3770, after opcountersRepl: 4040, after repl: 5730, after storageEngine: 6810, after tcmalloc: 7760, after wiredTiger: 8770, at end: 11440 } 2016-05-02T07:29:27.423+0000 I NETWORK [conn1382] end connection 127.0.0.1:37155 (2 connections now open) 2016-05-02T07:29:31.802+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:29:35.176+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:29:35.774+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:29:37.954+0000 I COMMAND [conn1383] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6642ms 2016-05-02T07:29:44.396+0000 I NETWORK [conn1383] end connection 127.0.0.1:37157 (1 connection now open) 2016-05-02T07:29:46.597+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:29:49.705+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:29:50.759+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 690, after connections: 1290, after extra_info: 2910, after globalLock: 3520, after locks: 4190, after network: 4660, after opcounters: 4970, after opcountersRepl: 4970, after repl: 5660, after storageEngine: 6100, after tcmalloc: 7070, after wiredTiger: 8750, at end: 11420 } 2016-05-02T07:29:52.018+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37159 #1384 (2 connections now open) 2016-05-02T07:29:58.353+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:30:02.439+0000 I COMMAND [conn1384] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4001ms 2016-05-02T07:30:06.341+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:30:09.329+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:30:10.872+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:30:15.383+0000 I COMMAND [conn1384] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3640ms 2016-05-02T07:30:18.343+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 840, after connections: 1230, after extra_info: 2200, after globalLock: 2980, after locks: 3340, after network: 3440, after opcounters: 3440, after opcountersRepl: 3440, after repl: 4310, after storageEngine: 5100, after tcmalloc: 5800, after wiredTiger: 8730, at end: 11270 } 2016-05-02T07:30:19.990+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:30:22.986+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:30:32.273+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37161 #1385 (3 connections now open) 2016-05-02T07:30:32.182+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:30:40.002+0000 I COMMAND [conn1385] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1599ms 2016-05-02T07:30:40.712+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37163 #1386 (4 connections now open) 2016-05-02T07:30:41.234+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:30:44.626+0000 I COMMAND [conn1384] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 4351ms 2016-05-02T07:30:44.715+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:30:45.123+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:30:51.223+0000 I COMMAND [conn1385] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 7175ms 2016-05-02T07:30:51.332+0000 I COMMAND [conn1386] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3576ms 2016-05-02T07:30:51.678+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 670, after connections: 680, after extra_info: 877, after globalLock: 877, after locks: 877, after network: 877, after opcounters: 877, after opcountersRepl: 877, after repl: 2577, after storageEngine: 3067, after tcmalloc: 4017, after wiredTiger: 5927, at end: 9267 } 2016-05-02T07:30:52.526+0000 I NETWORK [conn1384] end connection 127.0.0.1:37159 (3 connections now open) 2016-05-02T07:30:55.908+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37164 #1387 (4 connections now open) 2016-05-02T07:30:56.512+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:30:57.232+0000 I NETWORK [conn1385] end connection 127.0.0.1:37161 (2 connections now open) 2016-05-02T07:30:59.026+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:31:04.982+0000 I COMMAND [conn1387] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1927ms 2016-05-02T07:31:06.839+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:31:10.325+0000 I COMMAND [conn1386] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3499ms 2016-05-02T07:31:10.757+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37166 #1388 (4 connections now open) 2016-05-02T07:31:12.460+0000 I COMMAND [conn1387] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 0, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 1844ms 2016-05-02T07:31:13.536+0000 I COMMAND [conn1381] command local.oplog.rs command: find { find: "oplog.rs", filter: { ts: { $gte: Timestamp 1462170501000|4 } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 60000, term: 46 } planSummary: COLLSCAN cursorid:12906024375 keysExamined:0 docsExamined:2 keyUpdates:0 writeConflicts:0 numYields:3 nreturned:2 reslen:754 locks:{ Global: { acquireCount: { r: 8 } }, Database: { acquireCount: { r: 4 } }, oplog: { acquireCount: { r: 4 } } } protocol:op_command 16076ms 2016-05-02T07:31:13.830+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 290, after asserts: 610, after connections: 980, after extra_info: 1610, after globalLock: 2000, after locks: 2480, after network: 2870, after opcounters: 3240, after opcountersRepl: 3250, after repl: 4070, after storageEngine: 4660, after tcmalloc: 5740, after wiredTiger: 6128, at end: 6898 } 2016-05-02T07:31:14.823+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:31:15.513+0000 I NETWORK [conn1386] end connection 127.0.0.1:37163 (3 connections now open) 2016-05-02T07:31:16.130+0000 I NETWORK [conn1381] end connection 127.0.0.1:37154 (3 connections now open) 2016-05-02T07:31:18.233+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:31:20.380+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:31:21.135+0000 I COMMAND [conn1388] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4150ms 2016-05-02T07:31:26.401+0000 I NETWORK [conn1387] end connection 127.0.0.1:37164 (1 connection now open) 2016-05-02T07:31:32.479+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:31:36.228+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:31:41.076+0000 I COMMAND [conn1388] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 9833ms 2016-05-02T07:31:43.763+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:31:46.864+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 200, after asserts: 500, after connections: 1080, after extra_info: 1860, after globalLock: 2280, after locks: 2680, after network: 3060, after opcounters: 3170, after opcountersRepl: 3170, after repl: 10540, after storageEngine: 11120, after tcmalloc: 11700, after wiredTiger: 14520, at end: 16900 } 2016-05-02T07:31:50.339+0000 I NETWORK [conn1388] end connection 127.0.0.1:37166 (0 connections now open) 2016-05-02T07:31:50.639+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37168 #1389 (2 connections now open) 2016-05-02T07:31:53.234+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:31:57.297+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:31:57.389+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:32:01.398+0000 I COMMAND [conn1389] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4531ms 2016-05-02T07:32:09.146+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:32:11.630+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 670, after connections: 760, after extra_info: 1720, after globalLock: 2570, after locks: 3030, after network: 3370, after opcounters: 3500, after opcountersRepl: 3500, after repl: 4450, after storageEngine: 5050, after tcmalloc: 5850, after wiredTiger: 7830, at end: 10280 } 2016-05-02T07:32:11.972+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:32:20.639+0000 I COMMAND [conn1389] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4388ms 2016-05-02T07:32:20.738+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:32:21.394+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 165ms 2016-05-02T07:32:23.309+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 194ms 2016-05-02T07:32:27.881+0000 I NETWORK [conn1389] end connection 127.0.0.1:37168 (0 connections now open) 2016-05-02T07:32:29.427+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:32:33.024+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:32:33.765+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:32:37.598+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37170 #1390 (1 connection now open) 2016-05-02T07:32:44.034+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 750, after asserts: 1030, after connections: 1710, after extra_info: 1990, after globalLock: 2630, after locks: 3250, after network: 3640, after opcounters: 4010, after opcountersRepl: 4470, after repl: 7770, after storageEngine: 8305, after tcmalloc: 8305, after wiredTiger: 8385, at end: 10585 } 2016-05-02T07:32:44.472+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:32:51.638+0000 I COMMAND [conn1390] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3537ms 2016-05-02T07:32:52.137+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:32:56.677+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:33:07.928+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:33:11.906+0000 I COMMAND [conn1390] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4953ms 2016-05-02T07:33:11.992+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:33:17.029+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 1070, after connections: 1370, after extra_info: 2830, after globalLock: 3320, after locks: 3820, after network: 4100, after opcounters: 4270, after opcountersRepl: 4270, after repl: 6850, after storageEngine: 7500, after tcmalloc: 8460, after wiredTiger: 10430, at end: 11730 } 2016-05-02T07:33:17.914+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:33:18.633+0000 I NETWORK [conn1390] end connection 127.0.0.1:37170 (0 connections now open) 2016-05-02T07:33:20.367+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:33:22.712+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37172 #1391 (1 connection now open) 2016-05-02T07:33:26.033+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 140ms 2016-05-02T07:33:28.702+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 127ms 2016-05-02T07:33:29.309+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:33:31.427+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:33:35.367+0000 I COMMAND [conn1391] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3681ms 2016-05-02T07:33:41.851+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:33:46.228+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:33:48.191+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 690, after connections: 1590, after extra_info: 3440, after globalLock: 4120, after locks: 4870, after network: 5270, after opcounters: 5280, after opcountersRepl: 5280, after repl: 6820, after storageEngine: 7670, after tcmalloc: 8260, after wiredTiger: 10050, at end: 13500 } 2016-05-02T07:33:49.448+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:33:53.287+0000 I COMMAND [conn1391] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5969ms 2016-05-02T07:33:54.689+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:33:57.632+0000 I NETWORK [conn1391] end connection 127.0.0.1:37172 (0 connections now open) 2016-05-02T07:34:04.607+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:34:06.877+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37174 #1392 (1 connection now open) 2016-05-02T07:34:08.539+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:34:14.956+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 680, after asserts: 860, after connections: 1480, after extra_info: 3280, after globalLock: 3469, after locks: 3469, after network: 3469, after opcounters: 3469, after opcountersRepl: 3469, after repl: 3469, after storageEngine: 3469, after tcmalloc: 4139, after wiredTiger: 5749, at end: 9369 } 2016-05-02T07:34:17.170+0000 I COMMAND [conn1392] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2678ms 2016-05-02T07:34:19.480+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:34:25.228+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:34:31.007+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:34:31.007+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 219ms 2016-05-02T07:34:33.288+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:34:36.032+0000 I COMMAND [conn1392] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2210ms 2016-05-02T07:34:42.621+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:34:46.655+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:34:50.266+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 420, after asserts: 880, after connections: 1340, after extra_info: 2680, after globalLock: 3540, after locks: 3980, after network: 4450, after opcounters: 4930, after opcountersRepl: 4930, after repl: 7060, after storageEngine: 8240, after tcmalloc: 9180, after wiredTiger: 10810, at end: 14490 } 2016-05-02T07:34:53.323+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37176 #1393 (2 connections now open) 2016-05-02T07:34:54.941+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:35:02.241+0000 I COMMAND [conn1392] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 2599ms 2016-05-02T07:35:02.443+0000 I COMMAND [conn1393] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2599ms 2016-05-02T07:35:02.642+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:35:03.042+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37178 #1394 (3 connections now open) 2016-05-02T07:35:06.866+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:35:07.467+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:35:13.414+0000 I COMMAND [conn1392] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4257ms 2016-05-02T07:35:13.845+0000 I COMMAND [conn1394] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3439ms 2016-05-02T07:35:16.505+0000 I COMMAND [conn1393] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 7758ms 2016-05-02T07:35:18.355+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 680, after globalLock: 1080, after locks: 1770, after network: 2260, after opcounters: 2560, after opcountersRepl: 2560, after repl: 5320, after storageEngine: 5810, after tcmalloc: 6910, after wiredTiger: 8710, at end: 11490 } 2016-05-02T07:35:18.742+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:35:20.257+0000 I NETWORK [conn1392] end connection 127.0.0.1:37174 (2 connections now open) 2016-05-02T07:35:20.836+0000 I NETWORK [conn1393] end connection 127.0.0.1:37176 (2 connections now open) 2016-05-02T07:35:21.356+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:35:22.048+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37179 #1395 (2 connections now open) 2016-05-02T07:35:25.185+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37180 #1396 (3 connections now open) 2016-05-02T07:35:30.262+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:35:30.754+0000 I COMMAND [conn1395] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1831ms 2016-05-02T07:35:32.232+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 195ms 2016-05-02T07:35:33.045+0000 I COMMAND [conn1394] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2272ms 2016-05-02T07:35:33.045+0000 I COMMAND [conn1396] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2272ms 2016-05-02T07:35:38.073+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37182 #1397 (4 connections now open) 2016-05-02T07:35:39.484+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:35:39.691+0000 I COMMAND [conn1395] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 0, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 1727ms 2016-05-02T07:35:41.618+0000 I NETWORK [conn1394] end connection 127.0.0.1:37178 (3 connections now open) 2016-05-02T07:35:41.911+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:35:45.023+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:35:45.519+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 600, after asserts: 790, after connections: 900, after extra_info: 1791, after globalLock: 1791, after locks: 1791, after network: 1791, after opcounters: 1791, after opcountersRepl: 1791, after repl: 1791, after storageEngine: 1791, after tcmalloc: 2641, after wiredTiger: 4511, at end: 6371 } 2016-05-02T07:35:46.627+0000 I COMMAND [conn1397] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1793ms 2016-05-02T07:35:51.634+0000 I NETWORK [conn1395] end connection 127.0.0.1:37179 (2 connections now open) 2016-05-02T07:35:53.220+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:35:56.522+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:36:00.615+0000 I COMMAND [conn1397] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7180ms 2016-05-02T07:36:04.533+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:36:08.982+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37184 #1398 (3 connections now open) 2016-05-02T07:36:09.074+0000 I NETWORK [conn1397] end connection 127.0.0.1:37182 (1 connection now open) 2016-05-02T07:36:13.300+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:36:13.507+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 790, after connections: 1680, after extra_info: 2670, after globalLock: 3190, after locks: 3630, after network: 4060, after opcounters: 4450, after opcountersRepl: 4630, after repl: 5610, after storageEngine: 6090, after tcmalloc: 6580, after wiredTiger: 7373, at end: 10763 } 2016-05-02T07:36:16.047+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:36:16.053+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:36:18.974+0000 I COMMAND [conn1398] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5045ms 2016-05-02T07:36:28.685+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:36:31.920+0000 I COMMAND [conn1398] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2729ms 2016-05-02T07:36:32.824+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 102ms 2016-05-02T07:36:33.419+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 179ms 2016-05-02T07:36:34.222+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:36:41.381+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:36:42.984+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 650, after asserts: 950, after connections: 1430, after extra_info: 2800, after globalLock: 3100, after locks: 3630, after network: 3940, after opcounters: 4310, after opcountersRepl: 4740, after repl: 6420, after storageEngine: 6770, after tcmalloc: 7860, after wiredTiger: 9540, at end: 11630 } 2016-05-02T07:36:44.319+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37186 #1399 (3 connections now open) 2016-05-02T07:36:50.686+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:36:54.227+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:36:54.721+0000 I COMMAND [conn1398] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5852ms 2016-05-02T07:36:54.898+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37187 #1400 (4 connections now open) 2016-05-02T07:36:54.903+0000 I COMMAND [conn1399] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5140ms 2016-05-02T07:37:01.823+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:37:02.730+0000 I NETWORK [conn1398] end connection 127.0.0.1:37184 (3 connections now open) 2016-05-02T07:37:04.025+0000 I COMMAND [conn1400] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3083ms 2016-05-02T07:37:06.020+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:37:06.566+0000 I COMMAND [conn1399] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 7203ms 2016-05-02T07:37:07.763+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 200, after asserts: 490, after connections: 780, after extra_info: 1580, after globalLock: 2350, after locks: 2560, after network: 2740, after opcounters: 2840, after opcountersRepl: 2840, after repl: 3920, after storageEngine: 4890, after tcmalloc: 5910, after wiredTiger: 7600, at end: 9710 } 2016-05-02T07:37:09.050+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:37:13.430+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37188 #1401 (4 connections now open) 2016-05-02T07:37:14.998+0000 I NETWORK [conn1399] end connection 127.0.0.1:37186 (2 connections now open) 2016-05-02T07:37:17.554+0000 I COMMAND [conn1400] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5679ms 2016-05-02T07:37:17.656+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:37:23.428+0000 I COMMAND [conn1401] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2798ms 2016-05-02T07:37:23.776+0000 I NETWORK [conn1400] end connection 127.0.0.1:37187 (2 connections now open) 2016-05-02T07:37:23.776+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37190 #1402 (4 connections now open) 2016-05-02T07:37:27.599+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:37:28.745+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37191 #1403 (4 connections now open) 2016-05-02T07:37:30.555+0000 I COMMAND [conn1401] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 0, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 1226ms 2016-05-02T07:37:31.592+0000 I COMMAND [conn1396] command local.oplog.rs command: find { find: "oplog.rs", filter: { ts: { $gte: Timestamp 1462170501000|4 } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 60000, term: 46 } planSummary: COLLSCAN cursorid:15127101258 keysExamined:0 docsExamined:2 keyUpdates:0 writeConflicts:0 numYields:4 nreturned:2 reslen:754 locks:{ Global: { acquireCount: { r: 10 } }, Database: { acquireCount: { r: 5 } }, oplog: { acquireCount: { r: 5 } } } protocol:op_command 18065ms 2016-05-02T07:37:31.592+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:37:31.592+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:37:34.864+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 130ms 2016-05-02T07:37:35.056+0000 I COMMAND [conn1402] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5066ms 2016-05-02T07:37:38.239+0000 I NETWORK [conn1401] end connection 127.0.0.1:37188 (3 connections now open) 2016-05-02T07:37:38.239+0000 I NETWORK [conn1396] end connection 127.0.0.1:37180 (3 connections now open) 2016-05-02T07:37:40.021+0000 I COMMAND [conn1403] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2852ms 2016-05-02T07:37:42.694+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:37:42.707+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 7, after asserts: 7, after connections: 7, after extra_info: 7, after globalLock: 7, after locks: 177, after network: 637, after opcounters: 917, after opcountersRepl: 917, after repl: 5327, after storageEngine: 6387, after tcmalloc: 7177, after wiredTiger: 8937, at end: 11457 } 2016-05-02T07:37:49.433+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:37:54.448+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:38:00.191+0000 I COMMAND [conn1403] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6947ms 2016-05-02T07:38:05.365+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:38:05.562+0000 I NETWORK [conn1403] end connection 127.0.0.1:37191 (1 connection now open) 2016-05-02T07:38:09.961+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:38:11.100+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 820, after asserts: 1230, after connections: 1900, after extra_info: 2840, after globalLock: 3390, after locks: 3740, after network: 3920, after opcounters: 4080, after opcountersRepl: 4080, after repl: 5300, after storageEngine: 5990, after tcmalloc: 7360, after wiredTiger: 9390, at end: 12170 } 2016-05-02T07:38:14.261+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:38:17.935+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:38:21.921+0000 I COMMAND [conn1402] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7109ms 2016-05-02T07:38:28.600+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-05-02T07:38:30.329+0000 I NETWORK [conn1402] end connection 127.0.0.1:37190 (0 connections now open) 2016-05-02T07:38:32.923+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T07:38:34.986+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37193 #1404 (1 connection now open) 2016-05-02T07:38:35.815+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T07:38:36.755+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 167ms 2016-05-02T07:38:38.675+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 132ms 2016-05-02T07:38:44.309+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:38:46.106+0000 I COMMAND [conn1404] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3170ms 2016-05-02T07:38:46.338+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 950, after connections: 1340, after extra_info: 2320, after globalLock: 2870, after locks: 3360, after network: 3559, after opcounters: 3559, after opcountersRepl: 3559, after repl: 5589, after storageEngine: 6109, after tcmalloc: 7189, after wiredTiger: 8989, at end: 11979 } 2016-05-02T07:38:52.829+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:38:56.743+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-05-02T07:38:58.937+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-05-02T07:38:59.336+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:39:01.775+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:39:04.431+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:39:10.099+0000 I COMMAND [conn1404] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 11852ms 2016-05-02T07:39:14.771+0000 I NETWORK [conn1404] end connection 127.0.0.1:37193 (0 connections now open) 2016-05-02T07:39:14.771+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 870, after connections: 1060, after extra_info: 2230, after globalLock: 2740, after locks: 2950, after network: 3140, after opcounters: 3140, after opcountersRepl: 3140, after repl: 5430, after storageEngine: 6100, after tcmalloc: 6980, after wiredTiger: 8250, at end: 11190 } 2016-05-02T07:39:15.875+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:39:17.705+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37195 #1405 (1 connection now open) 2016-05-02T07:39:19.054+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:39:26.029+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:39:27.929+0000 I COMMAND [conn1405] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3220ms 2016-05-02T07:39:36.221+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:39:39.170+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:39:39.576+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:39:41.468+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 189ms 2016-05-02T07:39:43.149+0000 I COMMAND [conn1405] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4790ms 2016-05-02T07:39:44.016+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 127ms 2016-05-02T07:39:49.685+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 750, after connections: 860, after extra_info: 1850, after globalLock: 2130, after locks: 2660, after network: 2950, after opcounters: 2950, after opcountersRepl: 2950, after repl: 6110, after storageEngine: 6860, after tcmalloc: 7920, after wiredTiger: 9480, at end: 12340 } 2016-05-02T07:39:50.507+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:39:54.653+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37197 #1406 (2 connections now open) 2016-05-02T07:39:56.094+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:40:02.483+0000 I COMMAND [conn1405] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 1651ms 2016-05-02T07:40:02.684+0000 I COMMAND [conn1406] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1651ms 2016-05-02T07:40:03.839+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37198 #1407 (3 connections now open) 2016-05-02T07:40:03.970+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:40:11.158+0000 I COMMAND [conn1407] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2031ms 2016-05-02T07:40:12.371+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:40:12.477+0000 I COMMAND [conn1405] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2571ms 2016-05-02T07:40:15.259+0000 I COMMAND [conn1406] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 6756ms 2016-05-02T07:40:15.949+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:40:17.242+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:40:17.350+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 590, after asserts: 790, after connections: 990, after extra_info: 2600, after globalLock: 3250, after locks: 3720, after network: 4100, after opcounters: 4460, after opcountersRepl: 4470, after repl: 5870, after storageEngine: 6440, after tcmalloc: 7300, after wiredTiger: 9390, at end: 11130 } 2016-05-02T07:40:18.087+0000 I NETWORK [conn1405] end connection 127.0.0.1:37195 (2 connections now open) 2016-05-02T07:40:21.587+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37200 #1408 (4 connections now open) 2016-05-02T07:40:23.034+0000 I NETWORK [conn1406] end connection 127.0.0.1:37197 (1 connection now open) 2016-05-02T07:40:24.272+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37201 #1409 (4 connections now open) 2016-05-02T07:40:27.468+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:40:31.595+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:40:32.400+0000 I COMMAND [conn1408] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4116ms 2016-05-02T07:40:35.127+0000 I COMMAND [conn1409] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3752ms 2016-05-02T07:40:35.915+0000 I COMMAND [conn1407] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6565ms 2016-05-02T07:40:38.320+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:40:39.538+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37203 #1410 (4 connections now open) 2016-05-02T07:40:41.358+0000 I COMMAND [conn1409] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 0, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 1312ms 2016-05-02T07:40:43.117+0000 I NETWORK [conn1407] end connection 127.0.0.1:37198 (3 connections now open) 2016-05-02T07:40:45.243+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 105ms 2016-05-02T07:40:46.086+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 490, after connections: 590, after extra_info: 1380, after globalLock: 2090, after locks: 2630, after network: 2920, after opcounters: 2920, after opcountersRepl: 2920, after repl: 4263, after storageEngine: 4563, after tcmalloc: 5763, after wiredTiger: 7153, at end: 8953 } 2016-05-02T07:40:46.958+0000 I COMMAND [conn1410] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3429ms 2016-05-02T07:40:47.663+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:40:49.731+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:40:50.646+0000 I NETWORK [conn1409] end connection 127.0.0.1:37201 (2 connections now open) 2016-05-02T07:40:50.839+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:41:00.118+0000 I COMMAND [conn1410] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2600ms 2016-05-02T07:41:02.009+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-05-02T07:41:05.980+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T07:41:07.727+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T07:41:17.027+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:41:17.262+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37205 #1411 (3 connections now open) 2016-05-02T07:41:17.756+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 900, after connections: 1970, after extra_info: 2660, after globalLock: 3150, after locks: 3790, after network: 4160, after opcounters: 4450, after opcountersRepl: 4450, after repl: 11410, after storageEngine: 12140, after tcmalloc: 13230, after wiredTiger: 14830, at end: 16004 } 2016-05-02T07:41:24.040+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:41:27.195+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-05-02T07:41:27.789+0000 I COMMAND [conn1411] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5338ms 2016-05-02T07:41:29.068+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37206 #1412 (4 connections now open) 2016-05-02T07:41:29.260+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-05-02T07:41:31.624+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:41:32.202+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:41:35.558+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:41:38.347+0000 I COMMAND [conn1410] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 11249ms 2016-05-02T07:41:38.718+0000 I COMMAND [conn1412] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5702ms 2016-05-02T07:41:39.338+0000 I COMMAND [conn1411] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 6550ms 2016-05-02T07:41:43.248+0000 I NETWORK [conn1410] end connection 127.0.0.1:37203 (3 connections now open) 2016-05-02T07:41:43.248+0000 I NETWORK [conn1411] end connection 127.0.0.1:37205 (3 connections now open) 2016-05-02T07:41:44.287+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37207 #1413 (5 connections now open) 2016-05-02T07:41:44.488+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 530, after connections: 1000, after extra_info: 1790, after globalLock: 2470, after locks: 3070, after network: 3560, after opcounters: 3660, after opcountersRepl: 3660, after repl: 6590, after storageEngine: 7150, after tcmalloc: 7660, after wiredTiger: 8990, at end: 11079 } 2016-05-02T07:41:47.466+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 101ms 2016-05-02T07:41:48.255+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:41:52.145+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:41:57.031+0000 I COMMAND [conn1413] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7648ms 2016-05-02T07:41:58.914+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:41:59.147+0000 I COMMAND [conn1408] command local.oplog.rs command: find { find: "oplog.rs", filter: { ts: { $gte: Timestamp 1462170501000|4 } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 60000, term: 46 } planSummary: COLLSCAN cursorid:14442501430 keysExamined:0 docsExamined:2 keyUpdates:0 writeConflicts:0 numYields:4 nreturned:2 reslen:754 locks:{ Global: { acquireCount: { r: 10 } }, Database: { acquireCount: { r: 5 } }, oplog: { acquireCount: { r: 5 } } } protocol:op_command 13545ms 2016-05-02T07:42:01.814+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37209 #1414 (4 connections now open) 2016-05-02T07:42:02.992+0000 I COMMAND [conn1412] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5291ms 2016-05-02T07:42:04.002+0000 I NETWORK [conn1408] end connection 127.0.0.1:37200 (3 connections now open) 2016-05-02T07:42:03.913+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 180, after asserts: 610, after connections: 1000, after extra_info: 1530, after globalLock: 1530, after locks: 1710, after network: 2110, after opcounters: 2210, after opcountersRepl: 2210, after repl: 3370, after storageEngine: 4040, after tcmalloc: 4670, after wiredTiger: 5689, at end: 6549 } 2016-05-02T07:42:04.846+0000 I COMMAND [conn1413] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 0, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 1348ms 2016-05-02T07:42:09.782+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:42:10.026+0000 I NETWORK [conn1412] end connection 127.0.0.1:37206 (2 connections now open) 2016-05-02T07:42:12.368+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:42:13.435+0000 I COMMAND [conn1414] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5029ms 2016-05-02T07:42:14.601+0000 I NETWORK [conn1413] end connection 127.0.0.1:37207 (1 connection now open) 2016-05-02T07:42:16.154+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:42:24.787+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:42:28.795+0000 I COMMAND [conn1414] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5732ms 2016-05-02T07:42:29.591+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:42:32.881+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 530, after asserts: 830, after connections: 1270, after extra_info: 2250, after globalLock: 2740, after locks: 3040, after network: 3320, after opcounters: 3320, after opcountersRepl: 3320, after repl: 4910, after storageEngine: 6100, after tcmalloc: 6490, after wiredTiger: 8660, at end: 11890 } 2016-05-02T07:42:35.714+0000 I NETWORK [conn1414] end connection 127.0.0.1:37209 (0 connections now open) 2016-05-02T07:42:35.722+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37210 #1415 (2 connections now open) 2016-05-02T07:42:36.405+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:42:46.313+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:42:46.305+0000 I COMMAND [conn1415] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2802ms 2016-05-02T07:42:49.633+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 144ms 2016-05-02T07:42:49.727+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:42:53.042+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:43:01.476+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:43:05.442+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-05-02T07:43:10.800+0000 I COMMAND [conn1415] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 8299ms 2016-05-02T07:43:12.029+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 620, after asserts: 1060, after connections: 1760, after extra_info: 3480, after globalLock: 3910, after locks: 4220, after network: 4610, after opcounters: 4770, after opcountersRepl: 4770, after repl: 8130, after storageEngine: 9040, after tcmalloc: 9660, after wiredTiger: 11720, at end: 14770 } 2016-05-02T07:43:13.182+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T07:43:14.212+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T07:43:15.846+0000 I NETWORK [conn1415] end connection 127.0.0.1:37210 (0 connections now open) 2016-05-02T07:43:20.605+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37213 #1416 (1 connection now open) 2016-05-02T07:43:22.884+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:43:27.437+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:43:29.606+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:43:31.821+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:43:33.736+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-05-02T07:43:36.270+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:43:38.213+0000 I COMMAND [conn1416] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 10320ms 2016-05-02T07:43:38.210+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:43:44.779+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 330, after asserts: 640, after connections: 1410, after extra_info: 2570, after globalLock: 3190, after locks: 3680, after network: 3880, after opcounters: 3890, after opcountersRepl: 3890, after repl: 5940, after storageEngine: 6480, after tcmalloc: 7490, after wiredTiger: 9500, at end: 12160 } 2016-05-02T07:43:49.049+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-05-02T07:43:51.266+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-05-02T07:43:52.665+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T07:43:53.025+0000 I COMMAND [conn1416] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6176ms 2016-05-02T07:43:54.000+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T07:43:57.777+0000 I NETWORK [conn1416] end connection 127.0.0.1:37213 (0 connections now open) 2016-05-02T07:44:01.513+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37215 #1417 (1 connection now open) 2016-05-02T07:44:03.312+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:44:07.863+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:44:09.465+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 560, after connections: 890, after extra_info: 1560, after globalLock: 1830, after locks: 2030, after network: 2500, after opcounters: 2500, after opcountersRepl: 2500, after repl: 3130, after storageEngine: 3130, after tcmalloc: 4170, after wiredTiger: 6230, at end: 8500 } 2016-05-02T07:44:10.338+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-05-02T07:44:11.536+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-05-02T07:44:14.804+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:44:16.114+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:44:16.426+0000 I COMMAND [conn1417] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7698ms 2016-05-02T07:44:19.965+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:44:27.843+0000 I COMMAND [conn1417] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2294ms 2016-05-02T07:44:31.523+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:44:35.883+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-05-02T07:44:43.601+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T07:44:44.950+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T07:44:45.870+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 780, after connections: 1020, after extra_info: 1810, after globalLock: 2410, after locks: 2910, after network: 3500, after opcounters: 3890, after opcountersRepl: 4480, after repl: 10960, after storageEngine: 11360, after tcmalloc: 11940, after wiredTiger: 14040, at end: 16480 } 2016-05-02T07:44:51.976+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37217 #1418 (2 connections now open) 2016-05-02T07:44:52.780+0000 I COMMAND [conn1417] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 3829ms 2016-05-02T07:44:52.881+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:44:55.116+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37218 #1419 (3 connections now open) 2016-05-02T07:44:55.211+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:45:01.744+0000 I COMMAND [conn1418] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3469ms 2016-05-02T07:45:01.744+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:45:05.323+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:45:07.530+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-05-02T07:45:10.317+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:45:10.318+0000 I COMMAND [conn1417] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 12865ms 2016-05-02T07:45:10.319+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:45:10.531+0000 I COMMAND [conn1419] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 8816ms 2016-05-02T07:45:14.004+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T07:45:14.001+0000 I COMMAND [conn1418] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 6229ms 2016-05-02T07:45:14.672+0000 I NETWORK [conn1417] end connection 127.0.0.1:37215 (2 connections now open) 2016-05-02T07:45:16.591+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 970, after connections: 1600, after extra_info: 3010, after globalLock: 3490, after locks: 3600, after network: 3690, after opcounters: 3690, after opcountersRepl: 3690, after repl: 7310, after storageEngine: 7630, after tcmalloc: 8890, after wiredTiger: 10620, at end: 13220 } 2016-05-02T07:45:17.383+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37219 #1420 (3 connections now open) 2016-05-02T07:45:18.387+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37220 #1421 (4 connections now open) 2016-05-02T07:45:19.257+0000 I NETWORK [conn1418] end connection 127.0.0.1:37217 (2 connections now open) 2016-05-02T07:45:24.300+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:45:27.771+0000 I COMMAND [conn1419] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 8427ms 2016-05-02T07:45:28.058+0000 I COMMAND [conn1420] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7155ms 2016-05-02T07:45:28.058+0000 I COMMAND [conn1421] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4505ms 2016-05-02T07:45:31.298+0000 I NETWORK [conn1419] end connection 127.0.0.1:37218 (2 connections now open) 2016-05-02T07:45:32.731+0000 I COMMAND [conn1420] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 754ms 2016-05-02T07:45:32.823+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:45:33.923+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:45:35.201+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37222 #1422 (3 connections now open) 2016-05-02T07:45:35.878+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:45:37.944+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 720, after connections: 720, after extra_info: 1560, after globalLock: 1740, after locks: 2200, after network: 2300, after opcounters: 2300, after opcountersRepl: 2300, after repl: 2400, after storageEngine: 2760, after tcmalloc: 3500, after wiredTiger: 4071, at end: 4651 } 2016-05-02T07:45:42.513+0000 I NETWORK [conn1420] end connection 127.0.0.1:37219 (2 connections now open) 2016-05-02T07:45:43.412+0000 I COMMAND [conn1422] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1747ms 2016-05-02T07:45:46.136+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:45:51.157+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-05-02T07:45:57.593+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T07:45:59.919+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T07:46:06.430+0000 I COMMAND [conn1422] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 9357ms 2016-05-02T07:46:08.249+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:46:09.605+0000 I NETWORK [conn1422] end connection 127.0.0.1:37222 (1 connection now open) 2016-05-02T07:46:11.014+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:46:11.768+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 340, after asserts: 630, after connections: 1510, after extra_info: 3270, after globalLock: 3560, after locks: 3750, after network: 4320, after opcounters: 4660, after opcountersRepl: 5260, after repl: 12630, after storageEngine: 13430, after tcmalloc: 14380, after wiredTiger: 16500, at end: 18980 } 2016-05-02T07:46:13.143+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:46:14.473+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37224 #1423 (2 connections now open) 2016-05-02T07:46:18.187+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:46:18.492+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:46:21.138+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-05-02T07:46:27.143+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:46:28.515+0000 I COMMAND [conn1423] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6794ms 2016-05-02T07:46:30.588+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:46:38.642+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:46:45.691+0000 I COMMAND [conn1423] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5487ms 2016-05-02T07:46:48.239+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:46:52.004+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 570, after asserts: 850, after connections: 1030, after extra_info: 2190, after globalLock: 3190, after locks: 3640, after network: 3870, after opcounters: 3870, after opcountersRepl: 3870, after repl: 5640, after storageEngine: 6400, after tcmalloc: 7180, after wiredTiger: 9560, at end: 13340 } 2016-05-02T07:46:53.568+0000 I NETWORK [conn1423] end connection 127.0.0.1:37224 (1 connection now open) 2016-05-02T07:46:53.715+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 192ms 2016-05-02T07:46:53.716+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:47:02.890+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:47:05.077+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37226 #1424 (2 connections now open) 2016-05-02T07:47:05.776+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:47:10.530+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:47:16.226+0000 I COMMAND [conn1424] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3265ms 2016-05-02T07:47:16.819+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:47:27.533+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:47:27.786+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 590, after connections: 690, after extra_info: 1870, after globalLock: 2680, after locks: 3220, after network: 3980, after opcounters: 4480, after opcountersRepl: 5010, after repl: 6690, after storageEngine: 7140, after tcmalloc: 8390, after wiredTiger: 10240, at end: 14220 } 2016-05-02T07:47:30.119+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:47:34.805+0000 I COMMAND [conn1424] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5793ms 2016-05-02T07:47:36.550+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:47:41.073+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:47:43.867+0000 I NETWORK [conn1424] end connection 127.0.0.1:37226 (1 connection now open) 2016-05-02T07:47:50.178+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:47:54.792+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:47:55.769+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 267ms 2016-05-02T07:47:57.263+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37228 #1425 (2 connections now open) 2016-05-02T07:48:03.379+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 700, after asserts: 1280, after connections: 2160, after extra_info: 3880, after globalLock: 4520, after locks: 5200, after network: 5511, after opcounters: 5511, after opcountersRepl: 5511, after repl: 5511, after storageEngine: 5511, after tcmalloc: 5981, after wiredTiger: 8041, at end: 10131 } 2016-05-02T07:48:05.501+0000 I COMMAND [conn1425] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2975ms 2016-05-02T07:48:06.976+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:48:09.076+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:48:19.676+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:48:20.470+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:48:29.568+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:48:29.577+0000 I COMMAND [conn1425] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4702ms 2016-05-02T07:48:31.375+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:48:35.750+0000 I NETWORK [conn1425] end connection 127.0.0.1:37228 (1 connection now open) 2016-05-02T07:48:42.129+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:48:42.034+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 970, after connections: 1740, after extra_info: 2730, after globalLock: 3320, after locks: 4010, after network: 4470, after opcounters: 4830, after opcountersRepl: 5010, after repl: 7080, after storageEngine: 7900, after tcmalloc: 8930, after wiredTiger: 11290, at end: 14040 } 2016-05-02T07:48:45.968+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37231 #1426 (2 connections now open) 2016-05-02T07:48:46.763+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:48:54.669+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:48:54.755+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:48:55.552+0000 I COMMAND [conn1426] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3484ms 2016-05-02T07:48:57.887+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 173ms 2016-05-02T07:49:05.330+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:49:08.161+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:49:15.887+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 580, after asserts: 970, after connections: 1390, after extra_info: 2390, after globalLock: 3220, after locks: 3570, after network: 4190, after opcounters: 4370, after opcountersRepl: 4370, after repl: 6630, after storageEngine: 7030, after tcmalloc: 7740, after wiredTiger: 9810, at end: 11790 } 2016-05-02T07:49:17.457+0000 I COMMAND [conn1426] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3702ms 2016-05-02T07:49:23.867+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:49:25.735+0000 I NETWORK [conn1426] end connection 127.0.0.1:37231 (1 connection now open) 2016-05-02T07:49:27.888+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:49:35.804+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:49:35.804+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:49:40.111+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37233 #1427 (2 connections now open) 2016-05-02T07:49:46.081+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:49:48.946+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:49:49.242+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 450, after asserts: 940, after connections: 1610, after extra_info: 2980, after globalLock: 3370, after locks: 3960, after network: 4730, after opcounters: 5220, after opcountersRepl: 5620, after repl: 5718, after storageEngine: 5718, after tcmalloc: 6698, after wiredTiger: 8148, at end: 11758 } 2016-05-02T07:49:49.745+0000 I COMMAND [conn1427] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2857ms 2016-05-02T07:49:59.877+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:50:03.197+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:50:10.661+0000 I COMMAND [conn1427] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6581ms 2016-05-02T07:50:11.148+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:50:13.525+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:50:18.385+0000 I NETWORK [conn1427] end connection 127.0.0.1:37233 (1 connection now open) 2016-05-02T07:50:20.575+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:50:20.575+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 870, after connections: 1380, after extra_info: 2200, after globalLock: 2660, after locks: 3250, after network: 3630, after opcounters: 3730, after opcountersRepl: 3730, after repl: 5390, after storageEngine: 6400, after tcmalloc: 7530, after wiredTiger: 9200, at end: 10840 } 2016-05-02T07:50:22.335+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:50:22.339+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37235 #1428 (2 connections now open) 2016-05-02T07:50:29.349+0000 I NETWORK [conn1421] end connection 127.0.0.1:37220 (1 connection now open) 2016-05-02T07:50:31.051+0000 I COMMAND [conn1428] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2410ms 2016-05-02T07:50:33.978+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:50:39.061+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:50:45.608+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:50:46.849+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:50:50.192+0000 I COMMAND [conn1428] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4819ms 2016-05-02T07:50:55.513+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 630, after asserts: 1220, after connections: 1710, after extra_info: 2680, after globalLock: 3350, after locks: 3970, after network: 4280, after opcounters: 4280, after opcountersRepl: 4280, after repl: 8130, after storageEngine: 8680, after tcmalloc: 9580, after wiredTiger: 12030, at end: 14940 } 2016-05-02T07:50:56.081+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:50:59.473+0000 I NETWORK [conn1428] end connection 127.0.0.1:37235 (0 connections now open) 2016-05-02T07:50:59.982+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:51:00.423+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-05-02T07:51:02.968+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37237 #1429 (2 connections now open) 2016-05-02T07:51:02.972+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 195ms 2016-05-02T07:51:11.223+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:51:16.981+0000 I COMMAND [conn1429] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5995ms 2016-05-02T07:51:18.151+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:51:22.258+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:51:28.386+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:51:29.621+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 280, after asserts: 800, after connections: 1410, after extra_info: 3070, after globalLock: 3790, after locks: 4270, after network: 5030, after opcounters: 5500, after opcountersRepl: 5690, after repl: 7260, after storageEngine: 7750, after tcmalloc: 8180, after wiredTiger: 9630, at end: 12280 } 2016-05-02T07:51:30.395+0000 I COMMAND [conn1429] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2969ms 2016-05-02T07:51:33.970+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:51:38.610+0000 I NETWORK [conn1429] end connection 127.0.0.1:37237 (0 connections now open) 2016-05-02T07:51:38.900+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:51:42.241+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37239 #1430 (1 connection now open) 2016-05-02T07:51:46.110+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:51:53.058+0000 I COMMAND [conn1430] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3024ms 2016-05-02T07:51:55.361+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:51:58.293+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:52:02.339+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 710, after asserts: 1020, after connections: 1340, after extra_info: 2240, after globalLock: 2690, after locks: 3070, after network: 3550, after opcounters: 3790, after opcountersRepl: 3790, after repl: 5340, after storageEngine: 6420, after tcmalloc: 7330, after wiredTiger: 9410, at end: 12020 } 2016-05-02T07:52:07.953+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:52:09.568+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:52:13.715+0000 I COMMAND [conn1430] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5408ms 2016-05-02T07:52:14.314+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:52:20.683+0000 I NETWORK [conn1430] end connection 127.0.0.1:37239 (0 connections now open) 2016-05-02T07:52:21.871+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:52:31.551+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:52:31.847+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37242 #1431 (1 connection now open) 2016-05-02T07:52:32.644+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 830, after connections: 940, after extra_info: 1910, after globalLock: 2310, after locks: 2680, after network: 2680, after opcounters: 2680, after opcountersRepl: 2680, after repl: 6130, after storageEngine: 7180, after tcmalloc: 8080, after wiredTiger: 10640, at end: 12319 } 2016-05-02T07:52:35.192+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:52:36.797+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:52:40.425+0000 I COMMAND [conn1431] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2395ms 2016-05-02T07:52:47.023+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:52:50.660+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:52:57.762+0000 I COMMAND [conn1431] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7670ms 2016-05-02T07:52:58.772+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:53:01.128+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 1120, after connections: 1520, after extra_info: 2300, after globalLock: 2780, after locks: 3450, after network: 3930, after opcounters: 4300, after opcountersRepl: 4410, after repl: 6820, after storageEngine: 7490, after tcmalloc: 8620, after wiredTiger: 9780, at end: 12450 } 2016-05-02T07:53:06.848+0000 I NETWORK [conn1431] end connection 127.0.0.1:37242 (0 connections now open) 2016-05-02T07:53:06.751+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 200ms 2016-05-02T07:53:07.139+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:53:09.274+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37244 #1432 (2 connections now open) 2016-05-02T07:53:10.412+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:53:14.377+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:53:19.126+0000 I COMMAND [conn1432] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2699ms 2016-05-02T07:53:22.168+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:53:25.750+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:53:32.818+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 790, after connections: 1680, after extra_info: 3340, after globalLock: 3920, after locks: 4130, after network: 4410, after opcounters: 4600, after opcountersRepl: 4600, after repl: 8130, after storageEngine: 8810, after tcmalloc: 10190, after wiredTiger: 11890, at end: 15440 } 2016-05-02T07:53:34.387+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:53:40.425+0000 I COMMAND [conn1432] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6152ms 2016-05-02T07:53:42.953+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:53:45.489+0000 I NETWORK [conn1432] end connection 127.0.0.1:37244 (0 connections now open) 2016-05-02T07:53:45.950+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:53:51.815+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:53:55.820+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37246 #1433 (1 connection now open) 2016-05-02T07:53:57.227+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:54:00.406+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:54:03.217+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 380, after asserts: 680, after connections: 1100, after extra_info: 1860, after globalLock: 2390, after locks: 3010, after network: 3700, after opcounters: 3890, after opcountersRepl: 3890, after repl: 5181, after storageEngine: 5181, after tcmalloc: 5181, after wiredTiger: 5181, at end: 9201 } 2016-05-02T07:54:06.292+0000 I COMMAND [conn1433] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2781ms 2016-05-02T07:54:09.626+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:54:17.401+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:54:20.187+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:54:23.375+0000 I COMMAND [conn1433] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 6215ms 2016-05-02T07:54:24.915+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:54:28.128+0000 I NETWORK [conn1433] end connection 127.0.0.1:37246 (0 connections now open) 2016-05-02T07:54:31.012+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:54:31.690+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 580, after asserts: 760, after connections: 860, after extra_info: 1150, after globalLock: 1240, after locks: 1340, after network: 1340, after opcounters: 1340, after opcountersRepl: 1340, after repl: 2200, after storageEngine: 3190, after tcmalloc: 4340, after wiredTiger: 6610, at end: 9610 } 2016-05-02T07:54:34.574+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:54:39.344+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37248 #1434 (1 connection now open) 2016-05-02T07:54:42.146+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:54:47.643+0000 I COMMAND [conn1434] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2352ms 2016-05-02T07:54:50.457+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:54:54.200+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:54:57.287+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:54:58.625+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 470, after asserts: 580, after connections: 670, after extra_info: 1530, after globalLock: 2020, after locks: 2530, after network: 2710, after opcounters: 2710, after opcountersRepl: 2710, after repl: 4280, after storageEngine: 4970, after tcmalloc: 5840, after wiredTiger: 7860, at end: 8730 } 2016-05-02T07:55:06.494+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:55:06.494+0000 I COMMAND [conn1434] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4063ms 2016-05-02T07:55:09.540+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:55:17.959+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:55:22.319+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37251 #1435 (2 connections now open) 2016-05-02T07:55:24.349+0000 I COMMAND [conn1434] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 2310ms 2016-05-02T07:55:26.096+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:55:27.433+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 810, after connections: 1410, after extra_info: 2630, after globalLock: 3310, after locks: 3620, after network: 3630, after opcounters: 3630, after opcountersRepl: 3630, after repl: 6150, after storageEngine: 6630, after tcmalloc: 7019, after wiredTiger: 8239, at end: 11269 } 2016-05-02T07:55:28.236+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37252 #1436 (3 connections now open) 2016-05-02T07:55:29.323+0000 I COMMAND [conn1435] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1431ms 2016-05-02T07:55:29.227+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:55:31.479+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:55:35.571+0000 I COMMAND [conn1434] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4794ms 2016-05-02T07:55:36.880+0000 I COMMAND [conn1436] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1781ms 2016-05-02T07:55:40.377+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:55:40.473+0000 I COMMAND [conn1435] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 7116ms 2016-05-02T07:55:41.974+0000 I NETWORK [conn1434] end connection 127.0.0.1:37248 (2 connections now open) 2016-05-02T07:55:44.995+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:55:47.077+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37253 #1437 (3 connections now open) 2016-05-02T07:55:50.217+0000 I NETWORK [conn1435] end connection 127.0.0.1:37251 (2 connections now open) 2016-05-02T07:55:50.217+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37254 #1438 (4 connections now open) 2016-05-02T07:55:51.869+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:55:55.866+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 300, after asserts: 500, after connections: 690, after extra_info: 1480, after globalLock: 2260, after locks: 2660, after network: 3200, after opcounters: 3300, after opcountersRepl: 3300, after repl: 6501, after storageEngine: 6501, after tcmalloc: 6502, after wiredTiger: 6502, at end: 9352 } 2016-05-02T07:55:56.457+0000 I COMMAND [conn1436] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 5977ms 2016-05-02T07:55:57.601+0000 I COMMAND [conn1438] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 746ms 2016-05-02T07:55:57.601+0000 I COMMAND [conn1437] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3204ms 2016-05-02T07:55:59.827+0000 I NETWORK [conn1436] end connection 127.0.0.1:37252 (2 connections now open) 2016-05-02T07:56:02.745+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:56:04.216+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:56:04.504+0000 I COMMAND [conn1437] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 889ms 2016-05-02T07:56:07.714+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37256 #1439 (3 connections now open) 2016-05-02T07:56:07.712+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:56:10.331+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 173ms 2016-05-02T07:56:14.846+0000 I COMMAND [conn1439] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2115ms 2016-05-02T07:56:15.056+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:56:17.676+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-05-02T07:56:18.714+0000 I NETWORK [conn1437] end connection 127.0.0.1:37253 (2 connections now open) 2016-05-02T07:56:23.900+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 860, after connections: 1930, after extra_info: 2920, after globalLock: 3380, after locks: 3890, after network: 4510, after opcounters: 5040, after opcountersRepl: 5620, after repl: 6640, after storageEngine: 7040, after tcmalloc: 8060, after wiredTiger: 8320, at end: 10250 } 2016-05-02T07:56:28.485+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T07:56:30.453+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T07:56:40.198+0000 I COMMAND [conn1439] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 10102ms 2016-05-02T07:56:40.198+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:56:45.257+0000 I NETWORK [conn1439] end connection 127.0.0.1:37256 (1 connection now open) 2016-05-02T07:56:45.349+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-05-02T07:56:46.622+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:56:46.723+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37258 #1440 (2 connections now open) 2016-05-02T07:56:49.424+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 400, after asserts: 700, after connections: 1090, after extra_info: 1620, after globalLock: 1720, after locks: 1800, after network: 1810, after opcounters: 1810, after opcountersRepl: 1810, after repl: 3080, after storageEngine: 3860, after tcmalloc: 4390, after wiredTiger: 5518, at end: 5518 } 2016-05-02T07:56:49.424+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-05-02T07:56:51.814+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T07:56:53.896+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T07:56:56.492+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:56:58.733+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:57:00.344+0000 I COMMAND [conn1440] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 7036ms 2016-05-02T07:57:03.231+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:57:09.199+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27015: ExceededTimeLimit: Operation timed out 2016-05-02T07:57:12.207+0000 I REPL [ReplicationExecutor] VoteRequester: Got failed response from localhost:27017: ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:57:12.603+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 192ms 2016-05-02T07:57:13.700+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 106ms 2016-05-02T07:57:13.700+0000 I REPL [ReplicationExecutor] not running for primary, we received insufficient votes 2016-05-02T07:57:14.973+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 199ms 2016-05-02T07:57:16.786+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:57:19.743+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:57:21.965+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:57:23.782+0000 I COMMAND [conn1440] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 11183ms 2016-05-02T07:57:23.684+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 620, after asserts: 1060, after connections: 1620, after extra_info: 2490, after globalLock: 2690, after locks: 2790, after network: 2790, after opcounters: 2790, after opcountersRepl: 2790, after repl: 6290, after storageEngine: 6980, after tcmalloc: 7870, after wiredTiger: 9540, at end: 12940 } 2016-05-02T07:57:28.973+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:57:29.189+0000 I NETWORK [conn1440] end connection 127.0.0.1:37258 (1 connection now open) 2016-05-02T07:57:33.032+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37260 #1441 (2 connections now open) 2016-05-02T07:57:37.584+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:57:40.736+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:57:44.144+0000 I COMMAND [conn1441] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3489ms 2016-05-02T07:57:50.491+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 410, after asserts: 970, after connections: 1530, after extra_info: 2600, after globalLock: 3020, after locks: 3020, after network: 3110, after opcounters: 3110, after opcountersRepl: 3110, after repl: 6010, after storageEngine: 6400, after tcmalloc: 7040, after wiredTiger: 8910, at end: 10860 } 2016-05-02T07:57:52.503+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:57:58.746+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:57:58.751+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:58:03.623+0000 I COMMAND [conn1441] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 9787ms 2016-05-02T07:58:05.836+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:58:14.572+0000 I NETWORK [conn1441] end connection 127.0.0.1:37260 (1 connection now open) 2016-05-02T07:58:16.165+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:58:16.659+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 205ms 2016-05-02T07:58:18.882+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:58:19.738+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37262 #1442 (2 connections now open) 2016-05-02T07:58:22.350+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 690, after asserts: 1260, after connections: 1670, after extra_info: 2990, after globalLock: 3960, after locks: 4460, after network: 5020, after opcounters: 5700, after opcountersRepl: 5880, after repl: 7720, after storageEngine: 8220, after tcmalloc: 9500, after wiredTiger: 11060, at end: 12362 } 2016-05-02T07:58:31.343+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:58:32.061+0000 I COMMAND [conn1442] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5727ms 2016-05-02T07:58:33.874+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:58:42.003+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:58:42.744+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:58:48.342+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 720, after asserts: 910, after connections: 1340, after extra_info: 1920, after globalLock: 2500, after locks: 3000, after network: 3400, after opcounters: 3400, after opcountersRepl: 3400, after repl: 4360, after storageEngine: 4900, after tcmalloc: 5720, after wiredTiger: 7120, at end: 10750 } 2016-05-02T07:58:49.835+0000 I COMMAND [conn1442] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 7571ms 2016-05-02T07:58:51.112+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:58:56.060+0000 I NETWORK [conn1442] end connection 127.0.0.1:37262 (1 connection now open) 2016-05-02T07:58:57.590+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:59:04.462+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37264 #1443 (2 connections now open) 2016-05-02T07:59:09.206+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:59:13.780+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:59:15.159+0000 I COMMAND [conn1443] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4086ms 2016-05-02T07:59:19.382+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T07:59:19.574+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 179ms 2016-05-02T07:59:21.082+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:59:24.427+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 390, after asserts: 690, after connections: 980, after extra_info: 2090, after globalLock: 2790, after locks: 3580, after network: 3690, after opcounters: 3690, after opcountersRepl: 3690, after repl: 7390, after storageEngine: 8700, after tcmalloc: 9750, after wiredTiger: 11330, at end: 14110 } 2016-05-02T07:59:33.012+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T07:59:37.320+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:59:39.740+0000 I COMMAND [conn1443] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 9406ms 2016-05-02T07:59:47.117+0000 I NETWORK [conn1443] end connection 127.0.0.1:37264 (1 connection now open) 2016-05-02T07:59:50.231+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T07:59:54.502+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T07:59:56.006+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37267 #1444 (2 connections now open) 2016-05-02T07:59:56.402+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 770, after asserts: 1310, after connections: 1660, after extra_info: 3280, after globalLock: 3880, after locks: 4760, after network: 5100, after opcounters: 5110, after opcountersRepl: 5110, after repl: 7610, after storageEngine: 8790, after tcmalloc: 9580, after wiredTiger: 11310, at end: 13094 } 2016-05-02T08:00:01.160+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T08:00:04.476+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:00:08.926+0000 I COMMAND [conn1444] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6541ms 2016-05-02T08:00:12.152+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T08:00:17.098+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:00:25.409+0000 I COMMAND [conn1444] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4103ms 2016-05-02T08:00:27.820+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:00:27.726+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 1160, after connections: 2080, after extra_info: 3150, after globalLock: 3860, after locks: 4400, after network: 4830, after opcounters: 4830, after opcountersRepl: 4830, after repl: 7570, after storageEngine: 8190, after tcmalloc: 9230, after wiredTiger: 10790, at end: 14290 } 2016-05-02T08:00:28.874+0000 I NETWORK [conn1444] end connection 127.0.0.1:37267 (1 connection now open) 2016-05-02T08:00:35.089+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:00:39.208+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:00:41.962+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37269 #1445 (2 connections now open) 2016-05-02T08:00:43.955+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T08:00:50.450+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:00:50.802+0000 I COMMAND [conn1445] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2804ms 2016-05-02T08:00:55.197+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T08:01:00.424+0000 I NETWORK [conn1438] end connection 127.0.0.1:37254 (1 connection now open) 2016-05-02T08:01:00.965+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 490, after asserts: 1090, after connections: 1680, after extra_info: 3350, after globalLock: 3850, after locks: 4630, after network: 5270, after opcounters: 5610, after opcountersRepl: 6000, after repl: 9360, after storageEngine: 9950, after tcmalloc: 10740, after wiredTiger: 12930, at end: 15280 } 2016-05-02T08:01:02.591+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:01:09.905+0000 I COMMAND [conn1445] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2403ms 2016-05-02T08:01:13.127+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:01:17.800+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:01:18.310+0000 I NETWORK [conn1445] end connection 127.0.0.1:37269 (0 connections now open) 2016-05-02T08:01:19.840+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T08:01:23.421+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 104ms 2016-05-02T08:01:26.127+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37271 #1446 (1 connection now open) 2016-05-02T08:01:29.476+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:01:29.881+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 550, after asserts: 1130, after connections: 2140, after extra_info: 3220, after globalLock: 3820, after locks: 4210, after network: 4510, after opcounters: 4510, after opcountersRepl: 4510, after repl: 6070, after storageEngine: 7430, after tcmalloc: 8332, after wiredTiger: 8332, at end: 8582 } 2016-05-02T08:01:33.074+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T08:01:42.136+0000 I COMMAND [conn1446] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6835ms 2016-05-02T08:01:42.280+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:01:50.157+0000 I COMMAND [conn1446] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 106ms 2016-05-02T08:01:51.375+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:01:53.233+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T08:01:53.233+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:01:55.027+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37274 #1447 (2 connections now open) 2016-05-02T08:01:55.265+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 200, after asserts: 300, after connections: 870, after extra_info: 1590, after globalLock: 1980, after locks: 1980, after network: 2070, after opcounters: 2070, after opcountersRepl: 2070, after repl: 2280, after storageEngine: 2280, after tcmalloc: 2280, after wiredTiger: 2280, at end: 3005 } 2016-05-02T08:02:02.586+0000 I COMMAND [conn1447] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2409ms 2016-05-02T08:02:04.804+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:02:08.556+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T08:02:09.386+0000 I COMMAND [conn1446] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4134ms 2016-05-02T08:02:12.228+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37275 #1448 (3 connections now open) 2016-05-02T08:02:15.842+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:02:15.940+0000 I COMMAND [conn1447] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 8393ms 2016-05-02T08:02:19.037+0000 I COMMAND [conn1446] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 2605ms 2016-05-02T08:02:19.237+0000 I COMMAND [conn1448] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1836ms 2016-05-02T08:02:21.049+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37277 #1449 (4 connections now open) 2016-05-02T08:02:21.644+0000 I NETWORK [conn1446] end connection 127.0.0.1:37271 (2 connections now open) 2016-05-02T08:02:21.644+0000 I NETWORK [conn1447] end connection 127.0.0.1:37274 (2 connections now open) 2016-05-02T08:02:23.868+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37278 #1450 (3 connections now open) 2016-05-02T08:02:24.260+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 0, after extra_info: 0, after globalLock: 90, after locks: 630, after network: 830, after opcounters: 830, after opcountersRepl: 830, after repl: 3950, after storageEngine: 4780, after tcmalloc: 5180, after wiredTiger: 6307, at end: 6969 } 2016-05-02T08:02:24.457+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:02:24.841+0000 I COMMAND [conn1448] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3596ms 2016-05-02T08:02:25.817+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 196ms 2016-05-02T08:02:27.581+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 102ms 2016-05-02T08:02:28.917+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:02:31.706+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T08:02:33.144+0000 I COMMAND [conn1449] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5705ms 2016-05-02T08:02:33.144+0000 I COMMAND [conn1450] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3762ms 2016-05-02T08:02:39.313+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:02:42.329+0000 I COMMAND [conn1448] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4545ms 2016-05-02T08:02:43.436+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37279 #1451 (4 connections now open) 2016-05-02T08:02:43.774+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T08:02:44.882+0000 I COMMAND [conn1449] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 2208ms 2016-05-02T08:02:46.002+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37280 #1452 (5 connections now open) 2016-05-02T08:02:47.972+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 630, after asserts: 770, after connections: 1260, after extra_info: 2420, after globalLock: 3080, after locks: 3090, after network: 3090, after opcounters: 3090, after opcountersRepl: 3090, after repl: 3630, after storageEngine: 4210, after tcmalloc: 4415, after wiredTiger: 5527, at end: 5527 } 2016-05-02T08:02:51.263+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:02:51.263+0000 I COMMAND [conn1451] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2122ms 2016-05-02T08:02:51.839+0000 I COMMAND [conn1448] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 3675ms 2016-05-02T08:02:57.037+0000 I NETWORK [conn1449] end connection 127.0.0.1:37277 (4 connections now open) 2016-05-02T08:02:57.037+0000 I NETWORK [conn1448] end connection 127.0.0.1:37275 (4 connections now open) 2016-05-02T08:02:59.156+0000 I COMMAND [conn1452] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5172ms 2016-05-02T08:03:00.453+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:03:04.699+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:03:05.507+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T08:03:07.265+0000 I COMMAND [conn1451] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 4723ms 2016-05-02T08:03:11.298+0000 I COMMAND [conn1452] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 6974ms 2016-05-02T08:03:12.356+0000 I NETWORK [conn1451] end connection 127.0.0.1:37279 (2 connections now open) 2016-05-02T08:03:13.308+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37282 #1453 (4 connections now open) 2016-05-02T08:03:15.285+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:03:16.563+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37283 #1454 (4 connections now open) 2016-05-02T08:03:18.156+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 480, after asserts: 970, after connections: 1180, after extra_info: 2090, after globalLock: 3060, after locks: 3660, after network: 3990, after opcounters: 4080, after opcountersRepl: 4080, after repl: 5340, after storageEngine: 6190, after tcmalloc: 6397, after wiredTiger: 6917, at end: 7606 } 2016-05-02T08:03:18.252+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T08:03:18.344+0000 I NETWORK [conn1452] end connection 127.0.0.1:37280 (2 connections now open) 2016-05-02T08:03:20.395+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37284 #1455 (4 connections now open) 2016-05-02T08:03:21.797+0000 I COMMAND [conn1453] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 1928ms 2016-05-02T08:03:25.571+0000 I COMMAND [conn1454] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 3738ms 2016-05-02T08:03:27.361+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:03:29.934+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 110ms 2016-05-02T08:03:31.792+0000 I COMMAND [conn1455] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5010ms 2016-05-02T08:03:35.745+0000 I COMMAND [conn1454] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 1584ms 2016-05-02T08:03:35.749+0000 I NETWORK [conn1453] end connection 127.0.0.1:37282 (3 connections now open) 2016-05-02T08:03:35.845+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:03:37.988+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:03:38.083+0000 I COMMAND [conn1450] command local.oplog.rs command: find { find: "oplog.rs", filter: { ts: { $gte: Timestamp 1462170501000|4 } }, tailable: true, oplogReplay: true, awaitData: true, maxTimeMS: 60000, term: 46 } planSummary: COLLSCAN cursorid:14494444029 keysExamined:0 docsExamined:2 keyUpdates:0 writeConflicts:0 numYields:4 nreturned:2 reslen:754 locks:{ Global: { acquireCount: { r: 10 } }, Database: { acquireCount: { r: 5 } }, oplog: { acquireCount: { r: 5 } } } protocol:op_command 19080ms 2016-05-02T08:03:42.484+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T08:03:43.856+0000 I COMMAND [conn1455] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 3336ms 2016-05-02T08:03:45.530+0000 I NETWORK [conn1454] end connection 127.0.0.1:37283 (2 connections now open) 2016-05-02T08:03:45.530+0000 I NETWORK [conn1450] end connection 127.0.0.1:37278 (2 connections now open) 2016-05-02T08:03:48.471+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:03:48.570+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 950, after asserts: 1560, after connections: 2090, after extra_info: 3390, after globalLock: 3880, after locks: 4410, after network: 4990, after opcounters: 5480, after opcountersRepl: 5680, after repl: 7150, after storageEngine: 7910, after tcmalloc: 9180, after wiredTiger: 10910, at end: 12280 } 2016-05-02T08:03:53.366+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T08:03:55.132+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37286 #1456 (2 connections now open) 2016-05-02T08:04:00.891+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:04:05.695+0000 I COMMAND [conn1456] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 4246ms 2016-05-02T08:04:06.191+0000 I COMMAND [conn1455] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 2985ms 2016-05-02T08:04:10.715+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37288 #1457 (3 connections now open) 2016-05-02T08:04:11.051+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:04:12.405+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:04:16.571+0000 I COMMAND [conn1455] command admin.$cmd command: replSetRequestVotes { replSetRequestVotes: 1, setName: "mongodbreplica", dryRun: true, term: 46, candidateIndex: 2, configVersion: 2, lastCommittedOp: { ts: Timestamp 1462170501000|4, t: 45 } } keyUpdates:0 writeConflicts:0 numYields:0 reslen:99 locks:{} protocol:op_command 5012ms 2016-05-02T08:04:17.540+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T08:04:18.403+0000 I COMMAND [conn1457] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 2642ms 2016-05-02T08:04:18.511+0000 I COMMAND [conn1456] query local.oplog.rs planSummary: COLLSCAN ntoreturn:1 ntoskip:0 keysExamined:0 docsExamined:1 cursorExhausted:1 keyUpdates:0 writeConflicts:0 numYields:2 nreturned:1 reslen:299 locks:{ Global: { acquireCount: { r: 6 } }, Database: { acquireCount: { r: 3 } }, oplog: { acquireCount: { r: 3 } } } 7693ms 2016-05-02T08:04:22.423+0000 I NETWORK [conn1455] end connection 127.0.0.1:37284 (2 connections now open) 2016-05-02T08:04:23.113+0000 I NETWORK [conn1456] end connection 127.0.0.1:37286 (2 connections now open) 2016-05-02T08:04:23.816+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37289 #1458 (4 connections now open) 2016-05-02T08:04:24.435+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 540, after asserts: 870, after connections: 1220, after extra_info: 2576, after globalLock: 2576, after locks: 2656, after network: 3146, after opcounters: 3256, after opcountersRepl: 3256, after repl: 7236, after storageEngine: 8386, after tcmalloc: 9726, after wiredTiger: 11266, at end: 14580 } 2016-05-02T08:04:24.733+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:04:24.748+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37290 #1459 (5 connections now open) 2016-05-02T08:04:29.813+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T08:04:34.505+0000 I COMMAND [conn1457] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 8894ms 2016-05-02T08:04:38.069+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:04:38.719+0000 I COMMAND [conn1458] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 9348ms 2016-05-02T08:04:38.719+0000 I COMMAND [conn1459] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 5728ms 2016-05-02T08:04:40.065+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37291 #1460 (4 connections now open) 2016-05-02T08:04:42.125+0000 I NETWORK [conn1457] end connection 127.0.0.1:37288 (2 connections now open) 2016-05-02T08:04:48.454+0000 I COMMAND [conn1458] command admin.$cmd command: replSetUpdatePosition { replSetUpdatePosition: 1, optimes: [ { durableOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, appliedOpTime: { ts: Timestamp 1462170576000|1, t: 46 }, memberId: 1, cfgver: 2 }, { durableOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, appliedOpTime: { ts: Timestamp 1462170501000|4, t: 45 }, memberId: 2, cfgver: 2 } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:22 locks:{} protocol:op_command 1871ms 2016-05-02T08:04:48.870+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:04:53.368+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:04:53.949+0000 I COMMAND [conn1460] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 6067ms 2016-05-02T08:05:03.805+0000 I NETWORK [conn1458] end connection 127.0.0.1:37289 (2 connections now open) 2016-05-02T08:05:04.011+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1030, after asserts: 1500, after connections: 2420, after extra_info: 3070, after globalLock: 3540, after locks: 4180, after network: 4470, after opcounters: 4860, after opcountersRepl: 5160, after repl: 6260, after storageEngine: 7430, after tcmalloc: 8580, after wiredTiger: 10480, at end: 13210 } 2016-05-02T08:05:04.988+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:05:08.679+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:05:09.078+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T08:05:19.679+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:05:23.852+0000 I COMMAND [conn1460] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 13588ms 2016-05-02T08:05:30.169+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T08:05:31.561+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 144ms 2016-05-02T08:05:32.056+0000 I NETWORK [conn1460] end connection 127.0.0.1:37291 (1 connection now open) 2016-05-02T08:05:34.853+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:06:12.882+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37293 #1461 (2 connections now open) 2016-05-02T08:06:15.823+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:06:42.309+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 266ms 2016-05-02T08:06:42.309+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:06:49.030+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 840, after asserts: 1320, after connections: 1960, after extra_info: 3640, after globalLock: 4470, after locks: 5070, after network: 5540, after opcounters: 5850, after opcountersRepl: 6140, after repl: 28840, after storageEngine: 33830, after tcmalloc: 38521, after wiredTiger: 38521, at end: 57491 } 2016-05-02T08:06:58.096+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1454ms 2016-05-02T08:07:00.060+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:07:23.115+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 402ms 2016-05-02T08:08:08.238+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:08:34.562+0000 I COMMAND [conn1461] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 78653ms 2016-05-02T08:08:42.548+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 769ms 2016-05-02T08:08:56.914+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:09:04.211+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 323ms 2016-05-02T08:09:10.183+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1139ms 2016-05-02T08:09:16.353+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:09:29.904+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:09:54.642+0000 I NETWORK [conn1459] end connection 127.0.0.1:37290 (1 connection now open) 2016-05-02T08:10:04.949+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:10:20.273+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T08:10:22.956+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1341ms 2016-05-02T08:10:38.814+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 380ms 2016-05-02T08:10:40.686+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:10:53.556+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 869ms 2016-05-02T08:11:15.987+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:11:30.709+0000 I COMMAND [conn1461] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 67157ms 2016-05-02T08:11:30.902+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T08:11:39.385+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:11:58.787+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 264ms 2016-05-02T08:12:07.794+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4080, after asserts: 8250, after connections: 13430, after extra_info: 20820, after globalLock: 23460, after locks: 26500, after network: 38280, after opcounters: 41740, after opcountersRepl: 42440, after repl: 93970, after storageEngine: 100730, after tcmalloc: 110870, after wiredTiger: 128330, at end: 153120 } 2016-05-02T08:12:16.906+0000 I NETWORK [conn1461] end connection 127.0.0.1:37293 (0 connections now open) 2016-05-02T08:12:16.700+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3654ms 2016-05-02T08:12:16.700+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37295 #1462 (2 connections now open) 2016-05-02T08:12:28.960+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:12:35.220+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 5419ms 2016-05-02T08:13:06.676+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:13:29.556+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:13:38.651+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 309ms 2016-05-02T08:13:53.688+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:14:04.388+0000 I COMMAND [conn1462] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 45171ms 2016-05-02T08:14:31.211+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:14:42.010+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 237ms 2016-05-02T08:15:01.810+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 729ms 2016-05-02T08:15:02.518+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:15:07.297+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 256ms 2016-05-02T08:15:39.304+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:15:50.062+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T08:15:53.385+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:16:09.241+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 305ms 2016-05-02T08:16:24.280+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:16:25.639+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1872ms 2016-05-02T08:16:33.027+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T08:16:38.914+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 9776ms 2016-05-02T08:16:42.267+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4160, after asserts: 5260, after connections: 11850, after extra_info: 22220, after globalLock: 27290, after locks: 30550, after network: 31930, after opcounters: 35090, after opcountersRepl: 35790, after repl: 88270, after storageEngine: 93200, after tcmalloc: 101160, after wiredTiger: 118040, at end: 136690 } 2016-05-02T08:16:55.590+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:17:24.974+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:17:36.278+0000 I COMMAND [conn1462] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 50688ms 2016-05-02T08:17:36.278+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37297 #1463 (2 connections now open) 2016-05-02T08:18:04.963+0000 I NETWORK [conn1462] end connection 127.0.0.1:37295 (1 connection now open) 2016-05-02T08:18:04.963+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 327ms 2016-05-02T08:18:06.814+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:18:30.598+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 4060ms 2016-05-02T08:18:44.464+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 322ms 2016-05-02T08:18:51.176+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:19:48.659+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:19:49.452+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 365ms 2016-05-02T08:19:50.035+0000 I COMMAND [conn1463] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 84921ms 2016-05-02T08:20:18.856+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 13731ms 2016-05-02T08:20:21.216+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:20:46.336+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:21:17.002+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T08:21:20.738+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:21:39.071+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:21:46.072+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 366ms 2016-05-02T08:21:51.603+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 537ms 2016-05-02T08:21:54.570+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T08:22:07.402+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 574ms 2016-05-02T08:22:21.424+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6280, after asserts: 10620, after connections: 18480, after extra_info: 33480, after globalLock: 36930, after locks: 58030, after network: 59280, after opcounters: 59280, after opcountersRepl: 59280, after repl: 92940, after storageEngine: 95190, after tcmalloc: 99240, after wiredTiger: 113530, at end: 147940 } 2016-05-02T08:22:24.057+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:22:46.043+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:23:14.530+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 305ms 2016-05-02T08:23:14.474+0000 I COMMAND [conn1463] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 86477ms 2016-05-02T08:23:23.154+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:23:32.196+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 5968ms 2016-05-02T08:23:32.108+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37300 #1464 (2 connections now open) 2016-05-02T08:23:46.438+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:23:46.964+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1685ms 2016-05-02T08:24:05.707+0000 I NETWORK [conn1463] end connection 127.0.0.1:37297 (1 connection now open) 2016-05-02T08:24:25.197+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:24:48.972+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:25:06.430+0000 I COMMAND [conn1464] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 37331ms 2016-05-02T08:25:14.887+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 310ms 2016-05-02T08:25:18.188+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:25:36.602+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 223ms 2016-05-02T08:25:54.566+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 594ms 2016-05-02T08:26:01.823+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:26:22.405+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:27:01.810+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:27:02.356+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 7660, after asserts: 9840, after connections: 15630, after extra_info: 31060, after globalLock: 34410, after locks: 39910, after network: 43330, after opcounters: 49420, after opcountersRepl: 52050, after repl: 74270, after storageEngine: 78560, after tcmalloc: 91170, after wiredTiger: 102700, at end: 116890 } 2016-05-02T08:27:02.565+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T08:27:06.446+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 390ms 2016-05-02T08:27:22.277+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 530ms 2016-05-02T08:27:23.450+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 474ms 2016-05-02T08:27:53.739+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:28:04.655+0000 I NETWORK [conn1464] end connection 127.0.0.1:37300 (0 connections now open) 2016-05-02T08:28:28.338+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 436ms 2016-05-02T08:28:46.476+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 184ms 2016-05-02T08:28:58.647+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:29:33.622+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T08:29:46.907+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37301 #1465 (1 connection now open) 2016-05-02T08:30:06.808+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:30:10.484+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2795ms 2016-05-02T08:30:22.814+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 819ms 2016-05-02T08:30:27.938+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 211ms 2016-05-02T08:30:40.826+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:30:56.719+0000 I COMMAND [conn1465] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 32247ms 2016-05-02T08:30:56.662+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:31:19.052+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:31:31.179+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 471ms 2016-05-02T08:31:42.456+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1690, after asserts: 3160, after connections: 4500, after extra_info: 6790, after globalLock: 8350, after locks: 9370, after network: 9570, after opcounters: 9570, after opcountersRepl: 9570, after repl: 45390, after storageEngine: 54400, after tcmalloc: 58060, after wiredTiger: 66550, at end: 94840 } 2016-05-02T08:31:43.570+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2795ms 2016-05-02T08:31:47.869+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 193ms 2016-05-02T08:31:48.932+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:32:10.371+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:32:35.093+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:32:50.948+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:32:51.556+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 152ms 2016-05-02T08:33:00.961+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 496ms 2016-05-02T08:33:19.909+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:33:34.097+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 350ms 2016-05-02T08:33:39.385+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:33:59.160+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T08:34:22.647+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:34:43.545+0000 I COMMAND [conn1465] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 68712ms 2016-05-02T08:34:57.310+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T08:35:01.098+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 203ms 2016-05-02T08:35:03.612+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:35:24.897+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 950ms 2016-05-02T08:35:24.141+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37303 #1466 (2 connections now open) 2016-05-02T08:35:32.554+0000 I NETWORK [conn1465] end connection 127.0.0.1:37301 (0 connections now open) 2016-05-02T08:35:48.636+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1063ms 2016-05-02T08:36:08.290+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:36:34.627+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:36:39.083+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6920, after asserts: 11960, after connections: 16300, after extra_info: 31630, after globalLock: 35730, after locks: 38800, after network: 42290, after opcounters: 43830, after opcountersRepl: 44020, after repl: 81781, after storageEngine: 81781, after tcmalloc: 82701, after wiredTiger: 98591, at end: 124101 } 2016-05-02T08:36:50.273+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 315ms 2016-05-02T08:36:54.539+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:37:19.379+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 547ms 2016-05-02T08:37:50.453+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 554ms 2016-05-02T08:38:10.077+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:38:12.455+0000 I COMMAND [conn1466] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 100826ms 2016-05-02T08:38:59.657+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:39:22.434+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 353ms 2016-05-02T08:39:33.208+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:39:36.616+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1213ms 2016-05-02T08:39:50.466+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 130ms 2016-05-02T08:39:57.474+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:40:22.390+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:40:48.067+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T08:40:59.478+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:41:09.544+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3060ms 2016-05-02T08:41:09.370+0000 I NETWORK [conn1466] end connection 127.0.0.1:37303 (0 connections now open) 2016-05-02T08:41:15.527+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 443ms 2016-05-02T08:41:30.691+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 347ms 2016-05-02T08:41:43.379+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:42:48.697+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:42:49.966+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 629ms 2016-05-02T08:43:14.275+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2144ms 2016-05-02T08:43:19.135+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T08:44:09.517+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 398ms 2016-05-02T08:44:13.051+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:44:36.908+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37305 #1467 (1 connection now open) 2016-05-02T08:44:40.577+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5180, after asserts: 8580, after connections: 18440, after extra_info: 41800, after globalLock: 50080, after locks: 55540, after network: 58780, after opcounters: 61660, after opcountersRepl: 63530, after repl: 138390, after storageEngine: 146650, after tcmalloc: 161580, after wiredTiger: 199630, at end: 218452 } 2016-05-02T08:45:28.160+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 356ms 2016-05-02T08:45:44.348+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:45:45.475+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 402ms 2016-05-02T08:45:46.276+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 277ms 2016-05-02T08:46:09.895+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:46:54.812+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 326ms 2016-05-02T08:46:54.812+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:47:02.035+0000 I COMMAND [conn1467] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 60239ms 2016-05-02T08:47:07.174+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1213ms 2016-05-02T08:47:20.133+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 375ms 2016-05-02T08:47:21.041+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:48:00.257+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:48:43.890+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 425ms 2016-05-02T08:48:50.051+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:48:56.206+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 977ms 2016-05-02T08:49:00.496+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T08:49:12.933+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 530ms 2016-05-02T08:49:36.614+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:50:13.470+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T08:50:35.633+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 592ms 2016-05-02T08:50:48.240+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37307 #1468 (2 connections now open) 2016-05-02T08:51:07.194+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:51:01.622+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 617ms 2016-05-02T08:51:11.188+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 15970, after asserts: 21420, after connections: 24220, after extra_info: 26900, after globalLock: 30940, after locks: 30940, after network: 30940, after opcounters: 30940, after opcountersRepl: 30940, after repl: 77340, after storageEngine: 91020, after tcmalloc: 108300, after wiredTiger: 116680, at end: 138377 } 2016-05-02T08:51:13.957+0000 I COMMAND [conn1467] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 170864ms 2016-05-02T08:51:16.358+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 908ms 2016-05-02T08:51:34.332+0000 I NETWORK [conn1467] end connection 127.0.0.1:37305 (1 connection now open) 2016-05-02T08:52:24.225+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:52:39.614+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2971ms 2016-05-02T08:52:59.986+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 827ms 2016-05-02T08:53:05.011+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:53:06.967+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 464ms 2016-05-02T08:53:34.856+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:53:57.159+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:54:15.860+0000 I COMMAND [conn1468] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 123210ms 2016-05-02T08:54:18.807+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 440ms 2016-05-02T08:54:23.470+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:54:23.798+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 374ms 2016-05-02T08:54:39.848+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T08:54:40.267+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 312ms 2016-05-02T08:55:00.604+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:55:43.157+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:55:59.686+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T08:56:03.125+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 292ms 2016-05-02T08:56:24.502+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1292ms 2016-05-02T08:56:27.985+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:56:28.476+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2380, after asserts: 4260, after connections: 7030, after extra_info: 13450, after globalLock: 20960, after locks: 23850, after network: 26520, after opcounters: 26790, after opcountersRepl: 26790, after repl: 72030, after storageEngine: 76320, after tcmalloc: 83980, after wiredTiger: 105100, at end: 118840 } 2016-05-02T08:56:30.744+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 409ms 2016-05-02T08:56:46.087+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:56:46.356+0000 I COMMAND [conn1468] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 75053ms 2016-05-02T08:56:59.608+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37310 #1469 (2 connections now open) 2016-05-02T08:57:15.938+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:57:35.542+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 349ms 2016-05-02T08:57:38.200+0000 I NETWORK [conn1468] end connection 127.0.0.1:37307 (1 connection now open) 2016-05-02T08:57:42.811+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:57:43.354+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 647ms 2016-05-02T08:57:44.611+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 205ms 2016-05-02T08:58:01.823+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:58:24.265+0000 I COMMAND [conn1469] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 31492ms 2016-05-02T08:58:24.574+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:58:49.791+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 492ms 2016-05-02T08:58:49.292+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:59:03.514+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 857ms 2016-05-02T08:59:22.466+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T08:59:44.852+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 284ms 2016-05-02T08:59:52.977+0000 I NETWORK [conn1469] end connection 127.0.0.1:37310 (0 connections now open) 2016-05-02T08:59:52.933+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T08:59:49.844+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T09:00:04.847+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:00:43.814+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2940, after asserts: 3870, after connections: 10520, after extra_info: 20770, after globalLock: 27860, after locks: 41450, after network: 44040, after opcounters: 51300, after opcountersRepl: 51420, after repl: 74310, after storageEngine: 84000, after tcmalloc: 90890, after wiredTiger: 102050, at end: 127140 } 2016-05-02T09:00:46.476+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:01:04.227+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 385ms 2016-05-02T09:01:04.227+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37311 #1470 (1 connection now open) 2016-05-02T09:01:12.309+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T09:01:13.720+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 591ms 2016-05-02T09:01:14.190+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 103ms 2016-05-02T09:01:33.111+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:02:16.683+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 607ms 2016-05-02T09:02:22.436+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:02:29.668+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1078ms 2016-05-02T09:02:50.127+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T09:03:01.295+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 479ms 2016-05-02T09:03:08.198+0000 I COMMAND [conn1470] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 74748ms 2016-05-02T09:03:19.818+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:03:48.840+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:04:11.130+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 307ms 2016-05-02T09:04:15.485+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T09:04:16.575+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 564ms 2016-05-02T09:04:23.205+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1533ms 2016-05-02T09:04:31.142+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:05:16.523+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T09:05:16.523+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:05:27.412+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3840, after asserts: 4150, after connections: 5690, after extra_info: 11280, after globalLock: 14600, after locks: 20610, after network: 24690, after opcounters: 27750, after opcountersRepl: 41280, after repl: 70360, after storageEngine: 83490, after tcmalloc: 94260, after wiredTiger: 111320, at end: 120970 } 2016-05-02T09:05:30.216+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:05:40.846+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 141ms 2016-05-02T09:05:57.919+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 425ms 2016-05-02T09:05:58.064+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T09:06:30.947+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:07:11.165+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 144ms 2016-05-02T09:07:12.857+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:07:31.151+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 765ms 2016-05-02T09:07:31.772+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 188ms 2016-05-02T09:07:35.174+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T09:07:37.476+0000 I COMMAND [conn1470] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 82577ms 2016-05-02T09:07:48.888+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37314 #1471 (2 connections now open) 2016-05-02T09:08:15.798+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:08:24.881+0000 I NETWORK [conn1470] end connection 127.0.0.1:37311 (1 connection now open) 2016-05-02T09:08:33.624+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:08:43.374+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1127ms 2016-05-02T09:09:07.598+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 949ms 2016-05-02T09:09:12.139+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T09:09:25.434+0000 I COMMAND [conn1471] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 44416ms 2016-05-02T09:09:25.652+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 385ms 2016-05-02T09:09:42.795+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:09:45.850+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5000, after asserts: 7000, after connections: 9080, after extra_info: 17930, after globalLock: 24330, after locks: 27160, after network: 27930, after opcounters: 27930, after opcountersRepl: 27930, after repl: 72184, after storageEngine: 74984, after tcmalloc: 83564, after wiredTiger: 108614, at end: 136954 } 2016-05-02T09:09:49.763+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T09:10:29.395+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:10:37.497+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 297ms 2016-05-02T09:10:47.257+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 378ms 2016-05-02T09:11:03.763+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 368ms 2016-05-02T09:11:29.886+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T09:11:58.083+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:12:44.182+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 317ms 2016-05-02T09:12:48.145+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:13:00.682+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37315 #1472 (2 connections now open) 2016-05-02T09:13:08.836+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 5516ms 2016-05-02T09:13:33.592+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 560ms 2016-05-02T09:13:41.048+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T09:13:58.857+0000 I COMMAND [conn1471] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 189023ms 2016-05-02T09:14:37.971+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:14:52.408+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 364ms 2016-05-02T09:14:52.408+0000 I NETWORK [conn1471] end connection 127.0.0.1:37314 (1 connection now open) 2016-05-02T09:15:02.627+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 697ms 2016-05-02T09:15:14.896+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:15:19.332+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 183ms 2016-05-02T09:15:25.035+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3180, after asserts: 4120, after connections: 7650, after extra_info: 27330, after globalLock: 31171, after locks: 31171, after network: 31171, after opcounters: 31171, after opcountersRepl: 31171, after repl: 89511, after storageEngine: 95871, after tcmalloc: 104291, after wiredTiger: 115911, at end: 134161 } 2016-05-02T09:16:03.059+0000 I COMMAND [conn1472] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 54388ms 2016-05-02T09:16:03.202+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T09:16:40.805+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 835ms 2016-05-02T09:16:56.137+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T09:17:06.390+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1116ms 2016-05-02T09:17:13.984+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:17:31.385+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 444ms 2016-05-02T09:18:47.632+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 411ms 2016-05-02T09:19:16.113+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1221ms 2016-05-02T09:19:25.856+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:19:43.626+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 541ms 2016-05-02T09:20:21.334+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T09:20:57.728+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 367ms 2016-05-02T09:21:21.088+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:21:22.202+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 555ms 2016-05-02T09:21:39.030+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 202ms 2016-05-02T09:22:29.230+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:23:01.238+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2821ms 2016-05-02T09:23:16.309+0000 I COMMAND [conn1472] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 112612ms 2016-05-02T09:23:19.256+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T09:23:22.936+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 240ms 2016-05-02T09:24:02.394+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-05-02T09:24:24.374+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:24:27.532+0000 I NETWORK [conn1472] end connection 127.0.0.1:37315 (0 connections now open) 2016-05-02T09:24:40.071+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3700, after asserts: 9500, after connections: 13160, after extra_info: 24060, after globalLock: 28100, after locks: 32710, after network: 35360, after opcounters: 43930, after opcountersRepl: 50870, after repl: 100620, after storageEngine: 108060, after tcmalloc: 115830, after wiredTiger: 137150, at end: 175190 } 2016-05-02T09:24:48.421+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37318 #1473 (2 connections now open) 2016-05-02T09:25:29.481+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 414ms 2016-05-02T09:25:53.844+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3855ms 2016-05-02T09:26:01.653+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:26:20.430+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 428ms 2016-05-02T09:26:57.655+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T09:27:55.639+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 365ms 2016-05-02T09:27:57.607+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T09:28:36.943+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 4876ms 2016-05-02T09:28:58.646+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 659ms 2016-05-02T09:29:05.974+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:30:23.189+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:30:24.365+0000 I COMMAND [conn1473] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 184976ms 2016-05-02T09:30:24.889+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 657ms 2016-05-02T09:30:48.730+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1639ms 2016-05-02T09:31:14.965+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T09:31:14.813+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1343ms 2016-05-02T09:31:53.176+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:32:42.722+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1074ms 2016-05-02T09:33:14.103+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 6860ms 2016-05-02T09:33:28.341+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:33:42.685+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2943ms 2016-05-02T09:34:17.292+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:34:19.510+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6120, after asserts: 7250, after connections: 10770, after extra_info: 22450, after globalLock: 32620, after locks: 37560, after network: 39240, after opcounters: 41510, after opcountersRepl: 43670, after repl: 136610, after storageEngine: 150150, after tcmalloc: 154770, after wiredTiger: 195900, at end: 216800 } 2016-05-02T09:34:47.024+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T09:35:00.165+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 222ms 2016-05-02T09:35:16.570+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 917ms 2016-05-02T09:35:40.662+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:35:43.871+0000 I COMMAND [conn1473] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 158482ms 2016-05-02T09:35:44.182+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 587ms 2016-05-02T09:36:12.158+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37320 #1474 (2 connections now open) 2016-05-02T09:37:28.313+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 592ms 2016-05-02T09:37:30.081+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:37:30.612+0000 I NETWORK [conn1473] end connection 127.0.0.1:37318 (1 connection now open) 2016-05-02T09:37:56.861+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 751ms 2016-05-02T09:38:14.140+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 113ms 2016-05-02T09:38:17.515+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T09:38:25.577+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T09:38:59.352+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:39:28.006+0000 I COMMAND [conn1474] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 94654ms 2016-05-02T09:39:35.461+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 288ms 2016-05-02T09:39:51.311+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 781ms 2016-05-02T09:40:07.024+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:40:11.513+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1146ms 2016-05-02T09:40:39.428+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T09:41:18.787+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:41:27.557+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 315ms 2016-05-02T09:41:40.730+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 315ms 2016-05-02T09:41:57.050+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2790, after asserts: 4730, after connections: 9280, after extra_info: 16910, after globalLock: 19690, after locks: 23950, after network: 26180, after opcounters: 29760, after opcountersRepl: 30670, after repl: 62930, after storageEngine: 67580, after tcmalloc: 81090, after wiredTiger: 111340, at end: 137310 } 2016-05-02T09:41:59.326+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 142ms 2016-05-02T09:42:23.333+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:43:03.344+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1013ms 2016-05-02T09:43:04.843+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37322 #1475 (2 connections now open) 2016-05-02T09:43:13.333+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:43:16.227+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3334ms 2016-05-02T09:43:40.423+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T09:44:11.023+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:44:29.286+0000 I COMMAND [conn1474] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 138835ms 2016-05-02T09:44:34.784+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 508ms 2016-05-02T09:44:49.622+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:44:49.584+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 499ms 2016-05-02T09:45:04.885+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 946ms 2016-05-02T09:45:05.999+0000 I COMMAND [conn1475] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 53505ms 2016-05-02T09:45:11.983+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T09:45:19.395+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T09:45:39.561+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:45:39.705+0000 I NETWORK [conn1474] end connection 127.0.0.1:37320 (1 connection now open) 2016-05-02T09:46:12.022+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 283ms 2016-05-02T09:46:32.355+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 372ms 2016-05-02T09:46:32.091+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:46:49.541+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 315ms 2016-05-02T09:46:54.208+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1620, after asserts: 4890, after connections: 5870, after extra_info: 16330, after globalLock: 19130, after locks: 22110, after network: 25280, after opcounters: 25530, after opcountersRepl: 25530, after repl: 58570, after storageEngine: 64210, after tcmalloc: 74730, after wiredTiger: 87300, at end: 103430 } 2016-05-02T09:46:58.996+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T09:47:33.973+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:47:57.506+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 519ms 2016-05-02T09:48:10.677+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1372ms 2016-05-02T09:48:37.564+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 6373ms 2016-05-02T09:49:10.697+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:49:10.697+0000 I COMMAND [conn1475] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 140613ms 2016-05-02T09:49:16.531+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37323 #1476 (2 connections now open) 2016-05-02T09:49:54.714+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 296ms 2016-05-02T09:50:04.624+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T09:50:11.058+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3084ms 2016-05-02T09:50:19.794+0000 I NETWORK [conn1475] end connection 127.0.0.1:37322 (1 connection now open) 2016-05-02T09:50:29.496+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 456ms 2016-05-02T09:50:40.845+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:51:43.719+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 438ms 2016-05-02T09:51:44.135+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:52:10.942+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 498ms 2016-05-02T09:52:16.239+0000 I COMMAND [conn1476] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 63482ms 2016-05-02T09:52:35.670+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 259ms 2016-05-02T09:52:41.813+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T09:53:27.954+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T09:53:27.954+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:54:01.419+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 415ms 2016-05-02T09:54:17.556+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1451ms 2016-05-02T09:54:37.382+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4230, after asserts: 8120, after connections: 15360, after extra_info: 25320, after globalLock: 28010, after locks: 32730, after network: 34400, after opcounters: 34400, after opcountersRepl: 34400, after repl: 97840, after storageEngine: 112920, after tcmalloc: 123440, after wiredTiger: 142500, at end: 162170 } 2016-05-02T09:54:54.584+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 522ms 2016-05-02T09:55:02.765+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:55:47.217+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T09:56:08.488+0000 I NETWORK [conn1476] end connection 127.0.0.1:37323 (0 connections now open) 2016-05-02T09:56:18.382+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 6871ms 2016-05-02T09:56:40.037+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 656ms 2016-05-02T09:57:02.422+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 365ms 2016-05-02T09:57:23.913+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:58:24.766+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 302ms 2016-05-02T09:58:29.340+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T09:58:52.991+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2933ms 2016-05-02T09:58:58.264+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37325 #1477 (1 connection now open) 2016-05-02T09:59:21.327+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 254ms 2016-05-02T09:59:26.841+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T10:00:16.033+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:00:36.007+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 755ms 2016-05-02T10:00:56.888+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3021ms 2016-05-02T10:01:17.561+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 461ms 2016-05-02T10:01:45.112+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:02:01.976+0000 I COMMAND [conn1477] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 110099ms 2016-05-02T10:02:51.710+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T10:02:53.400+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 661ms 2016-05-02T10:02:53.400+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T10:03:16.517+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1404ms 2016-05-02T10:03:49.793+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:03:54.091+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4700, after asserts: 6530, after connections: 9760, after extra_info: 18130, after globalLock: 23690, after locks: 27370, after network: 30530, after opcounters: 33410, after opcountersRepl: 35610, after repl: 144230, after storageEngine: 149200, after tcmalloc: 157020, after wiredTiger: 180080, at end: 213060 } 2016-05-02T10:03:45.949+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 377ms 2016-05-02T10:05:17.792+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:05:48.419+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 349ms 2016-05-02T10:05:53.289+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T10:06:01.360+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 898ms 2016-05-02T10:06:21.267+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 763ms 2016-05-02T10:07:58.865+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:08:15.369+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 522ms 2016-05-02T10:08:45.520+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 464ms 2016-05-02T10:09:09.701+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3180ms 2016-05-02T10:09:20.928+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:10:08.691+0000 I COMMAND [conn1477] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 195329ms 2016-05-02T10:10:08.691+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:10:25.282+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 988ms 2016-05-02T10:10:57.988+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1488ms 2016-05-02T10:11:02.041+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T10:11:05.663+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37328 #1478 (2 connections now open) 2016-05-02T10:11:19.543+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 350ms 2016-05-02T10:11:33.857+0000 I NETWORK [conn1477] end connection 127.0.0.1:37325 (0 connections now open) 2016-05-02T10:12:06.322+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:12:37.088+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 375ms 2016-05-02T10:12:53.345+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T10:13:00.628+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2537ms 2016-05-02T10:13:09.838+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:13:26.573+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 429ms 2016-05-02T10:13:57.877+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 9420, after asserts: 11500, after connections: 13080, after extra_info: 20000, after globalLock: 22340, after locks: 30890, after network: 35836, after opcounters: 35836, after opcountersRepl: 35836, after repl: 83626, after storageEngine: 97836, after tcmalloc: 114916, after wiredTiger: 139036, at end: 155776 } 2016-05-02T10:14:23.315+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T10:14:42.946+0000 I COMMAND [conn1478] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 122071ms 2016-05-02T10:14:54.405+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 5453ms 2016-05-02T10:15:08.319+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 595ms 2016-05-02T10:15:21.296+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:15:23.490+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 418ms 2016-05-02T10:16:25.386+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:16:33.185+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1353ms 2016-05-02T10:16:56.467+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 471ms 2016-05-02T10:17:05.038+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T10:18:05.717+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:18:32.090+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 9181ms 2016-05-02T10:19:16.357+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 280ms 2016-05-02T10:19:33.587+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:19:43.474+0000 I COMMAND [conn1478] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 188050ms 2016-05-02T10:19:41.301+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-05-02T10:20:14.523+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37330 #1479 (2 connections now open) 2016-05-02T10:20:35.991+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T10:21:15.580+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 614ms 2016-05-02T10:21:21.475+0000 I NETWORK [conn1478] end connection 127.0.0.1:37328 (1 connection now open) 2016-05-02T10:21:32.720+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:21:42.087+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1368ms 2016-05-02T10:21:51.367+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T10:21:55.600+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1023ms 2016-05-02T10:22:56.330+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 12340, after asserts: 16790, after connections: 24760, after extra_info: 63370, after globalLock: 71110, after locks: 74520, after network: 80190, after opcounters: 81890, after opcountersRepl: 84000, after repl: 138261, after storageEngine: 149081, after tcmalloc: 156611, after wiredTiger: 185631, at end: 216831 } 2016-05-02T10:23:11.846+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:23:28.770+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2182ms 2016-05-02T10:24:01.526+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1172ms 2016-05-02T10:24:17.743+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T10:24:32.061+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 323ms 2016-05-02T10:24:32.531+0000 I COMMAND [conn1479] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 138077ms 2016-05-02T10:25:21.925+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:26:08.913+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 553ms 2016-05-02T10:26:39.365+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1181ms 2016-05-02T10:27:19.223+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 338ms 2016-05-02T10:28:04.187+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:28:48.987+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T10:29:17.962+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 816ms 2016-05-02T10:29:49.949+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 158ms 2016-05-02T10:29:55.582+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:30:12.943+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 494ms 2016-05-02T10:31:42.376+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 372ms 2016-05-02T10:31:44.661+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:32:20.942+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 8577ms 2016-05-02T10:32:49.953+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T10:33:04.439+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37332 #1480 (2 connections now open) 2016-05-02T10:33:04.439+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 527ms 2016-05-02T10:33:11.709+0000 I COMMAND [conn1479] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 256507ms 2016-05-02T10:33:52.612+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:34:23.615+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5170, after asserts: 12510, after connections: 15430, after extra_info: 23230, after globalLock: 23230, after locks: 23230, after network: 31170, after opcounters: 33840, after opcountersRepl: 38230, after repl: 120205, after storageEngine: 120205, after tcmalloc: 120205, after wiredTiger: 127985, at end: 159355 } 2016-05-02T10:34:30.141+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 448ms 2016-05-02T10:34:34.961+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T10:35:06.092+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:35:17.408+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 758ms 2016-05-02T10:35:26.477+0000 I NETWORK [conn1479] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:37330] 2016-05-02T10:35:29.467+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 684ms 2016-05-02T10:36:00.474+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:36:56.622+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T10:36:56.794+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1544ms 2016-05-02T10:37:23.830+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 849ms 2016-05-02T10:37:38.543+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:37:40.984+0000 I COMMAND [conn1480] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 110792ms 2016-05-02T10:37:44.807+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 377ms 2016-05-02T10:39:11.672+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:39:21.579+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 514ms 2016-05-02T10:39:33.072+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 273ms 2016-05-02T10:39:44.357+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:40:10.243+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T10:40:58.492+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2329ms 2016-05-02T10:41:21.580+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 580ms 2016-05-02T10:41:30.243+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:41:46.166+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 350ms 2016-05-02T10:42:47.204+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:43:18.667+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 394ms 2016-05-02T10:43:45.724+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T10:43:46.096+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 416ms 2016-05-02T10:43:46.774+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T10:43:50.874+0000 I COMMAND [conn1480] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 185763ms 2016-05-02T10:44:08.491+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5810, after asserts: 8930, after connections: 11760, after extra_info: 30140, after globalLock: 33340, after locks: 40740, after network: 43320, after opcounters: 51750, after opcountersRepl: 52350, after repl: 169700, after storageEngine: 183370, after tcmalloc: 189830, after wiredTiger: 233820, at end: 267269 } 2016-05-02T10:44:09.716+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37334 #1481 (2 connections now open) 2016-05-02T10:44:48.376+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:45:22.061+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 442ms 2016-05-02T10:45:41.445+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 902ms 2016-05-02T10:46:05.721+0000 I NETWORK [conn1480] end connection 127.0.0.1:37332 (1 connection now open) 2016-05-02T10:46:05.045+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 412ms 2016-05-02T10:47:23.090+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:47:32.595+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 285ms 2016-05-02T10:47:59.438+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 889ms 2016-05-02T10:48:07.064+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T10:48:29.449+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1611ms 2016-05-02T10:49:21.516+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:49:44.054+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 252ms 2016-05-02T10:49:53.801+0000 I COMMAND [conn1481] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 209622ms 2016-05-02T10:49:58.235+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 404ms 2016-05-02T10:50:09.573+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 405ms 2016-05-02T10:50:35.490+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:51:18.155+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T10:51:30.969+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 631ms 2016-05-02T10:51:37.091+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:51:50.900+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 535ms 2016-05-02T10:52:08.758+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 420ms 2016-05-02T10:52:35.692+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3510, after asserts: 5770, after connections: 12890, after extra_info: 23420, after globalLock: 31730, after locks: 36130, after network: 39850, after opcounters: 42280, after opcountersRepl: 42550, after repl: 78460, after storageEngine: 94040, after tcmalloc: 98750, after wiredTiger: 121420, at end: 146860 } 2016-05-02T10:52:41.534+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:53:21.175+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T10:53:27.782+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2921ms 2016-05-02T10:53:38.278+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 142ms 2016-05-02T10:53:55.184+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1488ms 2016-05-02T10:54:16.093+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T10:54:22.330+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:54:37.802+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37336 #1482 (2 connections now open) 2016-05-02T10:54:59.010+0000 I COMMAND [conn1481] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 179534ms 2016-05-02T10:55:21.604+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 475ms 2016-05-02T10:55:33.581+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 650ms 2016-05-02T10:55:37.659+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:55:54.041+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 315ms 2016-05-02T10:55:56.671+0000 I NETWORK [conn1481] end connection 127.0.0.1:37334 (1 connection now open) 2016-05-02T10:56:17.516+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T10:57:08.149+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:57:16.365+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 561ms 2016-05-02T10:57:20.255+0000 I COMMAND [conn1482] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 78229ms 2016-05-02T10:57:35.704+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 215ms 2016-05-02T10:57:46.629+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1957ms 2016-05-02T10:57:53.728+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:58:22.364+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T10:59:05.907+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 763ms 2016-05-02T10:59:06.811+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T10:59:25.676+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 592ms 2016-05-02T10:59:25.676+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 7330, after asserts: 9620, after connections: 12920, after extra_info: 24020, after globalLock: 26970, after locks: 27270, after network: 28000, after opcounters: 29810, after opcountersRepl: 30050, after repl: 72700, after storageEngine: 76030, after tcmalloc: 86090, after wiredTiger: 105020, at end: 131760 } 2016-05-02T10:59:37.318+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 264ms 2016-05-02T11:00:22.450+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:01:05.866+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 7000ms 2016-05-02T11:01:17.933+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T11:01:31.641+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3994ms 2016-05-02T11:01:38.647+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T11:01:46.891+0000 I COMMAND [conn1482] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 147201ms 2016-05-02T11:01:54.534+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37338 #1483 (2 connections now open) 2016-05-02T11:02:27.266+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:02:45.796+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 993ms 2016-05-02T11:03:12.248+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 555ms 2016-05-02T11:03:16.989+0000 I NETWORK [conn1482] end connection 127.0.0.1:37336 (1 connection now open) 2016-05-02T11:03:25.628+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1301ms 2016-05-02T11:03:34.688+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:04:03.863+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:04:33.926+0000 I COMMAND [conn1483] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 47441ms 2016-05-02T11:04:33.915+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T11:04:42.114+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 299ms 2016-05-02T11:04:46.132+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 737ms 2016-05-02T11:05:10.382+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1239ms 2016-05-02T11:05:21.565+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:06:38.032+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 188ms 2016-05-02T11:06:43.689+0000 I NETWORK [conn1483] end connection 127.0.0.1:37338 (0 connections now open) 2016-05-02T11:06:49.586+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:06:56.536+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2426ms 2016-05-02T11:07:09.979+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 8970, after asserts: 10860, after connections: 16260, after extra_info: 25200, after globalLock: 29030, after locks: 33030, after network: 35050, after opcounters: 35160, after opcountersRepl: 35160, after repl: 123000, after storageEngine: 130270, after tcmalloc: 136360, after wiredTiger: 154720, at end: 183520 } 2016-05-02T11:07:31.639+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 303ms 2016-05-02T11:07:40.249+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T11:08:20.092+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:08:45.210+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37340 #1484 (1 connection now open) 2016-05-02T11:08:45.210+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2598ms 2016-05-02T11:09:13.882+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 426ms 2016-05-02T11:09:25.935+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 603ms 2016-05-02T11:09:35.708+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T11:09:45.967+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:10:26.910+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:10:41.280+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 475ms 2016-05-02T11:10:55.507+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1175ms 2016-05-02T11:11:00.346+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T11:11:15.171+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 340ms 2016-05-02T11:11:18.016+0000 I COMMAND [conn1484] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 41740ms 2016-05-02T11:11:48.006+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:12:36.758+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 469ms 2016-05-02T11:12:52.859+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1835ms 2016-05-02T11:13:00.531+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:13:09.901+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 310ms 2016-05-02T11:13:26.056+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:13:57.653+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T11:14:24.313+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 596ms 2016-05-02T11:14:37.341+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:14:46.952+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 632ms 2016-05-02T11:15:03.375+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 109ms 2016-05-02T11:15:23.055+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:15:23.575+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 9100, after asserts: 10390, after connections: 11570, after extra_info: 17000, after globalLock: 21200, after locks: 24250, after network: 27080, after opcounters: 31800, after opcountersRepl: 34540, after repl: 97660, after storageEngine: 108200, after tcmalloc: 119220, after wiredTiger: 149310, at end: 208180 } 2016-05-02T11:15:50.178+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:15:50.178+0000 I COMMAND [conn1484] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 85053ms 2016-05-02T11:16:17.128+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T11:16:40.541+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 558ms 2016-05-02T11:17:00.540+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:17:14.454+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2208ms 2016-05-02T11:17:20.180+0000 I NETWORK [conn1484] end connection 127.0.0.1:37340 (0 connections now open) 2016-05-02T11:17:25.407+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37342 #1485 (2 connections now open) 2016-05-02T11:17:39.700+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1067ms 2016-05-02T11:17:50.044+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:18:03.232+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T11:18:21.800+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:19:07.869+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T11:19:12.639+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 257ms 2016-05-02T11:19:56.131+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 315ms 2016-05-02T11:20:01.695+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:20:21.616+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 439ms 2016-05-02T11:21:37.990+0000 I COMMAND [conn1485] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 112410ms 2016-05-02T11:21:49.297+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:21:53.209+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 7156ms 2016-05-02T11:22:22.847+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 765ms 2016-05-02T11:22:26.629+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T11:23:09.436+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 304ms 2016-05-02T11:23:49.164+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6970, after asserts: 9350, after connections: 12870, after extra_info: 32160, after globalLock: 34020, after locks: 38760, after network: 42030, after opcounters: 43970, after opcountersRepl: 46460, after repl: 148170, after storageEngine: 151620, after tcmalloc: 162520, after wiredTiger: 190720, at end: 225060 } 2016-05-02T11:23:52.742+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:24:30.294+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 587ms 2016-05-02T11:25:02.042+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1069ms 2016-05-02T11:25:34.681+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:25:49.328+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 809ms 2016-05-02T11:26:52.339+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T11:26:52.138+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T11:27:17.347+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 489ms 2016-05-02T11:27:39.478+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1278ms 2016-05-02T11:27:50.179+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:28:26.959+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 400ms 2016-05-02T11:29:33.565+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:29:52.563+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1714ms 2016-05-02T11:30:23.188+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T11:30:30.982+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 714ms 2016-05-02T11:30:42.741+0000 I COMMAND [conn1485] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 208065ms 2016-05-02T11:30:54.730+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 305ms 2016-05-02T11:30:58.750+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37344 #1486 (2 connections now open) 2016-05-02T11:31:02.743+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:32:15.564+0000 I NETWORK [conn1485] end connection 127.0.0.1:37342 (1 connection now open) 2016-05-02T11:32:15.564+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 5119ms 2016-05-02T11:32:54.180+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:33:22.153+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 485ms 2016-05-02T11:33:49.430+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1089ms 2016-05-02T11:34:18.891+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T11:35:28.219+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:35:33.918+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 11925ms 2016-05-02T11:35:42.257+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2044, after asserts: 2044, after connections: 2044, after extra_info: 2044, after globalLock: 2044, after locks: 15284, after network: 26004, after opcounters: 32864, after opcountersRepl: 35704, after repl: 152394, after storageEngine: 173134, after tcmalloc: 184404, after wiredTiger: 209174, at end: 238704 } 2016-05-02T11:36:17.154+0000 I COMMAND [conn1486] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 168234ms 2016-05-02T11:36:52.927+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:36:40.735+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1257ms 2016-05-02T11:37:51.818+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 847ms 2016-05-02T11:38:00.532+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T11:39:11.980+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T11:39:18.969+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:39:22.838+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 547ms 2016-05-02T11:39:49.180+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 257ms 2016-05-02T11:39:59.525+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:40:25.604+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 383ms 2016-05-02T11:40:43.046+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T11:41:00.338+0000 I NETWORK [conn1486] end connection 127.0.0.1:37344 (0 connections now open) 2016-05-02T11:41:15.302+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:41:42.432+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1792ms 2016-05-02T11:42:07.740+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2809ms 2016-05-02T11:42:21.392+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:42:35.257+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 556ms 2016-05-02T11:42:59.615+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T11:43:24.351+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:43:51.444+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6480, after asserts: 8930, after connections: 11690, after extra_info: 30460, after globalLock: 36550, after locks: 41700, after network: 43680, after opcounters: 44190, after opcountersRepl: 44190, after repl: 103330, after storageEngine: 109840, after tcmalloc: 114590, after wiredTiger: 137250, at end: 158360 } 2016-05-02T11:43:54.576+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 407ms 2016-05-02T11:44:06.115+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3009ms 2016-05-02T11:44:07.885+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:44:33.757+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37347 #1487 (1 connection now open) 2016-05-02T11:44:33.757+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 439ms 2016-05-02T11:44:52.973+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T11:45:44.477+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 683ms 2016-05-02T11:45:55.589+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 909ms 2016-05-02T11:45:59.479+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:46:05.317+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T11:46:13.702+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 761ms 2016-05-02T11:46:53.841+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:47:00.714+0000 I COMMAND [conn1487] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 89722ms 2016-05-02T11:47:29.417+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 244ms 2016-05-02T11:47:29.412+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T11:47:49.662+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 707ms 2016-05-02T11:48:10.641+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:48:10.573+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 248ms 2016-05-02T11:48:56.586+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:49:17.288+0000 I NETWORK [conn1487] end connection 127.0.0.1:37347 (0 connections now open) 2016-05-02T11:49:39.778+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 268ms 2016-05-02T11:49:47.790+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T11:50:04.902+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 726ms 2016-05-02T11:50:28.653+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:50:37.234+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 718ms 2016-05-02T11:51:06.955+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:51:46.489+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T11:52:05.812+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2840, after asserts: 5000, after connections: 16440, after extra_info: 29500, after globalLock: 31810, after locks: 38740, after network: 40350, after opcounters: 40350, after opcountersRepl: 40350, after repl: 112000, after storageEngine: 123900, after tcmalloc: 135290, after wiredTiger: 182340, at end: 232950 } 2016-05-02T11:52:05.812+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 4219ms 2016-05-02T11:52:24.440+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1766ms 2016-05-02T11:52:33.253+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:52:50.552+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 293ms 2016-05-02T11:53:46.208+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:54:00.478+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37349 #1488 (1 connection now open) 2016-05-02T11:54:07.010+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 708ms 2016-05-02T11:54:24.272+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T11:54:36.704+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 638ms 2016-05-02T11:54:53.324+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 133ms 2016-05-02T11:54:53.324+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T11:55:13.856+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:56:14.974+0000 I COMMAND [conn1488] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 79576ms 2016-05-02T11:56:23.335+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 4042ms 2016-05-02T11:56:31.731+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:56:37.902+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 551ms 2016-05-02T11:56:56.596+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T11:57:07.527+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2764ms 2016-05-02T11:57:17.269+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:57:42.708+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 7250, after asserts: 12070, after connections: 20520, after extra_info: 27800, after globalLock: 29890, after locks: 33460, after network: 36600, after opcounters: 42590, after opcountersRepl: 46320, after repl: 83330, after storageEngine: 89180, after tcmalloc: 96240, after wiredTiger: 110640, at end: 132170 } 2016-05-02T11:57:49.827+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:57:51.525+0000 I NETWORK [conn1488] end connection 127.0.0.1:37349 (0 connections now open) 2016-05-02T11:58:03.674+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T11:58:19.878+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T11:58:33.514+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 328ms 2016-05-02T11:58:58.024+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 668ms 2016-05-02T11:59:12.891+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 294ms 2016-05-02T11:59:47.455+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:00:19.360+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 458ms 2016-05-02T12:00:19.360+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T12:00:45.209+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 835ms 2016-05-02T12:00:57.394+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:01:09.408+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 331ms 2016-05-02T12:02:31.379+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:02:43.340+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2423ms 2016-05-02T12:03:04.619+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37351 #1489 (1 connection now open) 2016-05-02T12:03:11.260+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2580ms 2016-05-02T12:03:22.485+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T12:03:27.645+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 365ms 2016-05-02T12:04:53.907+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:05:16.142+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T12:05:19.274+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2060ms 2016-05-02T12:05:51.730+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2037ms 2016-05-02T12:06:27.667+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 702ms 2016-05-02T12:06:51.301+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:07:26.822+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 11190, after asserts: 15460, after connections: 26970, after extra_info: 32538, after globalLock: 37608, after locks: 47428, after network: 50078, after opcounters: 51198, after opcountersRepl: 51598, after repl: 169968, after storageEngine: 182558, after tcmalloc: 190108, after wiredTiger: 220558, at end: 244278 } 2016-05-02T12:07:26.528+0000 I COMMAND [conn1489] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 137984ms 2016-05-02T12:07:34.583+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T12:08:13.752+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 371ms 2016-05-02T12:08:25.609+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:08:42.337+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1199ms 2016-05-02T12:09:08.344+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 432ms 2016-05-02T12:10:35.634+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 214ms 2016-05-02T12:10:48.611+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:10:57.458+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1423ms 2016-05-02T12:11:21.703+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 405ms 2016-05-02T12:11:24.602+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T12:12:12.548+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:12:36.394+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2686ms 2016-05-02T12:12:50.516+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1277ms 2016-05-02T12:13:19.096+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 330ms 2016-05-02T12:13:33.544+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:14:04.705+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T12:14:12.876+0000 I NETWORK [conn1489] end connection 127.0.0.1:37351 (0 connections now open) 2016-05-02T12:14:35.890+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37353 #1490 (2 connections now open) 2016-05-02T12:14:49.245+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 390ms 2016-05-02T12:15:06.629+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:15:16.113+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 891ms 2016-05-02T12:15:55.971+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 517ms 2016-05-02T12:16:35.928+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:16:54.215+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T12:17:27.256+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 199ms 2016-05-02T12:17:28.763+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:17:42.522+0000 I COMMAND [conn1490] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 57527ms 2016-05-02T12:17:53.504+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 9500, after asserts: 12080, after connections: 20440, after extra_info: 32360, after globalLock: 37370, after locks: 42000, after network: 45775, after opcounters: 45775, after opcountersRepl: 45775, after repl: 98195, after storageEngine: 112205, after tcmalloc: 122355, after wiredTiger: 152695, at end: 175445 } 2016-05-02T12:17:57.260+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 4680ms 2016-05-02T12:18:22.620+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:18:34.929+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1941ms 2016-05-02T12:18:55.518+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T12:19:56.424+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 263ms 2016-05-02T12:20:22.529+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:20:31.641+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1448ms 2016-05-02T12:20:36.857+0000 I NETWORK [conn1490] end connection 127.0.0.1:37353 (0 connections now open) 2016-05-02T12:20:47.417+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 466ms 2016-05-02T12:22:12.958+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 775ms 2016-05-02T12:22:31.924+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:22:33.812+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 379ms 2016-05-02T12:22:37.984+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1090ms 2016-05-02T12:22:58.633+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:23:54.887+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T12:24:08.422+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1772ms 2016-05-02T12:24:30.261+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 979ms 2016-05-02T12:25:03.894+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 285ms 2016-05-02T12:25:03.894+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:25:36.036+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37355 #1491 (1 connection now open) 2016-05-02T12:26:25.981+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:26:37.920+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3526ms 2016-05-02T12:27:06.396+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1340ms 2016-05-02T12:27:45.999+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T12:27:53.930+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3549ms 2016-05-02T12:28:42.844+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:28:44.298+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3750, after asserts: 5880, after connections: 11530, after extra_info: 19480, after globalLock: 22900, after locks: 26690, after network: 33280, after opcounters: 36400, after opcountersRepl: 41490, after repl: 97581, after storageEngine: 106611, after tcmalloc: 113581, after wiredTiger: 149501, at end: 173001 } 2016-05-02T12:28:44.325+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T12:29:15.327+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:29:19.616+0000 I COMMAND [conn1491] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 123259ms 2016-05-02T12:29:27.159+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 335ms 2016-05-02T12:29:49.398+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 696ms 2016-05-02T12:30:00.752+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 265ms 2016-05-02T12:30:15.554+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T12:30:50.635+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:31:16.650+0000 I NETWORK [conn1491] end connection 127.0.0.1:37355 (0 connections now open) 2016-05-02T12:31:28.415+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:31:28.660+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 580ms 2016-05-02T12:31:54.069+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 131ms 2016-05-02T12:31:54.565+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T12:32:12.662+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1590ms 2016-05-02T12:32:21.898+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:33:06.224+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:33:20.992+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 364ms 2016-05-02T12:33:51.216+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T12:33:51.127+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3414ms 2016-05-02T12:34:12.797+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:34:21.661+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37357 #1492 (1 connection now open) 2016-05-02T12:34:39.111+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6130, after asserts: 7140, after connections: 11450, after extra_info: 19800, after globalLock: 27350, after locks: 34700, after network: 37700, after opcounters: 38680, after opcountersRepl: 38680, after repl: 77390, after storageEngine: 84890, after tcmalloc: 95880, after wiredTiger: 137850, at end: 147694 } 2016-05-02T12:35:02.434+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 205ms 2016-05-02T12:35:10.941+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:35:22.178+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1734ms 2016-05-02T12:35:38.798+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 281ms 2016-05-02T12:35:44.646+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T12:36:20.920+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T12:36:54.548+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 152ms 2016-05-02T12:37:01.413+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:37:09.249+0000 I COMMAND [conn1492] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 107561ms 2016-05-02T12:37:09.079+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 729ms 2016-05-02T12:37:24.650+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 331ms 2016-05-02T12:37:29.423+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:37:58.935+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T12:38:29.836+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:38:40.417+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 457ms 2016-05-02T12:38:44.362+0000 I NETWORK [conn1492] end connection 127.0.0.1:37357 (0 connections now open) 2016-05-02T12:38:53.658+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 665ms 2016-05-02T12:38:59.723+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:39:05.676+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 307ms 2016-05-02T12:39:14.466+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T12:39:41.228+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:40:00.176+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37359 #1493 (1 connection now open) 2016-05-02T12:40:16.717+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:40:20.966+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 355ms 2016-05-02T12:40:30.927+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3913ms 2016-05-02T12:40:37.609+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T12:40:49.180+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 657ms 2016-05-02T12:40:51.736+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:40:59.566+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 9970, after asserts: 11450, after connections: 14890, after extra_info: 29460, after globalLock: 34200, after locks: 38320, after network: 45480, after opcounters: 46020, after opcountersRepl: 46020, after repl: 68830, after storageEngine: 72820, after tcmalloc: 76800, after wiredTiger: 102030, at end: 131119 } 2016-05-02T12:41:09.180+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:41:28.735+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T12:41:57.223+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 288ms 2016-05-02T12:42:11.715+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T12:42:28.457+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 687ms 2016-05-02T12:42:28.008+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:42:36.855+0000 I COMMAND [conn1493] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 90014ms 2016-05-02T12:42:41.626+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 232ms 2016-05-02T12:43:29.253+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:43:52.021+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 172ms 2016-05-02T12:44:02.068+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T12:44:08.006+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 6994ms 2016-05-02T12:44:29.080+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 534ms 2016-05-02T12:44:41.571+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:45:44.099+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 625ms 2016-05-02T12:45:49.937+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:45:55.636+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 614ms 2016-05-02T12:45:59.251+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1359ms 2016-05-02T12:46:17.350+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:46:49.702+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T12:46:49.142+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5170, after asserts: 8470, after connections: 15960, after extra_info: 25150, after globalLock: 28990, after locks: 35580, after network: 36340, after opcounters: 40300, after opcountersRepl: 41380, after repl: 96680, after storageEngine: 104300, after tcmalloc: 110820, after wiredTiger: 136670, at end: 152830 } 2016-05-02T12:47:21.641+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 346ms 2016-05-02T12:47:45.077+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3690ms 2016-05-02T12:48:05.824+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:48:09.362+0000 I COMMAND [conn1493] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 162052ms 2016-05-02T12:48:25.272+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1261ms 2016-05-02T12:48:46.101+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37361 #1494 (2 connections now open) 2016-05-02T12:49:21.254+0000 I NETWORK [conn1493] end connection 127.0.0.1:37359 (1 connection now open) 2016-05-02T12:49:39.264+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 879ms 2016-05-02T12:49:43.788+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T12:49:43.788+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:49:56.352+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 947ms 2016-05-02T12:50:24.391+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 405ms 2016-05-02T12:50:30.653+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T12:51:10.962+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:51:32.848+0000 I COMMAND [conn1494] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 105239ms 2016-05-02T12:51:47.107+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 364ms 2016-05-02T12:52:06.613+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 933ms 2016-05-02T12:52:12.026+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:52:25.189+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 443ms 2016-05-02T12:52:53.734+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T12:53:09.091+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:53:24.728+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 750, after asserts: 4450, after connections: 9770, after extra_info: 26470, after globalLock: 29390, after locks: 30950, after network: 31270, after opcounters: 31270, after opcountersRepl: 31270, after repl: 71030, after storageEngine: 76780, after tcmalloc: 84130, after wiredTiger: 94140, at end: 106520 } 2016-05-02T12:53:54.708+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 512ms 2016-05-02T12:54:02.246+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:54:13.102+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 525ms 2016-05-02T12:54:19.586+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 184ms 2016-05-02T12:55:25.199+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T12:55:43.717+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 427ms 2016-05-02T12:55:58.246+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:55:59.409+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 632ms 2016-05-02T12:56:19.079+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37363 #1495 (2 connections now open) 2016-05-02T12:56:31.852+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 4280ms 2016-05-02T12:56:36.305+0000 I COMMAND [conn1494] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 160604ms 2016-05-02T12:56:46.396+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:57:18.754+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T12:57:20.580+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T12:57:46.635+0000 I NETWORK [conn1494] end connection 127.0.0.1:37361 (1 connection now open) 2016-05-02T12:57:46.223+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1335ms 2016-05-02T12:57:56.366+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:58:13.873+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 430ms 2016-05-02T12:58:46.887+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 298ms 2016-05-02T12:58:54.745+0000 I COMMAND [conn1495] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 90587ms 2016-05-02T12:59:04.419+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T12:59:23.883+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T12:59:50.171+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 8750, after asserts: 14620, after connections: 21110, after extra_info: 33620, after globalLock: 38340, after locks: 43440, after network: 46020, after opcounters: 46570, after opcountersRepl: 46570, after repl: 114130, after storageEngine: 117850, after tcmalloc: 121990, after wiredTiger: 132210, at end: 154300 } 2016-05-02T13:00:05.940+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:00:06.299+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 4104ms 2016-05-02T13:00:52.719+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1530ms 2016-05-02T13:01:04.722+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 381ms 2016-05-02T13:01:05.435+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:02:23.615+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1088ms 2016-05-02T13:02:34.036+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 640ms 2016-05-02T13:02:38.835+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:02:54.557+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1275ms 2016-05-02T13:03:02.581+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T13:03:28.677+0000 I COMMAND [conn1495] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 130159ms 2016-05-02T13:03:47.400+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:03:48.985+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37365 #1496 (2 connections now open) 2016-05-02T13:04:05.791+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 454ms 2016-05-02T13:04:28.762+0000 I NETWORK [conn1495] end connection 127.0.0.1:37363 (1 connection now open) 2016-05-02T13:04:28.762+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 7283ms 2016-05-02T13:04:37.178+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 119ms 2016-05-02T13:04:46.934+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T13:05:14.758+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:05:33.345+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T13:06:03.540+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 505ms 2016-05-02T13:06:08.814+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:06:17.297+0000 I COMMAND [conn1496] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 46129ms 2016-05-02T13:06:24.007+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1315ms 2016-05-02T13:06:44.411+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 894ms 2016-05-02T13:07:07.829+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 0, after asserts: 0, after connections: 6620, after extra_info: 14670, after globalLock: 19330, after locks: 21250, after network: 27260, after opcounters: 28670, after opcountersRepl: 28670, after repl: 62910, after storageEngine: 73640, after tcmalloc: 81030, after wiredTiger: 128320, at end: 153200 } 2016-05-02T13:07:16.443+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:07:55.202+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 678ms 2016-05-02T13:07:56.846+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T13:08:03.720+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 651ms 2016-05-02T13:08:16.947+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:08:19.288+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 159ms 2016-05-02T13:09:09.245+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:09:21.976+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 423ms 2016-05-02T13:09:31.303+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T13:09:41.193+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3028ms 2016-05-02T13:10:06.618+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:10:44.556+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T13:11:06.035+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 278ms 2016-05-02T13:11:32.772+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 521ms 2016-05-02T13:11:39.703+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:11:55.409+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 551ms 2016-05-02T13:12:15.562+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37367 #1497 (2 connections now open) 2016-05-02T13:12:17.135+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T13:12:18.757+0000 I COMMAND [conn1496] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 167194ms 2016-05-02T13:12:49.884+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:13:23.240+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 497ms 2016-05-02T13:13:25.081+0000 I NETWORK [conn1496] end connection 127.0.0.1:37365 (1 connection now open) 2016-05-02T13:13:36.172+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:13:51.865+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 672ms 2016-05-02T13:14:10.540+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 261ms 2016-05-02T13:14:11.928+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5370, after asserts: 6900, after connections: 11880, after extra_info: 27340, after globalLock: 33370, after locks: 35720, after network: 38130, after opcounters: 40910, after opcountersRepl: 42730, after repl: 73981, after storageEngine: 84801, after tcmalloc: 97001, after wiredTiger: 121001, at end: 145511 } 2016-05-02T13:14:23.342+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T13:14:49.736+0000 I COMMAND [conn1497] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 71260ms 2016-05-02T13:15:01.969+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:15:23.281+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 352ms 2016-05-02T13:15:44.627+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 964ms 2016-05-02T13:16:11.029+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 165ms 2016-05-02T13:16:41.929+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:17:20.823+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T13:17:31.127+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1256ms 2016-05-02T13:17:57.275+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 568ms 2016-05-02T13:18:18.159+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 338ms 2016-05-02T13:18:21.743+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:18:21.743+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T13:19:40.849+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2019ms 2016-05-02T13:19:58.067+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:20:02.921+0000 I COMMAND [conn1497] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 202406ms 2016-05-02T13:20:05.170+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 578ms 2016-05-02T13:20:08.491+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37369 #1498 (2 connections now open) 2016-05-02T13:20:24.951+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 335ms 2016-05-02T13:20:50.990+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T13:21:21.531+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:21:22.724+0000 I NETWORK [conn1497] end connection 127.0.0.1:37367 (1 connection now open) 2016-05-02T13:21:55.659+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3296ms 2016-05-02T13:22:17.497+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1343ms 2016-05-02T13:22:16.158+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:22:16.868+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 8290, after asserts: 10600, after connections: 15060, after extra_info: 27710, after globalLock: 37890, after locks: 45860, after network: 47700, after opcounters: 48080, after opcountersRepl: 48080, after repl: 108549, after storageEngine: 112149, after tcmalloc: 120159, after wiredTiger: 136689, at end: 155289 } 2016-05-02T13:22:34.189+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 206ms 2016-05-02T13:22:42.078+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:22:54.898+0000 I COMMAND [conn1498] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 75595ms 2016-05-02T13:23:24.157+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T13:23:47.628+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 730ms 2016-05-02T13:24:13.076+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 824ms 2016-05-02T13:24:24.451+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 292ms 2016-05-02T13:24:32.246+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:25:16.201+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:25:28.884+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T13:25:53.080+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2104ms 2016-05-02T13:26:12.180+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:26:17.747+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1205ms 2016-05-02T13:26:40.893+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T13:26:40.661+0000 I COMMAND [conn1498] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 102542ms 2016-05-02T13:26:41.607+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1602ms 2016-05-02T13:27:24.078+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:27:57.900+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37371 #1499 (2 connections now open) 2016-05-02T13:28:10.290+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 406ms 2016-05-02T13:28:23.354+0000 I NETWORK [conn1498] end connection 127.0.0.1:37369 (0 connections now open) 2016-05-02T13:28:37.581+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 6914ms 2016-05-02T13:28:37.581+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:29:00.155+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 336ms 2016-05-02T13:29:26.553+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4610, after asserts: 6670, after connections: 8500, after extra_info: 17380, after globalLock: 22620, after locks: 30000, after network: 32390, after opcounters: 35980, after opcountersRepl: 40760, after repl: 81362, after storageEngine: 81362, after tcmalloc: 86762, after wiredTiger: 102192, at end: 139582 } 2016-05-02T13:29:38.496+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:30:32.286+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T13:30:36.338+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 180ms 2016-05-02T13:30:46.500+0000 I COMMAND [conn1499] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 81649ms 2016-05-02T13:30:53.271+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 217ms 2016-05-02T13:31:07.100+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:31:11.109+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 525ms 2016-05-02T13:32:37.925+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 4069ms 2016-05-02T13:32:51.003+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 263ms 2016-05-02T13:33:03.221+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:33:14.132+0000 I NETWORK [conn1499] end connection 127.0.0.1:37371 (0 connections now open) 2016-05-02T13:33:21.448+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1302ms 2016-05-02T13:33:31.657+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T13:33:32.495+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T13:34:42.755+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:34:42.660+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 120ms 2016-05-02T13:35:10.735+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1970ms 2016-05-02T13:35:48.948+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2751ms 2016-05-02T13:36:03.040+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:36:54.982+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 379ms 2016-05-02T13:36:58.337+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T13:37:12.478+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2086ms 2016-05-02T13:37:40.042+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 785ms 2016-05-02T13:38:11.053+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:38:13.455+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37373 #1500 (1 connection now open) 2016-05-02T13:39:15.846+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 263ms 2016-05-02T13:39:26.368+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1554ms 2016-05-02T13:39:50.532+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3380, after asserts: 11550, after connections: 19190, after extra_info: 28990, after globalLock: 33860, after locks: 38480, after network: 41670, after opcounters: 45110, after opcountersRepl: 47730, after repl: 132310, after storageEngine: 141110, after tcmalloc: 145218, after wiredTiger: 149838, at end: 192348 } 2016-05-02T13:39:59.729+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3733ms 2016-05-02T13:40:05.972+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:41:07.670+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T13:41:28.202+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 415ms 2016-05-02T13:41:39.057+0000 I COMMAND [conn1500] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 76232ms 2016-05-02T13:41:54.144+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 605ms 2016-05-02T13:42:12.422+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1693ms 2016-05-02T13:42:26.024+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:43:32.314+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:43:42.845+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1484ms 2016-05-02T13:44:06.713+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1745ms 2016-05-02T13:44:06.713+0000 I NETWORK [conn1500] end connection 127.0.0.1:37373 (0 connections now open) 2016-05-02T13:44:24.429+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T13:44:36.811+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1590ms 2016-05-02T13:45:16.757+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T13:45:22.268+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:45:55.116+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 690ms 2016-05-02T13:46:35.409+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:46:39.354+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3399ms 2016-05-02T13:46:56.478+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1236ms 2016-05-02T13:47:13.231+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T13:48:22.256+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 4670ms 2016-05-02T13:48:21.979+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:48:41.879+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3550, after asserts: 5750, after connections: 11840, after extra_info: 24330, after globalLock: 28220, after locks: 33260, after network: 43000, after opcounters: 45930, after opcountersRepl: 50880, after repl: 115500, after storageEngine: 121910, after tcmalloc: 134110, after wiredTiger: 168000, at end: 198370 } 2016-05-02T13:48:43.308+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2611ms 2016-05-02T13:49:00.526+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37375 #1501 (1 connection now open) 2016-05-02T13:49:20.796+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 543ms 2016-05-02T13:49:49.280+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:50:40.605+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 556ms 2016-05-02T13:51:21.123+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1589ms 2016-05-02T13:51:29.213+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T13:51:46.904+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 4703ms 2016-05-02T13:52:37.123+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:53:14.268+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 255ms 2016-05-02T13:53:39.918+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1781ms 2016-05-02T13:53:57.643+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 269ms 2016-05-02T13:53:57.094+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:53:56.143+0000 I COMMAND [conn1501] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 178475ms 2016-05-02T13:55:09.852+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T13:55:19.294+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1781ms 2016-05-02T13:55:39.195+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 5268ms 2016-05-02T13:55:46.886+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T13:56:06.168+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 204ms 2016-05-02T13:56:05.651+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:57:22.874+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:57:29.488+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1033ms 2016-05-02T13:58:06.102+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1207ms 2016-05-02T13:58:12.478+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T13:58:15.620+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5850, after asserts: 11090, after connections: 13580, after extra_info: 25670, after globalLock: 29890, after locks: 35840, after network: 37950, after opcounters: 38430, after opcountersRepl: 38430, after repl: 115220, after storageEngine: 119400, after tcmalloc: 125050, after wiredTiger: 155050, at end: 179380 } 2016-05-02T13:58:33.702+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3005ms 2016-05-02T13:59:03.565+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T13:59:07.427+0000 I NETWORK [conn1501] end connection 127.0.0.1:37375 (0 connections now open) 2016-05-02T13:59:54.384+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 143ms 2016-05-02T14:00:21.661+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1275ms 2016-05-02T14:00:43.139+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 366ms 2016-05-02T14:01:03.631+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:01:42.460+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T14:02:10.650+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 303ms 2016-05-02T14:02:26.382+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:02:30.371+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1556ms 2016-05-02T14:03:01.706+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 248ms 2016-05-02T14:03:27.972+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:03:45.442+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37378 #1502 (1 connection now open) 2016-05-02T14:03:59.737+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T14:04:22.429+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1732ms 2016-05-02T14:04:31.928+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:04:39.827+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 125ms 2016-05-02T14:04:45.647+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T14:04:50.869+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1079ms 2016-05-02T14:05:32.476+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:05:54.360+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6570, after asserts: 8730, after connections: 12340, after extra_info: 13683, after globalLock: 13683, after locks: 13683, after network: 13683, after opcounters: 13683, after opcountersRepl: 13683, after repl: 50683, after storageEngine: 56533, after tcmalloc: 61073, after wiredTiger: 76163, at end: 96883 } 2016-05-02T14:06:06.126+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T14:06:10.156+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 174ms 2016-05-02T14:06:16.095+0000 I COMMAND [conn1502] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 72264ms 2016-05-02T14:06:37.200+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 5147ms 2016-05-02T14:06:43.464+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:06:57.396+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 622ms 2016-05-02T14:08:12.035+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:08:12.035+0000 I NETWORK [conn1502] end connection 127.0.0.1:37378 (0 connections now open) 2016-05-02T14:08:12.685+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 384ms 2016-05-02T14:08:46.947+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T14:08:46.899+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 794ms 2016-05-02T14:09:09.958+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 261ms 2016-05-02T14:09:30.948+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:10:31.824+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:10:36.790+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2641ms 2016-05-02T14:11:00.830+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1357ms 2016-05-02T14:11:12.390+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T14:11:12.331+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37380 #1503 (1 connection now open) 2016-05-02T14:11:13.199+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-05-02T14:11:51.194+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:11:54.541+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T14:12:32.597+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 418ms 2016-05-02T14:13:14.879+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1620ms 2016-05-02T14:13:14.879+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:13:34.877+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1550ms 2016-05-02T14:14:05.582+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5060, after asserts: 9480, after connections: 10990, after extra_info: 16800, after globalLock: 20810, after locks: 25240, after network: 28230, after opcounters: 30369, after opcountersRepl: 30369, after repl: 79309, after storageEngine: 87179, after tcmalloc: 96439, after wiredTiger: 123769, at end: 147519 } 2016-05-02T14:14:33.096+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T14:14:49.343+0000 I COMMAND [conn1503] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 122469ms 2016-05-02T14:14:52.571+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 449ms 2016-05-02T14:15:16.357+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 596ms 2016-05-02T14:15:22.924+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:15:35.490+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 225ms 2016-05-02T14:16:57.953+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 237ms 2016-05-02T14:17:09.918+0000 I NETWORK [conn1503] end connection 127.0.0.1:37380 (0 connections now open) 2016-05-02T14:17:20.334+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37382 #1504 (2 connections now open) 2016-05-02T14:17:23.251+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:17:27.253+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1757ms 2016-05-02T14:18:16.396+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 612ms 2016-05-02T14:18:46.229+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T14:19:57.673+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1257ms 2016-05-02T14:20:01.226+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:20:19.924+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3565ms 2016-05-02T14:20:50.106+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 500ms 2016-05-02T14:21:38.273+0000 I COMMAND [conn1504] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 122038ms 2016-05-02T14:21:44.581+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:22:26.208+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 355ms 2016-05-02T14:22:35.580+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T14:22:37.847+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 466ms 2016-05-02T14:22:55.595+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 497ms 2016-05-02T14:23:09.831+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:23:20.327+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T14:23:31.446+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 11910, after asserts: 16530, after connections: 22270, after extra_info: 30350, after globalLock: 33620, after locks: 37880, after network: 45090, after opcounters: 46810, after opcountersRepl: 47130, after repl: 103150, after storageEngine: 108730, after tcmalloc: 115420, after wiredTiger: 127390, at end: 157460 } 2016-05-02T14:24:09.893+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 239ms 2016-05-02T14:24:35.514+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1072ms 2016-05-02T14:24:37.450+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:24:52.823+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 161ms 2016-05-02T14:25:42.301+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37383 #1505 (2 connections now open) 2016-05-02T14:26:05.156+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T14:26:11.978+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 941ms 2016-05-02T14:26:40.216+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 826ms 2016-05-02T14:26:59.289+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:27:04.851+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 748ms 2016-05-02T14:27:38.130+0000 I COMMAND [conn1504] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 244117ms 2016-05-02T14:28:24.883+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:28:31.101+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 388ms 2016-05-02T14:28:49.273+0000 I COMMAND [conn1505] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 83438ms 2016-05-02T14:29:12.644+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1422ms 2016-05-02T14:29:38.373+0000 I NETWORK [conn1504] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:37382] 2016-05-02T14:29:43.296+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T14:29:47.132+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1308ms 2016-05-02T14:30:40.153+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:31:25.540+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1236ms 2016-05-02T14:31:44.216+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37385 #1506 (2 connections now open) 2016-05-02T14:31:48.274+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 595ms 2016-05-02T14:31:58.014+0000 I NETWORK [conn1505] end connection 127.0.0.1:37383 (0 connections now open) 2016-05-02T14:32:12.712+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:32:26.220+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 121ms 2016-05-02T14:32:45.575+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T14:33:15.403+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:33:16.527+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6100, after asserts: 9400, after connections: 13630, after extra_info: 17440, after globalLock: 21510, after locks: 28380, after network: 33090, after opcounters: 43770, after opcountersRepl: 46030, after repl: 164520, after storageEngine: 174826, after tcmalloc: 174826, after wiredTiger: 184236, at end: 214476 } 2016-05-02T14:33:42.659+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T14:33:57.391+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 159ms 2016-05-02T14:34:19.625+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:34:20.511+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 254ms 2016-05-02T14:34:47.214+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 163ms 2016-05-02T14:35:28.419+0000 I COMMAND [conn1506] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 92866ms 2016-05-02T14:35:33.490+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T14:36:15.397+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 808ms 2016-05-02T14:36:38.947+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2299ms 2016-05-02T14:36:38.947+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:37:04.499+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2112ms 2016-05-02T14:37:54.764+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:37:56.927+0000 I NETWORK [conn1506] end connection 127.0.0.1:37385 (0 connections now open) 2016-05-02T14:38:26.595+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3779ms 2016-05-02T14:38:32.261+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:38:48.317+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 209ms 2016-05-02T14:39:05.922+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T14:39:53.123+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:40:15.217+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 305ms 2016-05-02T14:40:33.988+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 696ms 2016-05-02T14:40:45.461+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:40:52.626+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 139ms 2016-05-02T14:41:03.766+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37387 #1507 (1 connection now open) 2016-05-02T14:41:16.970+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T14:41:29.438+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4970, after asserts: 6170, after connections: 10500, after extra_info: 17750, after globalLock: 22400, after locks: 28240, after network: 31940, after opcounters: 41070, after opcountersRepl: 43550, after repl: 105440, after storageEngine: 109950, after tcmalloc: 114180, after wiredTiger: 126824, at end: 126824 } 2016-05-02T14:42:14.829+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:42:21.462+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 399ms 2016-05-02T14:42:43.723+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T14:42:48.470+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3251ms 2016-05-02T14:43:13.674+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1658ms 2016-05-02T14:44:28.190+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:44:33.605+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 240ms 2016-05-02T14:44:49.176+0000 I COMMAND [conn1507] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 127974ms 2016-05-02T14:45:00.434+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 803ms 2016-05-02T14:45:00.028+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Remote command timed out while waiting to get a connection from the pool. 2016-05-02T14:45:23.661+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2902ms 2016-05-02T14:45:52.980+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:46:23.232+0000 I NETWORK [conn1507] end connection 127.0.0.1:37387 (0 connections now open) 2016-05-02T14:46:38.555+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:46:46.303+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 274ms 2016-05-02T14:47:03.114+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T14:47:08.076+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2708ms 2016-05-02T14:47:26.976+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2373ms 2016-05-02T14:47:43.927+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:48:39.749+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:48:50.697+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1102ms 2016-05-02T14:48:52.168+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4790, after asserts: 8660, after connections: 10410, after extra_info: 15690, after globalLock: 22010, after locks: 24200, after network: 26370, after opcounters: 26760, after opcountersRepl: 26760, after repl: 86450, after storageEngine: 89080, after tcmalloc: 92620, after wiredTiger: 108880, at end: 145100 } 2016-05-02T14:48:54.712+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 526ms 2016-05-02T14:49:08.735+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T14:49:14.800+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 684ms 2016-05-02T14:49:45.438+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:49:51.321+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37389 #1508 (1 connection now open) 2016-05-02T14:50:42.575+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 433ms 2016-05-02T14:50:50.427+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 488ms 2016-05-02T14:50:58.702+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:51:11.070+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T14:51:44.809+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T14:51:56.283+0000 I COMMAND [conn1508] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 53884ms 2016-05-02T14:52:08.868+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:52:09.886+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 384ms 2016-05-02T14:52:24.518+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 637ms 2016-05-02T14:52:37.964+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 487ms 2016-05-02T14:52:56.157+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:53:43.778+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T14:53:59.015+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 734ms 2016-05-02T14:54:19.827+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 418ms 2016-05-02T14:54:19.343+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:54:19.700+0000 I NETWORK [conn1508] end connection 127.0.0.1:37389 (0 connections now open) 2016-05-02T14:55:07.052+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 321ms 2016-05-02T14:55:31.114+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:55:54.417+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2800, after asserts: 6860, after connections: 6860, after extra_info: 8890, after globalLock: 13180, after locks: 23960, after network: 29210, after opcounters: 31760, after opcountersRepl: 33700, after repl: 106550, after storageEngine: 112210, after tcmalloc: 117170, after wiredTiger: 135310, at end: 185800 } 2016-05-02T14:55:58.268+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:56:35.936+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 344ms 2016-05-02T14:56:37.218+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T14:57:06.076+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 778ms 2016-05-02T14:57:33.508+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:57:33.844+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 940ms 2016-05-02T14:58:06.043+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:37391 #1509 (1 connection now open) 2016-05-02T14:58:44.776+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T14:58:53.748+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 604ms 2016-05-02T14:59:08.656+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T14:59:09.401+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 413ms 2016-05-02T14:59:41.775+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 404ms 2016-05-02T15:00:05.874+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:00:25.208+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T15:00:48.591+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:00:59.773+0000 I COMMAND [conn1509] command admin.$cmd command: isMaster { isMaster: 1 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:339 locks:{} protocol:op_query 94514ms 2016-05-02T15:01:06.590+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3254ms 2016-05-02T15:01:19.950+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 356ms 2016-05-02T15:01:34.306+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T15:01:37.643+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 290ms 2016-05-02T15:02:37.085+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:03:22.473+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4550, after asserts: 7780, after connections: 16750, after extra_info: 44160, after globalLock: 51050, after locks: 54350, after network: 55710, after opcounters: 56790, after opcountersRepl: 56790, after repl: 105150, after storageEngine: 112850, after tcmalloc: 140900, after wiredTiger: 165500, at end: 211350 } 2016-05-02T15:03:24.391+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 622ms 2016-05-02T15:04:08.756+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1272ms 2016-05-02T15:04:12.859+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:04:35.823+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 918ms 2016-05-02T15:05:53.100+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:06:02.622+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1225ms 2016-05-02T15:06:27.080+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2907ms 2016-05-02T15:06:34.349+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T15:07:01.635+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 435ms 2016-05-02T15:07:38.018+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:07:41.739+0000 I COMMAND [conn1509] command admin.$cmd command: replSetHeartbeat { replSetHeartbeat: "mongodbreplica", configVersion: 2, from: "localhost:27015", fromId: 2, term: 46 } keyUpdates:0 writeConflicts:0 numYields:0 reslen:375 locks:{} protocol:op_command 238260ms 2016-05-02T15:08:19.809+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:08:34.177+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3061ms 2016-05-02T15:09:00.328+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T15:09:02.134+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2093ms 2016-05-02T15:09:15.542+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 320ms 2016-05-02T15:09:34.359+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:09:42.379+0000 I NETWORK [conn1509] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:37391] 2016-05-02T15:10:12.948+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:10:42.846+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 869ms 2016-05-02T15:10:58.410+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 913ms 2016-05-02T15:11:00.811+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T15:11:10.896+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T15:11:16.101+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 515ms 2016-05-02T15:12:02.259+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:12:49.767+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 506ms 2016-05-02T15:12:56.847+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:13:26.182+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 390ms 2016-05-02T15:13:36.877+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5460, after asserts: 14560, after connections: 18820, after extra_info: 30100, after globalLock: 36140, after locks: 40420, after network: 42950, after opcounters: 45330, after opcountersRepl: 52590, after repl: 139710, after storageEngine: 146140, after tcmalloc: 154200, after wiredTiger: 194930, at end: 233330 } 2016-05-02T15:13:37.887+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Operation timed out 2016-05-02T15:13:46.858+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 601ms 2016-05-02T15:14:12.022+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:15:02.665+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 413ms 2016-05-02T15:15:30.247+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 5773ms 2016-05-02T15:15:55.192+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:15:56.959+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 493ms 2016-05-02T15:16:29.319+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T15:17:14.345+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:17:18.148+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 926ms 2016-05-02T15:17:44.861+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 871ms 2016-05-02T15:18:01.139+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:18:12.530+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 655ms 2016-05-02T15:18:37.442+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T15:19:21.573+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:19:47.673+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 295ms 2016-05-02T15:20:09.512+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 928ms 2016-05-02T15:20:20.875+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:20:22.316+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 149ms 2016-05-02T15:20:42.849+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5910, after asserts: 9230, after connections: 14180, after extra_info: 22170, after globalLock: 27610, after locks: 36440, after network: 38710, after opcounters: 42780, after opcountersRepl: 53720, after repl: 127550, after storageEngine: 134780, after tcmalloc: 139870, after wiredTiger: 164640, at end: 172820 } 2016-05-02T15:20:44.588+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T15:21:29.070+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:21:35.559+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 695ms 2016-05-02T15:21:55.659+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 730ms 2016-05-02T15:22:20.513+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 342ms 2016-05-02T15:22:50.332+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:23:30.520+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 326ms 2016-05-02T15:23:34.421+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T15:23:42.738+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1229ms 2016-05-02T15:24:04.270+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 251ms 2016-05-02T15:24:24.537+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:25:30.071+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:25:37.002+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 372ms 2016-05-02T15:26:09.237+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 490ms 2016-05-02T15:26:19.476+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T15:26:43.696+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 441ms 2016-05-02T15:27:08.508+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:27:13.874+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6540, after asserts: 9110, after connections: 13860, after extra_info: 23770, after globalLock: 25720, after locks: 33420, after network: 37310, after opcounters: 38580, after opcountersRepl: 38680, after repl: 108520, after storageEngine: 119430, after tcmalloc: 129280, after wiredTiger: 150860, at end: 163890 } 2016-05-02T15:27:53.590+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:28:00.411+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 350ms 2016-05-02T15:28:22.051+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 558ms 2016-05-02T15:28:33.982+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T15:28:52.142+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 300ms 2016-05-02T15:29:07.719+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:29:40.144+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:30:06.779+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 341ms 2016-05-02T15:30:07.306+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T15:30:30.841+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3576ms 2016-05-02T15:30:46.277+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:31:24.593+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:31:53.083+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 542ms 2016-05-02T15:32:08.424+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T15:32:09.609+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 339ms 2016-05-02T15:32:20.960+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 581ms 2016-05-02T15:32:36.939+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:33:10.234+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2830, after asserts: 7470, after connections: 12160, after extra_info: 17800, after globalLock: 20400, after locks: 22080, after network: 22240, after opcounters: 22240, after opcountersRepl: 22240, after repl: 71740, after storageEngine: 74570, after tcmalloc: 86250, after wiredTiger: 114680, at end: 135220 } 2016-05-02T15:33:20.002+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:33:42.607+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T15:33:49.221+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 372ms 2016-05-02T15:34:01.225+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 458ms 2016-05-02T15:34:08.436+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 620ms 2016-05-02T15:34:12.019+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:35:15.472+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:35:26.189+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 367ms 2016-05-02T15:35:42.466+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2699ms 2016-05-02T15:35:52.741+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T15:35:59.699+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 4389ms 2016-05-02T15:36:14.886+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:37:05.938+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:37:11.420+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 290ms 2016-05-02T15:37:22.953+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 129ms 2016-05-02T15:37:36.278+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T15:37:53.109+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 419ms 2016-05-02T15:38:03.210+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:38:36.881+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2110, after asserts: 8680, after connections: 12260, after extra_info: 19230, after globalLock: 29290, after locks: 35840, after network: 36970, after opcounters: 37810, after opcountersRepl: 37810, after repl: 74290, after storageEngine: 85650, after tcmalloc: 92410, after wiredTiger: 111500, at end: 131010 } 2016-05-02T15:38:42.994+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:39:04.839+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 350ms 2016-05-02T15:39:04.661+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T15:39:09.529+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1057ms 2016-05-02T15:39:17.765+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:39:23.687+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 323ms 2016-05-02T15:40:30.333+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:40:38.464+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 316ms 2016-05-02T15:40:49.173+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 894ms 2016-05-02T15:40:52.436+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T15:40:55.648+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 269ms 2016-05-02T15:41:05.915+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:41:58.976+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:42:06.601+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 718ms 2016-05-02T15:42:19.472+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3064ms 2016-05-02T15:42:36.439+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 520ms 2016-05-02T15:42:36.312+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T15:43:19.551+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:43:55.441+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 303ms 2016-05-02T15:44:15.196+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 604ms 2016-05-02T15:44:32.089+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:44:36.567+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 860ms 2016-05-02T15:44:49.357+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4370, after asserts: 6600, after connections: 10310, after extra_info: 20040, after globalLock: 22890, after locks: 26140, after network: 29250, after opcounters: 31040, after opcountersRepl: 32630, after repl: 116340, after storageEngine: 122380, after tcmalloc: 131040, after wiredTiger: 141990, at end: 160460 } 2016-05-02T15:45:06.369+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T15:45:53.063+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:45:59.922+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 597ms 2016-05-02T15:46:26.570+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 503ms 2016-05-02T15:46:53.332+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 246ms 2016-05-02T15:48:01.569+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:48:21.360+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 795ms 2016-05-02T15:48:46.543+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T15:48:51.880+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2126ms 2016-05-02T15:49:08.326+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 344ms 2016-05-02T15:49:26.483+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:50:11.335+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:50:27.721+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1955ms 2016-05-02T15:50:38.676+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T15:50:44.586+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1573ms 2016-05-02T15:51:15.362+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:52:00.911+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2004ms 2016-05-02T15:52:08.191+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:52:16.873+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1719ms 2016-05-02T15:52:32.868+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 200ms 2016-05-02T15:52:38.807+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T15:52:41.709+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2830, after asserts: 6220, after connections: 11980, after extra_info: 20280, after globalLock: 22930, after locks: 25960, after network: 27720, after opcounters: 27720, after opcountersRepl: 27720, after repl: 80410, after storageEngine: 85090, after tcmalloc: 90460, after wiredTiger: 113950, at end: 125790 } 2016-05-02T15:52:52.770+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:53:50.796+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2658ms 2016-05-02T15:53:52.121+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:54:05.829+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2667ms 2016-05-02T15:54:29.766+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T15:55:11.814+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:55:21.719+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2365ms 2016-05-02T15:55:33.961+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 272ms 2016-05-02T15:55:41.868+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 677ms 2016-05-02T15:56:13.849+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:56:55.033+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T15:56:54.371+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 499ms 2016-05-02T15:57:10.631+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 173ms 2016-05-02T15:57:24.122+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:57:50.422+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2500, after asserts: 3130, after connections: 4600, after extra_info: 9230, after globalLock: 11450, after locks: 14260, after network: 16530, after opcounters: 17520, after opcountersRepl: 17520, after repl: 67840, after storageEngine: 73120, after tcmalloc: 77340, after wiredTiger: 102800, at end: 119770 } 2016-05-02T15:58:13.747+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:58:29.321+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2144ms 2016-05-02T15:58:43.747+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 420ms 2016-05-02T15:58:56.870+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T15:59:19.900+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T15:59:49.789+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:00:01.108+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 391ms 2016-05-02T16:00:08.235+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T16:00:14.708+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 894ms 2016-05-02T16:00:19.627+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1492ms 2016-05-02T16:00:27.451+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:01:22.917+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:01:33.596+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 274ms 2016-05-02T16:01:40.497+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T16:01:50.504+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 565ms 2016-05-02T16:02:05.083+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 407ms 2016-05-02T16:02:05.083+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:02:05.083+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3990, after asserts: 7560, after connections: 11320, after extra_info: 18820, after globalLock: 21320, after locks: 25590, after network: 27090, after opcounters: 27200, after opcountersRepl: 27200, after repl: 76090, after storageEngine: 80340, after tcmalloc: 85090, after wiredTiger: 99480, at end: 113620 } 2016-05-02T16:02:47.132+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:03:26.195+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 248ms 2016-05-02T16:03:28.525+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:03:36.466+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 329ms 2016-05-02T16:03:51.925+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:04:44.994+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:04:50.682+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 395ms 2016-05-02T16:04:54.071+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 499ms 2016-05-02T16:04:54.449+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 119ms 2016-05-02T16:05:03.654+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:05:31.379+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:05:56.913+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 271ms 2016-05-02T16:06:01.294+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:06:05.578+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1449ms 2016-05-02T16:06:11.748+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T16:06:18.029+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 116ms 2016-05-02T16:06:26.962+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:06:41.394+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1020, after asserts: 3750, after connections: 4910, after extra_info: 17780, after globalLock: 21860, after locks: 24540, after network: 26100, after opcounters: 26360, after opcountersRepl: 26360, after repl: 52690, after storageEngine: 58670, after tcmalloc: 61710, after wiredTiger: 75880, at end: 90350 } 2016-05-02T16:07:07.764+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:07:31.622+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 359ms 2016-05-02T16:07:44.051+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:07:49.207+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1881ms 2016-05-02T16:08:00.647+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 236ms 2016-05-02T16:08:12.472+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:08:54.768+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:09:14.763+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 273ms 2016-05-02T16:09:22.465+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:09:34.456+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1398ms 2016-05-02T16:09:46.220+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:09:52.299+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 201ms 2016-05-02T16:10:19.402+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:10:40.574+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 13550, after asserts: 17380, after connections: 19230, after extra_info: 27990, after globalLock: 31040, after locks: 35070, after network: 36990, after opcounters: 37330, after opcountersRepl: 37330, after repl: 63770, after storageEngine: 68290, after tcmalloc: 71840, after wiredTiger: 82490, at end: 100540 } 2016-05-02T16:10:46.711+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T16:10:56.042+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 111ms 2016-05-02T16:11:09.482+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:11:10.610+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 338ms 2016-05-02T16:11:21.334+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1236ms 2016-05-02T16:12:05.973+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:12:41.524+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:12:45.542+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2941ms 2016-05-02T16:12:53.446+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 717ms 2016-05-02T16:13:09.686+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 474ms 2016-05-02T16:13:09.686+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:13:36.179+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:14:10.522+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:14:24.995+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1134ms 2016-05-02T16:14:34.346+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 1830, after asserts: 3990, after connections: 9590, after extra_info: 13240, after globalLock: 16340, after locks: 19570, after network: 20300, after opcounters: 20300, after opcountersRepl: 20300, after repl: 38320, after storageEngine: 51030, after tcmalloc: 59010, after wiredTiger: 69680, at end: 92800 } 2016-05-02T16:14:35.545+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2053ms 2016-05-02T16:14:39.006+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:14:40.622+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1425ms 2016-05-02T16:14:58.508+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:15:33.276+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:15:48.423+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 159ms 2016-05-02T16:16:03.427+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 688ms 2016-05-02T16:16:06.469+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:16:20.344+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 677ms 2016-05-02T16:17:05.686+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:17:34.397+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2260ms 2016-05-02T16:17:36.385+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:17:38.986+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 613ms 2016-05-02T16:17:45.604+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 322ms 2016-05-02T16:17:54.588+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:17:56.068+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4150, after asserts: 5990, after connections: 6430, after extra_info: 10840, after globalLock: 16400, after locks: 19470, after network: 20610, after opcounters: 20610, after opcountersRepl: 20610, after repl: 63030, after storageEngine: 78510, after tcmalloc: 88170, after wiredTiger: 96790, at end: 106900 } 2016-05-02T16:18:47.961+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:19:16.395+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 466ms 2016-05-02T16:19:31.184+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:19:42.280+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 404ms 2016-05-02T16:19:54.150+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:19:58.891+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 134ms 2016-05-02T16:20:41.958+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:21:12.354+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:21:18.454+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 381ms 2016-05-02T16:21:24.487+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:21:31.765+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 595ms 2016-05-02T16:21:41.850+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 207ms 2016-05-02T16:21:56.055+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:22:16.305+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:22:49.130+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:22:50.436+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 6520, after asserts: 10240, after connections: 14470, after extra_info: 33430, after globalLock: 37720, after locks: 43100, after network: 45420, after opcounters: 45660, after opcountersRepl: 45660, after repl: 69000, after storageEngine: 72210, after tcmalloc: 84030, after wiredTiger: 94420, at end: 110230 } 2016-05-02T16:22:59.403+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 186ms 2016-05-02T16:23:04.016+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 637ms 2016-05-02T16:23:24.763+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 429ms 2016-05-02T16:23:37.195+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:24:25.085+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T16:24:37.258+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 376ms 2016-05-02T16:24:47.914+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:24:48.773+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1372ms 2016-05-02T16:25:10.341+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3247ms 2016-05-02T16:25:15.062+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:25:45.260+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T16:26:18.686+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:26:21.380+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 137ms 2016-05-02T16:26:34.639+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 485ms 2016-05-02T16:26:51.959+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 495ms 2016-05-02T16:27:06.789+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:27:37.928+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:28:08.038+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:28:17.303+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 292ms 2016-05-02T16:28:22.705+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 891ms 2016-05-02T16:28:25.538+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3000, after asserts: 5220, after connections: 11470, after extra_info: 20760, after globalLock: 23840, after locks: 30870, after network: 36460, after opcounters: 37710, after opcountersRepl: 37710, after repl: 89620, after storageEngine: 94670, after tcmalloc: 99440, after wiredTiger: 114770, at end: 136910 } 2016-05-02T16:28:33.893+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 764ms 2016-05-02T16:28:49.359+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:29:21.248+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T16:29:46.338+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 183ms 2016-05-02T16:29:55.558+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 585ms 2016-05-02T16:30:03.803+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:30:08.034+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 388ms 2016-05-02T16:30:22.157+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:30:38.007+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:30:57.929+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:31:26.174+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:31:31.253+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 439ms 2016-05-02T16:31:43.527+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:31:47.615+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 344ms 2016-05-02T16:32:13.894+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:32:17.437+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 454ms 2016-05-02T16:32:45.917+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:33:05.925+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:33:30.241+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:33:39.131+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 364ms 2016-05-02T16:33:52.699+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:33:52.913+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2950, after asserts: 5360, after connections: 6080, after extra_info: 15620, after globalLock: 23870, after locks: 26540, after network: 27320, after opcounters: 27320, after opcountersRepl: 27320, after repl: 52210, after storageEngine: 61020, after tcmalloc: 72670, after wiredTiger: 97260, at end: 115210 } 2016-05-02T16:33:57.030+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 276ms 2016-05-02T16:34:30.311+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:35:17.014+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:35:21.199+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 472ms 2016-05-02T16:35:39.696+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1080ms 2016-05-02T16:35:54.454+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T16:36:51.330+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:36:58.159+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-05-02T16:37:28.672+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 5474ms 2016-05-02T16:37:49.688+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 506ms 2016-05-02T16:38:04.024+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:38:49.188+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:39:08.302+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:39:08.302+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 147ms 2016-05-02T16:39:33.735+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4330, after asserts: 7090, after connections: 9790, after extra_info: 22410, after globalLock: 24900, after locks: 29090, after network: 31230, after opcounters: 33480, after opcountersRepl: 34080, after repl: 115570, after storageEngine: 121310, after tcmalloc: 125330, after wiredTiger: 137870, at end: 162780 } 2016-05-02T16:39:35.300+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 665ms 2016-05-02T16:39:43.869+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:39:48.159+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1199ms 2016-05-02T16:39:58.302+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T16:40:28.262+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:40:56.447+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:41:02.955+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 928ms 2016-05-02T16:41:16.822+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 4218ms 2016-05-02T16:41:17.249+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T16:41:33.748+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 755ms 2016-05-02T16:41:44.371+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:42:12.125+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:42:36.746+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T16:42:46.411+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 367ms 2016-05-02T16:43:04.738+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1238ms 2016-05-02T16:43:05.109+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:43:16.061+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 474ms 2016-05-02T16:43:45.731+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:43:50.373+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3070, after asserts: 5280, after connections: 6820, after extra_info: 10630, after globalLock: 14020, after locks: 16220, after network: 18430, after opcounters: 20760, after opcountersRepl: 21630, after repl: 73770, after storageEngine: 77690, after tcmalloc: 81700, after wiredTiger: 98010, at end: 115110 } 2016-05-02T16:44:05.488+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:44:15.276+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:44:29.589+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 449ms 2016-05-02T16:44:42.981+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 385ms 2016-05-02T16:44:54.860+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 267ms 2016-05-02T16:45:05.048+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:45:21.346+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:45:40.471+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:45:59.190+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 173ms 2016-05-02T16:46:08.153+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 121ms 2016-05-02T16:46:20.980+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:46:22.726+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 602ms 2016-05-02T16:46:37.069+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:47:07.129+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T16:47:31.397+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 377ms 2016-05-02T16:47:40.245+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:47:43.206+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 386ms 2016-05-02T16:48:04.130+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 354ms 2016-05-02T16:48:08.287+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:48:12.200+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3670, after asserts: 10850, after connections: 11690, after extra_info: 18300, after globalLock: 21520, after locks: 26730, after network: 27960, after opcounters: 27960, after opcountersRepl: 27960, after repl: 78000, after storageEngine: 82320, after tcmalloc: 88460, after wiredTiger: 98720, at end: 103870 } 2016-05-02T16:48:22.009+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T16:49:05.584+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:49:13.094+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 730ms 2016-05-02T16:49:22.950+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 311ms 2016-05-02T16:49:38.231+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:49:55.618+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:50:10.208+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:50:35.620+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:50:42.400+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1156ms 2016-05-02T16:50:56.145+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 260ms 2016-05-02T16:51:02.034+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T16:51:07.188+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1150ms 2016-05-02T16:51:22.632+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:51:26.737+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2180, after asserts: 3120, after connections: 4960, after extra_info: 7530, after globalLock: 9110, after locks: 9650, after network: 9890, after opcounters: 9890, after opcountersRepl: 9890, after repl: 35380, after storageEngine: 43760, after tcmalloc: 48080, after wiredTiger: 73570, at end: 82400 } 2016-05-02T16:52:10.847+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:52:15.720+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 581ms 2016-05-02T16:52:24.513+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 648ms 2016-05-02T16:52:43.661+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 382ms 2016-05-02T16:53:09.265+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:53:25.486+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:53:54.789+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 269ms 2016-05-02T16:54:10.982+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:54:16.718+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 265ms 2016-05-02T16:54:47.226+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:55:00.933+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:55:19.499+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5320, after asserts: 7630, after connections: 10770, after extra_info: 16220, after globalLock: 19060, after locks: 20980, after network: 20980, after opcounters: 20980, after opcountersRepl: 20980, after repl: 54630, after storageEngine: 58330, after tcmalloc: 64330, after wiredTiger: 75880, at end: 91350 } 2016-05-02T16:55:22.391+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 482ms 2016-05-02T16:55:33.203+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1548ms 2016-05-02T16:55:42.667+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1086ms 2016-05-02T16:55:45.402+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:56:07.913+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:56:29.873+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:56:47.099+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 241ms 2016-05-02T16:56:59.249+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:57:07.333+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 620ms 2016-05-02T16:57:14.852+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:57:17.821+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 150ms 2016-05-02T16:57:20.733+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:57:51.359+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:58:14.932+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T16:58:32.169+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 167ms 2016-05-02T16:58:39.478+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 747ms 2016-05-02T16:58:46.516+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T16:58:48.601+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 270ms 2016-05-02T16:59:02.605+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3280, after asserts: 5310, after connections: 6520, after extra_info: 10330, after globalLock: 14690, after locks: 14930, after network: 15210, after opcounters: 16940, after opcountersRepl: 16940, after repl: 43170, after storageEngine: 47120, after tcmalloc: 58680, after wiredTiger: 71750, at end: 94780 } 2016-05-02T16:59:16.648+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:00:02.712+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 180ms 2016-05-02T17:00:04.410+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:00:25.289+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1577ms 2016-05-02T17:00:29.754+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 233ms 2016-05-02T17:00:38.014+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:01:33.020+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:01:52.183+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:01:55.180+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 222ms 2016-05-02T17:02:25.755+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2945ms 2016-05-02T17:02:39.560+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:02:46.638+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3320, after asserts: 5330, after connections: 7450, after extra_info: 15340, after globalLock: 18250, after locks: 21700, after network: 23800, after opcounters: 26180, after opcountersRepl: 26570, after repl: 35240, after storageEngine: 53720, after tcmalloc: 59070, after wiredTiger: 74770, at end: 88750 } 2016-05-02T17:02:48.766+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 218ms 2016-05-02T17:03:29.623+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:04:07.541+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 854ms 2016-05-02T17:04:20.078+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T17:04:22.331+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 521ms 2016-05-02T17:04:36.635+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:05:05.789+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:05:30.151+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:05:38.655+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 425ms 2016-05-02T17:05:48.361+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 893ms 2016-05-02T17:06:01.709+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:06:02.679+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 246ms 2016-05-02T17:06:34.593+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:06:53.454+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T17:07:15.575+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:07:16.663+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2819ms 2016-05-02T17:07:25.200+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 158ms 2016-05-02T17:07:28.361+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 982ms 2016-05-02T17:07:44.905+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5570, after asserts: 11610, after connections: 13560, after extra_info: 16430, after globalLock: 19550, after locks: 21400, after network: 23040, after opcounters: 23310, after opcountersRepl: 23310, after repl: 52000, after storageEngine: 60970, after tcmalloc: 66960, after wiredTiger: 86310, at end: 102830 } 2016-05-02T17:07:52.139+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:08:15.321+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:08:42.181+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:08:43.063+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 138ms 2016-05-02T17:08:51.914+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 966ms 2016-05-02T17:09:04.750+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 126ms 2016-05-02T17:09:43.945+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:10:01.641+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:10:20.862+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 783ms 2016-05-02T17:10:22.909+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:10:38.749+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1639ms 2016-05-02T17:10:53.408+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 280ms 2016-05-02T17:10:59.542+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:11:23.051+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:11:52.447+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:12:07.950+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 285ms 2016-05-02T17:12:23.857+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 345ms 2016-05-02T17:12:33.527+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 236ms 2016-05-02T17:12:46.906+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:13:20.924+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:13:22.235+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5170, after asserts: 7790, after connections: 9190, after extra_info: 17120, after globalLock: 19770, after locks: 28300, after network: 29510, after opcounters: 31690, after opcountersRepl: 32050, after repl: 78550, after storageEngine: 84560, after tcmalloc: 94720, after wiredTiger: 112030, at end: 154790 } 2016-05-02T17:13:43.998+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:13:51.349+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 790ms 2016-05-02T17:14:11.494+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 479ms 2016-05-02T17:14:28.919+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 501ms 2016-05-02T17:14:44.731+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:15:20.840+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:15:39.939+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:15:40.594+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1019ms 2016-05-02T17:15:52.336+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 663ms 2016-05-02T17:16:00.510+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:16:06.358+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 272ms 2016-05-02T17:16:30.853+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:16:44.282+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:17:15.487+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:17:18.209+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 146ms 2016-05-02T17:17:30.688+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T17:17:31.951+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 113ms 2016-05-02T17:17:44.848+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3030, after asserts: 5930, after connections: 8340, after extra_info: 17120, after globalLock: 19910, after locks: 22170, after network: 26430, after opcounters: 27530, after opcountersRepl: 27760, after repl: 63460, after storageEngine: 70610, after tcmalloc: 75500, after wiredTiger: 90920, at end: 100070 } 2016-05-02T17:17:46.869+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 224ms 2016-05-02T17:17:51.822+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:18:30.506+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:19:05.032+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 335ms 2016-05-02T17:19:19.925+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 797ms 2016-05-02T17:19:19.925+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T17:19:34.761+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 348ms 2016-05-02T17:19:58.104+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:20:39.074+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 494ms 2016-05-02T17:20:45.937+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:20:45.544+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2711ms 2016-05-02T17:21:03.462+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 313ms 2016-05-02T17:21:17.441+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:21:57.347+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:22:18.509+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 368ms 2016-05-02T17:22:23.571+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:22:27.944+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 755ms 2016-05-02T17:22:34.088+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 244ms 2016-05-02T17:22:46.225+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:22:48.839+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5280, after asserts: 5660, after connections: 5990, after extra_info: 11720, after globalLock: 18870, after locks: 26260, after network: 31670, after opcounters: 32220, after opcountersRepl: 32220, after repl: 90610, after storageEngine: 96210, after tcmalloc: 105400, after wiredTiger: 122920, at end: 140030 } 2016-05-02T17:23:02.373+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:23:42.846+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:23:58.068+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3824ms 2016-05-02T17:24:11.475+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 309ms 2016-05-02T17:24:20.853+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 497ms 2016-05-02T17:24:22.823+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:24:37.188+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:25:21.591+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:25:38.603+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 8667ms 2016-05-02T17:25:58.527+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:25:58.784+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 951ms 2016-05-02T17:26:00.636+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 292ms 2016-05-02T17:26:10.400+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:26:45.020+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:27:08.210+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 567ms 2016-05-02T17:27:15.653+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 527ms 2016-05-02T17:27:32.011+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:27:33.109+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2560, after asserts: 4810, after connections: 5470, after extra_info: 13950, after globalLock: 16170, after locks: 17660, after network: 21040, after opcounters: 23210, after opcountersRepl: 24110, after repl: 57510, after storageEngine: 60550, after tcmalloc: 64590, after wiredTiger: 74030, at end: 94750 } 2016-05-02T17:28:04.108+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:28:37.713+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:28:37.713+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 304ms 2016-05-02T17:28:54.109+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 512ms 2016-05-02T17:28:58.939+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 237ms 2016-05-02T17:29:26.865+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:29:53.369+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:30:00.860+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 362ms 2016-05-02T17:30:18.939+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 410ms 2016-05-02T17:30:26.568+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1267ms 2016-05-02T17:30:26.918+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:31:25.362+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:31:54.280+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 175ms 2016-05-02T17:31:56.166+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:32:07.657+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2960, after asserts: 4620, after connections: 5100, after extra_info: 7910, after globalLock: 11980, after locks: 15320, after network: 15810, after opcounters: 15810, after opcountersRepl: 15810, after repl: 58910, after storageEngine: 62480, after tcmalloc: 69520, after wiredTiger: 86170, at end: 96010 } 2016-05-02T17:32:11.081+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1237ms 2016-05-02T17:32:16.403+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 180ms 2016-05-02T17:32:19.601+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:33:04.799+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:33:18.498+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:33:37.756+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 124ms 2016-05-02T17:33:48.981+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:33:55.567+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1833ms 2016-05-02T17:34:12.972+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 388ms 2016-05-02T17:34:21.802+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:34:53.794+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:35:26.255+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:35:33.772+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 700ms 2016-05-02T17:35:44.093+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 480ms 2016-05-02T17:36:02.965+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 109ms 2016-05-02T17:36:08.438+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:36:20.981+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T17:36:31.800+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 8050, after asserts: 10030, after connections: 12000, after extra_info: 18340, after globalLock: 27700, after locks: 33390, after network: 37060, after opcounters: 44220, after opcountersRepl: 45940, after repl: 101460, after storageEngine: 104820, after tcmalloc: 109510, after wiredTiger: 122730, at end: 138980 } 2016-05-02T17:36:44.641+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:37:14.568+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 413ms 2016-05-02T17:37:26.408+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 217ms 2016-05-02T17:37:39.694+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 946ms 2016-05-02T17:37:42.662+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:37:59.758+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:38:25.192+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:38:51.272+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 280ms 2016-05-02T17:39:01.233+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 446ms 2016-05-02T17:39:10.092+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 246ms 2016-05-02T17:39:17.718+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:39:47.426+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:40:20.766+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:40:32.696+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 495ms 2016-05-02T17:40:55.955+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:40:58.734+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 873ms 2016-05-02T17:41:15.163+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1487ms 2016-05-02T17:41:19.208+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:41:42.716+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5320, after asserts: 10100, after connections: 12570, after extra_info: 16940, after globalLock: 21630, after locks: 25330, after network: 27240, after opcounters: 27790, after opcountersRepl: 27790, after repl: 76480, after storageEngine: 81840, after tcmalloc: 94230, after wiredTiger: 115690, at end: 132790 } 2016-05-02T17:41:48.992+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:42:27.531+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:42:32.927+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1179ms 2016-05-02T17:42:44.275+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 311ms 2016-05-02T17:42:57.256+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 119ms 2016-05-02T17:43:08.353+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:43:39.372+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:44:16.418+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1960ms 2016-05-02T17:44:21.295+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:44:31.764+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 379ms 2016-05-02T17:44:40.695+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 137ms 2016-05-02T17:44:49.156+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:45:07.213+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:45:46.731+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:45:51.584+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 380ms 2016-05-02T17:46:10.296+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:46:15.486+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3537ms 2016-05-02T17:46:31.078+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 350ms 2016-05-02T17:46:34.764+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:46:43.661+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2480, after asserts: 5800, after connections: 14470, after extra_info: 19430, after globalLock: 27740, after locks: 31120, after network: 35670, after opcounters: 37730, after opcountersRepl: 39030, after repl: 80910, after storageEngine: 94250, after tcmalloc: 100320, after wiredTiger: 119620, at end: 126340 } 2016-05-02T17:47:09.549+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:47:48.171+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 555ms 2016-05-02T17:47:54.194+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:48:13.058+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 887ms 2016-05-02T17:48:29.401+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:48:38.055+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 328ms 2016-05-02T17:48:56.620+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:49:17.533+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T17:49:43.943+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 372ms 2016-05-02T17:49:44.685+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:49:53.072+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2542ms 2016-05-02T17:50:09.519+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:50:16.505+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 378ms 2016-05-02T17:50:35.430+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:50:56.443+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5540, after asserts: 10610, after connections: 16630, after extra_info: 22750, after globalLock: 30680, after locks: 33010, after network: 34510, after opcounters: 34510, after opcountersRepl: 34510, after repl: 63790, after storageEngine: 68070, after tcmalloc: 70650, after wiredTiger: 86300, at end: 99640 } 2016-05-02T17:51:16.949+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:51:25.594+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 841ms 2016-05-02T17:51:32.804+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 365ms 2016-05-02T17:51:50.058+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 317ms 2016-05-02T17:51:56.628+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:53:01.929+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:53:08.200+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 461ms 2016-05-02T17:53:23.267+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1370ms 2016-05-02T17:53:30.280+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:53:32.846+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 385ms 2016-05-02T17:53:54.101+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:54:35.084+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:54:45.315+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 340ms 2016-05-02T17:54:49.857+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:54:57.955+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 546ms 2016-05-02T17:55:10.642+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 953ms 2016-05-02T17:55:18.770+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:55:53.203+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4210, after asserts: 7360, after connections: 9650, after extra_info: 13710, after globalLock: 16580, after locks: 18600, after network: 18840, after opcounters: 18840, after opcountersRepl: 18840, after repl: 60770, after storageEngine: 63110, after tcmalloc: 64380, after wiredTiger: 72290, at end: 89020 } 2016-05-02T17:55:58.882+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:56:18.434+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:56:21.113+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 327ms 2016-05-02T17:56:35.712+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 273ms 2016-05-02T17:56:42.135+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:57:22.343+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:57:51.394+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:57:57.453+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 349ms 2016-05-02T17:58:08.928+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 493ms 2016-05-02T17:58:17.799+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:58:20.589+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 862ms 2016-05-02T17:58:46.057+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:59:25.606+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T17:59:39.365+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 173ms 2016-05-02T17:59:49.637+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 611ms 2016-05-02T17:59:51.906+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T17:59:53.399+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 200ms 2016-05-02T18:00:10.939+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:00:32.060+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2040, after asserts: 3190, after connections: 15740, after extra_info: 25450, after globalLock: 29660, after locks: 33530, after network: 34710, after opcounters: 34710, after opcountersRepl: 34710, after repl: 72380, after storageEngine: 76740, after tcmalloc: 80320, after wiredTiger: 89370, at end: 105900 } 2016-05-02T18:00:55.708+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 355ms 2016-05-02T18:00:55.493+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:01:05.407+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 562ms 2016-05-02T18:01:23.502+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T18:01:42.816+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:02:16.550+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:02:20.421+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 347ms 2016-05-02T18:02:31.157+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 227ms 2016-05-02T18:02:36.331+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:02:40.710+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 199ms 2016-05-02T18:03:02.818+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:03:50.609+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 287ms 2016-05-02T18:03:50.542+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:03:58.303+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 127ms 2016-05-02T18:04:02.850+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:04:06.903+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 436ms 2016-05-02T18:04:18.256+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:04:49.908+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5020, after asserts: 8470, after connections: 9890, after extra_info: 18180, after globalLock: 23410, after locks: 26300, after network: 28460, after opcounters: 29370, after opcountersRepl: 29370, after repl: 71110, after storageEngine: 76500, after tcmalloc: 85810, after wiredTiger: 98650, at end: 116650 } 2016-05-02T18:04:50.327+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:05:12.534+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:05:20.939+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 125ms 2016-05-02T18:05:40.040+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 349ms 2016-05-02T18:05:48.110+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:05:55.105+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 212ms 2016-05-02T18:06:51.052+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:07:08.903+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 249ms 2016-05-02T18:07:17.850+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T18:07:19.992+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 552ms 2016-05-02T18:07:35.716+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:07:36.132+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 345ms 2016-05-02T18:08:08.071+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:08:36.944+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:08:55.199+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 447ms 2016-05-02T18:09:15.523+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 716ms 2016-05-02T18:09:19.491+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:09:30.294+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 313ms 2016-05-02T18:10:06.391+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:10:19.714+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2000, after asserts: 2600, after connections: 5570, after extra_info: 18740, after globalLock: 23740, after locks: 32470, after network: 33070, after opcounters: 33070, after opcountersRepl: 33070, after repl: 87520, after storageEngine: 96020, after tcmalloc: 108200, after wiredTiger: 125620, at end: 145970 } 2016-05-02T18:10:28.217+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:10:37.358+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 164ms 2016-05-02T18:10:36.438+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:10:46.558+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 990ms 2016-05-02T18:11:00.952+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 190ms 2016-05-02T18:11:52.024+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:12:03.892+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 141ms 2016-05-02T18:12:04.772+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:12:20.979+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 171ms 2016-05-02T18:12:39.289+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 948ms 2016-05-02T18:12:41.778+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:13:21.806+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:13:35.394+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:14:05.368+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 144ms 2016-05-02T18:14:04.902+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:14:20.581+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 296ms 2016-05-02T18:14:37.835+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3170, after asserts: 6060, after connections: 7090, after extra_info: 8340, after globalLock: 9190, after locks: 13890, after network: 14620, after opcounters: 14620, after opcountersRepl: 14620, after repl: 46110, after storageEngine: 50060, after tcmalloc: 51440, after wiredTiger: 63210, at end: 78170 } 2016-05-02T18:14:38.411+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 735ms 2016-05-02T18:14:41.499+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:14:53.786+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:15:24.337+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:15:45.730+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 129ms 2016-05-02T18:16:01.581+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 407ms 2016-05-02T18:16:02.386+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 107ms 2016-05-02T18:16:26.633+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:16:58.220+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T18:17:06.346+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 605ms 2016-05-02T18:17:29.467+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2827ms 2016-05-02T18:17:39.054+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:18:18.513+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:18:45.979+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 287ms 2016-05-02T18:18:49.808+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:18:54.731+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 249ms 2016-05-02T18:19:09.025+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 573ms 2016-05-02T18:19:12.039+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:19:55.515+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:20:22.922+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3800, after asserts: 11960, after connections: 17060, after extra_info: 26370, after globalLock: 28650, after locks: 35530, after network: 40740, after opcounters: 48400, after opcountersRepl: 49230, after repl: 112040, after storageEngine: 116180, after tcmalloc: 123710, after wiredTiger: 130960, at end: 145630 } 2016-05-02T18:20:26.286+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:20:32.064+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 296ms 2016-05-02T18:20:40.567+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 139ms 2016-05-02T18:20:51.235+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:20:51.942+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 126ms 2016-05-02T18:21:31.631+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:22:11.257+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2666ms 2016-05-02T18:22:11.257+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:22:21.003+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1141ms 2016-05-02T18:22:38.315+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 339ms 2016-05-02T18:22:49.191+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:23:36.656+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:23:54.572+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 545ms 2016-05-02T18:24:00.777+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T18:24:02.097+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 436ms 2016-05-02T18:24:19.538+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1333ms 2016-05-02T18:24:26.508+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:24:46.328+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3810, after asserts: 5870, after connections: 9530, after extra_info: 18130, after globalLock: 22990, after locks: 26840, after network: 32310, after opcounters: 33410, after opcountersRepl: 33410, after repl: 65640, after storageEngine: 83070, after tcmalloc: 94570, after wiredTiger: 109190, at end: 125670 } 2016-05-02T18:25:06.543+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:25:36.219+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:25:44.933+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 4302ms 2016-05-02T18:26:02.455+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2078ms 2016-05-02T18:26:11.173+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:26:17.516+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 306ms 2016-05-02T18:27:16.428+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:27:23.577+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 350ms 2016-05-02T18:27:37.865+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:27:39.229+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1123ms 2016-05-02T18:27:48.108+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 308ms 2016-05-02T18:28:08.613+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:28:45.489+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:29:08.954+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 388ms 2016-05-02T18:29:18.788+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T18:29:19.400+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 127ms 2016-05-02T18:29:35.108+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:30:09.257+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:30:12.304+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5730, after asserts: 7520, after connections: 8740, after extra_info: 20190, after globalLock: 25220, after locks: 28700, after network: 32740, after opcounters: 33220, after opcountersRepl: 33220, after repl: 62150, after storageEngine: 67990, after tcmalloc: 82450, after wiredTiger: 92510, at end: 119630 } 2016-05-02T18:30:24.423+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:30:31.700+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 305ms 2016-05-02T18:30:41.563+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1120ms 2016-05-02T18:30:44.927+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:30:53.897+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 484ms 2016-05-02T18:31:43.500+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:32:04.104+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 330ms 2016-05-02T18:32:19.385+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1172ms 2016-05-02T18:32:28.840+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:32:58.757+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:33:24.495+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:33:39.466+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 334ms 2016-05-02T18:33:52.259+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 258ms 2016-05-02T18:34:11.591+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:34:13.231+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 135ms 2016-05-02T18:34:33.370+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:34:55.570+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:34:56.787+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4960, after asserts: 6090, after connections: 7780, after extra_info: 10810, after globalLock: 10960, after locks: 19950, after network: 22360, after opcounters: 24610, after opcountersRepl: 25700, after repl: 68140, after storageEngine: 76330, after tcmalloc: 81970, after wiredTiger: 92050, at end: 107510 } 2016-05-02T18:35:36.006+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 246ms 2016-05-02T18:35:39.856+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:35:56.656+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 880ms 2016-05-02T18:36:19.222+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 228ms 2016-05-02T18:36:34.559+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:37:06.459+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:37:37.883+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 241ms 2016-05-02T18:37:47.159+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:37:52.616+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 769ms 2016-05-02T18:38:10.080+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2215ms 2016-05-02T18:38:10.580+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:38:35.039+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:39:23.456+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 418ms 2016-05-02T18:39:23.456+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:39:34.431+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 472ms 2016-05-02T18:39:44.452+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:39:45.703+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3930, after asserts: 8220, after connections: 14340, after extra_info: 25120, after globalLock: 27750, after locks: 29650, after network: 31080, after opcounters: 33280, after opcountersRepl: 35780, after repl: 65130, after storageEngine: 76840, after tcmalloc: 83150, after wiredTiger: 95900, at end: 110830 } 2016-05-02T18:39:49.190+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 273ms 2016-05-02T18:40:02.904+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:40:54.280+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:40:55.747+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 380ms 2016-05-02T18:41:15.314+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1039ms 2016-05-02T18:41:21.781+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:41:26.239+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 512ms 2016-05-02T18:41:41.191+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:42:20.146+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:42:33.999+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:42:40.995+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T18:42:51.362+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:43:34.261+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:43:44.213+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 146ms 2016-05-02T18:43:54.358+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:43:57.439+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 504ms 2016-05-02T18:44:09.705+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 316ms 2016-05-02T18:44:09.888+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:44:34.758+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:44:39.840+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3110, after asserts: 3220, after connections: 3490, after extra_info: 5060, after globalLock: 6440, after locks: 13660, after network: 18230, after opcounters: 20270, after opcountersRepl: 22980, after repl: 55810, after storageEngine: 62310, after tcmalloc: 69340, after wiredTiger: 80660, at end: 99080 } 2016-05-02T18:44:51.872+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:45:08.249+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:45:20.420+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 442ms 2016-05-02T18:45:44.832+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:46:11.219+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:46:37.524+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 650ms 2016-05-02T18:46:47.264+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 170ms 2016-05-02T18:46:54.371+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:47:36.165+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:48:02.528+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 317ms 2016-05-02T18:48:03.747+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:48:10.859+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 370ms 2016-05-02T18:48:23.273+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:48:59.950+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:49:14.785+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 708ms 2016-05-02T18:49:16.372+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5480, after asserts: 7840, after connections: 10070, after extra_info: 17940, after globalLock: 23140, after locks: 27430, after network: 29860, after opcounters: 30920, after opcountersRepl: 30920, after repl: 75320, after storageEngine: 78600, after tcmalloc: 88340, after wiredTiger: 97900, at end: 121780 } 2016-05-02T18:49:34.278+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T18:49:32.138+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 781ms 2016-05-02T18:49:54.594+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:49:58.633+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 405ms 2016-05-02T18:50:55.645+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:51:15.194+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 238ms 2016-05-02T18:51:24.810+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:51:30.912+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 286ms 2016-05-02T18:51:44.654+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 184ms 2016-05-02T18:51:52.599+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:52:35.983+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:52:57.353+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 486ms 2016-05-02T18:52:58.106+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:53:06.143+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 168ms 2016-05-02T18:53:17.157+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:53:22.368+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 367ms 2016-05-02T18:53:27.122+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2690, after asserts: 5400, after connections: 8270, after extra_info: 15530, after globalLock: 20750, after locks: 23260, after network: 26500, after opcounters: 27070, after opcountersRepl: 27070, after repl: 56460, after storageEngine: 60070, after tcmalloc: 67650, after wiredTiger: 82830, at end: 101980 } 2016-05-02T18:53:44.687+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:54:12.266+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:54:35.602+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 674ms 2016-05-02T18:54:46.853+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 697ms 2016-05-02T18:55:04.327+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2277ms 2016-05-02T18:55:04.721+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:56:06.156+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:56:20.775+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 460ms 2016-05-02T18:56:36.650+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 596ms 2016-05-02T18:56:40.354+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:56:50.594+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 356ms 2016-05-02T18:57:06.330+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:57:39.128+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:58:04.552+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T18:58:13.908+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 323ms 2016-05-02T18:58:20.967+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4700, after asserts: 6450, after connections: 8640, after extra_info: 12470, after globalLock: 15840, after locks: 20290, after network: 24090, after opcounters: 26220, after opcountersRepl: 27040, after repl: 67330, after storageEngine: 71520, after tcmalloc: 79940, after wiredTiger: 102480, at end: 117090 } 2016-05-02T18:58:26.861+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:58:31.155+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 234ms 2016-05-02T18:58:36.359+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 475ms 2016-05-02T18:58:59.892+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:59:36.994+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T18:59:54.044+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 218ms 2016-05-02T19:00:00.256+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T19:00:05.153+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1365ms 2016-05-02T19:00:24.335+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 269ms 2016-05-02T19:00:32.634+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:00:54.858+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:01:09.908+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:01:39.640+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 310ms 2016-05-02T19:01:40.333+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T19:01:49.284+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 803ms 2016-05-02T19:01:55.299+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:02:03.215+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 283ms 2016-05-02T19:02:33.891+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:02:57.210+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T19:03:05.958+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2360, after asserts: 4780, after connections: 12040, after extra_info: 24650, after globalLock: 37590, after locks: 41310, after network: 45870, after opcounters: 48400, after opcountersRepl: 51170, after repl: 87790, after storageEngine: 91500, after tcmalloc: 100350, after wiredTiger: 111950, at end: 123400 } 2016-05-02T19:03:13.023+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 871ms 2016-05-02T19:03:22.563+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:03:23.499+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 508ms 2016-05-02T19:03:45.801+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 352ms 2016-05-02T19:04:20.645+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:04:49.793+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T19:04:56.986+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 245ms 2016-05-02T19:05:10.147+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 183ms 2016-05-02T19:05:14.873+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:05:23.941+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 173ms 2016-05-02T19:05:51.772+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:06:16.873+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T19:06:36.167+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1319ms 2016-05-02T19:06:44.227+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:06:50.262+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 708ms 2016-05-02T19:07:06.938+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:07:07.208+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 175ms 2016-05-02T19:07:23.108+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T19:07:54.134+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4070, after asserts: 5230, after connections: 8420, after extra_info: 19420, after globalLock: 25470, after locks: 29000, after network: 33810, after opcounters: 36120, after opcountersRepl: 36200, after repl: 82390, after storageEngine: 94570, after tcmalloc: 99770, after wiredTiger: 120900, at end: 144310 } 2016-05-02T19:08:08.772+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:08:20.731+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 118ms 2016-05-02T19:08:38.734+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 605ms 2016-05-02T19:08:42.663+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:08:58.621+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1740ms 2016-05-02T19:09:40.135+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T19:10:25.640+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 155ms 2016-05-02T19:10:42.144+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:10:51.812+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 677ms 2016-05-02T19:11:05.139+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 421ms 2016-05-02T19:11:44.484+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:12:20.972+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T19:12:26.304+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 296ms 2016-05-02T19:12:37.170+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 790ms 2016-05-02T19:12:48.620+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 308ms 2016-05-02T19:12:51.471+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:13:28.955+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:13:50.263+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2860, after asserts: 7290, after connections: 13150, after extra_info: 19480, after globalLock: 23730, after locks: 27670, after network: 29120, after opcounters: 30690, after opcountersRepl: 30690, after repl: 77140, after storageEngine: 81190, after tcmalloc: 84930, after wiredTiger: 98670, at end: 109800 } 2016-05-02T19:14:02.225+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T19:14:01.401+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 280ms 2016-05-02T19:14:18.797+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 451ms 2016-05-02T19:14:27.677+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:14:27.963+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 186ms 2016-05-02T19:15:42.456+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 184ms 2016-05-02T19:15:42.456+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:15:50.739+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 916ms 2016-05-02T19:16:07.036+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T19:16:51.528+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:17:10.488+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 512ms 2016-05-02T19:17:31.302+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1677ms 2016-05-02T19:17:49.043+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 921ms 2016-05-02T19:18:07.118+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:18:54.861+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 156ms 2016-05-02T19:18:57.691+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T19:19:10.349+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 286ms 2016-05-02T19:19:21.461+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:19:26.655+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1650ms 2016-05-02T19:19:44.733+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4090, after asserts: 5580, after connections: 6850, after extra_info: 13080, after globalLock: 19690, after locks: 24760, after network: 26310, after opcounters: 28650, after opcountersRepl: 30750, after repl: 77070, after storageEngine: 81170, after tcmalloc: 89330, after wiredTiger: 100620, at end: 118040 } 2016-05-02T19:20:28.316+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:20:48.469+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 698ms 2016-05-02T19:21:11.122+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2430ms 2016-05-02T19:21:29.952+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 798ms 2016-05-02T19:22:01.564+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T19:22:42.589+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 110ms 2016-05-02T19:22:51.024+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:23:14.947+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 693ms 2016-05-02T19:23:44.361+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1528ms 2016-05-02T19:24:23.182+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:25:08.113+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1568ms 2016-05-02T19:25:15.178+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T19:25:33.301+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2340ms 2016-05-02T19:25:52.550+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 675ms 2016-05-02T19:26:05.784+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:27:05.028+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:27:14.004+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 373ms 2016-05-02T19:27:37.375+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1588ms 2016-05-02T19:28:00.337+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2651ms 2016-05-02T19:28:10.599+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3610, after asserts: 6220, after connections: 12270, after extra_info: 19660, after globalLock: 24770, after locks: 28870, after network: 34200, after opcounters: 34830, after opcountersRepl: 34830, after repl: 101180, after storageEngine: 111440, after tcmalloc: 121030, after wiredTiger: 147950, at end: 169960 } 2016-05-02T19:28:13.647+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T19:28:47.495+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:29:19.296+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 382ms 2016-05-02T19:29:40.400+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1581ms 2016-05-02T19:30:03.559+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 823ms 2016-05-02T19:30:50.863+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:31:30.506+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 563ms 2016-05-02T19:31:40.413+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T19:31:44.860+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1057ms 2016-05-02T19:32:12.171+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:32:15.160+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 972ms 2016-05-02T19:33:40.410+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 352ms 2016-05-02T19:33:51.657+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:34:13.486+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2565ms 2016-05-02T19:34:39.585+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 797ms 2016-05-02T19:34:39.585+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T19:35:36.390+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:36:04.660+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 766ms 2016-05-02T19:36:25.786+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 793ms 2016-05-02T19:36:47.448+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 412ms 2016-05-02T19:37:33.488+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:38:05.963+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3680, after asserts: 7050, after connections: 11560, after extra_info: 21720, after globalLock: 24410, after locks: 29250, after network: 30990, after opcounters: 34370, after opcountersRepl: 36130, after repl: 128610, after storageEngine: 141400, after tcmalloc: 155580, after wiredTiger: 183090, at end: 194530 } 2016-05-02T19:38:06.998+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1650ms 2016-05-02T19:38:13.743+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T19:38:34.199+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3412ms 2016-05-02T19:38:57.499+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 447ms 2016-05-02T19:39:00.899+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:40:19.441+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 262ms 2016-05-02T19:40:37.582+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:40:36.858+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3037ms 2016-05-02T19:41:02.078+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 455ms 2016-05-02T19:41:12.040+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T19:41:44.777+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:42:26.385+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1163ms 2016-05-02T19:42:40.628+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:42:46.196+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1460ms 2016-05-02T19:43:09.122+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T19:43:41.695+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:44:03.317+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 542ms 2016-05-02T19:44:24.058+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2200ms 2016-05-02T19:44:49.112+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 722ms 2016-05-02T19:44:56.013+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:45:05.807+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4360, after asserts: 6500, after connections: 13230, after extra_info: 20080, after globalLock: 23370, after locks: 26220, after network: 28790, after opcounters: 30460, after opcountersRepl: 30460, after repl: 86710, after storageEngine: 92100, after tcmalloc: 96770, after wiredTiger: 111330, at end: 133840 } 2016-05-02T19:45:19.433+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T19:46:04.920+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1991ms 2016-05-02T19:46:04.455+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:46:24.410+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1780ms 2016-05-02T19:46:49.856+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1480ms 2016-05-02T19:47:43.100+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:48:05.703+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 972ms 2016-05-02T19:48:17.831+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 727ms 2016-05-02T19:48:30.174+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T19:48:34.495+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 295ms 2016-05-02T19:49:11.790+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:49:54.027+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 321ms 2016-05-02T19:50:07.704+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:50:16.124+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3881ms 2016-05-02T19:50:34.111+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 378ms 2016-05-02T19:50:47.442+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T19:51:11.290+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:51:24.989+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3200, after asserts: 5110, after connections: 9930, after extra_info: 17480, after globalLock: 20180, after locks: 23630, after network: 25610, after opcounters: 25680, after opcountersRepl: 25680, after repl: 75230, after storageEngine: 80280, after tcmalloc: 87150, after wiredTiger: 98180, at end: 113040 } 2016-05-02T19:51:57.080+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 324ms 2016-05-02T19:52:14.299+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1149ms 2016-05-02T19:52:17.679+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:52:53.408+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T19:53:15.577+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:53:26.535+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 218ms 2016-05-02T19:53:40.845+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1399ms 2016-05-02T19:53:57.137+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:53:57.502+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 777ms 2016-05-02T19:54:28.089+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T19:55:07.229+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:55:18.967+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 339ms 2016-05-02T19:55:37.115+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2410ms 2016-05-02T19:55:51.156+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 311ms 2016-05-02T19:56:06.869+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:56:45.230+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T19:56:59.997+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4260, after asserts: 7050, after connections: 12800, after extra_info: 20810, after globalLock: 25660, after locks: 28880, after network: 31550, after opcounters: 32890, after opcountersRepl: 33090, after repl: 73360, after storageEngine: 79050, after tcmalloc: 83140, after wiredTiger: 95610, at end: 111530 } 2016-05-02T19:57:11.348+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 492ms 2016-05-02T19:57:26.155+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:57:31.629+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1569ms 2016-05-02T19:57:54.820+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 194ms 2016-05-02T19:59:06.444+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 452ms 2016-05-02T19:59:07.046+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T19:59:25.735+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1643ms 2016-05-02T19:59:42.016+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 306ms 2016-05-02T19:59:46.081+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T20:00:14.495+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:00:55.612+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2042ms 2016-05-02T20:01:08.524+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:01:17.775+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1516ms 2016-05-02T20:01:40.421+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1553ms 2016-05-02T20:01:52.255+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T20:02:33.652+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:03:03.278+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1462ms 2016-05-02T20:03:23.337+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 624ms 2016-05-02T20:03:40.119+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:03:47.394+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 260ms 2016-05-02T20:04:04.893+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3490, after asserts: 6370, after connections: 11680, after extra_info: 19730, after globalLock: 21910, after locks: 22550, after network: 24890, after opcounters: 26290, after opcountersRepl: 26410, after repl: 86500, after storageEngine: 91080, after tcmalloc: 98340, after wiredTiger: 114040, at end: 126410 } 2016-05-02T20:04:15.577+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T20:04:45.643+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:05:04.724+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 166ms 2016-05-02T20:05:22.680+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1796ms 2016-05-02T20:05:38.374+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 208ms 2016-05-02T20:05:56.731+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:06:16.940+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T20:06:47.937+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:06:52.238+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 227ms 2016-05-02T20:07:04.860+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1373ms 2016-05-02T20:07:15.172+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1607ms 2016-05-02T20:07:36.255+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:08:16.955+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T20:08:41.891+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1216ms 2016-05-02T20:09:02.506+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:09:12.325+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2838ms 2016-05-02T20:09:27.662+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 324ms 2016-05-02T20:10:09.296+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:10:38.868+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3940, after asserts: 7350, after connections: 11030, after extra_info: 16740, after globalLock: 20440, after locks: 26850, after network: 30310, after opcounters: 31720, after opcountersRepl: 31720, after repl: 104510, after storageEngine: 109820, after tcmalloc: 113210, after wiredTiger: 147000, at end: 157170 } 2016-05-02T20:10:43.367+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 482ms 2016-05-02T20:10:48.067+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T20:11:02.210+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3491ms 2016-05-02T20:11:15.168+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1281ms 2016-05-02T20:11:15.168+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:12:30.527+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 224ms 2016-05-02T20:12:41.760+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1930ms 2016-05-02T20:12:41.760+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:13:07.086+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T20:13:42.168+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:13:45.868+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 289ms 2016-05-02T20:13:58.933+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 191ms 2016-05-02T20:14:29.894+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:14:53.663+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T20:15:12.223+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1005ms 2016-05-02T20:15:18.767+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:15:29.105+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 360ms 2016-05-02T20:15:55.208+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 137ms 2016-05-02T20:16:17.323+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2200, after asserts: 5220, after connections: 9360, after extra_info: 13720, after globalLock: 17210, after locks: 20680, after network: 22580, after opcounters: 22880, after opcountersRepl: 22880, after repl: 52270, after storageEngine: 56790, after tcmalloc: 62010, after wiredTiger: 77810, at end: 117660 } 2016-05-02T20:16:19.430+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:16:55.042+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T20:17:20.954+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 317ms 2016-05-02T20:17:34.146+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:17:47.107+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1609ms 2016-05-02T20:18:02.435+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 271ms 2016-05-02T20:19:17.158+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1231ms 2016-05-02T20:19:25.611+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:19:42.949+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3050ms 2016-05-02T20:20:06.727+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 251ms 2016-05-02T20:20:16.160+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T20:21:22.449+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 367ms 2016-05-02T20:21:23.036+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:21:47.863+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 424ms 2016-05-02T20:22:33.323+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1639ms 2016-05-02T20:22:51.536+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:23:47.609+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T20:24:00.086+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1677ms 2016-05-02T20:24:09.769+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1618ms 2016-05-02T20:24:32.497+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:24:34.805+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2063ms 2016-05-02T20:24:39.256+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4650, after asserts: 8050, after connections: 12980, after extra_info: 20240, after globalLock: 25240, after locks: 33120, after network: 34990, after opcounters: 34990, after opcountersRepl: 34990, after repl: 88090, after storageEngine: 93600, after tcmalloc: 99290, after wiredTiger: 126780, at end: 135350 } 2016-05-02T20:25:52.201+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:25:58.678+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 494ms 2016-05-02T20:26:29.086+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1047ms 2016-05-02T20:27:00.638+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 963ms 2016-05-02T20:27:39.162+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T20:28:15.957+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:28:16.098+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 261ms 2016-05-02T20:28:44.702+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 563ms 2016-05-02T20:29:15.812+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 603ms 2016-05-02T20:30:02.455+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:30:38.839+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 633ms 2016-05-02T20:31:01.142+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T20:31:07.512+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1239ms 2016-05-02T20:31:33.525+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 815ms 2016-05-02T20:31:53.538+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:32:58.504+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 354ms 2016-05-02T20:33:21.356+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2745ms 2016-05-02T20:33:33.117+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:33:44.211+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 3435ms 2016-05-02T20:34:26.746+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T20:34:51.905+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3580, after asserts: 4770, after connections: 11630, after extra_info: 20880, after globalLock: 24820, after locks: 30890, after network: 35080, after opcounters: 39110, after opcountersRepl: 40290, after repl: 111630, after storageEngine: 117550, after tcmalloc: 128170, after wiredTiger: 183430, at end: 210850 } 2016-05-02T20:35:06.690+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 145ms 2016-05-02T20:35:06.690+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:35:27.273+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1437ms 2016-05-02T20:35:45.843+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 325ms 2016-05-02T20:36:58.356+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:37:02.564+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 517ms 2016-05-02T20:37:10.271+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 697ms 2016-05-02T20:37:32.630+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1761ms 2016-05-02T20:37:34.050+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T20:38:11.284+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:38:51.969+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 478ms 2016-05-02T20:39:06.670+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:39:07.043+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1563ms 2016-05-02T20:39:29.018+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 854ms 2016-05-02T20:39:48.437+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T20:40:26.061+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:40:48.322+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 415ms 2016-05-02T20:41:02.697+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1742ms 2016-05-02T20:41:15.518+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 2250, after asserts: 4020, after connections: 6960, after extra_info: 14140, after globalLock: 18520, after locks: 22400, after network: 24710, after opcounters: 25340, after opcountersRepl: 25340, after repl: 82910, after storageEngine: 87600, after tcmalloc: 91150, after wiredTiger: 103710, at end: 117750 } 2016-05-02T20:41:19.780+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:41:23.633+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 138ms 2016-05-02T20:41:46.283+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T20:42:32.976+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:42:37.001+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 231ms 2016-05-02T20:43:05.669+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1520ms 2016-05-02T20:43:25.623+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 273ms 2016-05-02T20:44:01.713+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:44:38.992+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T20:44:49.044+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1501ms 2016-05-02T20:45:10.337+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 413ms 2016-05-02T20:45:17.609+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:46:28.870+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1308ms 2016-05-02T20:46:38.743+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:46:52.677+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1493ms 2016-05-02T20:47:22.450+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 513ms 2016-05-02T20:47:26.598+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T20:48:06.900+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:48:42.541+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 962ms 2016-05-02T20:48:45.424+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 4060, after asserts: 6230, after connections: 13850, after extra_info: 21480, after globalLock: 25820, after locks: 29030, after network: 30410, after opcounters: 32080, after opcountersRepl: 32080, after repl: 97830, after storageEngine: 103270, after tcmalloc: 108420, after wiredTiger: 138420, at end: 155550 } 2016-05-02T20:49:06.047+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2230ms 2016-05-02T20:49:06.047+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:49:22.941+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 368ms 2016-05-02T20:49:52.715+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T20:50:44.250+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1435ms 2016-05-02T20:51:13.836+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 677ms 2016-05-02T20:51:13.836+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:51:34.093+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 407ms 2016-05-02T20:52:28.923+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:52:59.927+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 378ms 2016-05-02T20:53:14.277+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T20:53:22.518+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 588ms 2016-05-02T20:53:43.953+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 861ms 2016-05-02T20:53:51.389+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:54:58.018+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:55:02.326+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 650ms 2016-05-02T20:55:30.794+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2092ms 2016-05-02T20:55:53.432+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 644ms 2016-05-02T20:56:01.720+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T20:56:44.502+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:56:58.030+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5110, after asserts: 7800, after connections: 11540, after extra_info: 15560, after globalLock: 17940, after locks: 18590, after network: 23920, after opcounters: 27110, after opcountersRepl: 28430, after repl: 93620, after storageEngine: 100560, after tcmalloc: 112590, after wiredTiger: 137970, at end: 149580 } 2016-05-02T20:57:20.440+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 404ms 2016-05-02T20:57:39.936+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1358ms 2016-05-02T20:57:58.402+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T20:58:04.350+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 450ms 2016-05-02T20:59:29.203+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T20:59:36.928+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 554ms 2016-05-02T21:00:00.407+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1471ms 2016-05-02T21:00:14.341+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 217ms 2016-05-02T21:00:24.285+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T21:01:27.450+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T21:01:37.162+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2292ms 2016-05-02T21:01:48.805+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1891ms 2016-05-02T21:02:01.720+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T21:02:06.108+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 136ms 2016-05-02T21:02:42.696+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T21:03:29.249+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 736ms 2016-05-02T21:03:55.563+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T21:03:58.770+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1349ms 2016-05-02T21:04:27.911+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T21:04:43.641+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 5080, after asserts: 6600, after connections: 9560, after extra_info: 14850, after globalLock: 19010, after locks: 24570, after network: 26490, after opcounters: 26490, after opcountersRepl: 26490, after repl: 79950, after storageEngine: 82930, after tcmalloc: 87390, after wiredTiger: 99230, at end: 114570 } 2016-05-02T21:05:00.128+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T21:05:11.929+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1697ms 2016-05-02T21:05:33.212+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 923ms 2016-05-02T21:05:51.907+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 260ms 2016-05-02T21:06:28.218+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T21:07:01.140+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T21:07:09.749+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 364ms 2016-05-02T21:07:27.699+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1467ms 2016-05-02T21:07:27.520+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T21:08:43.674+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T21:08:47.811+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 247ms 2016-05-02T21:09:01.791+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 2626ms 2016-05-02T21:09:12.293+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T21:09:17.372+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 230ms 2016-05-02T21:09:33.797+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T21:10:43.127+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1075ms 2016-05-02T21:11:07.217+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T21:11:07.694+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 3283ms 2016-05-02T21:11:46.405+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; HostUnreachable: HostUnreachable 2016-05-02T21:12:07.502+0000 I COMMAND [ftdc] serverStatus was very slow: { after basic: 3590, after asserts: 5570, after connections: 7840, after extra_info: 14810, after globalLock: 18370, after locks: 23670, after network: 25230, after opcounters: 26190, after opcountersRepl: 26190, after repl: 82930, after storageEngine: 87210, after tcmalloc: 91680, after wiredTiger: 133960, at end: 161270 } 2016-05-02T21:12:45.655+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T21:12:45.655+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1995ms 2016-05-02T21:13:16.748+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1541ms 2016-05-02T21:13:49.251+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 479ms 2016-05-02T21:14:23.257+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T21:15:13.684+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1724ms 2016-05-02T21:15:16.850+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T21:15:38.868+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 1672ms 2016-05-02T21:16:09.757+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T21:17:06.893+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 2303ms 2016-05-02T21:17:44.488+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T21:17:51.843+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 1252ms 2016-05-02T21:18:21.908+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 506ms 2016-05-02T21:18:43.865+0000 I REPL [ReplicationExecutor] Error in heartbeat request to localhost:27015; ExceededTimeLimit: Couldn't get a connection within the time limit 2016-05-02T21:20:02.138+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 367ms 2016-05-02T21:20:04.192+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T21:20:24.595+0000 I COMMAND [PeriodicTaskRunner] task: UnusedLockCleaner took: 895ms 2016-05-02T21:21:07.049+0000 I COMMAND [PeriodicTaskRunner] task: DBConnectionPool-cleaner took: 530ms 2016-05-02T21:21:55.471+0000 I REPL [ReplicationExecutor] Not starting an election, since we are not electable 2016-05-02T21:24:30.713+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-05-02T21:24:31.066+0000 I CONTROL [initandlisten] MongoDB starting : pid=1065 port=27016 dbpath=/var/lib/mongodb-replica/mongodbreplica2 64-bit host=ip-172-31-6-169 2016-05-02T21:24:31.066+0000 I CONTROL [initandlisten] db version v3.2.5 2016-05-02T21:24:31.066+0000 I CONTROL [initandlisten] git version: 34e65e5383f7ea1726332cb175b73077ec4a1b02 2016-05-02T21:24:31.066+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014 2016-05-02T21:24:31.066+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-05-02T21:24:31.066+0000 I CONTROL [initandlisten] modules: none 2016-05-02T21:24:31.066+0000 I CONTROL [initandlisten] build environment: 2016-05-02T21:24:31.066+0000 I CONTROL [initandlisten] distmod: ubuntu1404 2016-05-02T21:24:31.066+0000 I CONTROL [initandlisten] distarch: x86_64 2016-05-02T21:24:31.066+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-05-02T21:24:31.066+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb.d/mongodbreplica2.conf", net: { bindIp: "127.0.0.1", http: { RESTInterfaceEnabled: true, enabled: true }, port: 27016 }, processManagement: { pidFilePath: "/var/run/mongodb-replica/mongodbreplica2.pid" }, replication: { oplogSizeMB: 128, replSet: "mongodbreplica" }, storage: { dbPath: "/var/lib/mongodb-replica/mongodbreplica2", mmapv1: { smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb-replica/mongodbreplica2.log" } } 2016-05-02T21:24:31.341+0000 I - [initandlisten] Detected data files in /var/lib/mongodb-replica/mongodbreplica2 created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2016-05-02T21:24:31.363+0000 W - [initandlisten] Detected unclean shutdown - /var/lib/mongodb-replica/mongodbreplica2/mongod.lock is not empty. 2016-05-02T21:24:31.363+0000 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2016-05-02T21:24:31.363+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-05-02T21:24:33.658+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-05-02T21:24:33.658+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 817834 records totaling to 2937930670 bytes 2016-05-02T21:24:33.686+0000 I STORAGE [initandlisten] Sampling from the oplog between Apr 23 04:15:56:1 and May 2 06:29:36:1 to determine where to place markers for truncation 2016-05-02T21:24:33.686+0000 I STORAGE [initandlisten] Taking 1009 samples and assuming that each section of oplog contains approximately 8100 records totaling to 29097883 bytes 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 06:07:06:1 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 08:03:09:2 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 09:31:51:2 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 11:03:04:1 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 12:16:45:2 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 13:36:53:1 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 15:10:58:1 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 16:21:07:1 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 17:47:49:1 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 20:11:03:3 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 22:07:45:3 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 23:28:54:2 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 01:43:45:3 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 03:38:21:1 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 04:51:54:1 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 06:14:56:3 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 07:25:57:2 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 08:31:02:1 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 09:55:59:2 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 11:03:04:1 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 12:14:45:4 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 13:43:07:2 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 15:22:45:4 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 17:31:45:3 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 19:16:01:1 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 20:50:08:2 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 22:14:45:5 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 25 00:27:45:5 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 25 02:30:39:2 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 25 04:10:45:3 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 25 05:56:56:6 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 25 18:51:01:1 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 25 21:14:28:2 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 25 23:49:00:4 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 01:28:05:2 2016-05-02T21:24:54.794+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 03:08:30:1 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 05:35:45:3 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 07:17:07:1 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 08:49:13:1 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 10:21:03:2 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 11:43:06:1 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 13:13:07:2 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 15:37:45:5 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 19:12:49:1 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 22:07:00:1 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 00:59:45:5 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 03:02:45:3 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 05:06:23:2 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 07:26:06:2 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 08:51:03:1 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 10:17:45:2 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 11:58:45:5 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 13:15:10:1 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 15:28:51:2 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 18:58:45:3 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 21:40:45:4 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 23:45:25:2 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 28 02:16:34:2 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 28 04:27:45:2 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 28 06:43:49:9 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 28 08:45:45:4 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 28 10:24:11:2 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 28 11:54:06:1 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 28 13:56:17:1 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 28 16:24:19:5 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 28 19:05:46:1 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 28 22:53:07:2 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 01:01:33:1 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 02:50:17:2 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 05:36:09:2 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 07:14:02:1 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 08:37:58:1 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 10:27:08:1 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 11:58:00:2 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 13:32:09:1 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 16:48:00:5 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 20:48:43:1 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 21:43:59:1dd4 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 22:30:11:1a 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 30 00:55:22:c 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 30 03:44:20:3 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 30 07:11:20:f 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 30 09:57:02:c 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 30 12:32:11:13 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 30 15:38:11:8 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 30 18:08:10:8 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 30 20:44:00:3a 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 30 23:45:04:e 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime May 1 02:07:00:52 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime May 1 04:36:11:1a 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime May 1 07:53:11:38 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime May 1 10:28:33:10 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime May 1 12:52:11:19 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime May 1 15:41:11:36 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime May 1 17:51:00:35 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime May 1 19:59:21:1 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime May 1 22:11:21:10 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime May 2 00:22:11:32 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime May 2 02:29:00:c 2016-05-02T21:24:54.795+0000 I STORAGE [initandlisten] Placing a marker at optime May 2 04:41:19:5 2016-05-02T21:24:56.826+0000 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2016-05-02T21:24:56.826+0000 I CONTROL [initandlisten] 2016-05-02T21:24:56.826+0000 I CONTROL [initandlisten] ** WARNING: Access control is not enabled for the database. 2016-05-02T21:24:56.826+0000 I CONTROL [initandlisten] ** Read and write access to data and configuration is unrestricted. 2016-05-02T21:24:56.826+0000 I CONTROL [initandlisten] 2016-05-02T21:24:56.860+0000 I NETWORK [websvr] admin web console waiting for connections on port 28016 2016-05-02T21:24:56.861+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb-replica/mongodbreplica2/diagnostic.data' 2016-05-02T21:24:56.862+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-05-02T21:24:56.864+0000 I NETWORK [initandlisten] waiting for connections on port 27016 2016-05-02T21:24:56.865+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "mongodbreplica", version: 2, protocolVersion: 1, members: [ { _id: 0, host: "localhost:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "localhost:27016", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "localhost:27015", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-05-02T21:24:56.865+0000 I REPL [ReplicationExecutor] This node is localhost:27016 in the config 2016-05-02T21:24:56.865+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-05-02T21:24:56.865+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-05-02T21:24:56.865+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-05-02T21:24:56.866+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-05-02T21:24:56.866+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T21:24:56.866+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-05-02T21:24:56.866+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-05-02T21:24:56.867+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-05-02T21:24:57.026+0000 I FTDC [ftdc] Unclean full-time diagnostic data capture shutdown detected, found interim file, some metrics may have been lost. OK 2016-05-02T21:25:00.036+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43092 #1 (1 connection now open) 2016-05-02T21:25:01.553+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43094 #2 (2 connections now open) 2016-05-02T21:25:05.044+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43095 #3 (3 connections now open) 2016-05-02T21:25:05.044+0000 I NETWORK [conn3] end connection 127.0.0.1:43095 (2 connections now open) 2016-05-02T21:25:05.044+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43096 #4 (3 connections now open) 2016-05-02T21:25:05.045+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43097 #5 (4 connections now open) 2016-05-02T21:25:05.048+0000 I NETWORK [conn4] end connection 127.0.0.1:43096 (3 connections now open) 2016-05-02T21:25:06.555+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43098 #6 (4 connections now open) 2016-05-02T21:25:06.556+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43099 #7 (5 connections now open) 2016-05-02T21:25:06.556+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43100 #8 (6 connections now open) 2016-05-02T21:25:06.556+0000 I NETWORK [conn6] end connection 127.0.0.1:43098 (5 connections now open) 2016-05-02T21:25:07.543+0000 I REPL [ReplicationExecutor] Starting an election, since we've seen no PRIMARY in the past 10000ms 2016-05-02T21:25:07.543+0000 I REPL [ReplicationExecutor] conducting a dry run election to see if we could be elected 2016-05-02T21:25:07.544+0000 I REPL [ReplicationExecutor] dry election run succeeded, running for election 2016-05-02T21:25:07.545+0000 I REPL [ReplicationExecutor] election succeeded, assuming primary role in term 47 2016-05-02T21:25:07.545+0000 I REPL [ReplicationExecutor] transition to PRIMARY 2016-05-02T21:25:07.546+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T21:25:07.546+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T21:25:07.868+0000 I REPL [rsSync] transition to primary complete; database writes are now permitted 2016-05-02T21:25:11.049+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43103 #9 (6 connections now open) 2016-05-02T21:25:11.050+0000 I NETWORK [conn9] end connection 127.0.0.1:43103 (5 connections now open) 2016-05-02T21:25:11.050+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43104 #10 (6 connections now open) 2016-05-02T21:25:11.567+0000 I NETWORK [conn7] end connection 127.0.0.1:43099 (5 connections now open) 2016-05-02T21:25:11.568+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43105 #11 (6 connections now open) 2016-05-02T21:25:11.569+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43106 #12 (7 connections now open) 2016-05-02T21:25:11.569+0000 I NETWORK [conn11] end connection 127.0.0.1:43105 (6 connections now open) 2016-05-02T21:25:20.050+0000 I REPL [ReplicationExecutor] stepping down from primary, because a new term has begun: 48 2016-05-02T21:25:20.050+0000 I REPL [replExecDBWorker-1] transition to SECONDARY 2016-05-02T21:25:20.051+0000 I NETWORK [conn12] end connection 127.0.0.1:43106 (5 connections now open) 2016-05-02T21:25:20.051+0000 I NETWORK [conn10] end connection 127.0.0.1:43104 (5 connections now open) 2016-05-02T21:25:20.052+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43107 #13 (5 connections now open) 2016-05-02T21:25:20.052+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43108 #14 (6 connections now open) 2016-05-02T21:25:20.052+0000 I NETWORK [conn1] end connection 127.0.0.1:43092 (5 connections now open) 2016-05-02T21:25:21.053+0000 I NETWORK [conn5] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:43097] 2016-05-02T21:25:21.549+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state PRIMARY 2016-05-02T21:25:21.572+0000 I NETWORK [conn8] SocketException handling request, closing client connection: 9001 socket exception [SEND_ERROR] server [127.0.0.1:43100] 2016-05-02T21:25:21.870+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-02T21:25:21.871+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-02T21:25:21.872+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-02T21:25:26.052+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43113 #15 (4 connections now open) 2016-05-02T21:25:26.052+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43114 #16 (5 connections now open) 2016-05-02T21:25:26.052+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:43115 #17 (6 connections now open) 2016-05-02T21:25:26.053+0000 I NETWORK [conn15] end connection 127.0.0.1:43113 (5 connections now open) 2016-05-02T21:27:14.485+0000 I CONTROL [main] ***** SERVER RESTARTED ***** 2016-05-02T21:27:14.573+0000 I CONTROL [initandlisten] MongoDB starting : pid=1100 port=27016 dbpath=/var/lib/mongodb-replica/mongodbreplica2 64-bit host=ip-172-31-6-169 2016-05-02T21:27:14.573+0000 I CONTROL [initandlisten] db version v3.2.5 2016-05-02T21:27:14.573+0000 I CONTROL [initandlisten] git version: 34e65e5383f7ea1726332cb175b73077ec4a1b02 2016-05-02T21:27:14.573+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014 2016-05-02T21:27:14.573+0000 I CONTROL [initandlisten] allocator: tcmalloc 2016-05-02T21:27:14.573+0000 I CONTROL [initandlisten] modules: none 2016-05-02T21:27:14.573+0000 I CONTROL [initandlisten] build environment: 2016-05-02T21:27:14.573+0000 I CONTROL [initandlisten] distmod: ubuntu1404 2016-05-02T21:27:14.573+0000 I CONTROL [initandlisten] distarch: x86_64 2016-05-02T21:27:14.573+0000 I CONTROL [initandlisten] target_arch: x86_64 2016-05-02T21:27:14.574+0000 I CONTROL [initandlisten] options: { config: "/etc/mongodb.d/mongodbreplica2.conf", net: { bindIp: "127.0.0.1", http: { RESTInterfaceEnabled: true, enabled: true }, port: 27016 }, processManagement: { pidFilePath: "/var/run/mongodb-replica/mongodbreplica2.pid" }, replication: { oplogSizeMB: 128, replSet: "mongodbreplica" }, storage: { dbPath: "/var/lib/mongodb-replica/mongodbreplica2", mmapv1: { smallFiles: true } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb-replica/mongodbreplica2.log" } } 2016-05-02T21:27:14.761+0000 I - [initandlisten] Detected data files in /var/lib/mongodb-replica/mongodbreplica2 created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'. 2016-05-02T21:27:14.761+0000 W - [initandlisten] Detected unclean shutdown - /var/lib/mongodb-replica/mongodbreplica2/mongod.lock is not empty. 2016-05-02T21:27:14.761+0000 W STORAGE [initandlisten] Recovering data from the last clean checkpoint. 2016-05-02T21:27:14.761+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0), 2016-05-02T21:27:15.981+0000 I STORAGE [initandlisten] Starting WiredTigerRecordStoreThread local.oplog.rs 2016-05-02T21:27:15.981+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 817834 records totaling to 2937930670 bytes 2016-05-02T21:27:15.983+0000 I STORAGE [initandlisten] Sampling from the oplog between Apr 23 04:15:56:1 and May 2 21:25:21:1 to determine where to place markers for truncation 2016-05-02T21:27:15.983+0000 I STORAGE [initandlisten] Taking 1009 samples and assuming that each section of oplog contains approximately 8100 records totaling to 29097883 bytes 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 06:07:06:1 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 08:03:09:2 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 09:31:51:2 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 11:03:04:1 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 12:16:45:2 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 13:36:53:1 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 15:10:58:1 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 16:21:07:1 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 17:47:49:1 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 20:11:03:3 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 22:07:45:3 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 23 23:28:54:2 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 01:43:45:3 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 03:38:21:1 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 04:51:54:1 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 06:14:56:3 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 07:25:57:2 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 08:31:02:1 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 09:55:59:2 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 11:03:04:1 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 12:14:45:4 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 13:43:07:2 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 15:22:45:4 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 17:31:45:3 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 19:16:01:1 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 20:50:08:2 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 24 22:14:45:5 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 25 00:27:45:5 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 25 02:30:39:2 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 25 04:10:45:3 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 25 05:56:56:6 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 25 18:51:01:1 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 25 21:14:28:2 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 25 23:49:00:4 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 01:28:05:2 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 03:08:30:1 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 05:35:45:3 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 07:17:07:1 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 08:49:13:1 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 10:21:03:2 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 11:43:06:1 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 13:13:07:2 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 15:37:45:5 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 19:12:49:1 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 26 22:07:00:1 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 00:59:45:5 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 03:02:45:3 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 05:06:23:2 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 07:26:06:2 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 08:51:03:1 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 10:17:45:2 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 11:58:45:5 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 13:15:10:1 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 15:28:51:2 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 18:58:45:3 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 21:40:45:4 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 27 23:45:25:2 2016-05-02T21:27:18.453+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 28 02:16:34:2 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 28 04:27:45:2 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 28 06:43:49:9 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 28 08:45:45:4 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 28 10:24:11:2 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 28 11:54:06:1 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 28 13:56:17:1 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 28 16:24:19:5 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 28 19:05:46:1 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 28 22:53:07:2 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 01:01:33:1 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 02:50:17:2 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 05:36:09:2 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 07:14:02:1 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 08:37:58:1 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 10:27:08:1 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 11:58:00:2 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 13:32:09:1 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 16:48:00:5 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 20:48:43:1 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 21:43:59:1dd4 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 29 22:30:11:1a 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 30 00:55:22:c 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 30 03:44:20:3 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 30 07:11:20:f 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 30 09:57:02:c 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 30 12:32:11:13 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 30 15:38:11:8 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 30 18:08:10:8 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 30 20:44:00:3a 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime Apr 30 23:45:04:e 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime May 1 02:07:00:52 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime May 1 04:36:11:1a 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime May 1 07:53:11:38 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime May 1 10:28:33:10 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime May 1 12:52:11:19 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime May 1 15:41:11:36 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime May 1 17:51:00:35 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime May 1 19:59:21:1 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime May 1 22:11:21:10 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime May 2 00:22:11:32 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime May 2 02:29:00:c 2016-05-02T21:27:18.454+0000 I STORAGE [initandlisten] Placing a marker at optime May 2 04:41:19:5 2016-05-02T21:27:19.038+0000 W STORAGE [initandlisten] Detected configuration for non-active storage engine mmapv1 when current storage engine is wiredTiger 2016-05-02T21:27:19.038+0000 I CONTROL [initandlisten] 2016-05-02T21:27:19.038+0000 I CONTROL [initandlisten] ** WARNING: Access control is not enabled for the database. 2016-05-02T21:27:19.038+0000 I CONTROL [initandlisten] ** Read and write access to data and configuration is unrestricted. 2016-05-02T21:27:19.038+0000 I CONTROL [initandlisten] 2016-05-02T21:27:19.086+0000 I NETWORK [websvr] admin web console waiting for connections on port 28016 2016-05-02T21:27:19.088+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/var/lib/mongodb-replica/mongodbreplica2/diagnostic.data' 2016-05-02T21:27:19.089+0000 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker 2016-05-02T21:27:19.091+0000 I NETWORK [initandlisten] waiting for connections on port 27016 2016-05-02T21:27:19.092+0000 I REPL [ReplicationExecutor] New replica set config in use: { _id: "mongodbreplica", version: 2, protocolVersion: 1, members: [ { _id: 0, host: "localhost:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "localhost:27016", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "localhost:27015", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.5, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 } } } 2016-05-02T21:27:19.092+0000 I REPL [ReplicationExecutor] This node is localhost:27016 in the config 2016-05-02T21:27:19.092+0000 I REPL [ReplicationExecutor] transition to STARTUP2 2016-05-02T21:27:19.092+0000 I REPL [ReplicationExecutor] Starting replication applier threads 2016-05-02T21:27:19.093+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27017 2016-05-02T21:27:19.093+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state SECONDARY 2016-05-02T21:27:19.093+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T21:27:19.094+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-05-02T21:27:19.094+0000 I REPL [ReplicationExecutor] transition to RECOVERING 2016-05-02T21:27:19.103+0000 I REPL [ReplicationExecutor] transition to SECONDARY 2016-05-02T21:27:20.018+0000 I FTDC [ftdc] Unclean full-time diagnostic data capture shutdown detected, found interim file, some metrics may have been lost. OK 2016-05-02T21:27:24.022+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51278 #1 (1 connection now open) 2016-05-02T21:27:24.071+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51279 #2 (2 connections now open) 2016-05-02T21:27:34.095+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state PRIMARY 2016-05-02T21:27:34.096+0000 I REPL [ReplicationExecutor] syncing from: localhost:27015 2016-05-02T21:27:34.097+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27015 2016-05-02T21:27:34.098+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27015 2016-05-02T21:27:44.101+0000 I REPL [ReplicationExecutor] could not find member to sync from 2016-05-02T21:27:44.102+0000 I ASIO [ReplicationExecutor] dropping unhealthy pooled connection to localhost:27015 2016-05-02T21:27:44.102+0000 I ASIO [ReplicationExecutor] after drop, pool was empty, going to spawn some connections 2016-05-02T21:27:44.102+0000 I REPL [ReplicationExecutor] Member localhost:27017 is now in state PRIMARY 2016-05-02T21:27:44.103+0000 I ASIO [NetworkInterfaceASIO-Replication-0] Successfully connected to localhost:27015 2016-05-02T21:27:44.103+0000 I REPL [ReplicationExecutor] Member localhost:27015 is now in state SECONDARY 2016-05-02T21:27:45.102+0000 I REPL [ReplicationExecutor] syncing from: localhost:27017 2016-05-02T21:27:45.103+0000 I REPL [SyncSourceFeedback] setting syncSourceFeedback to localhost:27017 2016-05-02T21:27:45.103+0000 I ASIO [NetworkInterfaceASIO-BGSync-0] Successfully connected to localhost:27017 2016-05-02T21:27:46.043+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51292 #3 (3 connections now open) 2016-05-02T21:27:46.044+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51293 #4 (4 connections now open) 2016-05-02T21:27:46.044+0000 I NETWORK [conn3] end connection 127.0.0.1:51292 (3 connections now open) 2016-05-02T21:27:46.045+0000 I NETWORK [initandlisten] connection accepted from 127.0.0.1:51294 #5 (4 connections now open)